making sense of your data to give new insight - elasticsearch at findability day 2014
TRANSCRIPT
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Making sense of your data to give you actionable insights
Presented by: Dimitri Marx, Sales Engineer !
Team here today: Sejal Korenromp, Arie Chapman
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibitedCopyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
What about Elasticsearch the Company?
!
• Drive the ELK Projects forward, great things to come!
• Commercial products: Marvel to monitor and manage ELK
• Support 100s of Companies in Production environments
• Training Developers and Ops around the world on ELK
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibitedCopyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibitedCopyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Who’s using Elasticsearch?
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
A quick history of SearchWho doesn’t like a history lesson :-)
!!!!!
Disclaimer: includes fire
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Life before Elasticsearch!
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Why Search?
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
How else would you find this?
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Or this?
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Or this?
Eyjafjallajökull
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Kinds of Search
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
People search
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Geographic Search
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Product Search
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Knowledge Search
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Thanks for listening!
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Something else?
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
USS Car Carrier
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Search is more than…
!?q=what+is+the+difference+between
+holland+and+netherlands"!
Don’t know? Watch this:"https://www.youtube.com/watch?v=eE_IUPInEuc
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
What if we could ask questions like…
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
What searches are trending right now?
Where are my customers coming from right now?
Are there any anomalies in our data right now?
How long is it taking for my customers to get through our service process?
Are we the victims of a DDOS attack right now?
The logging stack: ES + LS + KB
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibitedCopyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Data From Any Source
Instantly Analyze
Actionable Insights
The ELK Stack
Logstash Elasticsearch Kibana
Clean & enrich before storage
Mobile Devices
Financial
Web Trends Data
Game Data
CRM
News Articles
Log Data
e-commerce
Social Data
Internet of things
Enrich: Geo code IP address, aggregate fields, etc. Clean: Filter out junk, mask, normalize into JSON
Logstash Collect From Any Source
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
highavailability
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
highavailability
RESTfulAPI
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
highavailability
RESTfulAPI
JSON over HTTP
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
highavailability
RESTfulAPI
JSON over HTTP
schemafree
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
distributed
scalesmassively
highavailability
RESTfulAPI
JSON over HTTP
schemafree
multitenancy
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
open-source
distributed
scalesmassively
highavailability
RESTfulAPI
JSON over HTTP
schemafree
multitenancy
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchreal time,
search and analytics engine
open-source
Lucenebased
distributed
scalesmassively
highavailability
RESTfulAPI
JSON over HTTP
schemafree
multitenancy
Kibana: Easily Explore Data
• See the Bigger “Picture” from your data
• Explore from 50K feet down to the ground
• Bring together a variety of Machine and User Data, New Correlations
• Constant query - not a point in a time - live stream
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Combine Search and Analytics on structured and unstructured data in a scalable way
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
You can always go back to this
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited
It’s showtime!