data days 2014 - mikio braun
TRANSCRIPT
WHAT IS REAL-TIME?
Dr. Mikio L. Braun / streamdrill
WHAT IS REAL-TIME?
Dr. Mikio L. Braun / streamdrill
VELOCITY VS. DIVERSITY
• 100 events/second• 360k per hour• 8.6M per day• 260M per month• 3.2B per year
http://www.flickr.com/photos/arenamontanus/269158554/
LATENCY VS. ACTION
BATCH VS. STREAM
APPROXIMATE VS. EXACT
ExactFast
Big Data
Approximate! Parallelize!
First seen here: http://www.slideshare.net/acunu/realtime-analytics-with-apache-cassandra
Dr. Mikio L. Braun / streamdrill
LESSON‘S LEARNED
• Process data as it comes in.• In-memory, disk too slow.• Focus on relevant data and approximate.• 20k/s on single machine.• 1M objects tracked per 1GB RAM.
THANK YOU VERY MUCH FOR YOUR ATTENTION!
Dr. Mikio L. Braun / streamdrill