blueflood and beyond: the future of metrics - berlin buzzwords 2014
DESCRIPTION
Presentation given at Berlin Buzzwords 2014 about Blueflood 2.0 and the future of metrics processing systems.TRANSCRIPT
![Page 1: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/1.jpg)
1
![Page 2: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/2.jpg)
Blueflood 2.0 and Beyond
@gdusbabek • Berlin Buzzwords 2014 • Rackspace
![Page 3: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/3.jpg)
Blueflood 2.0 and Beyond
@gdusbabek • Berlin Buzzwords 2014 • Rackspace
![Page 4: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/4.jpg)
Blueflood 2.0 and Beyond
@gdusbabek • Berlin Buzzwords 2014 • Rackspace
![Page 5: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/5.jpg)
$ cat CHANGES.txt | grep AWESOME!
![Page 6: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/6.jpg)
Blueflood 2.0 and Beyond
@gdusbabek • Berlin Buzzwords 2014 • Rackspace
![Page 7: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/7.jpg)
Outline ① Current state of Blueflood
② State and potential of the metrics community
③ How you can get involved in Blueflood ④ Beyond!!!11
![Page 8: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/8.jpg)
① Current State
March 2013 – Decide to release
August 2013 – Actually released
Working hard in the mean time.
![Page 9: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/9.jpg)
Lesson:�Open source project is best started open
![Page 10: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/10.jpg)
Lesson:�Open source project is best started open
![Page 11: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/11.jpg)
Old:�Ingesting 15k
points per second
![Page 12: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/12.jpg)
New:�Ingesting 30k
points per second*
![Page 13: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/13.jpg)
Higher Loads Tested
![Page 14: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/14.jpg)
New Features
![Page 15: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/15.jpg)
(basically) �
Gauge
![Page 16: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/16.jpg)
Gauge Counter�Timer�Set
![Page 17: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/17.jpg)
Export Rollups to External Systems
![Page 18: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/18.jpg)
Index metrics on ingest
![Page 19: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/19.jpg)
Index metrics on ingest
![Page 20: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/20.jpg)
Index metrics on ingest
![Page 21: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/21.jpg)
Performance:�Batch
Operations
![Page 22: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/22.jpg)
Cassandra Storage
Improvements
![Page 23: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/23.jpg)
Cassandra Storage
Improvements
![Page 24: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/24.jpg)
Improved Blueflood
API
![Page 25: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/25.jpg)
Better Multi-tenant Experience
![Page 26: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/26.jpg)
Better Multi-tenant Experience
![Page 27: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/27.jpg)
Great progress, Right?
![Page 28: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/28.jpg)
Blueflood is a young project
![Page 29: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/29.jpg)
![Page 30: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/30.jpg)
![Page 31: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/31.jpg)
AWKWARD!
![Page 32: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/32.jpg)
IMMATURE
![Page 33: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/33.jpg)
Software
Matures too
![Page 34: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/34.jpg)
�Java
![Page 35: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/35.jpg)
![Page 36: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/36.jpg)
Blueflood Maturity
![Page 37: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/37.jpg)
![Page 38: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/38.jpg)
We are here
![Page 39: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/39.jpg)
![Page 40: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/40.jpg)
② Potential of the
metrics ecosystem
![Page 41: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/41.jpg)
Just getting started
![Page 42: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/42.jpg)
Expected Future �vs�
Actual Future
![Page 43: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/43.jpg)
![Page 44: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/44.jpg)
1MM pts per second per node
![Page 45: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/45.jpg)
Not That Far Away
![Page 46: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/46.jpg)
③ Act Now!
![Page 47: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/47.jpg)
Documentation
![Page 48: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/48.jpg)
Give Blueflood
a Try
![Page 49: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/49.jpg)
Contribute Code
![Page 50: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/50.jpg)
Enhance the Tools
![Page 51: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/51.jpg)
Integration
![Page 52: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/52.jpg)
statsD�github.com/gdusbabek/blueflood-statsd-backend
![Page 53: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/53.jpg)
Graphite
![Page 54: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/54.jpg)
DEMONSTRATION ��
https://github.com/gdusbabek/blueflood/tree/graphite_integration �https://github.com/gdusbabek/blueflood/tree/lucene_discovery �
https://github.com/gdusbabek/graphite-web/tree/blueflood_graphite
![Page 55: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/55.jpg)
④
If We Succeed…
![Page 56: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/56.jpg)
Community
![Page 57: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/57.jpg)
Easy Installation
![Page 58: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/58.jpg)
No Bottlenecks
![Page 59: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/59.jpg)
Better Technology
![Page 60: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/60.jpg)
Barriers to Success
![Page 61: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/61.jpg)
Bottlenecks
![Page 62: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/62.jpg)
Immaturity of metrics space
![Page 63: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/63.jpg)
Non-technical Problems
![Page 64: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/64.jpg)
Where do we go next?
![Page 65: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/65.jpg)
Where do we go next?
![Page 66: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/66.jpg)
Start Helping
![Page 67: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/67.jpg)
The Future!
![Page 68: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/68.jpg)
Native Distributed Time Series Data Store
![Page 69: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/69.jpg)
Common APIs
![Page 70: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/70.jpg)
Time Series Community
![Page 71: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/71.jpg)
More Time Series: Tue 11:30 – Time Series Data With Apache Cassandra
More Cassandra:
Tue 16:10 – Data Modeling in the New World
![Page 72: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/72.jpg)
@gdusbabek
![Page 73: Blueflood and Beyond: The Future of Metrics - Berlin Buzzwords 2014](https://reader035.vdocuments.mx/reader035/viewer/2022062418/554bbfa2b4c90594278b50a2/html5/thumbnails/73.jpg)
outline https://www.flickr.com/photos/zen/3978223!class https://www.flickr.com/photos/22326055@N06/4264216476!funnels https://www.flickr.com/photos/7603557@N08/9630569058!loads https://www.flickr.com/photos/carsten_tb/7326580242!gauges https://www.flickr.com/photos/antonymayfield/3221166562!train https://www.flickr.com/photos/trains_in_tasmania/11214831086!cookies https://www.flickr.com/photos/rhinoneal/5633001128!drawers https://www.flickr.com/photos/inesplicabile/2093653233!apartments https://www.flickr.com/photos/tracerbullet999/3722416917!plants https://www.flickr.com/photos/br1dotcom/3251911748!meat https://www.flickr.com/photos/splorp/12200621!help https://www.flickr.com/photos/carianoff/4153837365!dogs https://www.flickr.com/photos/81509206@N00/466440988!future https://www.flickr.com/photos/perhapstoopink/4434966765!bottles https://www.flickr.com/photos/temily/5521871004!ape https://www.flickr.com/photos/tambako/8164835802!books https://www.flickr.com/photos/azrasta/5088254388!tools https://www.flickr.com/photos/katerha/5746905652!legos https://www.flickr.com/photos/paul_garland/2510703886!thinker https://www.flickr.com/photos/seatbelt67/502255276!map https://www.flickr.com/photos/80497449@N04/8280699806!birds https://www.flickr.com/photos/infomastern/12020409446!thanks https://www.flickr.com/photos/psd/2086641!
h$ps://crea-vecommons.org/licenses/by/2.0/
Image Credits