![Page 1: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/1.jpg)
Streaming Anomaly Detection for Big Data /
Internet of ThingsAdam Drake
FOSSAsia 20160319 @aadrake
http://aadrake.com
![Page 2: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/2.jpg)
@aadrake #hacker
or
@aadrake #ThoughtLeader
![Page 3: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/3.jpg)
Background
• Applied mathematics
• Startups
• Many industries
![Page 4: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/4.jpg)
Time Series is the New Big Data
https://www.mapr.com/blog/time-series-data-new-big-data
![Page 5: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/5.jpg)
https://blogs.technet.microsoft.com/machinelearning/2014/11/05/anomaly-detection-using-machine-learning-to-detect-abnormalities-in-time-series-data/
![Page 6: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/6.jpg)
Graphite Prometheus (SoundCloud)
Nagios BreakoutDetection (Twitter)
Surus (Netflix) Atlas (Netflix) Skyline (Etsy)
Bosun (Stack Exchange)
![Page 7: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/7.jpg)
![Page 8: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/8.jpg)
https://grey-boundary.io/the-architecture-of-clustering-graphite/
![Page 9: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/9.jpg)
![Page 10: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/10.jpg)
metrics
kaas
![Page 11: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/11.jpg)
DON'T DO THIS
![Page 12: Streaming Anomaly Detection for Big Data / Internet of Things · 2020. 12. 27. · carbon-cache: a writes Wh r metrics | 0.0.10:2003 | carbon.relay consisteN hash metrics Carbon Relay](https://reader036.vdocuments.mx/reader036/viewer/2022071510/612ef4851ecc515869432338/html5/thumbnails/12.jpg)
https://blogs.technet.microsoft.com/machinelearning/2014/11/05/anomaly-detection-using-machine-learning-to-detect-abnormalities-in-time-series-data/