anomaly detection for global scale at netflix

GLOBAL SCALE ANOMALY DETECTION FOR

Upload: extract-data-conference

Post on 20-Feb-2017

528 views

Category:

Data & Analytics

1 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Anomaly Detection for Global Scale at Netflix

GLOBAL SCALEANOMALY DETECTION FOR

Page 2: Anomaly Detection for Global Scale at Netflix

DIRECTOR, DATA ENGINEERING & ANALYTICSPAUL ELLWOOD

Page 3: Anomaly Detection for Global Scale at Netflix

1 INTERNATIONAL

EXPANSION

Page 4: Anomaly Detection for Global Scale at Netflix

Page 5: Anomaly Detection for Global Scale at Netflix

2 FINITE ANALYST

CAPACITY

Page 6: Anomaly Detection for Global Scale at Netflix

UNREALISTIC EXPECTATIONS

TEST ANALYSIS DASHBOARD

▸ One test

▸ One report (of the five)

▸ Ignoring multi-select combinations

▸ Ignoring date range selections

Page 7: Anomaly Detection for Global Scale at Netflix

16,821,043,200 UNIQUE VIEWS

3 ANOMALY

DETECTION

Page 11: Anomaly Detection for Global Scale at Netflix

SMARTER ANALYTIC PRODUCTS

Page 12: Anomaly Detection for Global Scale at Netflix

SMARTER ANALYTIC PRODUCTS

▸ Statistical Anomalies

▸ Personalized

▸ Filtered & Ranked by Impact

▸ Usable

▸ Ability to Dig Deeper

Page 13: Anomaly Detection for Global Scale at Netflix

CASE STUDY

PAYMENT PROCESSING

▸ Multiple dimensions

▸ High cardinality dimensions

▸ Hundreds of thousands of time series

▸ Increasing volumes

▸ High business impact

Page 14: Anomaly Detection for Global Scale at Netflix

Page 15: Anomaly Detection for Global Scale at Netflix

Page 16: Anomaly Detection for Global Scale at Netflix

QUESTIONS?

Page 17: Anomaly Detection for Global Scale at Netflix

DIRECTOR, DATA ENGINEERING & ANALYTICSPAUL ELLWOOD

@pellwoodhttps://www.linkedin.com/in/pellwood

https://www.linkedin.com/in/pellwood

Anomaly detection- Credit Card Fraud Detection

Anomaly Detection Systems

BGP Anomaly Detection

Adaptive anomaly detection with evolving connectionist systemstechlab.bu.edu/files/resources/articles_tt/Adaptive anomaly... · Adaptive anomaly detection with evolving connectionist

Anomaly Detection: Principles, Benchmarking, Explanation ...tgd/talks/dietterich-anomaly... · Anomaly Detection: Principles, Benchmarking, Explanation, and Theory Tom Dietterich

09 anomaly detection

Intrusion & Anomaly Detection & Preventiongauss.ececs.uc.edu/Courses/c6056/pdf/intrusion.pdfIntrusion & Anomaly Detection & Prevention Intrusion Detection: Monitor events, analyze

Survey Anomaly Detection

Anomaly Detection

Anomaly Detection Technology Using BigGraph€¦ · Anomaly Detection Technology Using BigGraph ... detection Several anomaly detection techniques have been developed and applied

Science of Anomaly detection - v4 Updated for HTM for IT · The#Science#of#Anomaly#Detection!! ! Page 3! Anomaly!Detection!inStreamingData" Early anomaly detection in streaming data

Anomaly Detection RapidMiner

Anomaly Detection Petty

Anomaly Detection using Outlier Detection Schemes

Anomaly detection char10

Real-Time Anomaly Detection in Water Distribution Networks ... Anomaly Detection in Water Distribution Networks using Spark Streaming ... 2.3 Anomaly Detection in Water Distribution

Introduction to Anomaly Detection - uwyo.educlan/teach/rampe18_anomaly.pdfWhat is anomaly detection? “Anomaly detection refers to the problem of finding patterns in data that do

Credit Card Fraud Detection - Anomaly Detection

Probabilistic Anomaly Detection in Dynamic Systemspapers.nips.cc/paper/805-probabilistic-anomaly-detection-in... · Probabilistic Anomaly Detection in Dynamic Systems 827 model (HMM)

Network Traffic Anomaly Detection and Characterizationcs.northwestern.edu/~ajb200/anomaly detection paper 1.0.pdf · Network Traffic Anomaly Detection and Characterization Aaron Beach

Anomaly Detection and Attribution Using Bayesian … · UNCLASSIFIED DSTO{TR{2975 Anomaly Detection and Attribution Using Bayesian Networks Executive Summary Anomaly detection techniques

Anomaly detection final

Data Mining II Anomaly Detection - uni-mannheim.deData Mining II Anomaly Detection Heiko Paulheim 02/26/18 Heiko Paulheim 2 Anomaly Detection • Also known as “Outlier Detection”

Spacecraft anomaly detection via transformer ...€¦ · measures, anomaly detection is important and necessary to warn operation engineer of anomalies. Current anomaly detection

Anomaly Detection in Predictive Maintenance - KNIME · 1 Anomaly Detection in Predictive Maintenance Time Alignment and Visualization for Anomaly Detection Rosaria Silipo [email protected]

Chap10 Anomaly Detection

Anomaly Detection and Mitigation. Outline DoS and DDoS Anomaly Detection and Mitigation Systems Cisco DDoS Anomaly Detection and Mitigation Solutions

Anomaly Detection Techniques

CUSUM Anomaly Detection - Measurement Lab · Abstract Introduction Background Anomaly Detection in Network Traffic Flows CUSUM Charts CUSUM Anomaly Detection (CAD) Applying CUSUM

Deep Learning based Anomaly Detection in€¦ · Deep Learning based Anomaly Detection in Multivariate Time-Series Data 1. Background Anomaly detection, also known as outlier detection,

Anomaly Detection Tutorial

Anomaly Detection Survey

Online Nonparametric Anomaly Detection in High-Dimensional ... · 13/2/2018 · Online Nonparametric Anomaly Detection in High-Dimensional Datasets Online Nonparametric Anomaly Detection

Anomaly Detection in Predictive Maintenance - KNIME · Anomaly Detection in Predictive Maintenance Anomaly Detection with Time Series Analysis

Anomaly Detection - Improving Security Together · Anomaly Detection • Anomaly Detection is the holy grail of security. • From a baseline of “normal” behavior, abnormal or