ADVANCED SPARKAND TENSORFLOW MEETUP

Deploy Spark and Tensorflow Models: From Notebook Dev to Microservice Prod

London - November 15, 2016

Thank You, PipelineIO, Rise, Barclays!http://pipeline.io

MEETUP AGENDA

• Meetup Updates, Metrics, and Announcements

• Spark Updates

• Tensorflow Updates

• Deploying and Scaling ML Models from Notebook to Production with PipelineIO(Chris Fregly, PipelineIO)

WHO AM I?

Chris Fregly--------

Research Scientist @ PipelineIO(Formerly Netflix and Databricks)

--------http://pipeline.io

WHO ARE YOU?

--Techies of London --

FUN WORKSHOP LAST MONTH(HERE IN LONDON)

MEETUP METRICS

• 10,000+ Members Globally in 1 Year!• 5,000 Members in San Francisco (Home)

• Github Repo: 900 Stars, 300 Forks

• DockerHub Repo: 6,200 Pulls

APACHE SPARK UPDATE

SPARK SUMMIT EU 2016 (BRUSSELS)

• https://spark-summit.org/eu-2016/schedule/• Structured Streaming (2 talks)• ML + Structured Streaming (1 talks)• ML Model Deployment (2 talks)• Spark Performance (4 talks)

TENSORFLOW UPDATE

TENSORFLOW WORKSHOP

• Great Workshop From Google Directly• Finally, training involving more than MNIST!

• Slides• http://bit.ly/tf-workshop-slides

• Workshop• https://github.com/amygdala/tensorflow-workshop

WHAT IS PIPELINE.IO?

Extending Your ML Pipelines into Production

100% Open Source!

http://pipeline.io

BRAINSTORMING AND VALIDATING

• Major Gaming Company

• Large Ride Sharing Service

• Popular Q & A Site

• Online Clothing Retailer

• Dominant Video Streaming

PIPELINE.IO FOCUS

• Model Deploying and Testing

• Model Scaling and Serving

• Online Model Training

• Dynamic Model Optimizing

MODEL DEPLOYING AND TESTING

Continuously Test and Deploy Models

in Production!

MODEL SCALING AND SERVING

ONLINE MODEL TRAINING

• Continuous, Incremental, and Partial Training

• Kafka + Spark Streaming + Spark ML

• Real-time, Dynamic Recommendations

DYNAMIC MODEL OPTIMIZING

Generate OptimizedCode from Spark ML!

BECOME A CONTRIBUTOR!

PIPELINE.IO PLAN FOR 2017

• Performance

• Code Generation: CPU and GPU

• Continued Global Expansion

MORE WORKSHOPS IN 2017

WE’RE HIRING!!

• Kafka, Spark ML, and TensorFlow Contributors

• Systems Engineers

• GPU/CUDA Engineers

• C++, Java, Scala, Python

WE ONLY HIRENICE PEOPLE!!

DEMO!

Circuit Breakers and Request Batching

DEMO!

Deploy Spark ML DecisionTree to Production

Deploy to Cloudor On-Premise!

DEMO!

Dynamic Code Generation of DecisionTree

THANK YOU!!

http://pipeline.io