cto view: driving the on-demand economy with predictive analytics

31
Nikita Shamgunov, CTO and Co-founder of MemSQL Driving the On-Demand Economy with Predictive Analytics

Upload: memsql

Post on 16-Jan-2017

73 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: CTO View: Driving the On-Demand Economy with Predictive Analytics

Nikita Shamgunov, CTO and Co-founder of MemSQL

Driving the On-Demand Economy with Predictive Analytics

Page 2: CTO View: Driving the On-Demand Economy with Predictive Analytics
Page 3: CTO View: Driving the On-Demand Economy with Predictive Analytics

In-Memory Computing

Page 4: CTO View: Driving the On-Demand Economy with Predictive Analytics

Scale-out

Page 5: CTO View: Driving the On-Demand Economy with Predictive Analytics

Imagine scaling a database on industry standard hardware.

Need 2x the performance? Add 2x the nodes.

Page 6: CTO View: Driving the On-Demand Economy with Predictive Analytics

Trying to build scale-out for

a traditional product

Page 7: CTO View: Driving the On-Demand Economy with Predictive Analytics
Page 8: CTO View: Driving the On-Demand Economy with Predictive Analytics

In-Memory and Scale-out in Action

Page 9: CTO View: Driving the On-Demand Economy with Predictive Analytics

▪Every piece of technology is scalable▪Analyzing data from hundreds of thousands of

machines▪Delivering immense value in real-time

• Real-time code deployment• Detecting anomalies• A/B testing results

▪Fundamentally making the business faster by providing data at your fingertips

An Insider’s View

Page 10: CTO View: Driving the On-Demand Economy with Predictive Analytics
Page 11: CTO View: Driving the On-Demand Economy with Predictive Analytics

▪An enterprise solution that could scale

▪Work well with existing tools and infrastructure

▪Database is only as successful as the ability to quickly and easily build applications on top of it

An Eye to Adoption

Page 12: CTO View: Driving the On-Demand Economy with Predictive Analytics

Embrace the tools and projects behindbig data and real-time transformation

Page 13: CTO View: Driving the On-Demand Economy with Predictive Analytics

Moving to Real-Time Data

Page 14: CTO View: Driving the On-Demand Economy with Predictive Analytics

Keeping Pace

On-demand economy Real-Time Data Predictive Analytics

Page 15: CTO View: Driving the On-Demand Economy with Predictive Analytics

In our world, fresh accurate analytics means live data▪We’ll build a pipeline from scratch

We get predictive analytics via real-time scoring and modeling▪I’ll show an example and we’ll see more across the

talks

Visualizations make the data consumable▪Off-the-shelf options like Tableau, as well as custom

Today in My Talk

Page 16: CTO View: Driving the On-Demand Economy with Predictive Analytics

What is MemSQL?

Page 17: CTO View: Driving the On-Demand Economy with Predictive Analytics

Scalable SQL database

Familiar syntax

Really really fast

Page 18: CTO View: Driving the On-Demand Economy with Predictive Analytics

MemSQL Confidential18

Product or Services Scores for Operational Data Warehouse

Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics

Gartner, July 2016

Page 19: CTO View: Driving the On-Demand Economy with Predictive Analytics

MemSQL Pipelines

Page 20: CTO View: Driving the On-Demand Economy with Predictive Analytics

Exactly Once

Automatically Distributed

Language Agnostic

Page 21: CTO View: Driving the On-Demand Economy with Predictive Analytics

CREATE PIPELINE ASLOAD DATA KAFKA "hostname:9092/tweets"INTO TABLE tweets

Page 22: CTO View: Driving the On-Demand Economy with Predictive Analytics

Master Aggregator

Leaf Node Leaf Node Leaf Node Leaf Node

Child Aggregators

Page 23: CTO View: Driving the On-Demand Economy with Predictive Analytics

Master Aggregator

Leaf Node Leaf Node Leaf Node Leaf Node

Child Aggregators

.sh .sh .sh .shTransform

Page 24: CTO View: Driving the On-Demand Economy with Predictive Analytics

Live Demoelection.memsql.com

Page 25: CTO View: Driving the On-Demand Economy with Predictive Analytics
Page 26: CTO View: Driving the On-Demand Economy with Predictive Analytics
Page 27: CTO View: Driving the On-Demand Economy with Predictive Analytics

Real-time Twitter Feed

Public Kafka

Load into table "tweets"Load into table "tweet-sentiment"

MemSQL Pipelines

1. Extract 2. Transform 3. Load

Custom dashboard

Tableau dashboard

Page 28: CTO View: Driving the On-Demand Economy with Predictive Analytics

1. Assume data is already published somewhere in Kafka2. Create Pipeline and point at Kafka

a. What are the schemas of the table?b. Sentiment analysisc. What is the connective tissue between Kafka and

applying sentiment analysis?

Page 29: CTO View: Driving the On-Demand Economy with Predictive Analytics

Run a set of commands1. Creating tables2. Creating pipelines

a. We will see data flowing into MemSQL3. Build a web app similar to election.memsql.com

a. Quicker alternative: Tableau

Page 30: CTO View: Driving the On-Demand Economy with Predictive Analytics

Launch Tableau1. Already streaming data from public Kafka into MemSQL as

seen earlier2. Connecting Tableau

a. Similar dashboard to election.memsql.comb. Display sentiment analysis time series

Page 31: CTO View: Driving the On-Demand Economy with Predictive Analytics

Thank You