5 steps to analytics...
TRANSCRIPT
1© Cloudera, Inc. All rights reserved.
March 9, 2017
Frank Saffoori | Business Strategist
5 Steps to Analytics Excellence
2© Cloudera, Inc. All rights reserved.
Expect more from your data
3© Cloudera, Inc. All rights reserved.
For newborns who can’t communicate discomfort, how can we manage the negative impact of environmental factors in the ICU?
Can we analyze more than three days’ worth of bedside monitor data?
Analyze 20 years of air quality data to prevent asthma attacks.Ingest 50 GBs of sensor and other unstructured data per week.
3© 2015 Cloudera, Inc. All rights reserved.
4© Cloudera, Inc. All rights reserved.
4
Saving Lives by Detecting Sepsis Early Enough for Successful Treatment
• Has saved 100s of lives already
• Centralizing data from many systems
• 2PB+ in multi-tenant environment supporting 100s of clients
• Secure yet explorable
• Reduces hospital readmissions
HEALTHCARE
» CUSTOMER 360°
» PREDICTIVE ANALYTICS
» IMPROVED SERVICE
DATA-DRIVENPRODUCTS
5© Cloudera, Inc. All rights reserved.
Patterns & Predictions,
along with DARPA and
University of Dartmouth,
use social media to find
answers to haunting
military problems
6© Cloudera, Inc. All rights reserved.
Warehouse club understands product movements at a granular, location-specific level, enabling smarter market research and procurement decisions.
7© Cloudera, Inc. All rights reserved.
The mean number of days to resolve cyber attacks is 46 with a total cost of $973,130 over the 46-day remediation period
Source: Ponemon Reserch 2015 report
8© Cloudera, Inc. All rights reserved.
A US national security organization identifies potentially suspicious activity across the worldwide web, and supply threat information to 700 commercial and federal organizations.
9© Cloudera, Inc. All rights reserved.
Source: medGaget, June 6, 2016
• Increased efficiency and
utilization of the parking spots
• Increased local revenue
• Saving $105M & reduced
emissions
Smart Cities: Smart Parking
Milton Keynes
10© Cloudera, Inc. All rights reserved.
Enabling US Auto Manufacturer to Effectively Capture & Analyze Data from over 30,000 Sensors in Every Car
Challenge:
• Effectively capture and analyze data emitting from 30,000 sensors in every car
Solution:
• Centralized data platform from Cloudera for analytics of all of the sensor data
• Monitor individual component performance and operational metrics
AUTOMOBILE
» CONNECTED CARS
» PREDICTIVE ANALYTICS
» REMOTE MONITORING
Connected Cars
DATA-DRIVENPROCESS
CASE STUDY
11© Cloudera, Inc. All rights reserved.
Homeland Security Advanced
Research Projects Agency
(HSARPA)
Fighting Fires
Top Cancer Research
Institutions
Working to Cure Cancer
Thorn
Destroying Human Trafficking Networks
Real World ImpactCloudera enables new ways of working with your data
12© Cloudera, Inc. All rights reserved.
Cloudera: Company Snapshot
Founded 2008, by former employees of
Funding to date Over $1B in cumulative investment
Employees Today 1,600+ Worldwide
Enterprise Grade 1,000+ Enterprise subscription software customers.
Product First commercial distribution of Hadoop CDH - 2.5M open source downloads since 2009
World Class Support 24x7 Global Staff & Operations in 28 CountriesProactive & Predictive Support Programs using our EDH
Mission Critical Production deployments in run-the-business applications worldwide – Financial Services, Retail, Telecom, Media, Health Care, Energy, Government
The Largest Ecosystem 2,600+ Partners
Cloudera University Over 45,000 Trained
Open Source Leaders Cloudera employees are leading developers & contributors to the complete Apache Hadoop ecosystem of projects
13© Cloudera, Inc. All rights reserved.
The Big Shift…
IT-LedSystem-of-Record Reporting
Business-LedSelf-Service Analytics
FROM TO
14© Cloudera, Inc. All rights reserved.
Data is Transforming Government
Connected Vehicles
Homeland Security
Transportation
Predictive Maintenance
Smart Ports Smart Healthcare
Student Success Smart Cities
15© Cloudera, Inc. All rights reserved.
Finance HealthcareRegulatoryIntelligence Defense
Where is the Public Sector data?
• Activity-Based
Data
• Video /
Surveillance
• Online Activity
• Mobile Activity
• Sensors
• Geospatial Data
• Social / Sentiment
• Associative Data
• Inventory / Supply
Chain
• Theater
Operations
• Netflow / Packet
Capture
• Citizen Data
• Demographic /
Census Data
• Social / Sentiment
• Trade Data
• Citizen Data
• Research /
Publications
• Communications
/ Documentation
• Environmental /
Clinical Data
• Policy Data
• Internet of
Things
• Market Data
• Trade Data
• Policy Data
• Demographic /
Census Data
• Communication /
Documentation
• Research /
Publications
• EMRs / EHRs
• Claims /
Insurance Data
• Policy Data
• Citizen Data
• Research /
Publications
• Clinical Studies
• Population
Health
16© Cloudera, Inc. All rights reserved.
Data is your
most important asset
your data can help achieve
your objectives and mission.
…only if...
17© Cloudera, Inc. All rights reserved.
Your Data is Officially an Asset… But Status Quo Won't Work Going Forward
• Enormous Amounts of Data (And We're Experiencing Compound Growth)
• Where's The Value? Need a Modern Approach To Realizing Value
• Data (a) Has Quantifiable Value + (b) Is Depreciable
• Think From the Perspective of Your Customers (Data's Beneficiaries)
• Serve Your Data Accordingly � Harness All Your Data to Optimize Impact
• Don't Wait – Be The First
• Even If You're Historically Risk Averse, Balance Taking Innovative Approach
18© Cloudera, Inc. All rights reserved.
Delivering Real-Time Weather Response with an IoT Platform
CUSTOMER 360
PUBLIC SECTOR
» IOT
» SERVICE IMPROVEMENT
» PREDICTIVE ANALYTICS
19© Cloudera, Inc. All rights reserved.
CUSTOMER 360Challenge / Opportunity
• Snow & ice expenses = $40-80M
• Control of material usage/costs due to spreader route inefficiencies
• 1,400 trucks
• 2014-15: nearly ran out of salt
• Couldn’t process & analyze 80K records generated per second
• Unable to apply predictive analytics for proactive preparation & management of snow events
20© Cloudera, Inc. All rights reserved.
CUSTOMER 360
• Optimize snow & ice response
• Real-time information management solution built on Cloudera
• Stream and analyze unlimited, real-time data from sources like…
• WAZE, Twitter, HERE, vehicle locators, weather
data
• Fully monitor route conditions
• Targeted to replace KYTC’s legacy 511 system
Solution
21© Cloudera, Inc. All rights reserved.
CUSTOMER 360
• Better, faster insights optimize efficiencies of snow & ice removal, reduce traffic, prevent crashes
• Rapid response to federal mandates
• IoT data ingested and available for analysis in 35 seconds (vs. 2 days)
• Aggregate 20M records/day
• Process >1M records/second
• Predictive analytics in 3 hours (vs. 4 days)
• Cost savings = $2-8M per year (payback = 1 season)
• Strategies for road and bridge maintenance (understanding impact of over-salting & plowing)
Results
22© Cloudera, Inc. All rights reserved.
5 Steps to Analytics Excellence
23© Cloudera, Inc. All rights reserved.
Big Data Is Different Than Traditional BI
1. Economically feasible to store more data
2. Powered to predictably process large data sets
3. Ability to build your data asset at linear scale
Extreme Performance
& Efficiency
4. Collect data in native format – enables agility
5. Build history of activity by collecting data prior to its use
6. You can have near real-time access to data, plus a view of history
7. Create community data by sharing across your business
8. Out-of-the-box thinking and fail-fast increases innovation
Analytic
Agility
24© Cloudera, Inc. All rights reserved.
Yet the Journey Requires Organizational Change
50%
50%
Through 2017,
By 2018,
or fewer organizations will have made the
cultural or business model adjustments to
benefit from big data.
of business ethics violations will be from
improper use of big data analytics.
Gartner “Predicts 2015: Big Data Challenges Move From Technology to the Organization” – November 2014
60%Through 2017, of big data projects won’t go beyond pilot or
experimentation and will be abandoned.
25© Cloudera, Inc. All rights reserved.
5 Steps to Analytics Excellence
• Measure, Analyze, Theorize (Quickly)
• Build Your Foundation
• Build Your Business Case
• Rinse, Lather, Repeat (And Be Agile!)
STEP 1
STEP 2
STEP 3• Quick Win = Creating Raving Fans
• Build Your Roadmap & Your Team
STEP 4
STEP 5
26© Cloudera, Inc. All rights reserved.
Measure, Analyze, Theorize (Quickly)
• You Can't Improve What You Can't Measure
• Apply DMAIC Principles (even if you don't have a 6S culture)
• Visibility Is Critical
• Current State Analysis (Process, Technology, Skills)
• Future State Analysis (Vision, Strategic Imperatives)
• Gaps & CSFs
• Be Agile (No More Waterfalls, Please!)
STEP 1
27© Cloudera, Inc. All rights reserved.
Build Your Foundation
• Establish a Base for Success (Plan for People-Process-Technology)
• Leverage Strengths & Core Competencies (Be Results Driven)
• Know Your Weaknesses (for the ambitious – do a full SWOT)
• Partner with Motivated Leaders (And Get an Executive Sponsor)
• Outline Your Business Case
• Orient Your Activity Around a Center of Excellence
STEP 2
28© Cloudera, Inc. All rights reserved.
Quick Win = Creating Raving Fans
• They Don't Want to Hear It From You (Raving Fans Apply Within)
• Define a “Quick Win" For Your Organization
• Define "Raving Fan" (Customer)
• Prioritize Use Cases on Technical Complexity & Value/Impact
• Operationalize Insights (in weeks, not months)
• Document Results, Lessons Learned, Next Steps (Iteration Is Critical)
• Socialize Across Your Organization (Via Your Raving Fans)
STEP 3(a)
29© Cloudera, Inc. All rights reserved.
Build Your Roadmap & Your Team
• This Is Not a One-time Exercise � Transformation Is a Journey
• Keep It Centered & Fluid
• Aligned with strategic imperatives & customer demand
• Include The What, How, When, Who, Where
• Acquire and Build Skills & Experience
• Partner with Technology Leaders
• Internal, other agencies, business sector colleagues, vendors
STEP 3(b)
30© Cloudera, Inc. All rights reserved.
Build Your Business Case
• Start with Illustration of Value
• Current State (Status Quo) + Future State (Vision)
• High Priority Use Cases (Projects)
• Highlight Quick Win (Proof This Works + Value)
• Outline Roadmap
• Cost-Benefit Analysis
• Investment Requirements, Quantitative & Qualitative Benefits, ROI,
Payback, NPV, TCO Comparison
STEP 4
31© Cloudera, Inc. All rights reserved.
Rinse, Lather, Repeat (And Be Agile!)
• Parallel Work Streams (Use Case Development)
• 2-4 Week Sprints
• Deliver Capabilities & Value Aimed at Creating Raving Fans
• Have a Communication Plan & Build a Brand of Excellence
(Compelling Progress & Value Delivered Frequently)
• Focus on Time to Value (Be Results Driven)
• Build & Evolve Your Analytics Center of Excellence
STEP 5
32© Cloudera, Inc. All rights reserved.
When you ask bigger questions,you get bigger answersAnd that makes anything possible
33© Cloudera, Inc. All rights reserved.
Digital Globe – full bleed Can we add more detailed data streams to better model the impact to the
watershed of actual day-to-day activity and occurrences?
34© Cloudera, Inc. All rights reserved.
What trading patterns should we look out for tomorrow that may indicate
market manipulations?
35© Cloudera, Inc. All rights reserved.
State of Indiana builds an operational data store to reduce infant mortality below the national average by 2020.
36© Cloudera, Inc. All rights reserved.
Data helps solve the world's biggest problems
What has your datadone for you lately?
37© Cloudera, Inc. All rights reserved.