hadoop stories - bigdatabigdata.be/wp-content/uploads/2016/01/hadoop-stories-bigdata.be_.… ·...

25
Page 1 © Hortonworks Inc. 2011 – 2015. All Rights Reserved Hadoop Stories Tim Marston Director, Regional Alliances EMEA @timmarston

Upload: others

Post on 20-May-2020

26 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 1 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hadoop Stories

Tim MarstonDirector, Regional Alliances EMEA

@timmarston

Page 2: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 2 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Page 3: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 3 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Plans for Hadoop Adoption (Gartner, May 2015)

No Plans55%Already doing

27%

Start within 1 year11%

Start within 2 years7%

Page 4: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 4 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Page 5: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 5 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Plans for Hadoop Adoption (Gartner, May 2015)

No Plans55%Already doing

27%

Start within 1 year11%

Start within 2 years7%

Page 6: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 6 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks: Hadoop for the EnterpriseO

NLY 100

open sourceApache Hadoop data platform

% Founded in 2011

HADOOP1STdistribution to go public

IPO Fall 2014 (NASDAQ: HDP)

subscriptioncustomers700+ employees across

800+

countriestechnology partners1350+ 17

TM

Page 7: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 7 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Modern Data Architecture

• Applications can be given access to all data through a single platform

• Simpler governance, security and operations

• Able to handle all sizes and types of applications and datasets

Clickstream Web&Social

Geolocation Sensor& Machine

ServerLogs

Unstructured

SOU

RC

ES

Existing Systems

ERP CRM SCM

ANAL

YTIC

S

Data Marts

Business Analytics

Visualization& Dashboards

ANAL

YTIC

S

Applications Business Analytics

Visualization& Dashboards

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

HDFS (Hadoop Distributed File System)

YARN: Data Operating System

Interactive Real-TimeBatch Partner ISVBatch BatchMPP

EDW

Page 8: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 8 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Hadoop Journey

Page 9: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 9 © Hortonworks Inc. 2011 – 2015. All Rights ReservedPage 9 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Historical Records

OPEXReduction

Mainframe Offloads

Fraud Prevention

Dataas a

Service

Public Data

Capture

IT executives are delivering substantial reductions in operating costs by modernizing their data architectures with Open Enterprise Hadoop. These cost saving innovations include active archive of cold data, offloading ETL processes and enriching existing data.

Digital Protection

Device Data

Ingest

Rapid Reporting

Page 10: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 10 © Hortonworks Inc. 2011 – 2015. All Rights ReservedPage 10 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Payment Tracking

Call Analysis

Machine Data

Product Design

Social Mapping

Factory Yields

Defect Detection

Due Diligence

M & A Proactive Repair

Disaster Mitigation

Investment Planning

Next Product

Recs

Store Design

Risk Modeling

Ad Placement

Inventory Predictions

Sentiment Analysis

Ad Placement

Basket Analysis Segments

Customer Support

Supply Chain

Cross-Sell

Customer Retention

Vendor Scorecards

Optimize Inventories

Business executives are driving transformational outcomes with next-generation applications that empower new uses of Big Data including: data discovery, a single view of the customer and predictive analytics.

Page 11: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 11 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Vision: Enabling the Data LakeSC

ALE

SCOPE

Data Lake Definition• Centralized Architecture

Multiple applications on a shared data set with consistent levels of service

• Any App, Any DataMultiple applications accessing all data affording new insights and opportunities.

• Unlocks ‘Systems of Insight’Advanced algorithms and applications used to derive new value and optimize existing value.

Drivers:1. Cost Optimization2. Advanced Analytic Apps

Goal:• Centralized Architecture• Data-driven Business

DATA LAKE

Journey to the Data Lake with Hadoop

Systems of Insight

Page 12: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 12 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Data Archive for legal casesProject cash positive after 12 months, with order of magnitude Opex savings once implemented.

Source: http://www.slideshare.net/Hadoop_Summit/making-the-case-for-hadoop-in-a-large-enterprisebritish-airways

Page 13: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 13 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Self-learning cars“...if British manufacturing is to survive it needs to be competitive. And it cannot be competitive without data.”

Source: https://diginomica.com/2015/09/11/using-hadoop-inside-jaguar-land-rover-zurich-insurance-and-the-home-office/

Page 14: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 14 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Modern Data Architecture“The aim is to use Hadoop, a mix of internal and external data, to take Zurich Insurance to the next level of maturity in terms of using data to drive business decisions.”

Source: https://diginomica.com/2015/09/11/using-hadoop-inside-jaguar-land-rover-zurich-insurance-and-the-home-office/

Page 15: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 15 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hadoop at Scale1300 Hadoop nodes, 42PB stored20TB ingested via Kafka per day200TB generated by Hadoop per day

Source: http://cdn.oreillystatic.com/en/assets/1/event/118/The%20Evolution%20of%20Hadoop%20at%20Spotify-%20Through%20Failures%20and%20Pain%20Presentation.pdf

Page 16: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 16 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Future?

Page 17: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 17 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The 100% open source Hadoop distribution

Page 18: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 18 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks Data Platformpowered by Apache Hadoop

Hortonworks Data Platformpowered by Apache Hadoop

EnrichContext

Store Data and Metadata

Internetof Anything

Hortonworks DataFlowpowered by Apache NiFi

Perishable Insights

HistoricalInsights

Hortonworks DataFlow

Page 19: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 19 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Appendix

Page 20: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 20 © Hortonworks Inc. 2011 – 2015. All Rights ReservedPage 20 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks Influences the Apache Community

We Employ the Committers--one third of all committers to the Apache®

Hadoop™ project, and a majority in other important projects

Our Committers Innovateand expand Open Enterprise Hadoop

We Influence the Hadoop Roadmapby communicating important requirements to the community through our leaders

A P A C H E H A D O O P C O M M I T T E R S

Page 21: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 21 © Hortonworks Inc. 2011 – 2015. All Rights ReservedPage 21 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks Data Platform Is Genuinely Open

Eliminates Riskof vendor lock-in by delivering 100% Apache open source technology

Maximizes Community Innovationwith hundreds of developers across hundreds of companies

Integrates Seamlesslythrough committed co-engineering partnerships with other leading technologies

M A X I M U M C O M M U N I T Y I N N O V A T I O N

T H E I N N O VAT I O N A D VA N TA G E

P R O P R I E T A R Y H A D O O P

T I M E

INN

OV

AT

ION

O P E N C O M M U N I T Y

Page 22: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 22 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Hortonworks Delivers Proactive Support

Hortonworks SmartSense™with machine learning and predictive analytics on your cluster

Integrated Customer Portalwith knowledge base and on-demand training

Knowledge Base

Integrated Customer Portal

On-Demand Training

Customer EnvironmentAny cloud • Hybrid Environment • Multi-tenant

Hortonworks SmartSense

Page 23: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 23 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Open Data Platform

Common ODP CoreApache Hadoop and Apache Ambari

Open Platform with Apache Hadoop

Pivotal HDHDP

April

14

Page 24: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 24 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

The Data Governance Initiative

Hadoop must snap in to the existing frameworks and openly

exchange metadata.

Hadoop must address governance within its own stack

of technologies

Page 25: Hadoop Stories - bigdatabigdata.be/wp-content/uploads/2016/01/Hadoop-Stories-bigdata.be_.… · Hortonworks: Hadoop for the Enterprise Y 100 open source Apache Hadoop data platform

Page 25 © Hortonworks Inc. 2011 – 2015. All Rights Reserved

Cautionary Statement Regarding Forward-Looking Statements

This presentation contains forward-looking statements involving risks and uncertainties.Such forward-looking statements in this presentation generally relate to future events, ourability to increase the number of support subscription customers, the growth in usage of theHadoop framework, our ability to innovate and develop the various open source projectsthat will enhance the capabilities of the Hortonworks Data Platform, anticipated customerbenefits and general business outlook. In some cases, you can identify forward-lookingstatements because they contain words such as “may,” “will,” “should,” “expects,” “plans,”“anticipates,” “could,” “intends,” “target,” “projects,” “contemplates,” “believes,” “estimates,”“predicts,” “potential” or “continue” or similar terms or expressions that concern ourexpectations, strategy, plans or intentions. You should not rely upon forward-lookingstatements as predictions of future events. We have based the forward-looking statementscontained in this presentation primarily on our current expectations and projections aboutfuture events and trends that we believe may affect our business, financial condition andprospects. We cannot assure you that the results, events and circumstances reflected in theforward-looking statements will be achieved or occur, and actual results, events, orcircumstances could differ materially from those described in the forward-lookingstatements.

The forward-looking statements made in this prospectus relate only to events as of the dateon which the statements are made and we undertake no obligation to update any of theinformation in this presentation.

TrademarksHortonworks is a trademark of Hortonworks, Inc. in the United States and otherjurisdictions. Other names used herein may be trademarks of their respective owners.