the formula for hadoop project success
DESCRIPTION
As the big data market matures, Hadoop discussions are expanding from pure technology to how businesses can use it to drive innovation and leap-frog competition. In this session, Karmasphere will outline how to successfully deploy Hadoop projects by bringing together the right people, technology and use cases. We will discuss the optimal project team, the role of data scientists and analysts, the new big data analytics workflow and use cases for driving rapid ROI and success.TRANSCRIPT
![Page 1: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/1.jpg)
The Formula for Hadoop Project Success
Gail EnnisCEO
![Page 2: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/2.jpg)
Volume, Variety and Velocity all increasing rapidly Source: IBM, Oct 2012
OMG!…The Opportunity Is Huge
![Page 3: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/3.jpg)
{"frequentlyPurchasedWith": [], "color": "Black", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "3039", "shortDescription": "Compatible with Windows 8 and RT and Android 3.0 tablets; Bluetooth technology; convertible stand/carrying case", "includedItemList": [{"includedItem": "Logitech Tablet Keyboard for Windows 8 and RT and Android 3.0+ Tablets"}, {"includedItem": "4 AAA batteries"}, {"includedItem": "Owner's manual"}], "subclassId": 2409, "sku": 6541967, "width": "12.3\"", "subclass": "BLUETOOTH KEYBOARDS", "source": "BoxStore", "modelNumber": "920-004569", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218752781558, "description": "None", "technologyCode": "None", "longDescription": "This Logitech 920-004569 keyboard features a low-profile, 65-key design for easy, comfortable typing on your Windows 8 or RT or Android 3.0 tablet. The convertible stand allows comfortable viewing and provides on-the-go protection for the keyboard.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Docks, Keyboards & Stands", "id": "pcmcat242000050003"}], "manufacturer": "Logitech", "classId": 492, "upc": "097855090973", "regularPrice": 69.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 4974041}, {"sku": 1306578835}, {"sku": 4640745}, {"sku": 9610542}, {"sku": 8785729}, {"sku": 6640676}]}{"frequentlyPurchasedWith": [], "color": "Gray", "skutype": "parent", "productTemplate": "Computer_Accessory", "salesRankMediumTerm": "None", "shortDescription": "Compatible with BlackBerry Playbook tablets; wool construction; TPU plastic cradle; elastic band; metallic clip; functions as a stand; play-through design", "includedItemList": [{"includedItem": "DICOTA TabBook Case for BlackBerry Playbook Tablets"}], "subclassId": 2404, "sku": 6738835, "width": "5.5\"", "subclass": "SO TABLET ACCY", "source": "BoxStore", "modelNumber": "D30203", "digital": false, "department": "COMPUTERS", "type": "HardGood", "productId": 1218789793935, "description": "None", "technologyCode": "None", "longDescription": "This DICOTA TabBook D30203 case helps keep your BlackBerry Playbook tablet safe from hazards, with wool construction and a TPU plastic cradle for durability and an elastic band to keep your tablet snug and secure in the case.", "categoryPath": [{"name": "Box Store", "id": "cat00000"}, {"name": "Computers & Tablets", "id": "abcat0500000"}, {"name": "iPad, Tablets & E-Readers", "id": "pcmcat209000050006"}, {"name": "Tablet Accessories", "id": "pcmcat231800050009"}, {"name": "Tablet Cases, Covers & Sleeves", "id": "pcmcat242000050002"}], "manufacturer": "DICOTA", "classId": 492, "upc": "7332752000964", "regularPrice": 49.99, "class_1": "TABLET ACCESSORIES", "relatedProducts": [{"sku": 6118882}, {"sku": 6118737}, {"sku": 1305180220}, {"sku": 4124528}, {"sku": 1304792301}, {"sku": 6744043}]}
![Page 4: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/4.jpg)
InformationWeek 2013
There’s certainlychallenges
![Page 5: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/5.jpg)
A Success Formula for a Hadoop Project
✚= =
WHATyour
company & you
HOWbest
practices
![Page 6: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/6.jpg)
MORE BI?
![Page 7: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/7.jpg)
Big Data Analytics
![Page 8: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/8.jpg)
What Can We Make Happen?“Data Platform of Intent”
Big Data Full
Fidelity Analysis
Unstructured Behavioral,
Open, Affordable
HADOOP
HQL
BI Data Cube
Analysis
Structured, Transactional
Closed, Expensive
RDBS & EDW
SQL
Powered by the CommunityPowered by Vendors
Report On What Happened?Database of Transactions
![Page 9: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/9.jpg)
1. What auxiliary products should we recommend?
2. What new features should our product have?
3. How can we eliminate support issues?
Hadoop Innovation Use Cases … some examples
![Page 10: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/10.jpg)
![Page 11: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/11.jpg)
Another IdeaScore Your Predictive Models On Hadoop
Model Builder Model Description
Hive UDFs
Standard Hive
![Page 12: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/12.jpg)
![Page 13: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/13.jpg)
Reinvent Your CareerLeadThrive
![Page 14: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/14.jpg)
This is the time to be the river, not the rock
![Page 15: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/15.jpg)
Big Data Projects on HadoopWe’re On a journey that’s just starting
You Are Here….Time to get going!
![Page 16: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/16.jpg)
But first!
Education Training Certifications
![Page 17: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/17.jpg)
#1. Form a Partnership With LOB Find a use case Identify some budget Form a project team Be willing to educate others Partner on a small POC, don’t boil the ocean
Hadoop Project SuccessBest Practice #1
![Page 18: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/18.jpg)
Teams are Highly Cross-Functional
Product Manager (LOB) Power Analysts (IT or LOB) Business Analyst (LOB) Product Manager (LOB IT Architect (IT) Project Manager (IT/LOB)
![Page 19: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/19.jpg)
“By 2016 the CMO will have more budget than the CIO”
- Gartner Group
Marketing The “Budget Richest” LOB?
![Page 20: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/20.jpg)
![Page 21: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/21.jpg)
#2. Use the Right Big Data Analytics tooling
• Supports the entire time• Reuse and share for speed and efficiency• Leverage pre-built analytics
Hadoop Project SuccessBest Practice #2
![Page 22: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/22.jpg)
PERSONALIZED ANALYTICS HUB
![Page 23: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/23.jpg)
#3. Embrace Full Fidelity Big Data Analytics Not sampled, all the data – maintains richness Don’t replicate or move the data Keep complexity and TCO low
Hadoop Project SuccessBest Practice #3
![Page 24: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/24.jpg)
Data Warehouse
OLTP to OLAP Mapping
Analyst
In SummaryIn BI, The Analyst Was at the End of the Process
Ordering App
Financial App
Master Data
Stag
ing
OLAPReports
BI UsingData Cube
Analysis
Structured, Sampled Transitional,
Closed, Expensive
RDBS & EDW
SQL
Driven by Vendors
![Page 25: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/25.jpg)
In Big Data Analytics on HadoopThe Analyst is at the Center of the Process
Application
AnalyticsData
Unstructured Behavioral,
Open, Affordable
HADOOP
HQL
Analyst
Full Fidelitiy Analytics
![Page 26: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/26.jpg)
Get distracted….
![Page 27: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/27.jpg)
Or
Big Data on Hadoop Project
![Page 28: The Formula for Hadoop Project Success](https://reader034.vdocuments.mx/reader034/viewer/2022042813/547bdf2cb4af9f173b8b4669/html5/thumbnails/28.jpg)
Thank YouWe’re happy to help
Questions