mt32 how relational (sql) and unstructured data (hadoop) learned to get along
TRANSCRIPT
MT32How relational (SQL) and unstructured data (Hadoop) learned to get along
David Leibowitz, Dell EMC
Stephen Kyriakos, North Texas Tollway Authority
Larry Levy, Microsoft
“The computer isn’t the thing. The computer’s the thing that gets us to the thing”- Joe MacMillan
3
Big Data
4
What Can I Do About It?
When Will it Happen?
Why Did it Happen?
What Happened?
Questions asked of Big Data
Innovation
Complex implementations
Spreadmarts
Siloed data
Transactional systems
Valu
e
Enterprise data warehouse
OLAPETL
Operational Reporting
Machine learning
Any dataIn-memory
Internet of Things
Optimization &
StimulationHadoop
DashboardsAd hoc analysis
Predictive Analytics
Data mining
Example of the Harmony of Structured & Unstructured Data:
Healthcare
Case Study:
Fullerton Health
Example of the Harmony of Structured & Unstructured Data:
Public
Case Study:
North Texas TollwayAuthority
9
BI System – 0 to 70 MPH
10
Theirs Theirs
11
Ours
12
Everyone drives on toll roads
$9.5 Billion in new projects
13
First to use transponder as
a method for toll collection
First to convert
entire system to ETC
Paving the way
14
• Public entity / Private bonds
• Multiple / diverse audiences
• Blind to 20% of customers
• Capture data at 70 MPH
It’s complicated
15
BI solves the complicated
7.4 million customers
2.1 million daily transactions
97% customer satisfaction
One of the fastest growing regions in the U.S.
16
It’s complicated. How we did it
Evaluated resources
Talked to the business
Reviewed infrastructure
Made a plan
17
Why BI? Inventoried data
VarietyVelocity
Venue
Volume
18
Define the “to be” state
Manage hybrid workloads
Integrate with business partners
Self-Service and Full-Service Analytics
Extend the solution
19
Delivered CARS
20
Become Your
Own Architect
We can purchase this photo if you like it.
It speaks to finding a solution that works – cutting through
layers in order to get what you need.
Defined our “To Be” stateExtend the BI team
Empower usersBe your own architect
21
Our Next Steps
Example of the Harmony of Structured & Unstructured Data:
Education
23
Demo:
Student Analytics with Education Data Management
24
Getting Started
25
Stakeholders
Procurement
PMO
It takes a village
Lessons Learned
Data Modernization & Becoming Future Ready
27
Key takeaways
Complicated is doable
Serve the business
Build a flexible, scalable solution
Plan your work, work your plan