dr ohad barzilay
DESCRIPTION
Big Data 12/3/14TRANSCRIPT
Big Data LandscapeBig Data Landscape
Dr. Ohad Barzilay
Technology Management and Information SystemsTechnology Management and Information Systems
What do you mean when you say
Big Data?Big Data?
Lots of Data
• Geology
• Space
• Human body
• Digital life• Digital life
• The Internet
• Social networks
• 3 V’s of Big Data:– Volume
– Velocity
– Variety
Enterprise Information
Systems
• Storage
• Processing
• Communication
• Internet Scale• Internet Scale
• New paradigms
– Moving to the cloud
– Distributed computing
– NoSQL
Data => Information => Knowledge
• Applications of theoretical research which exists for years:– Data Mining
– Machine learning
Statistics
Machine learning
– Statistics
– Econometrics
• "By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analytical skills“
[Mckinsey, May 2011]
Data => Information =>
Knowledge => Decision Making
Sources: IDC: 2012 “Worldwide Big Data Technology and Services Forecast: 2011-2015,
Gartner: 2012 “Big Data Drives Rapid Changes in Infrastructure and $232 Billion in IT Spending Through 2016
“By 2018, the United States alone could face a shortage of 1.5 million managers
and analysts with the know-how to use the analysis of big data to make effective
decisions”
[Mckinsey, May 2011]
Big Data Technology Stack
Is Big Data Only a Buzz?
• A major criticism of Big Data say it is just a re-
branding of existing stuff
BUTBUT
• Big Data provides a managerial framework for
making data driven business decisions
• A scientific mindset
Data Does NOT Tell Any Story!
From Big Data to Data Science
Formulate hypotheses
Make decisions
Analyze it correctly, find
correlations, infer causality
• Capture the phenomena correctly
• Measure relevant data
correlations, infer causality
Process the data
What do people buy before a
hurricane?
Some insights
• As business grow there is too much data to
make sense of:
– Distributed organizations
– Distributed responsibilities– Distributed responsibilities
– Small adjustments have
large impact
Another Example: SportVU
• An Israeli startup acquired by STATS
• Player Tracking Technology
– Basketball
– Football (Soccer)– Football (Soccer)
• Lets examine SportVU technology on top of
the Big Data Technology Stack
SportVU and the
Big Data Technology Stack
SportVU and the
Big Data Technology Stack
SportVU and the
Big Data Technology Stack
SportVU and the
Big Data Technology Stack
Moneyball on steroids
http://grantland.com/features/expected-value-possession-nba-analytics/
http://grantland.com/features/the-toronto-raptors-sportvu-cameras-nba-analytical-revolution/
SportVU and the
Big Data Technology Stack
Live twitting
SportVU and the
Big Data Technology Stack
Sport Medicine
Thank you
[email protected]@tau.ac.il