ega - big data keynote - feb 2016
DESCRIPTION
EGA - Big Data Keynote - Feb 2016TRANSCRIPT
-
BIG DATA ANALYTICS
Asst. Prof. Natawut Nupairoj, Ph.D.
Head of Department
Department of Computing Engineering
Chulalongkorn University
https://natawutn.wordpress.com
-
Data is a new class of economic asset, like currency and gold - World Economic Forum
-
BIG DATA
Source: IBM
-
..
-
BIG DATA
40,000+ = 500+Wifi + NAT
Log
-
90 = 39,000,000,000 events (6.5TB)
-
Internal External
Structured Unstructured
-
USHAHIDI2007
Kenya
2010
Haiti
Chile
Washington DC
Russia
2011
Christchurch
Middle East
India
Japan
Australia
US
Macedonia
2012
Balkans
2014Kenya
-
BIG DATA ARCHITECTURE
Data Source
Data Source
Data Source
Data Source
Data
Ingestion
Fast Data Path
Big Data Path
Data Stream Processors
Data Lake
(Landing Zone)
Data Refinery /
Data Analytics
Da
ta V
isu
aliz
atio
n
Traditional Data Warehouse / Reporting tools
-
NOSQL
Python R
-
Data Science
(Data Analytics)
Data Engineering
(Big Data)
-
( )
GPS
VDO Streaming /
:
?
?
?
-
DATA ANALYTICS
-
DATA VALUE CHAIN
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
-
DATA VALUE CHAIN
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
Data Engineering
Data Science
-
DATA VALUE CHAIN IT LOG
Source: http://steinvox.com/blog/big-data-and-analytics-the-analytics-value-chain/
Data Engineering
Data Science
-
BIG DATA Bigger / Faster / More Up-to-Date Data Warehouse
Social Listening / Crowdsourcing
Workforce Planning / Economics Planning
Smart Education
Precision Agricultural / Resource Management
Preventive Healthcare
Fraud Detection (e.g. Tax, Social Security, etc.)
Video Analytics / Satellite Image Analytics
-
Real-Time Data Warehouse
-
Data Driven Organization