strata conference + hadoop world 2012 참관기 김영우 kt...
TRANSCRIPT
![Page 1: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/1.jpg)
Strata Conference + Hadoop World 2012 참관기
김영우 KT Cloudware (NexR)
Brandon.kim@{kt|nexr}.com
![Page 2: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/2.jpg)
1
![Page 3: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/3.jpg)
튜토리얼
• Building applications with HBase
2
![Page 4: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/4.jpg)
튜토리얼
• Hadoop Data Warehousing with Hive
3
![Page 5: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/5.jpg)
이벤트 - 스타트업 쇼케이스
4
![Page 6: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/6.jpg)
세션
• Paypal
• Akamai
• Last.fm
• Cloudera
• Metamarkets
• Comcast
• Nokia
• WibiData
• Netflix
• Hortonworks
• SAP
• SAS
• Microsoft
• …… 5
![Page 7: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/7.jpg)
세션 (2)
6
• Hadoop as a Complementary Data Platform at PayPal
![Page 8: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/8.jpg)
세션 (3)
7
• Trecul : Data Flow Processing Using LLVM-based JIT Compilation on Top of Hadoop
![Page 9: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/9.jpg)
세션 (4)
8
• Large Scale ETL with Hadoop
![Page 10: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/10.jpg)
세션 (5)
9
• Facebook's Large Scale Monitoring System Built on HBase
![Page 11: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/11.jpg)
세션 (6)
10
• Performing Data Science with HBase
![Page 12: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/12.jpg)
세션 (7)
11
• Data Science on Hadoop: How Cloudera Impala Unlocks New Productivity and Insights
![Page 13: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/13.jpg)
세션 (8)
12
• Netflix's Evolving Data Science Architecture
![Page 14: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/14.jpg)
세션 (9)
13
• Beyond Hadoop: Fast Ad-Hoc Queries on Big Data
![Page 15: Strata Conference + Hadoop World 2012 참관기 김영우 KT …ktnexr.com/upload/hadoop_world.pdf · DSE Platform Chukwa + Execution Service / Genie + Event Service + Metadata Service](https://reader033.vdocuments.mx/reader033/viewer/2022051916/600808c53740e43c8873f300/html5/thumbnails/15.jpg)
결론
14
• In-memory storage and query engine
• SQL and SQL-like(DSL) tools to analyze big data
• The life cycle of the Big Data