Download - 2012-01-10-data tuesday
![Page 1: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/1.jpg)
Hadoop sur AzureData Tuesday – 10 janvier 2012Pierre Lagarde (DPE) – [email protected] Guinebertière (DPE) – www.benjguin.com
![Page 2: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/2.jpg)
Microsoft Distribution of Hadoop [MDH]
• Code name : Isotope• Leveraging the Hadoop data-driven
community – OnPremise – Cloud– Windows Server integration [AD – Secure
HDFS]– Connection with SQL Server / Excel– Developer Framework [JavaScript, .NET, F#,
…]– Hadoop as a Service through Azure [eMDH]
![Page 3: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/3.jpg)
Structural Overview
A SEAMLESS OCEAN OF INFORMATION PROCESSING AND ANALYTICS
EIS / ERP RDBMS File System OData [RSS] Azure Storage
ISOTOPE[Azure and Enterprise]
OCEAN OF DATA[unstructured, semi-structured, structured]
Java - JavaScript Streaming OM HiveQL PigLatin (T)SQL.NET/C#/F#
HDFS
NOSQL ETL
![Page 4: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/4.jpg)
Création d’un cluster à la demande
![Page 5: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/5.jpg)
Map/Reduce - Java
![Page 6: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/6.jpg)
Map/Reduce – C#
![Page 7: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/7.jpg)
Map/Reduce - JavaScript
![Page 8: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/8.jpg)
Démo - JavaScript
Azure Storage
distcp HDFS Sort/filter
JavaScript M/R
HDFS File
Graph.bar(data)
Excel ODBC Hive Connector
Reporting SQLServer
from("books") .mapReduce("file.js", "word, count:long") .orderBy("count DESC") .take(10) .to("top10")
![Page 9: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/9.jpg)
![Page 10: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/10.jpg)
![Page 11: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/11.jpg)
• from("books").mapReduce("bin/WordCountLong.js", "word, count:long").orderBy("count DESC").take(10).to("demo-top10")
![Page 12: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/12.jpg)
![Page 13: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/13.jpg)
• #get top10
![Page 14: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/14.jpg)
![Page 15: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/15.jpg)
![Page 16: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/16.jpg)
![Page 17: 2012-01-10-data tuesday](https://reader034.vdocuments.mx/reader034/viewer/2022052619/5560b36ad8b42a033c8b47eb/html5/thumbnails/17.jpg)