1. 2012829 MIT United

2. Hadoop Osamu Yonetani MIT United 3. 4. / 4 5. 1960331 30264 3,720572011412012331 8,066612011412012331 5,974 20124126193355 201210 73 5 6. MIT United "Marketing and IT" UnitedCEO HR MIT PMO 6 7. 7 8. 9. . 9 10. . 10 11. . 11 12. .Gate Review Gate Review Gate ReviewR-StageDev-Stage -Stage -Stage 12 13. Hadoop 14. Gate Review Gate Review Gate ReviewR-StageDev-Stage -Stage -Stage Hadoop14 15. HadoopJAVAMapReduceJava HDFSMapReduceMAPjavaSHUFFLE REDUCE HDFS 15 16. RDB PV Quest Data Connectorive HadoopmA16 17. Hive HadoopRDB SQLHiveQLMapReduceSQL Hive MapReduceHive17 18. mahout Java 18 19. Sqoop HadoopRDBMSOracleOraOopRDBMSRDBMS HadoopRDBMS DB Hadoop Hadoop 19 20. 21. 1234 20 12040 20089201020112012Web 21 22. Apache Hadoop / CDH MapR / GreenplumMRHeartbeat + DRBDMasterNode1 MasterNode2MasterNode3MasterNode4Node1Node2Node3 Node4 JobTrackerJobTrackerCLDB CLDB CLDBCLDB NameNodeNameNodeJobTracker JobTracker JobTrackerJobTrackerSecondarySecondary TaskTrackerTaskTrackerTaskTracker TaskTrackerNameNode NameNode FileServer FileServer FileServerFileServerWardenSlaveNode1SlaveNode2 SlaveNode3 SlaveNode4 Node5Node6Node7 Node8 TaskTracker TaskTrackerTaskTrackerTaskTracker CLDB CLDB CLDBCLDB DataNodeDataNode DataNode DataNodeJobTracker JobTracker JobTrackerJobTracker TaskTrackerTaskTrackerTaskTracker TaskTrackerFileServer FileServer FileServerFileServerMaster4Slave15+batch120 NodeSlave 22 23. 24. /SQLRHadoopMapReduceMahoutJavaR 24 25. 3 25 26. 26 27. MIT 27 28. Hadoop 29. 30. * * /ETC/ 30 31. 31 32. 32 33. //////ETC/ /////// ///// 30 33 34. DB DB *1/18/*34030and 34 35. hadoopHadoop DB Hadoop DB 1 35 36. Hadoop DB Hadoop DB 950136 37. 38. SC 38 39. 39 40. 40 41. 41 42. D EA I/F I/F DBB C F ASPGMP I/F 43. D HadoopEUCEA I/F DBB CF ASPMP 44. 60 1415 85 44 45. CVR . 45 46. KWDLP UU KPI LPO UU HP KPI 4646 47. UU KWDLP KPI LPO UU HP KPI 4747 48. 49. DWHKVSorRDB49 50. with DWH KVS HadoopMahoutLucene or RDB with S4STORM with Siri GPS50 51. Hadoop20111,000Cloudera Todd Lipcon QA 51 52. MIT United2012101 IThttp://recruit-tech.co.jp52 53.