ntb0e5xqqjihzzxh3bit 140416002604-phpapp02-140416020154-phpapp02

Download Ntb0e5xqqjihzzxh3bit 140416002604-phpapp02-140416020154-phpapp02

If you can't read please download the document

Post on 16-Apr-2017

151 views

Category:

Business

0 download

Embed Size (px)

TRANSCRIPT

  • HadoopEdit by Cassell Hsu2013.04.19

  • HadoopMasterSlaveSlaveSlave

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • NameNodeWhere is NameNode?MasterHDFS(Hadoop Distributed File System)What is NameNode?

  • NameNode? DataNode

  • DataNodeWhat is DataNodeWhere is DataNodeHDFSSlaves (and Master)

  • UserDataNodeNameNodeDataNodeDataNode128MbB64MbA64MbCheck hdfs-site.xmlB64MbA64Mb

    *

  • Hadoop

    DataNodeNameNodeMaster

    DataNode

    DataNode

    DataNodeSlaves

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • JobTrackerWhat is JobTracker?Where is JobTracker?Master

    *

  • JobTracker & TaskTracker

    JobTrackerTaskTrackerWhereMasterSlavesWhat

    *

  • Hadoop

    DataNodeNameNodeMaster

    DataNodeSlavesJobTrackerTaskTracker

  • HadoopMasterNameNodeJobTrackerSecondaryNameNode

  • SecondaryNameNodeWhat is SecondaryNameNode?NameNodeWhere is SecondaryNameNode?Master

  • Hadoop

    DataNodeNameNodeMaster

    DataNodeSlavesJobTrackerTaskTrackerSecondaryNode

  • MapReduceUserMasterSlave2Slave1A

    A1A2TaskNameNode

    TaskResult1Result2ReduceFinal Result

  • MapReduceHadoop

    *

    *

    *