powerpoint presentationlboloni/teaching/cda5106_fall2017/slides/mapred… · • used in hadoop 2.x...
Post on 05-Jul-2020
1 Views
Preview:
TRANSCRIPT
•
•
•
•
•
•
•
• Used in Hadoop 2.x +
• YARN = Yet Another Resource Negotiator
• Treats each server as a collection of containers
• Container = some CPU + some memory
• Has 3 main components
• Global Resource Manager (RM)
• Scheduling
• Per-server Node Manager (NM)
• Daemon and server-specific functions
• Per-application (job) Application Master (AM)
• Container negotiation with RM and NMs
• Detecting task failures of that job
•
•
top related