introduction to the grid n1™ grid engine 6 software
TRANSCRIPT
Introduction to the GridIntroduction to the GridN1™ Grid Engine 6 SoftwareN1™ Grid Engine 6 Software
Overview
A brief explanation of grid computing
Grid examplesHow grid works? (grid as bank)Grid jobsA description of each important
components
What Is Grid Computing?
Collection of computing resources that perform tasks
A large system that provides a single point of access to powerful distributed resources
Define the goal in more detail
Grid ExamplesGrid Examples
Chess960@homeVast collection of Chess960 games
Africa@homeAllow your computer to contribute to
African humanitarian causes. QMC@Home
Developing and testing Quantum Monte Carlo (QMC) for use in quantum chemistry.
FightAIDS@HomeSimulation techniques to search for ways to
cure or prevent the spread of AIDS and HIV.
Chess960@homeVast collection of Chess960 games
Africa@homeAllow your computer to contribute to
African humanitarian causes. QMC@Home
Developing and testing Quantum Monte Carlo (QMC) for use in quantum chemistry.
FightAIDS@HomeSimulation techniques to search for ways to
cure or prevent the spread of AIDS and HIV.
Grid ExamplesGrid Examples
Grid ExamplesGrid Examples
Shrek 2DreamWorksOperation Systems: Red Hat Linux
7.2330 Hewlett Packard workstationsDual-Intel Xeon 2.4GHz processors,
nVidia Quadro 4 XGL graphics cards, 2GB Ram and dual monitors
Recalculated frames make more detailed
Shrek 2DreamWorksOperation Systems: Red Hat Linux
7.2330 Hewlett Packard workstationsDual-Intel Xeon 2.4GHz processors,
nVidia Quadro 4 XGL graphics cards, 2GB Ram and dual monitors
Recalculated frames make more detailed
What is “N1 Grid Engine 6” software?
Sun’s Resource management software
Accepts jobs submitted by usersUses resource management policies
to schedule jobs to be run on appropriate
Users can submit millions of jobs at a time without concern
Grid jobsGrid jobs
Batch jobsShell scriptsSequence of command-linecsh, tcsh, sh, or ksh
Batch jobsShell scriptsSequence of command-linecsh, tcsh, sh, or ksh
Input Output
Process Process Process
Grid jobsGrid jobs
Interactive jobsRequire direct input to influence the
job results.
Interactive jobsRequire direct input to influence the
job results.
Input Output
Process Process
Grid jobsGrid jobs
Parallel jobs Parallel jobs
Input Output
Process
Process
Process
How grid works?How grid works?
1. Accepts jobs from the outside world.
2. Puts jobs in a holding area 3. Sends to an execution device.4. Manages running jobs.5. Logs the record of job execution.
1. Accepts jobs from the outside world.
2. Puts jobs in a holding area 3. Sends to an execution device.4. Manages running jobs.5. Logs the record of job execution.
How grid works? (grid as bank)
How grid works? (grid as bank)
On entering the bank: customers declares their name, their
affiliations their service needs Record entering time. Bank would serve the following
customers: Customers whose needs match suitable
and immediately available resources Customers whose requirements have the
highest priority Customers who were waiting in the lobby
for the longest time
On entering the bank: customers declares their name, their
affiliations their service needs Record entering time. Bank would serve the following
customers: Customers whose needs match suitable
and immediately available resources Customers whose requirements have the
highest priority Customers who were waiting in the lobby
for the longest time
How grid works? (grid as bank)
How grid works? (grid as bank)
One least-loaded and most-suitable bank employee helps several customers.
Bank manager, define service policies: Provide preferential service to commercial
customers Make sure a certain customer group is
served well Customers get a timely response Prefer a certain customer on direct
demand of a bank executive
One least-loaded and most-suitable bank employee helps several customers.
Bank manager, define service policies: Provide preferential service to commercial
customers Make sure a certain customer group is
served well Customers get a timely response Prefer a certain customer on direct
demand of a bank executive
Jobs and QueuesJobs and Queues
Jobs correspond to bank customers.
Jobs wait in a computer holding area instead of a lobby. queues, which provide services for jobs, correspond to bank employees.
Jobs correspond to bank customers.
Jobs wait in a computer holding area instead of a lobby. queues, which provide services for jobs, correspond to bank employees.
3 classes of Grid
Usage PoliciesUsage Policies
Urgency Resource requirements, job’s deadline, job
waits. Functional
Job’s affiliation with a certain user group, project.
Share-based Usage of resources by all users.
Override Manual intervention by the cluster administrator
Combination 90% share-based and 10% functional
Urgency Resource requirements, job’s deadline, job
waits. Functional
Job’s affiliation with a certain user group, project.
Share-based Usage of resources by all users.
Override Manual intervention by the cluster administrator
Combination 90% share-based and 10% functional
Using Tickets to Administer Policies
Using Tickets to Administer Policies
Functional, share-based, and override policies are defined through tickets.
Tickets = Company’s stock.More stock = More important
Functional, share-based, and override policies are defined through tickets.
Tickets = Company’s stock.More stock = More important
Grid Engine System Components
Grid Engine System Components
Hosts Master host Execution hosts Administration hosts Submit hosts
Daemons sge_qmaster – the Master Daemon sge_schedd – the Scheduler Daemon sge_execd – the Execution Daemon
Queues
Hosts Master host Execution hosts Administration hosts Submit hosts
Daemons sge_qmaster – the Master Daemon sge_schedd – the Scheduler Daemon sge_execd – the Execution Daemon
Queues
