Resource WG Breakout

Agenda• How we will support/develop data grid testbed and possible applicati

ons (1st day)– Introduction of Gfarm (Osamu)– Introduction of current status of data grid testbed (Cindy)– Identify some Gfarm applications– Set milestones

• Report from routine-basis drivers to get feedback– 1st day: Call for presenters from routine-basis drivers– 2nd day: presentation

• Dedicate use of PRAGMA Grid testbed for specific purposes (1st day)– Motivation to dedicated use (Yoshio)– Ask comments from resource providers

• Mid- to long-term direction of PRAGMA Grid– More applications?– Integrate with data grid testbed?– Meta scheduler? Co-allocator?

• Main focuses and works between PRAGMA11-12– Should be based on the discussion on the previous agenda

WG Agenda

• Monday– Moving towards data grid

• Resource & Data WG are now one WG• Gfarm intro / discussion• Status of AIST/UCSD Gfarm “production” Grid FS• Applications and milestones

– Dedicated use of PRAGMA for specific purposes– Mid to Long Term Planning

• Data applications• Scheduling• ???

• Tuesday– Presentations from Application Drivers– Plan for work from now to next meeting

• Other issues?

Status of GFram deployment

• Latest version: 1.3.1

• AIST, SDSC: New version done

• ASGCC, KISTI, NCSA, TITECH, UZurich– Need to be upgraded

• NECTEC, BII, NCHC, Tsukuba, Osaka, APAC, NGO, ThaiGrid, CNIC, MIMOS– Have interests

To Do

• Identify applications– GriddLeS (MU),– iGap– Savanna

• Milestones?– All sites upgrade or deploy Gfarm at least by J

an. ~ Feb. including monitoring by SCMSWeb.

– Contact to MU soon.

National Institute of Advanced Industrial Science and Technology

Dedication of PRAGMA Gridfor specific purposes

Yoshio TanakaYoshio Tanaka

Motivation

PRAGMA Grid is used routinely as a PRAGMA Grid is used routinely as a shared infrastructure.shared infrastructure.

No reservation, dedication is supported.Users cannot estimate when his job will be running.Users cannot expect co-allocation.

PRAGMA Grid is expected to be PRAGMA Grid is expected to be dedicated for specific purposes.dedicated for specific purposes.

ExperimentsDemonstration

Agenda

Should PRAGMA Grid allow dedicated use?Should PRAGMA Grid allow dedicated use?Do resource providers agree to allow dedication?

How is the procedure for the dedication?How is the procedure for the dedication?Application by the driver.Should the application reviewed and approved?

Who will review and approve?

Policies?Maximum time/sites/processors for the dedication?

ImplementationImplementationHow the reservation is implemented.

Start with manually, then consider to use software for advance reservation.Just asking the other drivers not to use resources enough?

I think NO.

Re-configuration of queues or clean up the jobs may increase the load of site admins.

Any suggestion?

Do we allow dedicated use?

Yes or NOYes or NO

Procedure: Application

Application form (proposal)Application form (proposal)Name(s) / Affiliation(s)Resources (Sites)Duration

the start time / end time (time zone must be indicated)

ProposalPurposeExpected outcome

ExampleExampleYoshio Tanaka / AISTAIST, SDSC, USM, KISTI, NECTEC, NCHCNov. 6 18:00 - Nov. 9 18:00 (JST)Proposal (should be more detailed)

Purpose: QM/MD experiments on PRAGMA/TeraGridExpected outcome: Scientific results and contribution to GIN

Procedure: approval

Is approval necessary?Is approval necessary?By whom?

By each resource owner

What is the criteria?According to the site’s policy

TodoTodoHow to prioritize multiple requests.

Implementation

In case of AIST (SGE)In case of AIST (SGE)Temporary remove all accounts except the driver.All existing jobs will be killed.

In case of PSC (Torque)In case of PSC (Torque)Give us the dedicated queue.

In case of NCSA (Torque)In case of NCSA (Torque)No dedicate queue???

Other choices?Other choices?Gentleman’s agreement?

Easy, but should have troubles…

Implementation

Site admin should decide how to provide dedicatioSite admin should decide how to provide dedication.n.PRAGMA admin will announce the other application PRAGMA admin will announce the other application drivers the schedule of the dedication.drivers the schedule of the dedication.PRAGMA admin will remind the other application drPRAGMA admin will remind the other application drivers the dedication is approaching.ivers the dedication is approaching.