Grid of Grids - from Local to GlobalCommunity Campus National

Grid Crunching Day 2006

OSG sites

Grid Crunching Day 2006

32 Virtual Organizations - participating Groups

3 with >1000 jobs max.(all particle physics)

3 with 500-1000 max.(all outside physics)

5 with 100-500 max(particle, nuclear, and astro physics)

Grid Crunching Day 2006

The DEISA supercomputing environment(21.900 processors and 145 Tf in 2006, more than 190 Tf in 2007)IBM AIX Super-cluster FZJ-Julich, 1312 processors, 8,9 teraflops peakRZG Garching, 748 processors, 3,8 teraflops peakIDRIS, 1024 processors, 6.7 teraflops peakCINECA, 512 processors, 2,6 teraflops peakCSC, 512 processors, 2,6 teraflops peakECMWF, 2 systems of 2276 processors each, 33 teraflops peakHPCx, 1600 processors, 12 teraflops peakBSC, IBM PowerPC Linux system (MareNostrum) 4864 processeurs, 40 teraflops peakSARA, SGI ALTIX Linux system, 416 processors, 2,2 teraflops peakLRZ, Linux cluster (2.7 teraflops) moving to SGI ALTIX system (5120 processors and 33 teraflops peak in 2006, 70 teraflops peak in 2007)HLRS, NEC SX8 vector system, 646 processors, 12,7 teraflops peak.Systems interconnected with dedicated 1Gb/s network currently upgrading to 10 Gb/s provided by GEANT and NRENs

Grid Crunching Day 2006

National Research Grid Infrastructure (NAREGI) 2003-2007Petascale Grid Infrastructure R&D for Future Deployment$45 mil (US) + $16 mil x 5 (2003-2007) = $125 mil totalHosted by National Institute of Informatics (NII) and Institute of Molecular Science (IMS)PL: Ken Miura (FujitsuNII)Sekiguchi(AIST), Matsuoka(Titech), Shimojo(Osaka-U), Aoyagi (Kyushu-U)Participation by multiple (>= 3) vendors, Fujitsu, NEC, Hitachi, NTT, etc.Follow and contribute to GGF Standardization, esp. OGSAAISTTitechFujitsuNECOsaka-UU-KyushuHitachiFocused Grand Challenge Grid Apps AreasU-Tokyo

Grid Crunching Day 2006

INFSO-RI-508833

High Energy Physics (LCG)LCG depends on two major science Grid infrastructures (plus regional Grids) EGEE - Enabling Grids for E-ScienceOSG - US Open Science Grid

Grid Crunching Day 2006

INFSO-RI-508833

Scientific Grid Infrastructures DEISAEGEENaregi Nordugrid OSGPragmaTeragrid

Grid Crunching Day 2006

INFSO-RI-508833

Grids are in Production Use

Grid Crunching Day 2006

INFSO-RI-508833

EGEE and SustainabilityBUT

How do Grid infrastructures compare to other computing infrastructures?Number of infrastructure users?Number of application domains?Number of computing nodes?Number of years in service?

What would happen, if Grid infrastructures are turned off?

What happens after April 2008 (End of EGEE-II)?

Grid Crunching Day 2006

INFSO-RI-508833

Why Sustainability?Scientific applications start to depend on Grid infrastructurese.g. EGEE supports well over 100 VOs, running over 50.000 jobs/dayRequire long-term support

New scientific collaborations have been formed thanks to the Grid infrastructureE.g. WISDOM (http://wisdom.healthgrid.org) Business and Industry are getting very interested but need a long term perspective E.g. over 20 companies were present at the Business Track during the EGEE06 conference, September, 2006

Grid Crunching Day 2006

INFSO-RI-508833

The Future of GridsIncreasing the number of infrastructure users by increasing awarenessDissemination and outreachTraining and educationGrids offer new opportunities for collaborative work

Increasing the number of applications by improving application support and middleware functionalityIncrease stability, scalability, and usabilityMajor efforts needed particularly on VO management, security infrastructure, data management, and job management High level grid middleware extensions

Increasing the grid infrastructureIncrease manageability of Grid services Incubating regional Grid projectsEnsuring interoperability between projects

Protecting user investmentsTowards a sustainable grid infrastructure

Grid Crunching Day 2006

INFSO-RI-508833

Sustainability: Beyond EGEE-IINeed to prepare for permanent Grid infrastructureEnsure a reliable and adaptive support for all sciencesIndependent of short project funding cyclesInfrastructure managed in collaboration with national grid initiatives

Grid Crunching Day 2006

INFSO-RI-508833

Grids in EuropeGreat investment in developing Grid technologySample of National Grid projects: Austrian Grid InitiativeDutchGrid France: Grid5000Germany: D-Grid; UnicoreGreece: HellasGridGrid Ireland Italy: INFNGrid; GRID.ITNorduGridSwiss GridUK e-Science: National Grid Service; OMII; GridPP

EGEE provides framework for national, regional and thematic Grids

Grid Crunching Day 2006

INFSO-RI-508833

EvolutionEuropean e-InfrastructureNationalGlobal

Grid Crunching Day 2006

INFSO-RI-508833

Summary

Grids represent a powerful new tool for scienceToday we have a window of opportunity to move grids from research prototypes to permanent production systems (as networks did a few years ago)

EGEE offers a mechanism for linking together people, resources and data of many scientific community a basic set of middleware for gridfying applications with documentation, training and support regular forums for linking with grid experts, other communities and industry

Grid Crunching Day 2006

Science is getting more digital world-wide LHC as example

Grid is key technology to support the research programme of many sciences

At Feb review:100 sites, 10K CPUs1st gLite release foreseen for March056 domains and Expand the idea and problems of the JRUAverage of 180 M per year since 2002 (national + EC)