1 global grid efforts richard cavanaugh university of florida
Post on 20-Dec-2015
214 views
TRANSCRIPT
2
3
(some) Global Grid Efforts• US
– Grid3– NEESgrid– TeraGrid– AccessGrid– Open Science Grid
• EU– DataGrid/EGEE– DataTAG– LCG– CrossGrid– GridLab – NorduGrid
• Asia Pacific– PRAGMA– ApGrid
• South America– CHEPRO
• Canadian– West Grid
• UK– GridPP
• German– D-Grid
• Italian– Grid Italy– INFN Grid
• Korean– K*Grid
• Australian– grangenet
• Japanese– NAREGI– Grid Technology Research Center
• China– CNGrid
This talk will survey a sample of these efforts diverse functionality + many active grids
5
• Perform tele-observation and tele-operation of experiments
• Publish to and make use of a curated data repository
• Access computational resources and open-source analytical tools
• Access collaborative tools for experiment planning, execution, analysis, and publication
• 10 Universities and Institutes across the US
• First trans-Pacific experiment carried out in March between US and Japan
6
• $98M Project
• General purpose computational facility
• ~20 Teraflops
• ~1 Petabyte networked disk storage
7
• Goal: An integrated U.S. Grid infrastructure– Grid computing infrastructure to support US scientific efforts– CPU & storage resources from laboratories and universities– DOE and NSF partnership– Internet2, ESNet, state, international optical networks
• Getting there: OSG-1 (Grid3), OSG-2, …– Series of releases increasing functionality & scale
• Initial meetings– Sep. 17 @ NSF: Educators, scientists, etc.– Jan. 12 @ Fermilab: Public discussion, planning sessions
• Next steps– White paper to be expanded into roadmap– Presentation to funding agencies (this Summer?)
9
GridPP• 19 UK Universities, CCLRC
(RAL & Daresbury) and CERN
• Funded by the Particle Physics and Astronomy Research Council (PPARC)
• GridPP1 - 2001-2004 £17m "From Web to Grid“
• GridPP2 - 2004-2007 £15m "From Prototype to Production"
10
• Project involves several Nordic universities and HPC centers
• Will continue for 3-4 years more– Forms the ”North European Grid Federation” of the
EGEE together with the Dutch Grid, Belgium and Estonia
– Will provide middleware for the ”Nordic Data Grid Facility” and related projects (SWEGRID, Danish Grid etc)
• Shares authentication and authorization mechanisms with EDG/LCG-1/EGEE
11
• European Project ( ~5 M€, 3 year project started March 2002 )– Polish (Cracow & Poznan) / Spanish
(CSIC & CESGA) / German (FZK)
• Objectives:– Extension of GRID in Europe,
assuring interoperability with DataGrid
– Interactive Applications (“human in the loop”):
• Environmental fields (meteorology/air pollution, flooding crisis management)
• High Energy Physics (interactive analysis over distributed datasets)
• Medicine (vascular surgery preparation)
12
LHC Computing Grid
• Grid for the Large Hadron Collider – Particle Physics Experiment
• 4 Scientific Collaborations:– 1000s of scientists– 100s of institutes– 10s of countries
LCG
CMS Experiment
Online System
CERN Computer Center > 20
TIPS
Institute
100-1500 MBytes/s
2.5-10 Gbps
1-10 Gbps
10-40 Gbps
1-2.5 Gbps
Tier 0
Tier 1
Tier 3
Tier 4
Tier 2
Physics cache
PCs
Institute
Institute
Institute
Tier2 Center
Tier2 Center
Tier2 Center
Tier2 Center
Korea UK Russia USA
• LCG-2 currently covers:– 22 Countries– 62 Sites (48 Europe, 2 US,
5 Canada, 6 Asia, 1 HP)– 4000 CPUs
13
• Develop a service grid infrastructure in Europe
• Brings together – 70 organisations– 27 countries
• Three core areas: – build a consistent, robust and secure grid
network – continuously improve and maintain the
middleware– attract new users from industry as well as
science and ensure high standard of support
• Two pilot application domains– Large Hadron Collider– Biomedicine
INFN GRID
NORDUGRID
14
• 13 resource providers consisting of 7 supercomputers and 9 high-performance clusters
• Heterogeneous computing architectures including Linux, AIX, HP-UX and IRIX
• Based on Globus Toolkit 2.4 and MPICH-G2 1.2.5
• Support application scientists to adapt the Grid environment
• Provide production CA service based on APGrid PMA(Policy Management Authority)
• Collaborate other international Grid communities such as PRAGMA, IHPC, GridLab
• Application Domains– High Energy Physics– Biotechnology– Nanotechnology– Environment Technology– Space Technology
KOREA
15
grangenet• 3 Year Program
• Install, Develop, Operate Multi-gigabit Network
• Participate in Global Grid Efforts– North America– Asia-Pacific– Europe
• Support Grid Services– Distributed Computing– Collaborative Visualisation– Cooperative Environments– Digital Libraries
• Application Domains– Computational Physics– Bioinformatics– Astronomy– Computational Engineering– On-line Health– Environmental modelling
AUSTRALIA
16
China National Grid Project
• Chinese Gov’t– Investing 12 M USD– Partnering with IBM
• Expected to be 6 Teraflops– Eventually increasing to 15
Teraflops
• Middleware based on Open Grid Services Architecture
• Initial Application Domains– Remote learning– Bioinformatics
17
PRAGMA and Ap Grid• Pacific Rim Application and
Grid Middleware Assembly– NSF funded– Establish sustained
collaboration with Asia-Pacific Grid efforts
• Asia Pacific Grid– 15 Countries, 49
Organisations– Not funded by any single
entity– Not application dedicated
• General platform– Open community for Grid
Researchers in AP
18
An Inter-Regional Center for High Energy Physics Research and Educational Outreach (CHEPREO) at
Florida International University
• E/O Center in Miami area• iVDGL Grid Activities• CMS Research• AMPATH network (S.
America)
19
Running on Global Grids
Aim for common interfaces and interoperability
Slide taken from Juergen Knobloch
20
Conclusion• I have grossly omitted the Global Grid Forum…
• The “Grid” as a concept is being Globally adopted– Multitude of national and international initiatives
• There are several sizable grids which are continuously active– O(10) production level Grids world-wide representing O(10 000) CPUs– Diverse functionality
• High-throughput computing• Interactive visualisation
– Indication that grid technology is maturing
• Interoperability and common interfaces are real issues facing Global Grid activity– Sociology is at least as important as technology– Standards bodies, like the GGF, are becoming increasingly important