Extensions of the European Grid Infrastructure

Federico Ruggieri – INFN(Federico.Ruggieri@roma3.infn.it)

IX International Conference on Science Arts and CultureECSAC2009 - Veli Losinj - 29 August 2009

Outline

• A bit of history (my version, sorry !)

• The European Vision

• Regional Grid Infrastructures co-funded by the European Commission

• Commonalities and differences

• A common strategy for the future

• Conclusions

A bit of (my) short history of Grids

• In 1998 I. Foster & K. Kesselman - The Grid: Blueprint for a New Computing Infrastructure

• 1998 GRID presentation in CHEP’98 – Chicago.• 1999 Evaluation of Globus in INFN• 2000 CERN invited to take the lead of European Project

on Grids with LHC computing as the main user.

• In the 80’ and early 90’ the accent was on client-server and meta-computing.

• 2000 - 2003 First EU Project DataGRID and PPDG & GRIPHYN in US.

• 2003 – 2006 EGEE Project in EU and OSG in US• … etc.

Computing intensive science• Many vital challenges require community effort

– Fundamental properties of matter– Genomics– Climate change– Medical diagnostics

• Research is increasingly digital, with increasing amounts of data

• Computation ever more demanding• e.g.: experimental science uses ever more

sophisticated sensors • Huge amounts of data• Serves user communities around the world• International collaborations

The European Vision• The Research Network infrastructure provides

fast interconnection and advanced services among Research and Education institutes of different countries’

– Projects: GEANT, SEEREN, EUMEDCONNECT, etc.

• The Research Grid infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems

– Projects: EGEE, SEE-GRID, EUMEDGRID etc.

• This integrated networking & grid environment is called electronic infrastructure (eInfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (eScience)

• The creation of the eInfrastructure is a key objective of the European Research Area

Network Infrastructure

e-Science Collaborations

Grid Infrastructure

Globalisation of Grid Infrastructures

CNGrid

Garuda

EUAsiaGrid

Virtual Communities & Impact• e-Infrastructures support wide geographically

distributed communities → enhance international collaboration of scientists → promote collaboration in other fields.

• Grids and networks allow the access of many researchers to scientific resources (laboratories and data) → disparity can be reduced and larger participation and contributions to high quality research.

• The e-Infrastructures promote the usage of network connectivity and stimulate scientific and technical development of countries → contribute to fight the digital divide and brain drain.

Two (at least) scenarios• Greenfield regions/countries

– No previous Grid and e-Infrastructures activities– Scarce knowledge and/or experience in deploying/managing

large e-Infrastructures.– Isolated spots of research activities with high computing

demands.• Advanced regions/countries

– e-Infrastructures already started/deployed– Locally developed MW.– Fair to good knowledge and experience in e-Infrastructures– High quality research groups and institutions with world

wide collaborations.

Consolidated Work-plan

Train users and site administrators to use and operate an e-Infrastructure based on the EGEE middleware

Disseminate, both “bottom-up” and “top-down”, the e-Infrastructure paradigm for long term sustainability of e-Science

Seek, identify, and support e-Science communities and deploy their applications

Set-up and manage a Pilot Grid Infrastructure

Instruments & methods• National Grid Initiatives

– Internal (national) Infrastructures sustainability is still an issue.

• Regional coordination– Difficult to shape the demand of collaboration with Europe

in a Regional perspective (bilateral agreements always preferred).

• Coordination and interoperation with EGEE (in future with EGI).

• Stable Communication Networks co-operations still under development.– Synergistic approach with GEANT and EU NRENs and

specific regional networks projects, i.e. ALICE, EUMEDCONNECT2, TEIN3, ORIENT

SEEGRID-SCI

Before

SEE-GRID-SCI

During

SEE-GRID-SCI

BalticGrid II

EELA II

EUAsiaGrid

INFN (IT)INFN (IT)CESNET (CZ)CESNET (CZ)NCeSS (UK)NCeSS (UK)

HealthGrid (FR)HealthGrid (FR)AdMU (PH)AdMU (PH)ANU (AU)ANU (AU)

ASGC (TW)ASGC (TW)ASTI (PH)ASTI (PH)HAII (TH)HAII (TH)IDA (SG)IDA (SG)

IAMI (VN)IAMI (VN)ITB (ID)ITB (ID)

NECTEC (TH) NECTEC (TH) UPM (MY)UPM (MY)

MIMOS (MY)MIMOS (MY)

EUMEDGRID

MA-GRID

INFN -Roma3

INFN -Catania

INFN - CNAF

ULAKBIM

CYNET

IUCC

GRNETUniv. of Tunis

Un. of Malta

ERI/EUNCERIST

NGI

NGI

NGI

NGI

NGI

NGI

NGI

NGINGI

NGI

NGI

IUGAZA

HIAST

JUNet

GARUDA &• The Department of Information

Technology (DIT), Government of India has funded the Centre for Development of Advanced Computing (C-DAC) to deploy the nation-wide computational grid GARUDA.

• In Proof of Concept (PoC) phase which ended on March 2008, 17 cities across the country were connected with an aim to bring “Grid” networked computing to research labs and industry.

• From April 2008 the Foundation phase is in progress with an aim to include more users’ applications, providing Service Oriented architecture, improving network stability and upgrading grid resources.

CNGRID &• The China National Grid (CNGrid) Project is supported by the

"High Performance Computer and its Kernel Software " project, which is a key project in the National High-Tech R&D Program (the 863 program).

• CNGrid is equipped with independently developed grid oriented high performance computers(Lenovo DeepComp 6800, Dawning 4000A) and constructs an open grid environment by 8 nodes including Hongkong.

• There are 11 application grids from various industies in CNGrid, such as National Geological Application Grid.

GOS to gLite pipeline

Gateway

gLite to GOS Pipeline

Gateway

Training, training, …. Training !First EUMEDGRID Grid School

(Cairo, Egypt, 17-28 April 2007)– 9 applications selected, all “gridified”,– 80 nodes, 4 grid sites, 6 Mb/s connection installed in a hotel

Workshops, conferences, events !

Jointly organised by EUMEDGRID, EUMEDCONNECT and GEANT2

Policy agenda for e-Infrastructures in the Mediterranean Countries

• More than 60 high level participants (Ministers, Politicians, EC Officers, Telecom Operators).• High profile speakers (HRH Princess Sumaya of Jordan, Mr. Mashour Abudaka Minister,

Palestine, Dr. Najib Abdul Wahed Deputy Minister of Higher Education for Scientific Research, Syria, etc.) and qualified participation of European Commission.

• Final panel expressed a strong support for the continuation of e-Infrastructures in the Mediterranean.

Dissemination, … dissemination !

e-Infrastructures

across the Mediterranean

http://ec.europa.eu/information_society/activities/internationalrel/dialogue_coop/euromed/docs_euromed/e_infrastructures_across_the_mediterranean_2008.pdf

• Combined effort of EUMEDGRID, EUMEDCONNECT and GEANT2

• Distributed in the folder of the Ministerial event in Cairo.

Policy, policy,….policy !

»Building an Enabling Environment for the EUROMED Information Society«

Cairo 27 February 2008

http://www.euromedinfo.eu/site.168.news.en.3214.html

14. The Ministers stressed the fundamental need to ensure interconnection of research networks to support, inter alia, the creation of grid-enabled scientific e-Infrastructures able to make ICT Research and Development cooperation between Europe and the Mediterranean countries more efficient;

Networks, networks, …. Networks !

IUCC - Il

GRNET - Gr

TUBITAK - Tr

MARWAN - Ma

- It

RED.ES - Es

ARN - Dz

EUN - Eg

JUNET - Jo

CYNET - Cy

Specific topics• In Greenfield regions:

– gLite and European approaches have been exported;– the Grid infrastructures have been promoted and are not yet sufficiently

mature to be sustainable;

• In large, rapidly developing, countries:– they have already well defined Grid infrastructures (China, India);– different Middleware implementations (not only gLite and ARC);– Internal (national) sustainability should not be an issue.

• Interoperability and interoperations with European Infrastructures and sustainability are the main goals– presently addressed in the activities of short lived projects (2 years max.)

with different speeds and time shifts due to the different EU calls where they have been approved;

– coordination, alignment of results, common road-maps are difficult to achieve, although being strongly pursued by all the projects.

What’s next• A new step forward - International Virtual Research

Organisations highly need e-Infrastructures with coordinated management and support to create truly global communities in the future.

• Value for EU - Europe has decisively contributed to the advent of e-Infrastructures in emerging regions (Asia, LA, Mediterranean) and new candidate EU countries (SEE, Baltic). Their evolution towards sustainable regional e-Science infrastructures should be finalised.

• Possible objectives:– Enhance the collaboration / coordination and harmonisation of European

and non-European e-Infrastructures in coherence with the EGI implementation.

– Co-ordinate and support the dissemination towards politicians and stakeholders for long term sustainability of e-Infrastructures in the regions concerned.

– Actively promote the adoption of standards and interoperable middleware solutions among the different regions.

CHAIN proposal

• EU partners: those managing past and existing initiatives of Regional Grid Infrastructures

• A number of non-EU partners as representatives of their regions (Maximum 10). The preferred choice will be to have a JRU or a single Organisation representing the whole region.

• Activities1. Policy Development – coherent scheme of cooperation and

interoperation of European and non-EU e-Infrastructures2. Technical – export EGI supported solutions and promote

interoperation with other non-EU e-Infrastructures.3. Leverage on cross-region communities and applications,

promote inter-regional, e-Infrastructures based, research infrastructures.

Timing2009 2010 2011 2012

EGEE III

EELA II

BalticGrid II

EUAsiaGrid

CHAIN

EUMEDGRID-Support

EUIndiaGrid2

EGI

SEEGRID-SCI

Conclusions• It’s a long road … to build stable e-Infrastructures, even in

Europe. An unreasonable acceleration can’t be applied to other regions.

• On the other hand many of those regions need to accelerate in order to catch up the more developed countries.

• However, some rapidly developing countries have already made it and are willing to interoperate with similar Infrastructures in other regions of the world.

• World wide spread scientific communities have started to appreciate the opportunities of working together on large inter-regional e-Infrastructures.

• It’s time to produce a coherent, multi-region and multi-path road-map for the sustainability and interoperations of those Regional infrastructures towards EGI and among themselves.

Thank you !