www.eu-eela.eu e-science grid facility for europe and latin america creating and operating a grid...

15
www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America Bernard M. Marechal EELA-2 Project Coordinator CETA-CIEMAT (Madrid - Spain) & UFRJ (Rio de Janeiro - Brazil) Philippe Gavillet EELA-2 Deputy Project Coordinator CETA-CIEMAT (Madrid - Spain) & CERN WSIS’08 - ICT / e-Science 21.05.2008 (3 rd Facilitation Meeting on Action Line C7 e-Science)

Post on 22-Dec-2015

214 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

www.eu-eela.eu

E-science grid facility forEurope and Latin America

Creating and operating a Grid infrastructure:

a use case from Europe & Latin America Bernard M. MarechalEELA-2 Project CoordinatorCETA-CIEMAT (Madrid - Spain) & UFRJ (Rio de Janeiro - Brazil)

Philippe GavilletEELA-2 Deputy Project CoordinatorCETA-CIEMAT (Madrid - Spain) & CERN

WSIS’08 - ICT / e-Science 21.05.2008(3rd Facilitation Meeting on Action Line C7 e-Science)

Page 2: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 2www.eu-eela.eu

KEY WORDS

• Grid: Multi-CPU Computing model that provides the ability to perform higher throughput computing with large storage capabilities

• e-Infrastructure: Distributed Grid infrastructure

• e-Science: Global collaborative scientific research, usually based on an e-Infrastructure

• JRU: Joint Research Unit

• NGI: National Grid Initiative

Page 3: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 3www.eu-eela.eu

MOTIVATIONS, PROBLEM AREA

• EELA (E-infrastructure shared between Europe and Latin America) under FP6 www.eu-eela.org

– Bridge consolidated e-Infrastructures in Europe and emerging ones in Latin America

– Create and operate a transcontinental Grid infrastructure– Address cost-effectively regional problems– Enhance Research in developing counties

• EELA-2 (E-science grid facility for Europe and Latin America) under FP7 www.eu-eela.eu

– Set up a high capacity, production quality, scalable Grid Facility– Ensure round-the-clock, worldwide access to distributed computing and

storage resources– Support a wide spectrum of applications for both European and Latin

American scientific communities

Page 4: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 4www.eu-eela.eu

RESEARCH OBJECTIVES

• EELA– Aim at building a Latin American e-Infrastructure at the level of

European standard– Focus on e-Science-related applications, profiting from a stable,

performant networking infrastructure (RedCLARA & GÉANT)– Disseminate the Grid culture (Decision makers) and train local

communities of all kinds (Users, System Administrators)

• EELA-2– Provide empowered Grid facility with versatile services fulfilling

all application requirements– Ensure long-term sustainability of the e-Infrastructure beyond

the term of the project (from 2010 onward)

Page 5: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 5www.eu-eela.eu

RESEARCH APPROACH

• EELA– Establish scientific network– Enlarge and train (hands-on workshops) communities– Establish a pilot Grid supporting proof-of-concept applications– Close collaboration with other EC funded projects– Grid Cluster deployment, definition and enforcement of

operational schemes and policies

• EELA-2– Expand the current EELA infrastructure– Provide the full set of Grid Services needed by all types of

applications– Collaborate with NRENs and create Regional Operation Centres– Support actively the creation of National Grid Initiatives (NGI)

Page 6: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 6www.eu-eela.eu

MAJOR OUTCOMES / RESULTS

• EELA

– Provide European researchers early access to a new, well-supported e-Infrastructure and enable them to speed up the processing of scientific data

– Strengthen scientific communities in Europe and Latin America

– Successful building of a reliable and almost “production quality” e-Infrastructure in Latin America

– Grid technology skills acquired to autonomously support the Latin American Grid on the long term

– Entrance and consolidation of Latin American communities in worldwide collaborations

– Amplification of the e-Infrastructures relevance, blazing the trail towards Latin American e-Science initiatives and/or NGIs

Page 7: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 7www.eu-eela.eu

EELA-2 COUNTRIES / RESOURCES

FranceIrelandItalyPortugalSpain

ArgentinaBrazilChileColombia CLARA (International)CubaEcuadorMexicoPeruVenezuela

14 Countries

16 Partners (9 JRUs)

53 Members

Page 8: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 8www.eu-eela.eu

EELA in numbers

– 21 partners from 10 countries (7 in Latin America and 3 in Europe), including 2 international organisations (CERN and CLARA)

– EC support: 1.7 MEuro for 2 years

– Additional CIEMAT funds (400 KEuro) for Latin America

– 4 Work Packages (Management; Pilot Test-bed operation and support; Support of applications; Dissemination activities)

– 1700 CPUs; 500,000 jobs successfully executed, i.e. 500 CPUs.year delivered to EELA users

– 15 applications deployed on the EELA infrastructure

– 18 tutorials (about 700 participants enrolled, i.e. 2000 participants.day)

– 2 EELA Grid schools (Concept of Stand-alone Grid; 30 students deployed 12 applications in 2 X 10 days)

Page 9: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 9www.eu-eela.eu

EELA-2 in numbers

– 16 JRU-type partners (6 from Europe, 9 from LA and 1 International Institution CLARA) in 14 countries (5 from Europe, 9 from Latin America)

– 53 institutions, most of them clustered in 9 Joint Research Units (JRU)

– EC support of about 2.1 MEuro (+ 300 KEuro from CIEMAT)

– 6 Activities (Management, Dissemination and training; Application support; Infrastructures services; Network resource provision; Development of services for applications and infrastructure)

– 30 Resource Centres; 3000 computing nodes; 700 TB of storag

– Foreseen growth over the project duration: 20 % in computing and 15% in storage

– About 50 applications selected (Biomedical, High Energy Physics, Earth Sciences, Climate, e-Learning, e-Government, e-Industry)

Page 10: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 10www.eu-eela.eu

SURVEY: APPLICATION DOMAINS

22

7

7

3

31 1 1 1 1 1 1

Bio

HEP

Earth Sciences

Engineering

Optimization

A.I

Civil Proctection

Data mining

e-Learning

Environmental Sciences

Food Engineering

Physics

Biomedicine: 45% HEP: 14% Earth Sciences: 14%

Page 11: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 11www.eu-eela.eu

SURVEY: APPLICATIONS PER COUNTRY

AR3

BR14

CL4CO

1CU2

EC1

FR3

IE1

IT1

MX3

PE2

PT3

ES13

VE1 AR

BR

CL

CO

CU

EC

FR

IE

IT

MX

PE

PT

ES

VE

BR: 29% ES: 27% CL: 8% AR=FR=MX=PT: 6%

Page 12: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 12www.eu-eela.eu

SURVEY: POTENTIAL IMPACTS (1)

• Scientific: <98%>– Consensus that the Grid model is (will be) useful and should

open new perspectives for Applications.

• Social: <55%> – Half of Applications will have positive outcomes socially

Biomedicine: <82%> HEP: It induces social benefits, but delayed beyond the project time

scale (e.g. Hadron therapy) Earth Sciences: <70%> Comment: Running Biomedicine & Earth sciences Applications on

EELA-2 will substantially contribute to enhance their socially useful results (higher accuracy of predictions, diagnosis, rates)

Page 13: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 13www.eu-eela.eu

SURVEY: POTENTIAL IMPACTS (2)

• Industry: <80%> – A rather large fraction of Applications is claimed to induce Industry spin-

offs. Arguments are:

Biomedicine <91%> • Induce better medical methods for observation, diagnosis, therapy / new tools• General feeling: By nature results should interest industry, but no clear link yet

HEP: <71%>• Grid boosts simulation studies, leading to more efficient detector R&D in

collaboration with Industry.

Earth Sciences: <57%>• Enhance forecasts (seismic, weather,..) for agriculture, industry activities

Comments: In fact, basically NO industry sector concerned by EELA-2 Applications is currently using a Grid model.

• Studies are outsourced to University teams (through University-Industry contract) which use a Grid for higher efficiency (faster, more accurate results)

• Challenge is to get Industry (especially SMEs) to use the EELA Grid.

Page 14: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 14www.eu-eela.eu

CONCLUSIONS AND OUTLOOK

– EELA was a success, recognized by the highest EC ranking

– EELA drastically changed the perspectives about e-Science in Latin America

– The mature grid empowered EELA Test-bed improved scientific collaborations between European and Latin American scientists

– EELA-2 was recently presented at IST-Africa’08 (7-9 May 2008) with interesting exchanges:

– EELA know-how could perfectly be “exported” through its powerful, comprehensive Training program (e.g. Grid Schools)

EELA-2 is willing to share resources and knowledge with other

institutions from other countries New collaboration is usually established via MoU

Page 15: Www.eu-eela.eu E-science grid facility for Europe and Latin America Creating and operating a Grid infrastructure: a use case from Europe & Latin America

UNESCO - WSIS’ 08 (ICT / e-Science) - Geneva 21.05.2008 15www.eu-eela.eu

Thank you for your attention

[email protected]

[email protected]