European, National and LocalEuropean, National and LocalINFN GRID projectsINFN GRID projects

European, National and LocalEuropean, National and LocalINFN GRID projectsINFN GRID projects

Leonardo Merola

Dipartimento di Scienze Fisiche - Università di Napoli “Federico II”

Istituto Nazionale di Fisica Nucleare - Sezione di Napoli

International Workshop “Engineering the GRID”International Workshop “Engineering the GRID”

San Leucio (CE), 30 Maggio 2003San Leucio (CE), 30 Maggio 2003

International Workshop “Engineering the GRID”International Workshop “Engineering the GRID”

San Leucio (CE), 30 Maggio 2003San Leucio (CE), 30 Maggio 2003

(1 m) (10 -10 m) (< 10 -18 m) (10 -15 m)

(10 -14 m) (10 -15 m)

(< 10 -18 m)

is the public Institute that promotes,

coordinates and developes experimental

and theoretical fundamental research in

nuclear and sub-nuclear physics.

In particular, it searches for the elementary building blocks of the Matter and studies the laws of their fundamental interactions.

LHC

SPS

CERNPS

GENEVA Airport

FRANCE

SWITZERLAND

LHC (2007-2020): Large Hadron ColliderLHC (2007-2020): Large Hadron Collider

protons protons protonsprotons (E(ECMCM = 14000 GeV) = 14000 GeV)

CERNCERN European Laboratory for Particle PhysicsEuropean Laboratory for Particle Physics

4 Underground ExperimentsATLAS, CMS,

ALICE and LHCb

1 PetaByte/year (RAW Data)

1 PetaByte/year (Simulated Data)

106 PC distributed computing power

Many challengesMany challenges

Germany

Regional Facilities

USAUK

France

ItalyINFN CNAF

BO

NORDIC CLUSTER

CERN Tier1

Asia

CERN

Tier0 National

Centres

Lab a

Russia

Lab c

Uni n

Switzerland

Roma

CanadaUni y

Uni x

Physicsdepartments

Desktop

Tier 1

The LHC Computing Model for the ATLAS ExperimentThe LHC Computing Model for the ATLAS Experiment

Hierarchical Modelbased on Tier-n(from Regional down to single desktops)

GRID tools and services for:

•Distributed Computing– synchronous processing

•High-Throughput Computing– asynchronous processing

•On-Demand Computing– dynamic resources

•Data-Intensive Computing– databases

•Collaborative Computing– scientists

Milano

Napoli

Tier 2

Tier 3

Network ConnectivityNetwork Connectivity

INFN GRID project (started in 1999):INFN GRID project (started in 1999):development of computing infrastructures for physics, based on GARR (the Italian Academic and Research Network).

DataGrid EU FP5 project (2001-03):DataGrid EU FP5 project (2001-03):A milestone towards a common European Research Area (ERA) prototyping the European Grid infrastructure. INFN is contributing in various areas of grid middelware development, especially in the production of brokering and scheduling services with Datamat S.p.A, in the monitoring and the grid activities and, together with Nice s.r.l., in the development of theWeb portal GENIUS (Grid Enabled web eNvironment for site Independent User Job submission).

INFN Condor Pool (started in 1997): INFN Condor Pool (started in 1997): more than 300 CPUs in a pre-GRID High Throughput Computing solution to distributed computing on WAN.

DataTag EU FP5 project (2001-03): DataTag EU FP5 project (2001-03): (Trans Atlantic Grid) project aims at prototyping a fast transatlantic optical network connection supporting grid activities and at developing interoperability between the grids in Europe and USA. It focuses on problems related to the transfer Protocols, reliability in the use and integration of the middleware. The EU-US Global Laboratory Universal EnvironmentEU-US Global Laboratory Universal Environment

(GLUE) activity, jointly developed by DataTag (EU) and iVDGL (US), will enable CERN, INFN and other European, American and Asian Laboratories to create the first world grid; it will be dedicated to High Energy Physics (HEP).

LCG

LHC Computing Grid (LCG) project (2003-08): LHC Computing Grid (LCG) project (2003-08): approved by the CERN Council in 2001 to help the experiments’ computing projects prepare, build and operate the computing environment needed to manage and analyze the data coming from the detectors. INFN deeply involved in all 4 experiments(ATLAS, CMS, ALICE, LHCb).

FIRB FIRB GRID.ITGRID.IT

LECCE

PISA

NAPOLI

COSENZA

PERUGIA

PADOVA

GENOVA

MILANO

PALERMO

ROMA

TORINO

MATERA

BARI

BOLOGNA

CAGLIARI

L’AQUILA

VENEZIA

GRID.IT MIUR-FIRB GRID.IT MIUR-FIRB projectproject (2002-2004):(2002-2004):governmental funds for investment in fundamental research: a new collaboration of INFN with other National Research Institutes, CNR (National Research Council, as coordinating partner), INAF (Institute for Astrophysics), ASI (Spatial Agency), INGV (Institute for Geophysics), many Universities and Centres of Excellence for Computing (CNIT), is involved in the development of a a common grid infrastructure supporting the Italian Research Area (IRA).

WP4: Fabric WP4: Fabric Linux Farms, Mosix, etc. (A.Doria, R. Esposito)WP6: TestbedWP6: Testbed (F. Taurino)WP7: Network Management and MonitoringNetwork Management and Monitoringe.g. Grid-ftp, etc. (P. Lo Re, P. Mastroserio, G. Tortone)WP8: HEP ApplicationsWP8: HEP Applicationse.g. ATLAS, CMS, VIRGO, PAMELA, etc. (F. Barone, G. Carlino, R. De Rosa, A. Doria, A.Eleuteri, L. Merola, L. Milano)

WP4: Network Management and MonitoringWP4: Network Management and Monitoringe.g. Nagios package, etc.(G. Tortone)(G. Tortone)

Firb Firb Grid.itGrid.it

WP3,5: Grid deployment and operation for the scientific WP3,5: Grid deployment and operation for the scientific communitycommunitye.g. Information service, monitoring, etc. (L. Merola, P. e.g. Information service, monitoring, etc. (L. Merola, P. Mastroserio; N. De Bortoli, R. Esposito, F. Taurino, G. Tortone)Mastroserio; N. De Bortoli, R. Esposito, F. Taurino, G. Tortone)

Napoli contributions to GRID specific activitiesNapoli contributions to GRID specific activities

ATLAS Data ChallengesMotivated by need to test scaling of solutions: Hardware, Middleware and Experiment Software)

DC0 – 2001/2002 DC0 – 2001/2002 • Tests of the ATLAS software

DC1 - 2002/2003 DC1 - 2002/2003 • Pile-Up Production (High and Low Luminosity)• Large scale Grid test for reconstruction• Reconstruction start March 2003• ~ 10**7 fully simulated events

DC2 - 2003/2004DC2 - 2003/2004• Geant4 replacing Geant3 • Pile-up in Athena• Use LCG common software• Use widely GRID middleware• Perform large scale physics analysis• As for DC1: ~ 10**7 fully simulated

events

DC3 - 2004/2005 DC3 - 2004/2005 scale: 5 x DC2

DC4 - 2005/2006 DC4 - 2005/2006 scale: 2 x DC3

Tier 2 Naples Linux Farm

16 diskless nodes (PIII 1 GHz, RAM 512) 16 diskless nodes (PIII 1 GHz, RAM 512)

3 TB storage3 TB storage

ATLAS SW and first GRID tools:ATLAS SW and first GRID tools:

EDG m/wEDG m/w, , CComputing omputing EElement, lement,

SStorage torage EElement, lement, UUser ser IInteface for analysisnteface for analysis

More than 25 CPU have been orderedMore than 25 CPU have been ordered

1 Gb/s

100 Mb/s CPU

ServerDiskServer

grid tools used at 11 sites

CERN

US D

JFI

CPUs Italia:46 RM140 CNAF16 NA10 LNF

The Sixth Framework European program (FP6) The Sixth Framework European program (FP6) aims to contribute to the creation of a true “European Research Area”“European Research Area” (ERA)>>(ERA)>>

Two new initiatives:Two new initiatives:

E G E E E G E E “EEnabling GGrid and EEScience in EEurope” having CERN as Coordinating partner, and aiming at developing a pan-European grid infrastructure and

SUGAR “Support User Grid Application communities on the UE Research Infrastructures”

have been promoted, together with partners from almost all European

Countries, by the IG-BIGESTIG-BIGEST ((IItaliantalian GGridrid for for eeBBusiness eusiness eIIndustry ndustry

eeGGovernment overnment ESEScience and cience and TTechnology)echnology) community which iscoordinated by INFN, that involves major National Research Institutions, Universities and Computing Centres, as well as many industries.

The Future GRIDThe Future GRID

INFN GRID OrganizationINFN GRID Organizationand related National and European projectsand related National and European projects

Deployment of a national GRID

1.Network connectivity2.High PerformanceNet4.GRID Interoperability

1.Scheduling2.Data Management4.Farms6.Testbed7.Network8.HEP Applications

LHC Computing GRID

CNAF Bologna

Integrated projects EU-USABIGEST

Italian GridCollaboration

LHC, VIRGO,APE,BABAR,CDF, etc.

ExperimentsExperiments

INFN Regional INFN Regional CentreCentre

SUGAR

(M. Mazzucato)