l. perini datagrid wp6 workshop 11 dec 2000 1 report on atlas grid activities sites, people,...

L. Perini DATAGRID WP6 workshop 11 Dec 2000

1

Report on ATLAS GRID activities

Sites, people, applications: setting up testbeds and grid-enabling first applications in the

different sites

Start of discussion about GRID requirements and milestones


2

General aspects

• US activities very important, however here concentrate on DataGrid part

• DataGrid activities starting in many countries: coordination between countries still very loose

• Level of info. provided by the different sites not uniform: the slides that follow are not covering uniformy all existing ATLAS GRID activities

• Almost all the work done is inside a single country ( exception Scandinavia…)


3

ATLAS GRID Requirements decisions

• At the last PTB it was stressed the importance of experiments requirements/use-cases both Short and Long term. ATLAS had already started work in this direction

• October 4th we decided first “kickoff” Requirement Collection to be done in connection with Computing Model for long term vision: first ideas presented by R.Baker end November

• For short term we had set up end July a first list of application to be run with Grid tools within mid-2001


4

Grid Activities till mid 2001

• Updated list to be prepared before Xmas

• Old list mostly old s/w, but GRID test with ATHENA application very important– muon trigger Geant3-DICE ~1010 SpI95*sec (Italy)– e-trigger simulation ( new?) (UK)– Tilecal TB (Obj) US (PPDG)– TRT Geant3-DICE US (GriPhyN) – Parallel PAW and ROOT (UK) PAW done– Parallel analysis of LAR TB uniformity scans (?) (France)


5

ATLAS GRID Milestones preparation

• Input Schedules from:– DATAGRID and US GRID Projects

– Running of GRID applications proposed by different countries/communities

– MDC1 and related studies

• First discussion in the s/w week at end November: January 24th was decided as data for a first draft


6

INFN situation• muon trigger Geant3-DICE ~ 1010 SpI95*sec• tests of GRID DB distribution Milano-CERN• ATLAS testbed sites Rome and Milano (in Pisa ATLAS not

main user)• ATLAS DATAGRID participants : L.Perini (60%), S.Resconi

(60%), L.Luminari (60%), A. De Salvo (40%)• The muon simulation will be one of the ATLAS short term

use cases• Some preliminary work started


7

INFN use case

• Sites involved: Rome (with the bulk of CPU power), Milan, CNAF, possibly Naples, (CERN?)

• Other people interested in running in GRID enviroment the Muon-trigger application, and “gridalizing” it: – Naples, Pavia, Rome2 the other main contributing institutes with

~3 FTE total available till results obtained (<1 for “gridalizing”)

• First tests before Xmas, and more details about this use case


8

UK Situation

• Globus version 1.1.3 installed on PC’s in 7 sites (Birmingham, Edinburgh, Manchester, Oxford, QMW, RAL)– gsi-enabled ssh, wu-ftpd and nc-ftp

• Network activities:– characterising performance of SuperJANET III

– QoS investigations

– High performance data movement


9

UK Applications

• Parallel PAW-G : working from mid-November• Parallel ROOT : design started• e-trigger simulation is another possible ATLAS use

case for short term: more details will be provided before Xmas


10

Japan situation

• GRID contact : Youhei Morita• Activities started:

– “Data Farm” prototype for optimizing distributed data handling in large PC farms

– WAN simulator under study: predict performances in high speed, high latency networks

• Testbeds now: 9 PC’s in KEK, 4 2-CPU at CERN• People: 1.7 FTE/3 Physicist

– KEK: Youhei 50%, Hirouki Sato 90%– Tokyo ICEPP: Takayuki Saeki 30% (available after LEP run)


11

Other sites and people (1)

• France: ~50% LAL engeneer, 25% E. Auge (LAL), >50% M. Huet (Saclay), S. Albrand + others 2 ( ~50% FTE in total) Grenoble +...

• Czech Republic: contact M. Lokajicek: M. Novak 50% active from start, more people will come when first GRID services available

• Sweden, Danemark and others in Scandinavia: see Oxana slides: the application there another possible short term use case?– All 3 candidates till now simulation based: rather similar...


12

10/12/00 15.51 Oxana Smirnova

Institutions involved

• Several groups from Swedish universitiesare getting involved:– Lund (2 groups), Stockholm (University &

KTH), Uppsala

• Cooperation with Denmark, Norway andFinland is developing– esp. active collaboration between Lund and

Copenhagen

• Facilities often shared betweenexperiments


13

10/12/00 15.51 Oxana Smirnova

Status• Globus 1.1.3 deployed at several

institutions:– Lund: a toy-farm (2 PCs) and a master-to-be

PC at a farm– Stockholm: two farms– Uppsala: installation in progress

• Simple job submission tests via Globusperformed:– inbetween single PCs and at a toy-farm with

openPBS - within Lund– between Lund and Copenhagen (some

authentication problems)– only executables submitted


14

1 0 / 1 2 / 0 0 1 5 . 5 1 O x a n a S m i r n o v a

E x a m p l e o f a n a p p l i c a t i o n

• L u n d g r o u p a r e a o f i n t e r e s t : m e a s u r e m e n to f a s y m m e t r y i n

• A l l t h e r e l e v a n t s i m u l a t i o n c a n b e r e - d o n ei n t h e G r i d - e n a b l e d f r a m e w o r k– g i v e s a t a s t e o f t h e r e a l d a t a a n a l y s i s– e v e n t g e n e r a t i o n a n d r e c o n s t r u c t i o n : a n

e x h a u s t i v e t e s t– a l l o w s t o f i n d a n d e l i m i n a t e p o t e n t i a l p r o b l e m s– p r o d u c e s s a m p l e s t o b e u s e d i n a c t u a l s t u d i e s

• N e e d s : l o t s o f C P U ( s e v e r a l f a r m s ? ) ,s u f f i c i e n t s t o r a g e s p a c e , r e l i a b l e n e t w o r k

0s

0d K J/ ψB


15

Other sites and people (2)

• Holland : GRID contact Kors Bos ; additional 1/3 FTE will be hired beginning 2001

• Russia: Protvino, Dubna and 2 Moscow institutes; 4 farms 10-20 PC’s each

• Spain: GRID contact Andreu Pacheco (Barcelona), Valencia (Jose’ Salt) also interested

• Greece: Yorgos Tsipolitis (NTU Athens) provisional contact, two more physicist interested, GRID farm being set up


16

Data Challenges and GRID• MDC 1 first half 2002 : first project release of DATAGRID

(PM12) is January 2002, GriPhyn end September 2001. The GRID services provided there should fit with what ATLAS want to do in MDC1

• ATLAS DC Milestones were written on the safe side, but we should try to be more ambitious and involve more sites and more complexity, further define MDC1 in next months getting involved GRID people and sites

• Computing TDR ready by end 2002: all experimentation needed before TDR to be planned for MDC1

l. perini datagrid wp6 workshop 11 dec 2000 1 report on atlas grid activities sites, people,...

Documents