K. HarrisonCERN, 15th May 2003

GANGA: GAUDI/ATHENA AND GRID ALLIANCE

- Development strategy- Ganga prototype- Release plans- Conclusions

15th May 2003 2

Feedback from March Software Workshop

- Concern expressed at March Software Workshop about number of projects relating to job configuration, submission and/or management: ASK, AtCom, Chimera, DIAL, Ganga, Grappa

- Consensus was that exploring a variety of approaches through the different projects had been a good thing, given uncertainties in how the Grid will develop, but a closer collaboration between projects is needed

- Development of software based on components was encouraged Allow possibility of combining components from different projects to obtain optimal solution

15th May 2003 3

Design and development strategy- Ganga design is based on a set of components that communicate via a software bus Implementation in Python

- Mini-workshop at CERN, 9-12 May, has helped define better how things should work in practice Reviewed status of prototype Discussed functionality required of Python bus Looked at breakdown into components Defined release schedule for rest of the year

- This week, have been talking with people from related projects All agreed in principle to tighter coordination and collaboration, details to be worked out

15th May 2003 4

Ganga prototype

- Code authors: K. Harrison, A. Soroko, C.L. Tan- Guidance and suggestions: N. Brook, R.W.L. Jones, W. Lavrijsen, P. Mato, C.E. Tull- Prototype is mainly for developers, but demonstrates Python as glue: need simplifications to improve usability- Has limitations, but Ganga prototype is already able to submit Atlfast jobs to the LSF batch system on lxplus Submission to EDG resource broker also possible, but need ATLAS software at worker node- Recipe for submitting Atlfast job available: http://ganga.web.cern.ch/ganga/user/recipes/AtlfastRecipe.html- First release for users planned for week of 16-20 June

15th May 2003 5

Basic GUI

15th May 2003 6

Job creation

15th May 2003 7

Application parameters

15th May 2003 8

Atlfast job-options editor (by C.L. Tan)

-Integral part of Ganga, but will function as standalone tool Command-line program with a GUI wrapper- GUI-assisted customisation of job-options files prevents certain errors (mis-spelt options/values, incorrect syntax)- User can define/manipulate sequences and lists- Editor is option-type aware Drop-down menus for discrete choices Arbitrary value entry for simple options Value append for list-type options- Favourite settings can be saved to file for subsequent reloading- User-guide available: http://ganga.web.cern.ch/ganga/user/JOE/JOE-UserGuide.html

15th May 2003 9

Sequence editor

15th May 2003 10

Options editor

15th May 2003 11

Preview of job-options file

15th May 2003 12

Listing of input files

15th May 2003 13

Job submission

15th May 2003 14

Job completion

15th May 2003 15

Release plans (1)

5-9 May: Ganga release 0.1– Prototype release, mainly for developers– Includes basic GUI, some job-configuration possibilities, job submission to local host or batch system (LSF, PBS, EDG)

12-16 May: ATLAS Software Workshop, CERN- Status and plans

15th May 2003 16

Release plans (2)

16 June 2003: Ganga release 1.0- CLI and Usability improvements

18-20 June 2003: LHCb Software Week- Announce Ganga 1.0 available for use

12-16 July 2003: 7th GridPP collaboration meeting, Oxford, UK- Preliminary user feedback on release 1.0

28 July 2003: Ganga release 1.1- Pure-client submit

15th May 2003 17

Release plans (3)

2-4 September 2003: UK All-Hands Meeting, Nottingham, UK

22-26 September 2003: ATLAS Software Workshop- User feedback on 1.1 29 September: Ganga release 2.0- CLI capture of GUI actions- PyBus and ASK modules- Pre-execute release installation

15th May 2003 18

Pre-execution of release installation

User runningGanga client

Gatekeeper

Worker nodes

Software server

Send script

Send job output

Requestsoftware

Receivesoftware

Submit job

Request software

Receive software

Send job output

15th May 2003 19

Release plans (4)

10 November: Ganga release 3.0- Enhanced monitoring

12-14 November 2003: LHCb Software Week

15-21 November 2003: SuperComputing/Grid 2003, Phoenix, USA- End-to-end troubleshooting demonstration

1-5 December: ATLAS Software Workshop

April-March 2004- ATLAS DC2

15th May 2003 20

Conclusions

- Ganga prototype has been developed

- Prototype includes basic GUI functionality and job-options editor, and allows submission of Atlfast jobs

- Mini-workshop at CERN, 9-12 May, has helped define Ganga roadmap for the rest of the year

- First Ganga release for users planned for week of 16-20 June

- Looking to coordinate and collaborate with ASK, AtCom, Chimera, DIAL and Grappa: aim for full integration of tools