lcg generator

50
September 27 2004 September 27 2004 CHEP 2004 CHEP 2004 LCG Generator LCG Generator P. Bartalini P. Bartalini (University of Florida) (University of Florida) F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, S. Makarychev, F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin Uzhinsky, A. Vologdin

Upload: william-garza

Post on 30-Dec-2015

56 views

Category:

Documents


0 download

DESCRIPTION

LCG Generator. P. Bartalini (University of Florida). F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin. MC4LHC. Generator Services P.Bartalini. WP. WP. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: LCG Generator

September 27 2004September 27 2004

CHEP 2004CHEP 2004

LCG GeneratorLCG Generator

P. BartaliniP. Bartalini(University of Florida)(University of Florida)

F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev,

F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. VologdinF. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin

Page 2: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

LCG Simulation Project OrganizationLCG Simulation Project Organization

Simulation ProjectG.Cosmo

FrameworkV. Pokorski

Geant4J.Apostolakis

FLUKAIntegration

A.Ferrari

PhysicsValidation

F.Gianotti/A.Ribon

ShowerParam

Geant4Project

FLUKAProject

ExperimentValidation

WPWP

WP

WPWP

WP

WPWP

WPWP

WP

WPWP

GeneratorServicesP.Bartalini

MC4LHC

WPWP

Page 3: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

LCG GeneratorLCG Generator

Florida (Coordination)CERN (Event Interfaces)

LCG-Russia (Library & Data Base)LCG-Spain (Production)

Collaboration with independent projects: LCG-UK (Validation, New MCs)Contact persons/Collaborators in MC Projects and LHC Experiments

GOAL: to guarantee the generator support for LHC

Started May 2003Started May 2003Long Term ProjectLong Term Project

Workshop on MC’s for the LHC (MC4LHC) Workshop on MC’s for the LHC (MC4LHC) CERN, July 7 - August 2 2003CERN, July 7 - August 2 2003

WPA: GENERATOR SERVICES LIBRARY (GENSER)

WPB: TUNING AND VALIDATION

WPC: SHARED EVENT FILES: PRODUCTION & DATA BASE

WPD: EVENT FORMATS AND EVENT INTERFACES

GENSER Review CERN, March 25 2004 CERN, March 25 2004

Page 4: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Between Two Different WorldsBetween Two Different Worlds

Small Theoretical groupsSmall Theoretical groups Huge fortran packages still in developmentHuge fortran packages still in development Need help with the new OO packagesNeed help with the new OO packages Need to share user support dutiesNeed to share user support duties

Large Experimental Collaborations

Complex OO Simulation Frameworks

Need easy access to many generators, responsive user support, bug fixes etc.

Page 5: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPA. The LCG Generator Library (GENSER)

Mandate: Collaborate with MC authors to prepare LCG Compliant Code

HERWIG (P.Richardson), PYTHIA (T.Sjöstrand), HIJING (X.N. Wang), ISAJET (F.E. Paige), LHAPDF (M.Whalley), ALPGEN (M.Mangano), COMPHEP (A.Sherstnev), EVTGENLHC (P. Robbe), GLAUBER (V.Uzhinsky), FROZEN (PHOTOS, PDFLIB), ORIGINAL CODE (Validation, Data Base, Production)

Future: DPMJET, MC@NLO, GRACE, MADGRAPH, NEXUS, PHOJET, SFM, TAUOLA, HERWIG++, PYTHIA 7, SHERPA, etc.

Clients: Addressed to LHC experimentalists and theorists both at CERN and in external laboratories. (Other users welcome!)

Tested by all the LHC experiments Quarterly Release Scheme

Librarian (MSU, ITEP, Troitsk, Protvino, CERN) ~ 1 FTE~ 1 FTE

One person based at CERN another one rotating with ~ quarterly shiftsOne person based at CERN another one rotating with ~ quarterly shifts

GOAL: to replace the obsolete CERN Library

ATLASATLAS PRODUCTION PRODUCTIONRELIES ON GENSER !!! RELIES ON GENSER !!!

Page 6: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPA. GENSER: Policy and Structure Releases decoupled from large library releases

Quarterly official releases, quick bug fixes and special versions

Most of the MC package versions released by the authors are installed Old versions have to be maintained as long as they are used

Manage to provide all the requested LCG supported platforms

CVS repository, AFS, Compact Tarball distribution, LCG Tools

SCRAM release and building tool for librarian and end-users Binary distribution also provided

Test/Validation software (provided by authors, end-users and librarians) Installed in the «Example» and «Test» modules

Code development for WPA, WPB, WPC, WPD

Documentation: http://lcgapp.cern.ch/project/simu/generator Savannah Portal: http://savannah.cern.ch/projects/simu/AFS: /afs/cern.ch/sw/lcg/app/releases/GENSER

Page 7: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPA. MC Packages: Inside or Outside WPA. MC Packages: Inside or Outside GENSER ?GENSER ?

Three possibilities:Three possibilities:

1) To develop the MC package in GENSER: 1) To develop the MC package in GENSER: MCDB, EVTGENLHCMCDB, EVTGENLHC EVTGENLHCEVTGENLHC derives from derives from EVTGENEVTGEN: : http://agenda.cern.ch/fullAgenda.php?ida=a035838http://agenda.cern.ch/fullAgenda.php?ida=a035838

Provided (Adapted) by LHCb Provided (Adapted) by LHCb Contact person P.Robbe Contact person P.Robbe LHCb has LHCb has full accessfull access to the package in the GENSER repository to the package in the GENSER repository Other contributors have a Other contributors have a limited accesslimited access (development of new decay models, decay files etc.) (development of new decay models, decay files etc.)

2) 2) To fully export the MC generator code in GENSER defining the corresponding sub-package: To fully export the MC generator code in GENSER defining the corresponding sub-package: MOST OF THE INSTALLED MCsMOST OF THE INSTALLED MCs

3) 3) To install the MC generator as external software packages in the LCG environment and to store in To install the MC generator as external software packages in the LCG environment and to store in GENSER just tests suites and other related code GENSER just tests suites and other related code COMPHEP, EVTGENCOMPHEP, EVTGEN

Just a technical issue! Just a technical issue! For each MC package an ad-hoc solution is found For each MC package an ad-hoc solution is found

taking into account the user requirementstaking into account the user requirements

Page 8: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPA. GENSER Repository WPA. GENSER Repository StructureStructure

GENSER_0_2_0GENSER_0_2_0|||--- config/|--- config/

|--- doc/|--- doc/

|--- include/|--- include/|--- logs/|--- logs/

|--- release.notes|--- release.notes |--- rh73_gcc323/|--- rh73_gcc323/lib/lib/

bin/bin/

tests/tests/

| ---include/| ---include/

|--- src/|--- src/herwig/herwig/data/data/

doc/doc/

dummy/dummy/

examples/examples/

includes/includes/

src/src/

MC Package version provided as CVS Tag

Page 9: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

GENSER_0_1_0: Mid Apr. 2004 (GENSER_0_1_0: Mid Apr. 2004 (rh73_gcc32rh73_gcc32) ) GENSER_0_2_0: Mid Sep. 2004 (GENSER_0_2_0: Mid Sep. 2004 (+ rh73_gcc323+ rh73_gcc323))

GENSER_1_0_0: Mid Dec. 2004 (GENSER_1_0_0: Mid Dec. 2004 (+ Scientific + Scientific LinuxLinux))

PYTHIA: PYTHIA: 6.205, 6.217, 6.220, 6.221, 6.222, 6.205, 6.217, 6.220, 6.221, 6.222, 6.223, 6.224, 6.304, 6.223, 6.224, 6.304, …… HERWIG: HERWIG: 6.500, 6.503, 6.504, 6.504b1, 6.500, 6.503, 6.504, 6.504b1, 6.505, 6.505, …… JIMMY: JIMMY: 4.1, 4.1, …… ISAJET: ISAJET: 7.67, 7.69, 7.67, 7.69, …… EvtGen:EvtGen: alpha-00-11-07alpha-00-11-07 EvtGenLHC: EvtGenLHC: 1.0, 1.0, …… AlpGen: AlpGen: 1.3.2, 1.3.2, …… CompHEP: CompHEP: 4.4.0, 4.4.0, …… LHAPDF: LHAPDF: 1.1, 2.0, 1.1, 2.0, …… PDFLIB: PDFLIB: 804804 PHOTOS: PHOTOS: 202, 207202, 207 Glauber Xs (Heavy Ions): Glauber Xs (Heavy Ions): 1.0, 1.0, …… HIJING (Heavy Ions): HIJING (Heavy Ions): 1.36, 1.37, 1.383, 1.383b, 1.36, 1.37, 1.383, 1.383b, …… Packages in the waiting list, with particular emphasis on SHERPAPackages in the waiting list, with particular emphasis on SHERPA

GENSER_0_2_0:GENSER_0_2_0:11 Generators11 Generators

2 PDF Packages2 PDF Packages30 Versions30 Versions

WPA.

Page 10: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPB. Monte Carlo Validation and Tuning

GOAL: to cross-check MCs and compare with data

Basic Sanity Checks Reference distributions (multiplicities, PT Spectra etc.)

Standalone Studies

Work on GENSER subpackages (Librarian, Beta Testers in Experiments)

ALPGEN Validation (Perugia) Essential to verify ALPGEN in GENSER

HIJING Validation (JINR, Dubna) Encouraged to contribute to JetWeb

Validation Framework

JetWeb: in production

LCG-UK (U.C.London)

http://jetweb.hep.ucl.ac.uk/

[Comp. Phys. Comm. vol 153/2 164-178 (2003)]

Database of Data, MC & Comparisons Web Database of Data, MC & Comparisons Web interface, Job submissioninterface, Job submission

Will switch soon to Will switch soon to GENSER GENSER ??

Page 11: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Production framework

Proposal June 2004June 2004 Design Available. Prototype Stage Active institutions: CERN, Santander, Oviedo

Production centre

Configuration & Book-keeping

~ 1 FTE from LCG Russia (MSU, ITEP, JINR) MCDB: version Deployed!

WPC: Production of Shared Event Files

GOAL: to produce certified generator level events

Will Be Officially Will Be Officially Adopted By Adopted By CMSCMS

Tested At Tested At FermilabFermilabTested By Tested By CMS CMS

Use them for benchmarks, comparisons & combinations in LHC W.G. Improve the quality of shared samples with respect to LEP W.G. era !!!

Page 12: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPC. Monte Carlo Data Base (MCDB)

Motivations Motivations To Provide To Provide ConfigurationConfiguration, , Book-keepingBook-keeping, , DocumentationDocumentation, , StorageStorage for the for the

Shared Event FilesShared Event Files To keep track of the full generation chain, To keep track of the full generation chain, Exploiting the Competences of Exploiting the Competences of

Monte Carlo Experts and Monte Carlo AuthorsMonte Carlo Experts and Monte Carlo Authors

CMS MCDB CMS MCDB http://cmsdoc.cern.ch/cms/generators/mcdb/http://cmsdoc.cern.ch/cms/generators/mcdb/ Only parton level files; AFS storage; No Searchable; No SQLOnly parton level files; AFS storage; No Searchable; No SQL

LCG MCDB LCG MCDB [[hep-ph/0404241hep-ph/0404241]] Same authors + Additional human resources and technical support Same authors + Additional human resources and technical support Core software supported by LCG Software Project InfrastructureCore software supported by LCG Software Project Infrastructure

MySQL; POOL; CASTOR (RFIO); CGI; Perl; ApacheMySQL; POOL; CASTOR (RFIO); CGI; Perl; Apache Web Interface, Dedicated Web Server http://mcdb.cern.chWeb Interface, Dedicated Web Server http://mcdb.cern.ch

version supports only Mozilla Browserversion supports only Mozilla Browser

Page 13: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPC. MCDB: SQL Structure WPC. MCDB: SQL Structure and Access Policyand Access PolicyEnd-UserEnd-User Read articles, comments, newsRead articles, comments, news Download event filesDownload event files

AuthorAuthor Post articlesPost articles Upload event filesUpload event files Post news and answer the commentsPost news and answer the comments

ModeratorModerator Manage users profilesManage users profiles Moderate articles and commentsModerate articles and comments

AdministratorAdministrator Control the systemControl the system Technical database managementTechnical database management

Application Package InterfaceApplication Package Interface Automated articles posting/retrieving and samples upload/downloadAutomated articles posting/retrieving and samples upload/download

SQL Table Structure

Page 14: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPC. MCDB Web Interface Screen-WPC. MCDB Web Interface Screen-shotshot

http://mcdb.cern.ch

Only Mozilla Browser Supported (for the time being)

Page 15: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPD. WPD. Event Formats and Event Event Formats and Event InterfacesInterfaces

The modularisationThe modularisation Basic idea in Basic idea in ThePEGThePEG, , PYTHIA 7PYTHIA 7, , HERWIG++HERWIG++, , SHERPASHERPA From April 2004 LCG Generator participates to the development of From April 2004 LCG Generator participates to the development of

ThePEGThePEG We started with improving the doxygen documentation (A.Ribon)We started with improving the doxygen documentation (A.Ribon) Activity coordinated with Activity coordinated with PhenogridPhenogrid (N.Glover et al.) (N.Glover et al.) Relevant for the Relevant for the Herwig++Herwig++ development development

The MC truthThe MC truth Interface Interface HEPMLHEPML proposal (XML - proposal (XML - Les Houches Agreement ILes Houches Agreement I compliant) compliant)

Meta-data format facilitating automated documentationMeta-data format facilitating automated documentation HEPMCHEPMC

Under the responsibility of Under the responsibility of CLHEPCLHEP (still some problems with translators)(still some problems with translators)

GOAL: standardize interfaces, support the new OO MCs

Page 16: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPD. HEPML ProposalWPD. HEPML Proposal

All data in event file are divided in two partsAll data in event file are divided in two parts Header -Header - describe the general informationdescribe the general information

Author, the file itself (Author, the file itself (creation date etc.creation date etc.), supported specifications, ), supported specifications, collider description etc.collider description etc.

Generator specific info, cuts, physical parameters etc.Generator specific info, cuts, physical parameters etc. Info for parser (Info for parser (format of event records etc.format of event records etc.))

Event Records - Event Records - variable data of events written in some variable data of events written in some compact format to one string (compact format to one string (particle momenta, color particle momenta, color chains etcchains etc.).)

Header is stored in a txt file with Header is stored in a txt file with XML SyntaxXML Syntax Event RecordsEvent Records are (zip) compressed and attached to are (zip) compressed and attached to

the the HeaderHeader file file

(COMPHEP Collaboration)

[S.Sherstnev]

Page 17: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPD. WPD. XML in HEPXML in HEPA.KryukovA.Kryukov

Skobeltsyn Institute of Nuclear PhysicsSkobeltsyn Institute of Nuclear Physics([email protected])([email protected])

On behalf of CompHEP CollaborationOn behalf of CompHEP Collaboration

Presented to LCG-GeneratorPresented to LCG-Generator

http://agenda.cern.ch/fullAgenda.php?ida=a035826http://agenda.cern.ch/fullAgenda.php?ida=a035826

Why XML ?Why XML ? Describe the document structureDescribe the document structure Extensible languageExtensible language WEB readyWEB ready Well defined open standardWell defined open standard Available tools to treat of XMLAvailable tools to treat of XML

Page 18: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

LCG Generator Future PlansLCG Generator Future Plans

MILESTONESMILESTONES

Q4/2004-WPA- GENSER: release version (Q4/2004-WPA- GENSER: release version (ref. ref. MC RTAG reportMC RTAG report)) Q1/2005-WPA- SHERPA (Q1/2005-WPA- SHERPA (F.Krauss et al.F.Krauss et al.) fully integrated in GENSER) fully integrated in GENSER Q2/2005-WPC- Generator level production framework: beta versionQ2/2005-WPC- Generator level production framework: beta version Q3/2005-WPD- First test of ThePEG and EvtGenLHC integration in Q3/2005-WPD- First test of ThePEG and EvtGenLHC integration in

Herwig++Herwig++ (and Possible insertion of Herwig++ in GENSER) (and Possible insertion of Herwig++ in GENSER) Q3/2005-WPC- Production centre integrated in the grid-middlewareQ3/2005-WPC- Production centre integrated in the grid-middleware Q4/2005-WPC- Generator level production framework: release versionQ4/2005-WPC- Generator level production framework: release version Q1/2006-WPC- MCDB Integration with Generator level production Q1/2006-WPC- MCDB Integration with Generator level production

framework, experiment specific APIs and management of large filesframework, experiment specific APIs and management of large files WPB milestones to be verified with other independent projectsWPB milestones to be verified with other independent projects

Enphasis on the collaboration with Enphasis on the collaboration with Object Oriented MC projectsObject Oriented MC projects

Page 19: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WEB pagehttp://lcgapp.cern.ch/project/simu/generator

Links to relevant documentation, CVS repository, release.notes etc.

CDS Agenda Home > Projects > LHC Computing Grid > Physics Generators Minutes of meetings, slides of presentations

Meetings: Last Thursday of the month at 5 PM in CERN-32-1-A24 & VRVS

(Last and Next meetings anticipated to SEP 23 and OCT 21 respectively) Next meeting will be devoted to the Management of GENSER Releases

Applications area mailing list: [email protected]

Organisational Issues

Page 20: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

BackupBackup

General

Page 21: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Agenda of LCG Generator Review Agenda of LCG Generator Review (March 2004)(March 2004)

13:45 Introduction (Bartalini, P.)

13:50 LHAPDF v2 (Whalley, M.)

14:20 GENSER, the generator library (Alexander, S.)

14:50 GENSER validation (Ambroglini, F.)

15:05 User experience with GENSER (Hinchliffe, I.)

15:25 The LCG generator library (Discussion) (all)

16:25 ---Coffee---

16:40 A framework for generator level production&validation (Bartalini, P.)

16:55 The MCDB project (Dudko, L.)

17:10 MCDB Implementation (Vologdin, A.)

17:25 The HEPCODE project (Stirling, W.J.)

17:35 Event formats & Monte Carlo data base. (Discussion) (all)

Page 22: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

WPC. Simple Generator Level WPC. Simple Generator Level Production FrameworkProduction Framework

Progress on the simple generator level production Progress on the simple generator level production framework were achieved during the quarter. framework were achieved during the quarter.

A Prototype is being developed by A Prototype is being developed by H.NavesH.Naves and and J.CuevasJ.Cuevas ( (SantanderSantander). ).

It reads It reads generator cardsgenerator cards, produces , produces eventsevents, performs , performs basic event selectionbasic event selection, and writes out using the , and writes out using the HEPMCHEPMC structure in structure in POOLPOOL and in and in ROOTROOT formats. formats.

Page 23: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

BackupBackup

MCDB

Page 24: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB IntroductionMCDB Introduction

Correct Monte Carlo simulation of complicated Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertiseprocesses requires rather sophisticated expertise

Different physics groups often are in need of the Different physics groups often are in need of the same MC samplessame MC samples

Public availability of the event files speeds up their Public availability of the event files speeds up their validationvalidation

Central and public location where well-documented Central and public location where well-documented event files can be found would be very usefulevent files can be found would be very useful

[S.Belov]

Page 25: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

CMS MCDBCMS MCDBAdvantagesAdvantages

Based on web Based on web technologiestechnologies

Stores detailed Stores detailed documentation for each documentation for each set of event samplesset of event samples

Storing data on AFS let Storing data on AFS let make its easy of accessmake its easy of access

Provide rapid Provide rapid communication between communication between users and expertsusers and experts

ProblemsProblems

Stores parton level events onlyStores parton level events only The expected number of physics The expected number of physics

processes in the database is processes in the database is several hundred (data are stored several hundred (data are stored on AFS so there is a space on AFS so there is a space limitation)limitation)

Cannot serve sophisticated Cannot serve sophisticated queries owing to it isn’t SQL queries owing to it isn’t SQL basedbased

[S.Belov]

Page 26: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Main Features of LCG MCDBMain Features of LCG MCDB

The most important reason to develop LCG MCDB is to The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDBexpel the restrictions of CMS MCDB

An SQL-based databaseAn SQL-based database Wide search abilitiesWide search abilities Possibility to keep the events at particle level as well as at Possibility to keep the events at particle level as well as at

partonic levelpartonic level Direct programming interface from LCG collaboration Direct programming interface from LCG collaboration

softwaresoftware Inheritance of all the advantages of the predecessor - CMS Inheritance of all the advantages of the predecessor - CMS

MCDBMCDB

[S.Belov]

Page 27: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB: General Conceptions and MCDB: General Conceptions and TermsTerms

Event file (sample)Event file (sample) – the file containing particle or partonic – the file containing particle or partonic eventsevents

ArticleArticle – a document describing the set of samples – a document describing the set of samples Event dataEvent data – the events themselves, all the data are stored into – the events themselves, all the data are stored into

event filesevent files Event metadataEvent metadata – information which describes all events in a – information which describes all events in a

sample in general (beam description, physics parameters, sample in general (beam description, physics parameters, applied cuts, etc.)applied cuts, etc.)

[S.Belov]

Page 28: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB InterfacesMCDB Interfaces

Search formSearch form Article management (creating, changing, removing)Article management (creating, changing, removing) Downloading sample filesDownloading sample files User management (registration, editing profiles, removing)User management (registration, editing profiles, removing) Editing metadata on physical models and parametersEditing metadata on physical models and parameters Moderating articles and user comments on themModerating articles and user comments on them Application programming interface to allow program-based Application programming interface to allow program-based

article creationarticle creation Comment the articlesComment the articles

[S.Belov]

Page 29: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Access Ways to LCG MCDBAccess Ways to LCG MCDB

End-UserEnd-User Read articles, comments, newsRead articles, comments, news Download event filesDownload event files

AuthorAuthor Post articles and upload event filesPost articles and upload event files Post news and answer the commentsPost news and answer the comments

ModeratorModerator Manage users profilesManage users profiles Moderate articles and commentsModerate articles and comments

AdministratorAdministrator Control the systemControl the system Technical database managementTechnical database management

Application softwareApplication software Automatic articles posting and samples uploadAutomatic articles posting and samples upload

[S.Belov]

Page 30: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

The Most Common Operations with The Most Common Operations with MCDBMCDB

Users in generalUsers in general

1)1) Browses articles via the tree view of physics categoriesBrowses articles via the tree view of physics categories

2)2) Searches by author, title, keywords, physical processes, Searches by author, title, keywords, physical processes, parameters values, etc.parameters values, etc.

3)3) Downloads desired sample after agreement on MCDB LicenseDownloads desired sample after agreement on MCDB License

Articles’ authorsArticles’ authors

1)1) Uploading event filesUploading event files

2)2) Completing article with the information that wasn’t not included Completing article with the information that wasn’t not included in the description of an event filein the description of an event file

[S.Belov]

Page 31: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB: Software SelectionMCDB: Software Selection

SQL DBMS: MySQLSQL DBMS: MySQL Script system: PerlScript system: Perl Web-server: Apache2Web-server: Apache2 Web-interface: CGI+PerlWeb-interface: CGI+Perl CASTOR: RFIO packageCASTOR: RFIO package

All the products are supported as standard software in LCGAll the products are supported as standard software in LCG

[A.Sherstnev]

Page 32: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

SQL tables in MCDBSQL tables in MCDB

AuthorsAuthors ArticlesArticles CategoriesCategories Generators and their parametersGenerators and their parameters Models and parameters namesModels and parameters names Model parameters’ valuesModel parameters’ values Processes, initial and final statesProcesses, initial and final states Applied cutsApplied cuts Event files, graph filesEvent files, graph files

and a few other tablesand a few other tables

[S.Belov]

Page 33: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB: Current StatusMCDB: Current Status

SQL tables structure: doneSQL tables structure: done Internal Perl modules (access to the MCDB SQL tables, parse Internal Perl modules (access to the MCDB SQL tables, parse

configuration file, many others): partly doneconfiguration file, many others): partly done User area:User area:

Web site: first prototype done (mcdb.cern.ch)Web site: first prototype done (mcdb.cern.ch) Web catalog script: doneWeb catalog script: done

Author areaAuthor area Web interface for creation of articles: doneWeb interface for creation of articles: done Uploading of files to HDD: done, to CASTOR: in progressUploading of files to HDD: done, to CASTOR: in progress Web interface for editing of articles: in progressWeb interface for editing of articles: in progress

Administrative area:Administrative area: User management interface: doneUser management interface: done Article management interface: in progressArticle management interface: in progress

[A.Sherstnev]

Page 34: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB: Short Term PlansMCDB: Short Term Plans

DocumentationDocumentation Internal programming interface with CASTORInternal programming interface with CASTOR Web-interface for editing of articlesWeb-interface for editing of articles First real testsFirst real tests Web access control: internal login/password, GRID certificatesWeb access control: internal login/password, GRID certificates Internal access control: to provide author’s privacyInternal access control: to provide author’s privacy Web-server tuningWeb-server tuning Providing of compatibility with different browsers (IE, Providing of compatibility with different browsers (IE,

Netscape, Opera)Netscape, Opera) HEPML: developing of XML tag setHEPML: developing of XML tag set Main milestone: first working prototype in DecemberMain milestone: first working prototype in December

[A.Sherstnev]

Page 35: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

MCDB: Mid Term PlansMCDB: Mid Term Plans

Search engine in MCDB SQL databaseSearch engine in MCDB SQL database Moderator interface (to manage articles and Moderator interface (to manage articles and

related objects, user comments, Web catolog)related objects, user comments, Web catolog) Internal parser for HEPMLInternal parser for HEPML Security system Security system Logging systemLogging system System of collection of statisticsSystem of collection of statistics MCDB Integration APIsMCDB Integration APIs

[A.Sherstnev]

Page 36: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

BackupBackup

A.KryukovA.KryukovSkobeltsyn Institute of Nuclear PhysicsSkobeltsyn Institute of Nuclear Physics

([email protected])([email protected])On behalf of CompHEP CollaborationOn behalf of CompHEP Collaboration

Presented to LCG-GeneratorPresented to LCG-Generatorhttp://agenda.cern.ch/fullAgenda.php?ida=a035826 http://agenda.cern.ch/fullAgenda.php?ida=a035826

XML in HEPXML in HEP

Page 37: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

OutlookOutlook

Why XML ?Why XML ? Describe the document structureDescribe the document structure Extensible languageExtensible language WEB readyWEB ready Well defined open standardWell defined open standard Available tools to treat of XML Available tools to treat of XML

[A.Kryukov][A.Kryukov]

Page 38: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Outlook (continue)Outlook (continue)

Experimental events and/or events simulation Experimental events and/or events simulation (illustration)(illustration) Detector modelsDetector models HEP modelsHEP models Partonic event structurePartonic event structure Hadronized eventsHadronized events Digitized eventsDigitized events

ConclusionConclusion[A.Kryukov][A.Kryukov]

Page 39: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Why XML ?Why XML ?

XML describe the document structure.XML describe the document structure. Most information in HEP can be and must be Most information in HEP can be and must be

presented as a tree structure or in more general presented as a tree structure or in more general case acyclic graphcase acyclic graph

XML is extensible languageXML is extensible language XML has no fixed set of targets and attributes. XML has no fixed set of targets and attributes.

User can introduce own targets and attributes.User can introduce own targets and attributes.

[A.Kryukov][A.Kryukov]

Page 40: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Why XML (continue) ?Why XML (continue) ?

WEB readyWEB ready XML document can be distribute through InternetXML document can be distribute through Internet XML document can be displayed in different way XML document can be displayed in different way

depends on the user request (XSLT, XSD)depends on the user request (XSLT, XSD) Most modern Web-browsers (Mozilla, IE) can Most modern Web-browsers (Mozilla, IE) can

display XML documents by default.display XML documents by default. Well defined open standardWell defined open standard

Recomended by W3CRecomended by W3C Supported by IBM, Sun, Microsoft, Linux/UN*X Supported by IBM, Sun, Microsoft, Linux/UN*X

communitycommunity[A.Kryukov][A.Kryukov]

Page 41: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Why XML (continue) ?Why XML (continue) ?

Available tools to treat of XMLAvailable tools to treat of XML SAX - JavaSAX - Java Expat – C/C++Expat – C/C++ PerlPerl PythonPython Other …Other …

SW developer can re-use these tools for SW developer can re-use these tools for applicationsapplications

[A.Kryukov][A.Kryukov]

Page 42: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Experimental events and/or Experimental events and/or simulated eventssimulated events

HEP models

ME Gen(CompHEP)

Hadronization(Pythia)

2 3

1

5

Simulation(Geant)

Detector or it models

4

Reconstruction(ORCA)

7

6

Phys. analysis

Event DB

5’

[A.Kryukov][A.Kryukov]

Page 43: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

1. HEP models1. HEP models

<<modelmodel>><<namename>>QEDQED</</namename>><<parametersparameters>>

<<parameterparameter namename=“alpha” =“alpha” typetype=“float” =“float” valuevalue=“0.00729927”>=“0.00729927”>Alpha QED (1/137)Alpha QED (1/137)

</ </ parameterparameter>></</parametersparameters>><<particlesparticles>>

<<particleparticle idid=“e” =“e” massmass=“0.511” =“0.511” typetype=“fermion”>=“fermion”>ElectronElectron

</</particleparticle>></</particlesparticles>>

</</modelmodel>>(See more details in A.Demichev, A.Kryukov, A.Rodionov, (See more details in A.Demichev, A.Kryukov, A.Rodionov,

hep-ph/0203102. See also http://theory.sinp.msu.ru/FeynXML)hep-ph/0203102. See also http://theory.sinp.msu.ru/FeynXML)

[A.Kryukov][A.Kryukov]

Page 44: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

2. ME events: partonic level2. ME events: partonic level

<<MachineMachine> > The LHC projectThe LHC project <<BeamBeam idid="1" ="1" energyenergy="7.00000E+03">="7.00000E+03"> <<ParticleParticle namename="proton" ="proton" KFKF="2212" ="2212" massmass="9.38000E-01"/>="9.38000E-01"/> <<StrfunStrfun namename='CTEQ' ='CTEQ' versionversion='5l'> <='5l'> <PDFLIBinfoPDFLIBinfo idid="46" ="46" grgr="4"/> ="4"/> </</BeamBeam> > </</MachineMachine>><<TaskTask>> <<ProcessProcess ID="1"> ID="1"> u, D -> n, e, E, b, B u, D -> n, e, E, b, B </</ProcessProcess>> <<GeneralInfoGeneralInfo>> <<CrosSection CrosSection value="1.11227E-03" error="1.90987E-03" Nevent="100"/>value="1.11227E-03" error="1.90987E-03" Nevent="100"/> <<GeneratorGenerator name="CompHEP" version="4.2.0"/> name="CompHEP" version="4.2.0"/> </</GeneralInfoGeneralInfo> > </</TaskTask>>……((Below partonic events. Below partonic events. NOT in XML format!NOT in XML format!)…)…

[A.Kryukov][A.Kryukov]

Page 45: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

3. Simulated events: particle level 3. Simulated events: particle level (illustration)(illustration)

<<headerheader>>

<<experimentexperiment namename=“CMS” =“CMS” datedate=“20070101”/>=“20070101”/>

<<beambeam typetype=“pp” =“pp” energyenergy=“14000”/>=“14000”/>

<!– etc. <!– etc. </</headerheader>>

(Below Pythia-like events. (Below Pythia-like events. NOT in XML format!NOT in XML format!))

[A.Kryukov][A.Kryukov]

Page 46: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

4. Detector models (illustration)4. Detector models (illustration)

<<detectordetector>><<namename idid=“CMS” =“CMS” versionversion=“2.33”>=“2.33”>

Compact Muon SolenoidCompact Muon Solenoid</</namename>><<basic_elementbasic_element idid=1 =1 URIURI=“http://xxx.cern.ch/cms/belement1” />=“http://xxx.cern.ch/cms/belement1” /><<basic_elementbasic_element idid=1 =1 URIURI=“http://xxx.cern.ch/cms/belement2” />=“http://xxx.cern.ch/cms/belement2” /><<unitunit namename=“shift” =“shift” dimdim=“mm”/>=“mm”/><<unitunit namename=“rotate” =“rotate” dimdim=“grad”/>=“grad”/><<elementelement deploy_fromdeploy_from=1 =1 shiftshift=“x,y,z” =“x,y,z” rotaterotate=“a,b,g” =“a,b,g” numbernumber=“100”/>=“100”/><<elementelement deploy_fromdeploy_from=2 =2 shiftshift=“0.0.0” =“0.0.0” rotaterotate=“10.0.0” =“10.0.0” materialmaterial=“Si”/>=“Si”/><<elementelement deploy_fromdeploy_from=2 =2 shiftshift=“x,y,z” =“x,y,z” rotaterotate=“0.0.0” =“0.0.0” materialmaterial=“Cu”/>=“Cu”/><!– etc. <!– etc.

</</detectordetector>>

[A.Kryukov][A.Kryukov]

Page 47: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Next points …Next points …

5.5. Simulated/experimental eventsSimulated/experimental events

6.6. Reconstructed eventsReconstructed events

7.7. Visualization, Web browsingVisualization, Web browsing

8.8. What else?What else?

[A.Kryukov][A.Kryukov]

Page 48: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Conclusions (pro)Conclusions (pro)

XML is very useful for presentation of XML is very useful for presentation of structured datastructured data Models, EventsModels, Events

Easy for realization on Java, C/C++, Perl, …Easy for realization on Java, C/C++, Perl, … Give a lot of possibilities for publication Give a lot of possibilities for publication

results through the WEB.results through the WEB. Unify interfaces of application softwareUnify interfaces of application software XML DB id native format of data base for XML DB id native format of data base for

XML presented data.XML presented data.

[A.Kryukov][A.Kryukov]

Page 49: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Conclusions (contra)Conclusions (contra)

Poor structured informationPoor structured information

Huge amount of information with strong Huge amount of information with strong defined and fixed structuredefined and fixed structure ME generated events, Pythia events and othersME generated events, Pythia events and others

[A.Kryukov][A.Kryukov]

Page 50: LCG Generator

P.Bartalini – CHEP 2004 - September 27 2004P.Bartalini – CHEP 2004 - September 27 2004

Main conclusion: Main conclusion: XML has XML has great advantage in HEP great advantage in HEP

applicationapplication

Thank you for attention!Thank you for attention!