Download - BNL’s Role in ATLAS Howard Gordon DOE Annual HEP Review Brookhaven National Lab April 17-19, 2006
BNL’s Role in ATLAS
Howard Gordon
DOE Annual HEP Review
Brookhaven National Lab
April 17-19, 2006
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
20 dipoles/week being installed -> 25/week in March leads to a magnet installation completion in Feb. 2007
LHC Machine Status from Dashboard
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Lyn Evans said in 2/06, the objective for 2007 is 75 ns operation with 1032
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL’s Role in ATLAS Overview of BNL Role in ATLAS H. Gordon
U.S. ATLAS Analysis Support Center BNL Role in US ATLAS Management BNL Role in Construction & Research program
Construction/Installation/Commissioning/ATLAS Upgrade D. Lissauer
Construction / Installation / Commissioning: Liquid argon calorimeter Cathode strip chambers (Muon system) ATLAS Technical Coordination
ATLAS upgrade – Tracking/Calorimeter/Muons Upgrade Project Office; Tracking; LAr
ATLAS Computing T. Wenaus Tier I Center Core Software
Physics K. Cranmer Reconstruction – system specific Physics Analysis Plus Parallel Session III (Theory)
Early Physics with ATLAS and LHC; (F. Paige) Implications of non-universal masses: a step beyond mSUGRA: (T. Krupovnickas)
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
General Approach Construction responsibility matched to unique
technical capability at BNL. Physics & Instrumentation Division were pioneers in
R&D for both LAr calorimeter and cathode strip chambers.
Contribution to the analysis builds on: detector expertise in the calorimeter and muon systems and Core software strength.
Much of computing and software aims at insuring that the U.S. can easily access the ATLAS data: data management, Tier 1 and Tier 2’s
ATLAS upgrade concentrates on the tracking system and Calorimeter readout where we take advantage of unique developments. Major role in overall optimization via Upgrade PO activities.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
~ 1 yr at 1034: up to 2.8 TeV
~ 1 yr at 1033: up to 2.3 TeV
~ 1 mo. at 1033: up to 2 TeV
Reach of Multijet + ETmiss
search
SUSY could be found quickly if isolated from SM backgrounds
A Supersymmetry Discovery Could Come SoonWe need to work hard to understand the backgrounds
ATLAS SUGRA Pt. 6
Meff = pT(ji) + ETmiss
This was the older S/B
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
We now believe SUSY may need a Lepton Trigger
ackgroundSignature for SUSY from Multi-jets and Missing ET is more robust if a lepton is required.
Using more modern generators indicates that the background in the no-lepton channel is higher than we thought.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
ATLAS100 fb-1
LHC Point 5
m () spectrumend-point : 109 GeVexp. precision ~0.3%
m (j)min spectrumend-point: 552 GeVexp. precision ~1 %
m (j) spectrumend-point: 479 GeVexp. precision ~1 %
Lq~ q 02
R
~ 0
1
m (j)max spectrumthreshold: 272 GeVexp. precision ~2 %
Example Reconstruction Of a SUSY Decay
Chain
GeV 121 157, 232, 690,)χ ,~ ,χ ,q~( m 12
0R
0L
Frank Paige had a significant role in this strategy
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
The ATLAS Detector
ATLAS is being assembled in its cavern at CERN
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL Deliverables to the ATLAS Experiment
Barrel Cryostat and utilities (BNL)CSC (BNL)
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Barrel TileCal and Liquid Argon at z=0
Status 8 November 2005
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Leading BNL Roles in ATLASNew since 2005
K. Assamagan Analysis Tools Coordinator Kyle Cranmer Co-Coordinator of ATLAS Jet/ETMiss trigger
softwareB. Gibbard International Computing Board (and Grid
Deployment Board)H. Gordon ATLAS Executive Board, National Contact
Physicist F. Lanni LAr Upgrade CoordinatorD. Lissauer Leader of Technical Coordination Project Office
(Task A)Head of Project Office for the Upgrade
H. Ma LAr Database CoordinatorCo-Coordinator of LAr Commissioning Analysis
S. Rajagopalan LAr Calorimeter Performance Co-Coordinator Event Data Model Architecture
LAr Management GroupATLAS Computing and Software Management
GroupsT. Wenaus ATLAS Database Project Co-Leader H. Takai Co-Coordinator Heavy Ion Physics GroupV. Polychronakos Cathode Strip Chamber Leader
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL Roles in U.S. ATLAS H. Gordon, Construction Project Manager;
Deputy Research Program Manager S. Rajagopalan, Software Subsystem Manager, WBS
2.2 T. Wenaus, Distributed Software Manager, WBS 2.2.4 A. Undrus, Software Infrastructure, WBS 2.2.6 H. Ma, BNL Analysis Support Center Coordinator,
WBS 2.2.7.1 B. Gibbard, Computing Facilities Manager, WBS 2.3
(R. Popescu, Deputy) P. Nevski, Grid Production, WBS 2.3.4 D. Lissauer, Technical Coordination Subsystem
Manager WBS 3.9 T. Maeno, K. Assamagan – Analysis Support Group K. Cranmer, Trigger Forum; F. Paige, SUSY Forum
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(1) Analysis Support GroupASG membership:
ASG chair (S. Willocq, U. Mass. Amhearst) ASC coordinators (J. Proudfoot @ ANL, H. Ma @ BNL, S. Loken @
LBNL) CERN contact person Support contacts:
- Software framework (Athena, CMT, how to run, etc.)
- Data management (incl. database)
- Distributed software (incl. grid)
- Software releases (incl. kit installation)
- Physics analysis tools (ESD/AOD/TAG, tools, etc.)
- Generators/Simulation
- InDet tracking, b-tagging & vertexing
- MuSpec tracking & muon ID
- LAr calorimetry & e/gamma ID
- Hadron calorimetry & jets/Etmiss/tau
- Trigger
Detectorperformancesupport
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(2) Analysis Support Centers (ASC)
• Main task:• Provide US ATLAS physicists with regional resources,
tutorials, support, leadership and focal point for meetings
• 3 ASCs:• Argonne National Lab: Midwest region• Brookhaven National Lab: Eastern region• Lawrence Berkeley National Lab: Western region
• Choice of 3 centers is motivated by the ability to tap into
the considerable infrastructure and human resources
available at those laboratories
• Also, it facilitates access to support and expertise for US
physicists at ‘nearby’ Universities
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(2) Analysis Support Centers• ASC Role: the following is to be made available
• Infrastructure:• Office space for visitors• Access to networking, printers, stationary, copy/fax/coffee machines• Secretarial assistance• Meeting rooms for tutorials and face-to-face analysis meetings• Video and phone conferencing facilities
• Software support: Requires 1 new FTE at each ASC• General software (framework, how to run jobs, etc.)• Physics analysis tools• Distributed analysis, grid use• Liaison to computing facilities
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(2) Analysis Support Centers
• ASC Role (cont’d):• Expertise:
• Basic software support as indicated above• Some members of the ASG will be stationed at an ASC,
this reinforces areas of expertise that already exists regionally:• ANL: Hadron calorimetry, jet reconstruction & calibration• BNL: LAr calorimetry, e/gamma ID, trigger for e/gamma, jets, missing
ET
+ regional groups for Muon tracking and ID, analysis tools, b-tagging• LBNL: Inner Detector tracking, b-tagging, vertexing
• Physics analysis through ASC physicist involvement in ATLAS physics• Coordination:
• ASC coordinators oversee local support activities• ASG chair coordinates the activities at the 3 ASCs:
• Tutorial and analysis support coordination across ASCs• Monthly meeting between ASC coordinators and ASG chair• Compilation of ASC-use metrics to assess effectiveness
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL ASC MOU sectionName Software/ Detector Performance Physics Analysis ATLAS
Fraction Area of Expertise ATLAS
Fraction Area of Activity
Ketevi Assamagan
60% Physics Analysis Tools Muon performance
20% Higgs BSM
Kyle Cranmer 80% Physics Analysis Tools MET/ Jet/ tau Trigger
20% Higgs SUSY
Denis Damazio 40% Calorimeter and egamma Trigger
20% Standard Model
Hong Ma 70% LAr Calorimeter Egamma performance Commissioning
10% Standard Model
Frank Paige 30% Jet & MissingET reco Physics validation
50% SUSY
Srini Rajagopalan 60% Athena Framework LAr Calorimeter Egamma reco/ perf
10% SUSY
George Redlinger 20% Trigger performance
80% SUSY
Scott Snyder 50% Core and Calorimeter Software EM calibration
20% Higgs
Iuliu Stumer 50% Magnetic Field
Total commitment
4.6FTE 2.3FTE
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL ASC MOU SectionName Available
ASC Fraction ASC Support Areas Source of Support
David Adams 20% Data management US ATLAS Research Program/ SW
Ketevi Assamagan* 20% Analysis Tools BNL HEP Core Program Wensheng Deng 20% Production
Data management US ATLAS Research Program/ Production
Hong Ma
15% ASC coordination Tier-1 usage
BNL HEP Core Program
Tadash Maeno* 10% Distributed Analysis US ATLAS Research Program/ SW
Pavel Nevski 20% Production/ Validation US ATLAS Research Program/ SW
Alex Undrus 50% Basic Software support US ATLAS Research Program/ SW
TOTAL 1.55FTE
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(3) Analysis Forums Main task:
Provide US ATLAS physicists with a forum for discussion and exchange of information, and to stimulate activity
AF membership: Analysis forums are led by ‘forum conveners’ who:
Call for presentations to regular video/phone meetings Make sure work is presented in ATLAS-wide meetings Provide input to computing Resource Allocation Committee
(RAC) Notes:
AFs are not substitutes for ATLAS working groups AFs have no approval power (ATLAS working groups do) Participation in AFs is not mandatory AF meetings need to be informal, stimulate discussion &
collaboration
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
(3) Analysis Forums Analysis Forums:
1. InDet tracking, b-tagging & vertexing
2. MuSpec tracking & muon ID
3. LAr calorimetry & e / gamma ID
4. Hadron calorimetry & jets / Etmiss / tau
5. Trigger
6. Standard Model & Higgs Physics
7. Beyond the Standard Model Physics Notes:
One forum convener for each of the forums 1-5 Two forum conveners for each of the forums 6-7
Physics forums could split into smaller units to maintain smaller, informal nature of each forum (would need only one convener per forum then)
Detectorperformance
Physics
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Typical Tutorial by K. Assamagan AnalysisTutorial1105 Introduction - What to do before coming to the Tutorial
Set up CMT Setup for the release 11.0.41 Run Time Setup The Next Time You Login Install Atlantis on your laptop Get The Necessary Files Run the AnalysisSkeleton for 100 Events More Information
Event Selection, Display and Visualization Event Selection
Use the AthenaAwareNTuple for Event Selection Selecting Events at the AOD, ESD and RDO Levels Passing Selected Events to Event Display
Event Display and Visualization 1. Getting started with atlantis: Looking at AOD events 2. Interactive athena/atlantis 3. Use the athena vertexing tools from within atlantis
Distributed Analysis Analysis on CSC samples using DQ2 How to run customized Athena to the Grid (OSG)
Event View
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
ATLAS Physics Analysis Tools led by K.
Assamagan Objectives:
Propose a unified, baseline framework for Analysis Common classes in the analysis domain Tools to build these objects General/common tools for analysis Navigations and Associations from ROOT NTuple back to AOD, ESD, and the Raw Data Tools to select the events of interest Event Display and visualization tools Tools for interactive analysis in ATHENA Tools for user analysis in the Distributed Analysis Environment Concrete, thorough analysis examples Tools for Multi-variate Analysis – Discriminant Analysis/Maximum Likelihood Analysis
Analysis Model: how all the above tools are integrated to define a model for how to do analysis on ATLAS data
ESD/AOD analysis to ROOT NTuple Concept of the EventView – tools for user analysis dependent, self consistent and
exhaustive view of the Event, containing mutually exclusive, reconstructed, final state particles
Interactions with combined performance groups & physics groups Interaction with the user – use support Common look and feel to the user BNL is heavily involved in the development of these analysis tools and the analysis model:
Overall coordination of various efforts Event Data Model for Analysis Distributed Analysis Tools Analysis Model – Event View
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Typical Activities of LAr Calorimeter Performance Coordinator, S. Rajagopalan
Set Priorities for the upcoming software release version 12.0.0 Review of the action items from the recently concluded
calorimeter trigger workshop (end of January) Organize a trigger software code review Update on the status of incorporating realistic geometries in
simulation. Update on the status of usage of the new conditions database
architecture Plan to incorporate schema evolution for calorimeter data
classes. Plans and follow up from the Commissioning Expert Week Defining a series of readiness notes for Calorimeter
performance. These notes are to be completed in one year time ensuring the calorimeter software is ready for data taking.
Defining a procedure to nominate speakers for upcoming conferences.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
U.S. ATLAS Project and Research Program Management
BNL is the Host Lab for the 33 U.S. institutions in ATLAS We have (almost) constant reviews We are active in the transition from a successful Construction
Project to the Research Program which includes: Construction Project achieve CD-4A Sept. 30, 2005 – 97% +
Complete M&O – consisting of pre-operations and commissioning
Highlight LAr M&O Technical Coordination and New Upgrade Project Office
Computing: Highlight PanDa and Service Challenge 4 Upgrade R&D: Highlight StripPixel
We are responsible for (monthly and quarterly) reports, budgets, MOUs, and other exercises
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Research Program Organization
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Safety David Lissauer (BNL) is the leader of the ATLAS Technical Coordination (TC)
Project Office (Activity A). The Project Office includes the ATLAS GLIMOS and therefore David participates in formal and informal meetings on safety issues.
Many U.S. leaders are involved in the preparation of many of the Work Packages which address risks and mitigation as well as training requirements.
There is a safety professional stationed in the Cavern, who is independent of ATLAS. He spends full time supervising all operations and looks for ways to reduce risk as well as enforcing safety rules - such as the wearing of required safety clothing.
Recently, ATLAS TC has applied the same procedures used in the Cavern to other areas where ATLAS work is being done - such as building 180. There is a Territorial Safety Officer (TSO) for each area who is a member of ATLAS TC. The TSO is responsible in these other locations and performs the same functions as 4) above.
We have tasked Steve Kane, who is our U.S. ATLAS Project Engineer and a certified safety professional, to review all ATLAS Work Packages (WP) where any U.S. worker could be involved. The purpose of the WP review will be to recommend what U.S. actions might be necessary, and alert the U.S. ATLAS Research Program Manager and Deputy Research Program Manager of the issues which need to be dealt with. The Deputy will interact with CERN and ATLAS management as appropriate to deal with the issues and follow up with the U.S. ATLAS Level 2 Managers and institutional representatives whose workers will be affected.
The review will include requirements for any additional safety training for U.S. workers.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
LAr FEBs and Power Supply System
LVPS locationon the Barrel Cal.
Front End Boards (FEB) in System Crates
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
FEB Production @ BNL(updated April 2006)
Assembly of analog components (PA, LSB) and cooling.
839 boards (>~50% of total production) Status: shortage of 25Ohm 5mA preamplifiers
prevented us from completion in Feb 2006. Missing about ~200 PAs (without counting spares).
Delivered to CERN: 830 boards All EMB boards delivered All EMEC boards delivered 9 FCAL board missing
Completion: June 06 Low Voltage DC/DC converters are now being
retrofitted and are working fine –
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
BNL LAr M&O Tasks
1. LVPS Commissioning2. Front-End Crate [FEC] Cooling Commissioning3. Front-End Detector Control System Commissioning
[DCS]4. Front-End Installation and Commissioning5. Cryostat and proximity service commissioning6. Cryogenics7. Databases8. Phase-III Analysis Commissioning
(David Lissauer will go into more detail on these points)
Topics
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Cathode Strip Chambers (CSC)
CSCs fabrication was completed at BNL in 2005 and sent to CERN.
At right is a chamber in its frame at CERN in pre-operation.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Technical Coordination (TC) organization
ATLAS management
C) Systems Construction
Liaison
E) Common systems
D) Electronics and Signal processing Ph. Farthouat
G) Logistics + experimental areas
INIGO-GOLFIN
H) Commissioning
activities
[spokesperson deputy spokesperson resources co-ordinator technical co-ordinator ]
TMB
(technical management board)
chairperson: M. Nessi
[activity managers, ATLAS management ]
A) TC Project Office. D. Lissauer
B) CERN Divisional Relations. M. Nessi
F1) IntegrationM. Hatch
F2)Installation
G. Tappern
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
US InvolvementUS Physicists Involved in TC:US Physicists Involved in TC:
D. LissauerD. Lissauer - TC Activity A, Placement Strategy (BNL)- TC Activity A, Placement Strategy (BNL)
M. ShupeM. Shupe - Radiation/Activation Studies (Arizona)- Radiation/Activation Studies (Arizona)
J. BensingerJ. Bensinger - Forward Muon Integration (Brandeis)- Forward Muon Integration (Brandeis)
B. StanekB. Stanek - - - Movements (ANL)- Movements (ANL)
M. SharpM. Sharp - Installation Data Base (Nevis@ CERN)- Installation Data Base (Nevis@ CERN)
TC Support @ CERN:TC Support @ CERN:
K. PommesK. Pommes Project Management – Eng.Project Management – Eng.
T. Klioutchnikova T. Klioutchnikova Senior Designer – Conf. ControlSenior Designer – Conf. Control
A. FoussardA. Foussard Installation Feet/Magnet. Installation Feet/Magnet.
BNL:BNL:
S. NortonS. Norton Senior Designer – Conf. ControlSenior Designer – Conf. Control
A. GordeevA. Gordeev Engineer – AccessEngineer – Access
J. FarrellJ. Farrell DesignerDesigner
ANL:ANL:
J. Grudzinski J. Grudzinski Movements/FEA Calc. Movements/FEA Calc.
LBL:LBL:
E. AndersonE. Anderson Pixel/Beam Interface.Pixel/Beam Interface.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Upgrade Project Office (PO) (D. Lissauer, head)
1. ATLAS upgrade PO is being established to implement the ATLAS organization for the upgrade R&D.
• Planning, Review, Configuration Control, Safety, Infrastructure Services, Integration
2. Resources from the collaboration will be needed to fill key positions in the upgrade plan. (As manpower become available in the institutions please contact us to see how best to integrate the effort – especially from outside institutions)
3. The PO will play an active role in maintaining the R&D focused on the ATLAS upgrade needs.
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Tracking R&D for Upgrade
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
New Software Project: Panda PanDA – Production and Distributed Analysis system Project started Aug 17, 2005 Baby Panda growing! New system developed
by U.S. ATLAS team Rapid development from scratch Leverages DC2/Rome experience
Lack of scalability Inspired by Dirac & other systems: pilot jobs in each site Already in use for CSC production in the U.S. Better scalability/usability compared to DC2 system Will be available for distributed analysis users in few months
One-stop shopping for all ATLAS computing users in U.S. Co-leader: T. Wenaus
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
US ATLAS Tier 1 Service Challenge Participation
BNL’s current connection is 20 Gb/s via ESNET – but not redundant
Need to insure ESNET upgrade in FY07
BNL Contributed to the Service Challenge 4 from the beginning
BNL is participating like other world centers.
BNL
H. Gordon , BNL DOE Annual HEP Program Review, April 18, 2006
Conclusions BNL is playing a leading role in U.S. ATLAS
and ATLAS overall: Physics Management Detector Construction/Technical
Coordination Installation Commissioning M&O
Computing Upgrade R&D
The erosion of the “Core Research” Program support prevents us from reaching our full potential BNL has little flexibility