GridPP15 – January 2006GridPP15 – January 2006

LCG Computing:LCG Computing:From Now until StartupFrom Now until Startup

Jamie Shiers, LCG Service ManagerJamie Shiers, LCG Service Manager

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Agenda

Timeline from now until LHC startup

Summary of current status

List of key actions

Step by step goals from now until startup

(Some) Concerns

Summary & Conclusions

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

LHC Startup

Startup schedule expected to be confirmed around March 2006

Working hypothesis remains ‘Summer 2007’ Update from Council next

Lower than design luminosity & energy expected initially

But triggers will be opened so that data rate = nominal

Machine efficiency still an open question – look at previous machines???

Current targets: Pilot production services from May 2006 Full production services from end September 2006 Ramp up in capacity & throughput to TWICE NOMINAL by April 2007

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

From December Council Meeting

Enormous progress since 2004…

We still maintain our plan to have first collision (sic) in 2007

Experiments will be ready to take data in 2007

(Some details on specific detectors etc.)

…

Service Challenges going rather well(!) (Jos Engelen - Service Challenges going rather well(!) (Jos Engelen - SPC)SPC)

LHCC Referees agree – SCs are vital & are going well.LHCC Referees agree – SCs are vital & are going well.

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

LHC Commissioning

Expect to be characterised by:

Poorly understood detectors, calibration, software, triggers etc.

Most likely no AOD or TAG from first pass – but ESD will be larger?

The pressure will be on to produce some results as soon as possible!

There will not be sufficient resources at CERN to handle the load

We need a fully functional distributed system, aka Grid

There are many Use Cases we did not yet clearly identify

Nor indeed test --- this remains to be done in the coming 9 months!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Service Challenge 4 (SC4)

Service Challenge 4 results in the initial WLCG Production Service ™

It tests / validates all remaining offline Use Cases of the experiments including ones we didn’t fully define yet

February (T1) and June (T2) workshops

Including any hanging over from SC3

‘dteam’ T0-T1 throughput demonstration – April 2006

VO production validation – May to September 2006

So what did we achieve in SC3 and what is left over?

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)SC3 Goals

Much more than just a throughput test!Much more than just a throughput test!

More data management services: SRM required at all sites Reliable File Transfer Service based on gLite FTS LFC file catalog deployed as required

Global catalog for LHCb, site local for ALICE + ATLAS [ Other services as per BSWG ]

More sites: All Tier1s took part – this was better than foreseen! Many Tier2s – now above 20 sites, covering most regions. This too is working well! Workshops held in many countries / regions (T1 + T2s + experiments) – this should

continue! UK, Italy, France, Germany, Asia-Pacific, North America, Nordic region, … (A-P w/s early May 2006; North American w/s around September GDB???)(A-P w/s early May 2006; North American w/s around September GDB???)

All experiments: Clear goals established together with metrics for measuring success List of issues has been summarised by Nick Brook – many issues already resolved

Throughput targets: 50% higher than SC2 but using SRM & FTS as above (150MB/s to disk at T1s) 60MB/s to tape at Tier1s (following disk – disk tests) Modest T2->T1 targets, representing MC upload (3 x 1GB file / hour)

Activities kicked off to address these issues weresuccessful

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

SC3 Throughput Tests

Unfortunately, July Throughput Tests did not meet targets

Compounded by service instability

Continued through to the end, i.e. disk – disk, disk – tape and T2 – T1 components

Spent most of August debugging and fixing

dCache workshop held in DESY identified concrete actions / configurations / dCache improvements

Improvements also in CASTOR SRM & gLite FTS

All software upgrades now released & deployed

Disk – disk rates obtained in July around 1/2 target, without stability!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Disk – Disk Rates (SC3 Repeat)

These are the nominal data rates capped at 150MB/s (200MB/s) Disk-tape re-run agreed at December 6th MB

Centre ALICE ATLAS CMS LHCb

Target Data Rate

MBytes/sec(Site target)

Canada, TRIUMF X 50 (++)

France, CC-IN2P3 X X X X 150 (100?)

Germany, GridKA X X X X 150

Italy, CNAF X X X X 150

Netherlands, NIKHEF/SARA X X X 150

Nordic Data Grid Facility X X X 50

Spain, PIC Barcelona X X X 100 (30)

Taipei, ASGC X X 100 (75)

UK, RAL X X X X 150

USA, BNL X 150

USA, FNAL X 150

January 2006

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)SC3 Services – Lessons

(re-)Learnt It takes a L O N GL O N G time to put services into (full) production

A lot of experience gained in running these services Grid-wide

Merge of ‘SC’ and ‘CERN’ daily operations meeting has been good

Still need to improve ‘Grid operations’ and ‘Grid support’Still need to improve ‘Grid operations’ and ‘Grid support’

A CERN ‘Grid Operations Room’ needs to be established

Need to be more rigorous about: Announcing scheduled downtimes; Reporting unscheduled ones; Announcing experiment plans; Reporting experiment results; Attendance at ‘V-meetings’; …

AA daily OPS ‘meeting’ is foreseen for LHC preparation / daily OPS ‘meeting’ is foreseen for LHC preparation / commissioningcommissioning

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Weekly Con-calls

Will continue at 16:00 Geneva time on Mondays

Will start with:

Summary of last week’s operational issues gleaned from various sources

Summary of each experiments’ activities ditto Outlook for coming week (or two…)

Other topical issues, such as SC3 setup / status, SC4 preparation …

+41227676000 access code 0164222

Or have system call you (see SC Web page)…

Minutes will go to service-challenge-info@cern.ch & MB

CERN - Computing Challenges 20

Status & Outlook Results of 2005

• 3 Challenges undertaken with varying degrees of success• Major issue is failure to meet SC3 T0-T1 throughput targets• Re-run disk-disk tests in January 2006 (demonstrate stability + twice the rate achieved in July)

• All T1s, >20 T2s in all regions and all experiments involved• Grid Services & VO variations now well understood & deployed

Plans for 2006• Ramp up T0-T1 transfer rates to full nominal rates (to tape)• Identify and validate all other production data flows (Tx - Ty)• Increase T2 participation from 20 (April) to 40 (September)• Broaden focus from production to analysis (many more users)• Streamline Operations & User Support building on existing efforts• FULL production services! FULL functionality!• Quantitative monitoring: service level vs MoU + requirements

Significant progress acknowledged by LHCC referees!and CERN SPC!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

SC4 – Service Validation

[ Identification of key Tierx Tiery data transfers ] “dteam validation” – aka “Throughput Phase” Validation by experiment productions [ Service improvement ]

Full demonstration of experiment production Full chain – data taking through to analysis! Expansion of services from production to general

users

Ramp-up in number of sites; service level Ramp-up in compute / storage / throughput capacity

Accompanied by agreed monitoring of actual and historical service level delivery

Repeat as required

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)Currently Scheduled Throughput

Tests January 2006 – rerun of SC3 disk – disk transfers (max 150MB/s)

All Tier1s – rates have been confirmed – ramp-up has started

February 2006 – rerun of SC3 disk – tape transfers (50MB/s – was 60MB/s in July)

Sites should allocate 5 current generation drives and understand issues involved

March 2006 – T0-T1 “loop-back” tests at 2 x nominal rate CERN, using new tape technology and corresponding infrastructure

April 2006 – T0-T1 disk-disk (nominal rates) disk-tape (50-75MB/s) All Tier1s – disk rates at BNL, FNAL, CNAF, FZK, IN2P3 go up to 200MB/s

July 2006 – T0-T1 disk-tape (nominal rates) All Tier1s – rates 50 – 200MB/s depending on VOs supported & resources provided

T1-T1; T1-T2; T2-T1 and other rates TBD according to CTDRs All Tier1s; 20 – 40 Tier2s; all VOs; all offline Use Cases

Still significant work ahead for experiments, T0, T1s and T2s!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)SC4 Use Cases – Finalise by

CHEP!Not covered so far in Service Challenges:

T0 recording to tape (and then out)

Reprocessing at T1s

Calibrations & distribution of calibration data

HEPCAL II Use Cases

Individual (mini-) productions (if / as allowed)

Additional services to be included:

Full VOMS integration

COOL, other AA services, experiment-specific services (e.g. ATLAS HVS)

PROOF, xrootd, … (analysis services in general…)

Testing of next generation IBM and STK tape drives

SC4 Workshop:

1. Data Management2. Grid Services3. Expt. Use Cases

Define Key Use Cases& Milestones for SC4.

From July PEB/GDB

(Some) Challenges Ahead

Middleware & Storage Management enhancements,

Identification & Testing of additional Use Cases,

…

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Middleware Enhancements

A compilation of enhancements requested by the experiments has been compiled by Flavia Donno from Task Force Discussions

See https://uimon.cern.ch/twiki/bin/view/Main/SummaryOpenIssues

These cover 12 (TWELVE) categories(!)

Being prioritised by experiments and discussed with TCG (and more)

The delivery, deployment and hardening of all of these will take a good fraction of 2006!

Some can be ‘pre-viewed’ via pilot(s) services – e.g. FTS

Will require coordination across M/W and/or DM components + site roll-out

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Middleware Categories

1. Security, authorization, authentication

2. Information System

3. Storage Management

4. Data Management

5. Workload Management

6. Monitoring Tools

7. Accounting

8. Applications

9. Deployment Issues

10.Operations

11.CASTOR

12.Miscellaneous

See https://uimon.cern.ch/twiki/bin/view/Main/SummaryOpenIssues

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Service Roll-out

How will these services be upgraded across sites?

Slots for enhancements strictly limited

SC4 startup – software must be available now

Mid-year upgrade? End-year upgrade?

Must identify which specific items will be delivered in these named service upgrades and have a clear roll-out path

c.f. ‘pilot’ services in SC3

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

TierN Services- TBCService VOs Tiers

SRM 2.1 All VOs 0,1,2

LFC LHCb 0

LFC ALICE, ATLAS 0,1,2

FTS ALICE, ATLAS, LHCb, (CMS) 0,1

CE All VOs 0,1,2

RB 0, (1?)

Global BDII 0

Site BDII 0,1,2

Myproxy 0

VOMS 0

R-GMA 0,1,2

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Experiment View

Master catalogue of services – at least level of detail of Flavia’s document (https://uimon.cern.ch/twiki/bin/view/LCG/SummaryOpenIssuesTF)

Define clearly new functionality options, specific performance goals as necessary

SC4 Planning for experiment

Service listno. service name catalogue ref. new functionality required performance

1 CASTOR 2 SRM link relative paths, pin/unpin 750 MB/sec recording at CERN2 VOMS link automatic proxy renewal3 DPM link VOMS groups and roles4 DPM SRM link space reservation5 dCache SRM (i) link relative paths, pin/unpin6 dCache SRM (ii) link space reservation....42 FTS Tier-0/1 service link see perfomance table by site43 FTS Tier-1/2 service link see perfomance table by site..

Les Robertson

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Additional Use Cases

The focus so far has been very much on first pass processing and associated data distribution

Some discussion on reprocessing has started recently

Goal of Mumbai workshop is to establish these Use Cases as well as the corresponding requirements in terms that are accessible to sites

Will have to define clear milestones and schedule associated with these!

Some ideas follow… (ATLAS, CMS, GridPP, …)

‘Pictorial’ Computing Models (LHCb) extremely valuable!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

ATLAS Data Processing Tier-0:

First pass processing on express/calibration physics stream 24-48 hours later, process full physics data stream with reasonable calibrations These imply large data movement from T0 to T1s

Tier-1: Reprocess 1-2 months after arrival with better calibrations Reprocess all resident RAW at year end with improved calibration and software These imply large data movement from T1 to T1 and T1 to T2

1/10 of RAW data and derived samples Shadow the ESD for another Tier-1 (e.g. 2/10 of whole sample) Full AOD sample Reprocess 1-2 months after arrival with better calibrations (to produce a

coherent dataset) Reprocess all resident RAW at year end with improved calibration and

software Provide scheduled access to ESD samples

Tier-2s Provide access to AOD and group Derived Physics Datasets Carry the full simulation load

Eric Lançon, 1Eric Lançon, 1erer Colloq LCG.FR Colloq LCG.FR

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

CMS Tier1 – Tier1 Transfers

In the CMS computing model the Tier-1 to Tier-1 transfers are reasonably small.

The Tier-1 centers are used for re-reconstruction of events so Reconstructed events from some samples and analysis objects from all samples are replicated between Tier-1 centers.

Goal for Tier-1 to Tier-1 transfers:

FNAL -> One Tier-1 1TB per day February 2006 FNAL -> Two Tier-1's 1TB per day each March 2006 FNAL -> 6Tier-1 Centers 1TB per day each July 2006 FNAL -> One Tier-1 4TB per day July 2006 FNAL -> Two Tier-1s 4TB per day each November 2006

Ian Fisk1 day = 86,400s ~105s

ATLAS – 2 copies of ESD?

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

CMS Tier1 Tier2 Transfers Transfers in the computing model to the Tier-2 centers are larger.

Imports are performed from a limited number of Tier-2 centers performing simulation that needs to be archived at the Tier-1 and backing up to tape user data from supported Tier-2 centers.

Exports are performed to all Tier-2 centers

CTDR estimate for aggregate rate from FNAL to all Tier-2 centers in 2008 is 3.5Gb/s sustained

CDTR estimate for aggregate rate for import rate to FNAL from simulation and supported Tier-2 centers 3.5Gb/s sustained

Goal in 2006 is 800Mb/s into FNAL from US Tier-2s Goal is 2006 is 800Mb/s total to all Tier-2s

Currently CMS has 13 Tier-2 centers capable of receiving data at reasonable scale. 20 Tier-2s are predicted by the end of the 2006

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

CMS Tier1 Tier2 Rates

Import Rates: 1 US Tier-2 -> FNAL 2TB per day February 2006 2 US Tier-2 -> FNAL 2TB per day each March 2006 All US Tier-2s -> FNAL 1TB per day each July 2006

(7TB per day) 2 US Tier-2 -> FNAL 5TB per day November 2006

(10TB per day)

Export Rates: FNAL -> 20% of Tier-2 centers 1TB per day each February 2006

(3TB per day total) FNAL -> 50% of Tier-2 centers 1TB per day each July 2006

(10TB per day total) FNAL -> 20% of Tier-2 centers 5TB per day each November 2006

(20TB per day total)

38

SC4 milestones (1)

SRM• 80% of sites have working (file transfers with 2 other sites successful) SRM by end of

December• All sites have working SRM by end of January• 40% of sites (using FTS) able to transfer files using an SRM 2.1 API by end Febraury• All sites (using FTS) able to transfer files using an SRM 2.1 API by end March• Interoperability tests between SRM versions at Tier-1 and Tier-2s (TBC)

FTS• FTS channel to be created for all T1-T2 connections by end of January• FTS client configured for 40% sites by end January• FTS channels created for one Intra-Tier-2 test for each Tier-2 by end of January• FTS client configured for all sites by end March

39

SC4 milestones (2)

Tier-1 to Tier-2 Transfers (target rate 300-500Mb/s)• Sustained transfer of 1TB data to 20% sites by end December• Sustained transfer of 1TB data from 20% sites by end December• Sustained transfer of 1TB data to 50% sites by end January• Sustained transfer of 1TB data from 50% sites by end January• Peak rate tests undertaken for the two largest Tier-2 sites in each Tier-2 by end

February• Sustained individual transfers (>1TB continuous) to all sites completed by mid-March• Sustained individual transfers (>1TB continuous) from all sites completed by mid-

March• Peak rate tests undertaken for all sites by end March• Aggregate Tier-2 to Tier-1 tests completed at target rate (rate TBC) by end March

Tier-2 Transfers (target rate 100 Mb/s)• Sustained transfer of 1TB data between largest site in each Tier-2 to that of another

Tier-2 by end February• Peak rate tests undertaken for 50% sites in each Tier-2 by end February

40

SC4 milestones (3)

LFC• LFC document available by end November• LFC installed at 1 site in each Tier-2 by end December• LFC installed at 50% sites by end January• LFC installed at all sites by end February• Database update tests (TBC)

VO Boxes (depending on experiment responses to security and operations questionnaire and GridPP position on VO Boxes)

• VOBs available (for agreed VOs only) for 1 site in each Tier-2 by mid-January• VOBs available for 50% sites by mid-February• VOBs available for all (participating) sites by end March

Experiment specific tests TBC• To be developed in conjunction with experiment plans

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Pre-CHEP Workshop

Data Management LCG OPN

FTS -requirements from sites

DPM / LFC – ditto

CASTOR2/SRM

dCache

Services & Service Levels

Checklist

Deployment issues

Monitoring and reporting

Service levels by site / VO

SC4 Use Cases By Experiment By Project

ARDA, ROOT, PROOF, xroot etc.

Understand data rates and flows.

Translate to services / requirements for Tier1s in particular.

February 10 – 12 Mumbai. Focus on Tier1 Issues, such as Reprocessing, Production of Calibrations, Analysis Subsets etc.

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)June 12-14 2006 “Tier2”

Workshop Focus on analysis Use Cases and Tier2s in particular

List of Tier2s reasonably well established

Try to attract as many as possible!

Some 20+ already active – target of 40 by September 2006!

Still many to bring up to speed – re-use experience of existing sites!

Important to understand key data flows How experiments will decide which data goes where Where does a Tier2 archive its MC data? Where does it download the relevant Analysis data? The models have evolved significantly over the past year!

Two-three day workshop followed by 1-2 days of tutorials

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

WLCG Service Coordination Weekly con-calls involving all Tiers plus experiments

1. On-going experiment usage of WLCG Services2. Issues related to setting up and running WLCG ServicesThese are now held on Monday, after EGEE hand-over call

Quarterly WLCG Service Coordination Meetings All Tier1s, main Tier2s, … minutes, agenda etc, material circulated in

advance…From December WLCG SCM, this might be too frequent at this stage…But this is the date by which the ‘plan’ should be agreed…

Bi-annual Service workshops One at CERN (April / May?), one outside (September – October?) Easter 2006 is April 14 – 17Subsumed by June T2 workshop proposal

Thematic workshops, site visits as required Each Tier1 visited once per quarter(?)

(Combined with other events where appropriate) Regular 1-1 Video Meetings

[ Fortnightly Tier0 Service Coordination meetings held at CERN ]

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

WLCG - Major Challenges Ahead1. Get data rates at all Tier1s up to MoU Values

Stable, reliable, rock-solid services We are currently about 1/2 the target level, without including

tape

2. Re-deploy Required Services at Sites to meet MoU Targets Measured, delivered Availability; maximum intervention time etc. Ensure that the services provided match the experiments’

requirements

T0 and T1 services are tightly coupled! Particularly during accelerator operation

Need to build strong collaborative spirit to be able to deliver required level of services

And survive the inevitable ‘crises’…

(These are not the only issues – just the top two!)

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

SC4 – Transfer Rate Plan Split Transfer Tests into Separate Steps

1. Rerun of SC3 Throughput in January 20062. Tier0 – Tier1 “loop-back” tests to new tape h/w by March 2006

Target is twice maximum nominal rate, i.e. 400MB/s3. Tier0 – Tier1 transfers at full nominal rate (disk – disk) April 20064. Tier0 – Tier1 transfers scaled to current h/w (disk – tape) April 20065. Tier0 – Tier1 transfers at full nominal rate (disk – tape) July 2006

Needs to be coordinated with site acquisition plans

Identify additional data flows & rates and establish corresponding milestones

There is already material on this in the TDRs and in a number of presentations by the experiments

Need to clearly explain these together with Tier1s / Tier2s Sites often have ‘local’ experts!

Pre-CHEP workshop has one day dedicated to this! (10 – 12 February, Mumbai)

We are also working proactively with the sites on Throughput issues Using all available opportunities! e.g. FZK workshop, GridPP15, 1er Colloq.FR

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Centre ALICE ATLAS CMS LHCb Rate into T1 (pp)MB/s

ASGC, Taipei - 8% 10% - 100

CNAF, Italy 7% 7% 13% 11% 200

PIC, Spain - 5% 5% 6.5% 100

IN2P3, Lyon 9% 13% 10% 27% 200

GridKA, Germany 20% 10% 8% 10% 200

RAL, UK - 7% 3% 15% 150

BNL, USA - 22% - - 200

FNAL, USA - - 28% - 200

TRIUMF, Canada - 4% - - 50

NIKHEF/SARA, NL 3% 13% - 23% 150

Nordic Data Grid Facility

6% 6% - - 50

Totals - - - - 1,600

Disk – Disk Rates (SC4 part 1)

April 2006

These are the nominal values based on Computing TDRswith rates weighted by agreed resource allocation / VO.

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)Disk – Tape Rates (SC4 part 1)

Still using SRM 1.1 & Current Tape Technology?

Centre ALICE ATLAS CMS LHCb Target Data Rate MB/s

Canada, TRIUMF X 50

France, CC-IN2P3 X X X X 75

Germany, GridKA X X X X 75

Italy, CNAF X X X X 75

Netherlands, NIKHEF/SARA X X X 75

Nordic Data Grid Facility X X X 50

Spain, PIC Barcelona X X X 75

Taipei, ASGC X X 75

UK, RAL X X X X 75

USA, BNL X 75

USA, FNAL X 75

April 2006

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Centre ALICE ATLAS CMS LHCb Rate into T1 (pp)MB/s

ASGC, Taipei - 8% 10% - 100

CNAF, Italy 7% 7% 13% 11% 200

PIC, Spain - 5% 5% 6.5% 100

IN2P3, Lyon 9% 13% 10% 27% 200

GridKA, Germany 20% 10% 8% 10% 200

RAL, UK - 7% 3% 15% 150

BNL, USA - 22% - - 200

FNAL, USA - - 28% - 200

TRIUMF, Canada - 4% - - 50

NIKHEF/SARA, NL 3% 13% - 23% 150

Nordic Data Grid Facility

6% 6% - - 50

Totals - - - - 1,600

Disk – Tape Rates (SC4 part 2)

July 2006Have to ramp up to twice this rate prior to April 2007!(See LCG TDR).

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Summary of Events

February 2006 – pre-CHEP workshop, MumbaiFocus on reprocessing and other Tier1 activities

March 2006 – ‘middleware workshops’, CERN

June 2006 – ‘Tier2 workshop’, CERN(?)Focus on Tier2 activities (particularly other than simulation)

Quarterly – WLCG Service Coordination MeetingsMonitor the service delivered, plan and coordinate

As required – site visits, regional & topical workshops

WLCG ‘conference’ sometime 6 – 9 months before CHEP 2007?

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Summary of Throughput Targets

Tier0 – Tier1 transfers tested January, February, April & July 2006

Tier1 – Tier1 and Tier1 Tier2 transfers identified February 2006 – milestones established by April 2006(?)

Essential that all transfers are fully validated by experiments

This should be a major goal of the productions from May – September 2006

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Timeline - 2006January SC3 disk repeat – nominal

rates capped at 150MB/sSRM 2.1 delivered (?)

July Tape Throughput tests at full nominal rates!(150MB/s for RAL)

February CHEP w/s – T1-T1 Use Cases, SC3 disk – tape repeat (50MB/s, 5 drives)

August T2 Milestones – debugging of tape results if needed

March Detailed plan for SC4 service agreed (M/W + DM service enhancements)

September LHCC review – rerun of tape tests if required?

April SC4 disk – disk (nominal) and disk – tape (reduced) throughput tests

October WLCG Service Officially opened. Capacity continues to build up.

May Start of SC4 productionTests by experiments of ‘T1 Use Cases’

November 1st WLCG ‘conference’All sites have network / tape h/w in production(?)

June ‘Tier2 workshop’ – identification of key Use Cases and Milestones for T2s

December ‘Final’ service / middleware review leading to early 2007 upgrades for LHC data taking??

O/S

Upg

rade

? S

omet

ime

befo

re A

pril

200

7!

Th

e L

HC

Com

puti

ng

Gri

d –

(Th

e W

orld

wid

e L

CG

)

Conclusions

A great deal of progress in less than one year…

Which is all we have left until FULL PRODUCTION

Focus now is on SERVICE

Service levels & functionality (including data transfers) defined in WLCG MoU

A huge amount of work by many people… Thanks to all!

(From CSO & LHCC Referees too!)