Slide Slide David Britton, University of Glasgow IET, Oct 09 1

Prof. David BrittonGridPP Project leaderUniversity of Glasgow

GridPP24 Collaboration Meeting14th April 2010

GridPP24 – Data!

Slide Slide

Data Arrives!

David Britton, University of Glasgow 3PPRP

Slide Slide

The Long Road…

David Britton, University of Glasgow GridPP24 4

24th GridPP Collaboration Meeting, RHUL, 14-15 April 2010 - Data.23rd GridPP Collaboration Meeting, University of Cambridge , 8-9 September 2009 – Final Steps22nd GridPP Collaboration Meeting, UCL, 1-2 April 2009 - Service Resilience21st GridPP Collaboration Meeting, Swansea University, 3-4 September 2008 - 21: Coming of Age20th GridPP Collaboration Meeting, Trinity College, Dublin, 11-12 March 2008 - Unreasonableness?19th GridPP Collaboration Meeting, Ambleside, 29-31 August 2007 – The end of (GridPP2) as we know it18th GridPP Collaboration Meeting, Glasgow, 20-21 March 200717th GridPP Collaboration Meeting, NeSC, Edinburgh, 1-2 November 200616th GridPP Collaboration Meeting, QMUL, 27-29 June 200615th GridPP Collaboration Meeting, RAL, 11-12 January 200614th GridPP Collaboration Meeting, University of Birmingham, 6-7 September 200513th GridPP Collaboration Meeting, Grey College Durham, 4-6 July 200512th GridPP Collaboration Meeting, Brunel, 31 January-1 February 200511th GridPP Collaboration Meeting, Liverpool, 14-15 September 200410th GridPP Collaboration Meeting, CERN, Geneva, 2-4 June 2004 9th GridPP Collaboration Meeting, NeSC, Edinburgh, 4-5 February 2004 8th GridPP Collaboration Meeting, Bristol, 22-23 September 2003 7th GridPP Collaboration Meeting, Oxford, 30 June-2 July 2003 6th GridPP Collaboration Meeting, Coseners House, 30-31 January 2003 5th GridPP Collaboration Meeting, Imperial College, 16-17 September 2002 4th GridPP Collaboration Meeting, Manchester, 9-10 May 2002 3rd GridPP Collaboration Meeting, Cambridge, 14-15 February 2002 2nd GridPP Collaboration Meeting, Edinburgh, 5-6 November 2001 1st GridPP Collaboration Meeting, Coseners House, 24-25 May 2001

383 PMB Meetings

Slide Slide

… to the Start!

David Britton, University of Glasgow GridPP24 5

Slide Slide

The Time is Now

David Britton, University of Glasgow GridPP24 6

Slide Slide

First Data

Tier-1 Review

RCUK International Review of e-Science

Tier-1 Opening

… and of course the GridPP4 proposal!

Since GridPP23

David Britton, University of Glasgow 7GridPP24

Slide Slide

First Data

David Britton, University of Glasgow GridPP24 8

From an Atlas presentation to wLCG MB

Slide Slide

Tier-1 Review

David Britton, University of Glasgow GridPP24 9

Third in a series of annual reviews of the Tier-1. Reviewers included three people from CERN.

It was noted that the weekly Tier-1/experiments meeting had enhanced communications.

The out-of-hour service had been successfully developed.

The excellent performance of RAL during STEP09 was noted.

The management processes had been successfully developed.

Many (but not all) of the problems last autumn were related to the new building R89.

The Tier-1 was encouraged to develop staff-agility to provide more cover.

Concerns were voiced about the CASTOR upgrade path (GridPP24 discussion).

Slide Slide

RCUK e-Science Review

David Britton, University of Glasgow 10

Report explicitly mentions:• GridPP’s expertise in large-scale distributed data management and analysis.• Our work with start-up companies.• The substantial secondary economic benefit arising from the ability to rapidly screen drugs "in-silico”. GridPP resources were used in this way to screen potential agents in the fight against bird-flu and malaria.

“NGS and GridPP have been highly successful, providing many users with access to more computing power than they could otherwise easily obtain. Looking forward, we recommend that these efforts, including enhanced capacity and function of distributed storage, be sustained and expanded.” RAL Tier-1

Slide Slide

Tier-1 Opening

David Britton, University of Glasgow GridPP24 11

Slide Slide

GridPP4 Time Line

David Britton, University of Glasgow GridPP24 12

Nov 5th – invitation to bid. Dec 10th – Face-to-face PMB to agree structure Dec 11th – CB meeting to agree structure Jan 15th – Face-to-face PMB to agree draft v6 Jan 21st – CB meeting to discuss v6. Jan 28th – Submission of draft to Oversight Committee Feb 4th – Meeting with Oversight Committee + STFC Feb 12th – Near-final draft incorporating feedback Feb 22nd – Final comments/typos/corrections done Feb 24th – Submitted! Mar 4th – Last possible submission date Apr 15th - PPRP May 14th – PPRP Visiting Panel.

12 Weeks

3 Weeks

Slide Slide

Proposal Structure

David Britton, University of Glasgow 13

WP-A: Tier-1 infrastructure and manpower;

WP-B: Tier-2 infrastructure and manpower;

WP-C: Grid deployment, operations and support;

WP-D: Experiment-specific technical support;

WP-E: Management team;

WP-F: Impact Plan (Economic Impact, Knowledge Transfer and Outreach)

WP-G: Travel and other costs.

In the midst of writing the proposal we were told to reduce the project by 20%. This was very complex but is now built into submitted document.

GridPP24

Slide Slide

Project Map

David Britton, University of Glasgow 14GridPP24

Slide Slide

Project Deliverables

David Britton, University of Glasgow RCUK e-Science Review 15

Slide Slide

Hardware Requirements

David Britton, University of Glasgow 16

LHC Schedule

Experiment

Computing Models

Global Resource

Requirements

UK Resource Requirement

s

Hardware Costings

UK Resource Request

Scrutiny by C-RSG (April 2010), CRRB, LHCC (May

2010).

UK Collaboration

sizes

A complex and evolving situation requiring constant management. Historically we have seen the integrated requirements are reasonably “good-and-improving” estimates of actual needs.

Experience with real data(March+ 2010)

Chamonix 2010 (Jan 2010)

GridPP24

Slide Slide

Hardware Scaling

David Britton, University of Glasgow 17

Tier-1 CPU Capacity

KSI2K vs Year Hardware requirements have increased exponentially – fortunately Moore’s Law has held true with about the same time constant.

Logarithmic scaleRAL CPU costs

Ramp for LHC start

~2-year Moore’s Law

GridPP24

Slide Slide

Hardware Costs

David Britton, University of Glasgow 18

Comparing predictions is even more difficult…

For CPU, there is a remarkably good (in fact, too-good) agreement between the CERN and GridPP predictions.

For Disk, factoring in different RAID strategies etc, estimates agree at about 5% level, which is better than the exchange-rate uncertainty alone.

Conclude: GridPP’s empirical approach leads to the same costing as an extensive top-down investigation of market and technology trends suggesting the Moore’s law assumption continues to be valid over the this time period.

27 pages

GridPP24

Slide Slide David Britton, University of Glasgow 19

The EGI/NGI Structure

EGI.euEGI.eu

EMIEMIEGI.inspire

EGI.inspire

European Framework-7 proposals

GridPP

NGSNGI

Operations

NGI Operations Coordinator

(John Gordon)

SecurityAccounting

and Monitoring

Training/

Outreach

Helpdesk and Regional Support

NGI Management Board

GridPP operates the largest scientific Grid in the UK and must ensure the UK NGI meets the needs of the large community we serve.

We have identified certain tasks that are absolutely required by GridPP and wLCG, which have wider UK applicability and would sensibly be done in close collaboration as part of a larger team within a UK NGI.

We have used this as a way to optimize our manpower, our leadership, and our influence in these areas. We believe that JISC is committed to funding an NGI at some level (signed up to EGI) but we have examined alternative scenarios and included in contingency.

GridPP24

Slide Slide

A UK NGI

David Britton, University of Glasgow RCUK e-Science Review 20

GridPP4

funded

NGS4 and EGI

funded

EGI not

funded

NGS4 not

funded

Slide Slide

Risks Register

David Britton, University of Glasgow 21

… 22 high level risks analysed in proposal.

Covered by:

W.A. (0.5 FTE)

WP-D Expt. Support

WP-C Data Man.

Old (atlas) building and other measuresTier-2 strategy

W.A. (0.5 FTE)

WP-C security team

WP-C security team

W.A. (1.0 FTE)

GridPP24

Slide Slide

Risks Register - 2

David Britton, University of Glasgow 22PPRP

These risks are covered by the Contingency

Slide Slide

Publications

David Britton, University of Glasgow 23

Maintain a list of publications (best-effort basis, so incomplete) on the GridPP website at: http://www.gridpp.ac.uk/papers/.

Currently 220 publications (2001 – 2009).

2009 papers: 22 papers,105 (~70 unique) authors

GridPP24

Slide Slide

In Summary

David Britton, University of Glasgow 24PPRP