d. britton gridpp status - projectmap 22/feb/06. d. britton22/feb/2006gridpp status gridpp2...

D. Britton

GridPP Status - ProjectMap22/Feb/06

22/Feb/2006 GridPP Status D. Britton

GridPP2 ProjectMap

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.10 0.11 0.12 0.13 0.14 0.15 0.16 0.17 0.100 0.101 0.102 0.103 0.104 0.105 0.106 0.107 0.108 0.109 0.110 0.111 0.112 0.113 0.114 0.115 0.116

0.18 0.19 0.20 0.21 0.22 0.23 0.24 0.25 0.26 0.27 0.28 0.29 0.30 0.31 0.32 0.33 0.34 0.117 0.118 0.119 0.120 0.121 0.122 0.123 0.124 0.125 0.126 0.127 0.128 0.129 0.130 0.131 0.132 0.133

0.35 0.36 0.37 0.38 0.39 0.40 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.50 0.51 0.134 0.135 0.136 0.137 0.138 0.139 0.140 0.141 0.142 0.143 0.144 0.145 0.146 0.1470.52 0.53 0.54 0.55 0.56 0.57 0.58 0.59 0.60 0.61 0.62

2.1 3.1 4.1 5.1 6.1

1.1.1 1.1.2 1.1.3 1.1.4 2.1.1 2.1.2 2.1.3 2.1.4 2.1.5 3.1.1 3.1.2 3.1.3 3.1.4 3.1.5 4.1.1 4.1.2 4.1.3 4.1.4 4.1.5 5.1.1 5.1.2 5.1.3 5.1.4 5.1.5 6.1.1 6.1.2 6.1.3 6.1.4 6.1.5

1.1.5 2.1.6 2.1.7 2.1.8 2.1.9 2.1.10 3.1.6 3.1.7 3.1.8 3.1.9 3.1.10 4.1.6 4.1.7 4.1.8 4.1.9 4.1.10 5.1.6 5.1.7 5.1.8 5.1.9 5.1.10 6.1.6 6.1.7 6.1.8 6.1.9

2.1.11 2.1.12 3.1.11 3.1.12 3.1.13 4.1.11 4.1.12 5.1.11 5.1.12

2.2 3.2 4.2 5.2 6.2

1.2.1 1.2.2 1.2.3 1.2.4 2.2.1 2.2.2 2.2.3 2.2.4 2.2.5 3.2.1 3.2.2 3.2.3 3.2.4 3.2.5 4.2.1 4.2.2 4.2.3 4.2.4 4.2.5 5.2.1 5.2.2 5.2.3 5.2.4 5.2.5 6.2.1 6.2.2 6.2.3 6.2.4 6.2.5

1.2.5 2.2.6 2.2.7 2.2.8 2.2.9 2.2.10 3.2.6 3.2.7 4.2.6 4.2.7 4.2.8 4.2.9 4.2.10 5.2.6 5.2.7 5.2.8 5.2.9 5.2.10 6.2.6 6.2.7 6.2.8 6.2.9 6.2.10

2.2.11 2.2.12 2.2.13 2.2.14 2.2.15 4.2.11 4.2.12 4.2.13 4.2.14 4.2.15 5.2.11 5.2.12 5.2.13 5.2.14 5.2.15 6.2.11 6.2.12 6.2.13 6.2.14

2.3 3.3 4.3 6.3

1.3.1 1.3.2 1.3.3 2.3.1 2.3.2 2.3.3 2.3.4 2.3.5 3.3.1 3.3.2 3.3.3 3.3.4 3.3.5 4.3.1 4.3.2 4.3.3 4.3.4 4.3.5 6.3.1 6.3.2 6.3.3 6.3.4 6.3.5

2.3.6 2.3.7 2.3.8 2.3.9 2.3.10 3.3.6 3.3.7 3.3.8 3.3.9 3.3.10 4.3.6 4.3.7 4.3.8 4.3.9 4.3.10

2.3.11 3.3.11 3.3.12 3.3.13 4.3.11 4.3.12 4.3.13

2.4 3.4 4.4 6.4

2.4.1 2.4.2 2.4.3 2.4.4 2.4.5 3.4.1 3.4.2 3.4.3 3.4.4 3.4.5 4.4.1 4.4.2 4.4.3 4.4.4 4.4.5 6.4.1 6.4.2 6.4.3 6.4.4

2.4.6 2.4.7 2.4.8 2.4.9 2.4.10 3.4.6 3.4.7 3.4.8 3.4.9 3.4.10 4.4.6 4.4.7 4.4.8 4.4.9

2.4.11 2.4.12 2.4.13 2.4.14 2.4.15 3.4.11 3.4.12 3.4.13 3.4.14 3.4.15

2.5 3.5 60 Days2.5.1 2.5.2 2.5.3 2.5.4 2.5.5 3.5.1 3.5.2 3.5.3 3.5.4 3.5.5

2.5.6 2.5.7 2.5.8 2.5.9 2.5.10 3.5.6 3.5.7 3.5.8 3.5.9 Monitor OK 1.1.1 2.5.11 Monitor not OK 1.1.1 Milestone complete 1.1.1

2.6 3.6 Milestone overdue 1.1.1

2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 3.6.1 3.6.2 3.6.3 3.6.4 3.6.5 Milestone due soon 1.1.1

2.6.6 2.6.7 2.6.8 2.6.9 2.6.10 3.6.6 3.6.7 3.6.8 3.6.9 3.6.10 Milestone not due soon 1.1.1

2.6.11 2.6.12 2.6.13 Item not Active 1.1.1

Workload

6

1.2

Development

Dissemination

Project Execution

BaBarMetadata

Storage

2 3

Knowledge Transfer

LHCb

GANGA

ATLAS

InteroperabilitySamGrid

Engagement

Production Grid Milestones Production Grid Metrics

1LCG External

4M/S/N

5Non-LHC Apps Management

Navigate downExternal link

PhenoGrid

LHC Apps

1.1

1.3

Security

InfoMon

Design

Service Challenges

Other Link Network LHC Deployment

Project Planning

CMS

Portal

Status Date - 31/Dec/05 + next

UKQCD

Update

Clear

Metric OK

Metric not OK

Tasks Complete

Tasks Overdue

Tasks due in next 60 days

Items Inactive

Tasks not Due

Change Forms

88

(91%)

9 103

(40%)

7 16 20 132 37


Metrics

88 are currently satisfied; the 9 below are not:

0.105: Number of LCG/EGEE jobs slots used. 0.106: GridPP KSI2K available.0.108: GridPP disk storage available: 0.131: Tier-1 service disaster recovery plans up to date.0.140: Training needs addressed.0.141: GridPP Helpdesk functioning adequately.5.2.4: Tier-2 Hardware realization.5.2.7: Quarterly reports received within 1 month of end of

quarter.5.2.13: Number of UB meetings

Shortage of Hardware (wrt planning): This reflects the slower than planned ramp-up of resources at the institutes. This is improving (Tier2 report). Usage is low.


Milestones

A total of 258 active milestones; 103 (40%) have been completed; there are 7 milestones overdue:

0.37: Full Tier-1 Team in place (2 posts advertised).

0.49: Tier-2 storage accessible via SRM interface. (Almost, but not quite all).

0.54: GridPP accounting data accessible. (This is largely available).

0.59: GridPP able to monitor networks to all supported sites. (Being rolled out).

1.3.3 and 5.1.10: International MoU with CERN (We believe that this is close!) 6.2.6: First stage connection of GridPP sites to NGS: (This is partly complete.)


Change Forms

Thirty seven change forms have been submitted, reviewed, enacted.

Production Grid (7)Storage Group (2)WLMS (2)Security (4)InfoMon (2)

ATLAS (4)GANGA (1)LHCb (3)CMS (1)PhenoGrid (2)LCG deployment (1)SAM (7)UKQCD (1)


Risk Register

R10-Apps: External middleware dependence.

R22-LCG, R22-Apps, R22-PRO: Hardware resources inadequate.

R32-PRO: Security inadequate to operate Grid.

R40-Apps: Lack of future funding.

Six high risks identified:ID Name

Li Im Risk Li Im Risk Li Im Risk Li Im Risk Li Im RiskR1 Recruitment/retention difficulties 2 2 4 2 2 4 2 2 4 2 2 4R2 Sudden loss of key staff 1 3 3 1 3 3 1 3 3 1 4 4R3 Minimal Contingency 2 2 4 1 2 2R4 GridPP deliverables late 1 3 3 2 3 6 3 2 6R5 Sub-components not delivered to project 1 2 2 2 3 6 2 3 6 2 3 6R6 Non take-up of project results 2 1 2 1 4 4 2 2 4 1 4 4R7 Change in project scope 1 1 1 2 2 4R8 Bad publicity 1 3 3 1 3 3 1 3 3 2 3 6R9 External OS dependence 3 1 3

R10 External middleware dependence 4 2 8 1 4 4 3 3 9 2 2 4R11 Lack of monitoring of staff 1 2 2 2 2 4 2 2 4 2 2 4R12 Withdrawal of an experiment 2 3 6 1 4 4R13 Lack of cooperation between Tier centres 2 2 4 1 4 4R14 Scalablity problems 1 2 2 2 2 4R15 Software maintainability problems 2 2 4 1 3 3 2 2 4 1 3 3R16 Technology shifts 1 2 2 2 3 6 2 3 6R17 Repitition of research 3 2 6R18 Lack of funding to meet LCG PH-1 goals 4 1 4R20 Conflicting software requirements 3 2 6 1 3 3R22 Hardware resources inadequate 3 3 9 4 3 12 3 3 9R25 Hardware procurement problems 3 2 6 2 3 6R26 LAN Bottlenecks 1 3 3R27 Tier-2 organisation fails 2 2 4

R28 Experiment Requirements not met 1 4 4R29 SYSMAN effort inadequate 2 3 6R30 Firewalls interfere with Grid 2 3 6R31 Inablility to establish trust relationshipsR32 Security inadequate to operate Grid 3 3 9R33 Interoperability 2 3 6R35 Failure of international cooperation 2 1 2R36 e-Science and GridPP divergence 1 3 3R37 Institutes do not embrace Grid 2 2 4R38 Grid does not work as required 4 2 8 4 2 8R39 Delay of the LHC 2 2 4R40 Lack of future funding 2 3 6 2 3 6 3 3 9R41 Network backbone failure 0 4 1R42 Network backbone bottleneck 2 2 4R43 Network backbone upgrade delay 1 4 4R44 Inadequate User Support 1 4 4Alt-i-r

Pro. GridGridPP LCG MSN Apps


Added Value

High Level Value added by GridPP

LCG 1 Enabling the start of the LCG Project

Mid

dlewar

e2 Generic Metadata Development.3 To provide common storage solutions for the UK.4 Test and validate the Workload Management system in the UK.5 Security in the Grid environment.6 Information Monitoring System.7 Network development.

Mid

dlewar

e

Applicat

ions 8 Integration of the LHC experiment applicationts.

9 Ganga Development.10 Integration with running experiments.11 Connecting with the Theory Community12 Grid PortalApplic

atio

ns

Infra

stru

cture 13 The Deployment Team

14 The Tier-2 structures15 The Tier-1 infrastructure16 Grid Support17 Service ChallengesIn

frast

ruct

ure

Coordin

atio

n 18 The GridPP Website19 The GridPP Identity20 Dissemination21 Management22 The largest Grid in the UK - GRIDPPCoord

inat

ion

The top six items (the order is not significant):1) The GridPP Identity 2) Enabling the LCG Project 3) Leading contributions to Grid Middleware

4) The Tier centre structures. 5) The Deployment team. 6) The UK Particle Physics Grid.

D. Britton

GridPP Status - Resources22/Feb/2006


GridPP Financial Summary

Category Sub-Cat FY01 FY02 FY03 FY04 FY05 FY06 FY07 Total CostLCG £0 £907,843 £2,379,162 £2,379,829 £0 £0 £0 £5,666,835Tier-1 Staff £62,045 £311,089 £513,625 £671,501 £763,045 £921,619 £410,135 £3,653,059Tier-1 Hardware £774,300 £602,366 £116,927 £820,535 £527,000 £996,000 £1,476,000 £5,313,128Tier-2 Staff £0 £0 £24,499 £293,881 £749,087 £1,051,215 £616,525 £2,735,207Tier-2 Hardware £0 £0 £0 £150,000 £49,000 £27,000 £0 £226,000Applications Staff £97,528 £668,448 £726,561 £776,943 £1,034,946 £1,081,376 £483,221 £4,869,024N/M/S Staff £561,819 £1,028,552 £1,203,242 £1,053,794 £890,950 £963,025 £477,777 £6,179,158Operations Managers £127,827 £243,448 £267,729 £294,056 £318,666 £329,170 £141,085 £1,721,981Operations Staff £0 £0 £0 £17,339 £138,621 £152,584 £61,147 £369,690Operations Travel £175,000 £182,733 £274,825 £268,493 £289,000 £296,000 £130,000 £1,616,051Operations Misc £113,000 £5,000 £45,195 £141,009 £10,000 £40,000 £15,000 £369,204

£1,911,519 £3,949,478 £5,551,766 £6,867,379 £4,770,316 £5,857,989 £3,810,890 £32,719,336£32,900,000

£74,423£255,087

TotalTotal PPARC funding

EU Travel RebateUnallocated Funds

Integrated GridPP1 + GridPP2 picture.


Unallocated Funds

• Unallocated Funds arose from:

• Lower average staff cost for FY04/05 at CCLRC (£61.1K compared to the planned value of £64.4K) This contributed £72K in total savings.

• Two vacant Tier-1 posts. This contributes £64.4K for each 6 month period. Table-1 includes this contribution up to the end of the 2005 calendar year.

• Application posts at Manchester (BaBar) and Bristol (Babar/WP6) ended early and funds were returned to the GridPP budget (£21,575 and £31,208, respectively).

• EU travel refunds (EDG and EGEE) with a total of £74,423 were received for travel originally paid by GridPP.

Propose to apply these funds to purchase additional Tier-1 hardware.


Future

Further funds of the order of £150K may become available in the future from the following sources:

• The average staff cost for CCLRC staff is now probably overestimated for FY05-FY07.

• The Tier-1 posts are presently being advertised but some additional savings will occur before these are filled.

• The projected FY05 travel out-turn (£283K) looks like it is close to the budgeted amount (£289K), but an EGEE-II travel funding for UK posts may return some amount.

• No expenditure is presently foreseen against £65K remaining on the GridPP consumables budget.


GridPP2 Post Summary

Work Area FTE Total Posts Unfilled

Application Interfaces 18.5 20 0

Middleware/Security/Networking 14.5 18 0

Tier-2 15 20 3 Note-1

Tier-1 13.5 13.5 2 Note-2

EGEE Infrastructure Support 4 4 0

Project Management Board 3.4 6 0

Operations 2.5 3 0

TOTAL 71.4 84.5 5

GridPP2 Funding

Note-1: Tier-2 security post; Tier-2 network post; Joint HP post.Note-2: Two Tier-1 posts currently advertised.


GridPP2 Effort Summary

Of planned Of actualGridPP and EU effort.

Of plannedGridPP and EU effort.

05Q4GridPP EU Other Total

Applications 100% #DIV/0! 25% 124%MSN 98% 91% 37% 132%Tier-1 78% #DIV/0! 32% 104%Tier-2 72% 95% 63% 128%

TOTAL 93% 93% 39% 129%

Cumulative to end of

Disclaimer: Numbers are indicative. There are many known effects that would need to be taken out to obtain precise statistics.


Travel Budget

The predicted outturn for financial year 2005 is £283K compared to a budget of £289K.


Resource Summary

• GridPP proposes to redirect £255K that is currently unallocated to address the anticipated shortage of Tier-1 hardware in 2007/8.

• The FY06 Tier-1 hardware budget remains at £996K. We note that the purchase must be initiated immediately in order to deploy the hardware needed this calendar year. We ask PPARC/OC for agreement to proceed with this.

• The project is in the steady-state with just a few vacant posts and with effort being delivered as anticipated.

d. britton gridpp status - projectmap 22/feb/06. d. britton22/feb/2006gridpp status gridpp2...

Documents