dr neil geddes cclrc head of e-science director of the uk grid operations support centre

19
Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Upload: redell

Post on 18-Jan-2016

27 views

Category:

Documents


0 download

DESCRIPTION

Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre. UK Core e-Science programme - Situation Today. National Grid Service. Level-2 Grid. * Leeds. Manchester *. * DL. * Oxford. RAL *. The Future According to Hey. N G S. UK Grid Operations - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Dr Neil Geddes CCLRC Head of e-Science

Director of the UK Grid Operations Support Centre

Page 2: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

UK Core e-Science programme - Situation Today

* LeedsManchester *

* OxfordRAL *

Level-2 Grid

National Grid Service

* DL

Page 3: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

The Future According to Hey

NGS

UK Grid OperationsSupport Centre

Page 4: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

NGS “Today”

Projectse-Mineralse-MaterialsOrbital Dynamics of GalaxiesBioinformatics (using BLAST) GEODISE projectUKQCD Singlet meson projectCensus data analysis MIAKT projecte-HTPX project.RealityGrid (chemistry)

Users LeedsOxfordUCLCardiffSouthamptonImperialLiverpoolSheffieldCambridgeEdinburghQUBBBSRCCCLRC.

InterfacesOGSI::LiteOGSI::LiteWSRF::LiteWSRF::Lite

Page 5: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

SRB serviceOGSA-DAI service

Page 6: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Also includes:

http://www.csar.cfs.ac.uk/256 Itanium2 processor SGI Altix512 processor Origin3800

•Thus, the NGS provides access to over 2000 processors, over 36TB of "data-grid"

capacity, common scientific applications and extensive data archives.

•Other resource providers anticipated to join in the future …

http://www.hpcx.ac.uk/Full installation = 1600 IBM p690+ Regatta processors currently 1236 processors

EMBL Nucleotide Sequences

NCBI, BLAST, EMBOSS, FASTA, Gaussian

Page 7: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

GOSC Roles UK Grid Services

National Services Authentication, authorisation, certificate management, VO management,

security, network monitoring, help desk + support centre. NGS Services

Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre.

NGS core-node Services CPU, (meta-) data storage, key software

Services to be coordinated with others (eg OMII, NeSC, LCG): Integration testing, compatibility & Validation Tests, User Management,

training

Administration: Policies and acceptable use SLA’s, SLD’s Coordinate deployment and Operations

Page 8: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

UKCampus

andother Grids

GOSC + ETF

• Core of GOSC built around experience in deploying and running National Grid Service (NGS)

– Support service

• Important to coordinate and integrate this with deployment and operations work in EGEE, LCG and similar projects.

– e.g. EGEE – low level services, CA, GOC, CERT...

• Focus on deployment and operations, NOT development.

OMII

ETF

NGSOther software sources Software with proven

capability & realistic deployment experience

‘Gold’ services

Prototypes &specifications

Feedback & future requirements

EGEE…

Deployment/testing/advice

Operations

Page 9: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

ETF• Registry

– A freely available UDDI implementation has been deployed/tested between 4 sites – Experience passed on to the GRIMOIRES OMII project.

• Secure Flocking of Condor– Condor pools at 4 sites have been flocked together, through firewalls– authentication through use of X.509 certifcates– OMII test bed

• Portals– Support access to the NGS.– Tied in with JISC VRE developments

• Evaluations– InnerGrid - Contractual issues delayed start - just started.– OMII – Start later this month– GT4 – Start later this month– gLite – start next month

Page 10: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Stuff We Don’t Do

• Run a repository• Develop software

– contribute to developments to influence/adapt cf “I’ve got one of those you can have. You just need to …”

• (Training – Edinburgh/NeSC are part of GOSC)• Extensive user hand-holding and app support

– Need the e-Science Centres– Priorities will be driven by users

Page 11: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

UofA

HPCx

UofD

GOSC

NGS Core Nodes: Host core services, coordinate integration, deployment and support+free to access resources for all VOs. Monitored interfaces + services

NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services

NGS Connected Sites: Integrated with NGS, support for some VO’sMonitored interfaces (+security etc.)

RAL Oxford

LeedsMan. CSAR

UofB

UofC

CommercialProvider

PSRE

Page 12: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

How do I Join ?

• Acceptable use and Security policies• Install required interfaces (~EGEE)

– VDT– EGEE CE and SE interfaces (and

Authorisation)– Monitoring and accounting

• Provide services as defined in your own SLD– Buys you representation at the board (?)

Page 13: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

GOSC Timeline

Q2 Q4 Q2 Q3Q1Q4Q3Q2Q1Q3

2004 20062005

EGEE gLite alpha release

gLite release 1

OMII release

NGS Expansion(Bristol, Cardiff…)

OGSA-DAI

WS plan

NGS ProductionService

NGS WS Service

EGEE gLite releaseOMII Release

NGS Expansion

WS2 plan

NGS WS Service 2

“Tomorrow”

Web Services based National Grid Infrastructure

Page 14: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

UK e-Infrastructure

LHC ISIS TS2HPCx + HECtoR

Regional and Campus grids

Users get common access, tools, information, Nationally supported services, through NGS

Integratedinternationally

VRE, VLE, IE

Page 15: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Core services to facilitate collaborative (grid) computing – run by GOSC

•Authentication (PKI X509)•Job submission/batch service•Resource brokering•Authorisation•Virtual Organisation management •Certificate management•Information service•Data access/integration services (SRB/OGSA-DAI/DQPS)•National Registry (of registry’s)•Data replication•Data caching•Grid monitoring•Accounting

UK e-Science Cert.gsi-ssh, globus-job-submit, condorGEDG-RBVOM/VOMSVOMS (+Grid3/EGEE)myProxy(++)BDII/Glue

? ETF ?? EGEE ?? EGEE ?EGEE/LCG + ETF +TeraGridEGEE/LCG/ETF/GGF

Web Services interfa

ces

Page 16: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

Timeline

Q2 Q4 Q2 Q3Q1Q4Q3Q2Q1Q3

2004 20062005

EGEE gLite alpha release

gLite release 1

OMII release

NGS Expansion(Bristol, Cardiff…)

OGSA-DAI

WS plan

NGS ProductionService

NGS WS Service

EGEE gLite releaseOMII Release

NGS Expansion

WS2 plan

NGS WS Service 2

Page 17: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

The End

Page 18: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre

NGS Status October 2004• All 4 cluster nodes (+HPC) operational

– Pre-Production 5th April– Production Service from September 1

• 120 registered users– 20 users registered since 1 September 2004– Not yet “full”

Page 19: Dr Neil Geddes  CCLRC Head of e-Science Director of the UK Grid Operations Support Centre