next steps

29
http://www.ngs.ac.uk http://www.grid- support.ac.uk http://www.eu- egee.org/ http:// www.pparc.ac.uk/ http:// www.nesc.ac.uk/ Next Steps Mike Mineter [email protected]

Upload: clark-estes

Post on 31-Dec-2015

19 views

Category:

Documents


0 download

DESCRIPTION

Next Steps. Mike Mineter [email protected]. Acknowledgements. Most slides are from GOSC / NGS: Stephen Pickles Neil Geddes Andy Richards. Goal of talk. Thus far the emphasis has been on what the NGS is, and how to use its core services. - PowerPoint PPT Presentation

TRANSCRIPT

http://www.ngs.ac.ukhttp://www.grid-support.ac.uk

http://www.eu-egee.org/http://www.pparc.ac.uk/http://www.nesc.ac.uk/

Next StepsMike Mineter

[email protected]

2

Acknowledgements

• Most slides are from GOSC / NGS:– Stephen Pickles– Neil Geddes– Andy Richards

3

Goal of talk

• Thus far the emphasis has been on what the NGS is, and how to use its core services.

• The goal of this talk is to ensure that intending users of the NGS know what support services and procedures are provided by GOSC.

4

Overview

• Story so far

• The Grid Operations Support Centre

• Joining the NGS

• More training??!

• Information sources

5

The story so far

• The National Grid Service is providing a production service

• It is a developing, dynamic service!– Core services in place: data, computation, portal– New middleware en route– More sites joining – International perspectives – EGEE, Teragrid

• Grid Operations Support Centre is poised to help you…

6

GOSC

The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme.

7

ETF

Audit Board

Management Board

Steering Committee

DirectorGOSC

Operations Board

Operations Manager/Technical Director

Development Manager

TRAININGOperations Board

Security NGSNetworking GOC GSC

USERS

8

GOSC Roles UK Grid Services

National Services Authentication, authorization, certificate management, VO management,

security, network monitoring, help desk + support centre. [email protected]

NGS Services Job submission, data transfer, data access and integration, resource

brokering, monitoring, grid management services, operations centre,… NGS core-node Services

CPU, (meta-) data storage, key software Services coordinated with others (eg OMII, NeSC, LCG):

Integration testing, compatibility & Validation Tests, User Management, training

Administration: Policies and acceptable use conditions Resource providers: service level agreements,… Coordinate deployment and Operations

9

• Access Grid• Certification• Condor• ETF• For Information• General• GT2• GT3• GT4• Globus-MDS• GridFTP

• Internal• Maillist• Myproxy• NGS• OGSA-DAI• Project Registration• RA• Security• SRB• Support Notices• Training• Unicore

10

Joining the NGS

• As– Users– Projects (VO’s)– Resource providers

11

End-users: what to do

• You need a current UK e-Science Certificate– http://ca.grid-support.ac.uk/ – See your local Registration Authority

• Complete the application form on the NGS web site, and read the conditions of use:– http://www.ngs.ac.uk/apply.html

• Wait 1-2 weeks for peer review• You gain access to all core nodes automatically (incl

SRB)• Contact GOSC to gain access to OGSA-DAI and Oracle• Use the NGS and GSC web sites and help-desk• Happy computing!

12

User Registration (Process)

User Applies(Via Website)

Application Submitted to Peer Review Panel

Application QC

Approved ?

Rejected(User Notified)

Accepted(User Notified)

User added to NGS VO

(includes SRB account)

User added NGS-USER and

NGS-ANNOUNCEMailing lists

13

Projects and VOs• Just need access to compute and data resources for users in your

project?– Currently, mainly applications from individuals– project-based applications being dealt with case-by-case, as procedures

are established– if in doubt, talk to us!

• Want to host your data on NGS?– consider GridFTP, SRB, Oracle, or OGSA-DAI– NGS maintains infrastructure– you populate and manage data

• Want to use NGS resources to provision services, portals for a community of users?– next slide

14

Providing services for a VO

• NGS resources can be used to provide a portal (or portlets) or other service for your community

• Deployment and security scenarios are negotiable• NGS policies (core nodes):

– your portal can present its own, or a delegated user’s credential to NGS, but tasks should be traceable to initiating end-user

– you should not run your own services in user space without prior agreement of NGS and hosting site

• we need to know that services are secure, will not jeopardise operation of other NGS services, or consume too much precious resource on head nodes

• Talk to GOSC!

15

UofA

HPCx

UofD

GOSC

NGS Core Nodes: Host core services, coordinate integration, deployment and support+free to access resources for all VOs. Monitored interfaces + services

NGS Partner Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services

NGS Affiliated Sites: Integrated with NGS, support for some VO’sMonitored interfaces (+security etc.)

RAL Oxford

LeedsMan. CSAR

UofB

UofC

CommercialProvider

PSRE

Resource providers

16

Resource providers

Resource providers join the NGS by• Defining level of service commitments • Adopting NGS acceptable use and security policies• Run compatible middleware

– as defined by NGS Minimum Software Stack– and verified by compliance test suite

• Support monitoring and accounting

Two levels of membership1. Affiliates run compatible stack, integrated support2. Partners also contribute “significant resources”

17

Affiliation

Affiliates commit to:• running NGS-compatible middleware

– as defined in NGS Minimum Software Stack– this means users of affiliate’s resources can access these using same

client tools they use to access NGS

• a well-defined level of service and problem referral mechanisms– SLD approved by NGS Management Board and published on NGS web-

site

• providing technical, administrative, and security (CERT) contacts• providing an account and mapping for daily compliance tests

(GITS++)• accepting UK e-Science certificates• maintaining baseline of logs to assist problem resolution

18

Partnership

Partners commit to same as affiliates, plus:• making “significant” resources available to NGS users

– creation of accounts/mappings– in future, VO support, pool accounts, etc

• recognise additional CAs with which UK e-Science programme has reciprocal agreements

• publish/provide additional information to support resource discovery, brokering

• ability to compile code for computational resources

Bristol and Cardiff going through certification process now.• supported by “buddies” and NGS-Rollout list• useful feedback on viability of NGS Minimum Software Stack

19

More training?

• Watch http://www.nesc.ac.uk/training• Also

• Globus Week, NeSC : 4-8 April via http://www.nesc.ac.uk/esi/esi.html

• http://egee.nesc.ac.uk/ for EGEE events and materials – repository.

• TELL US WHAT YOU WANT !!!!– In future versions of this course– In application developer courses– …..

20

NeSC UK Training

• Establishing set of core courses:– Induction, sysadmin, application devel.,…

• For EGEE (current and gLite), NGS• Cooperating with OMII

– Fundamentals: WS, WS-RF

• In NeSC national role:– Building collaborations to support/co-deliver training with UK e-

science centres and VO’s– Establishing repository and website

http://www.nesc.ac.uk/training

• In NeSC’s regional role, providing: – events in Scotland– Training and support for potential & current users of grids

21

Information Sources

22

EGEE www.eu-egee.orgTraining activity homepage: http://egee.nesc.ac.uk/Roadmap: training events since the start of EGEE http://www.egee.nesc.ac.uk/schedreg/index.html

LCG lcg.web.cern.ch/LCG/

NeSC www.nesc.ac.uk

The Grid Cafe www.gridcafe.org

•More EU sites:

•http://www.cordis.lu/ist/grids/fp6_grid_projects.htm

•http://www.gridstart.org/concertation_mtg.shtml

•“Concertation event” and EGEE conferencehttp://public.eu-egee.org/conferences/2nd/programme/outline.html

•e-Infrastructures Reflection Group http://www.e-irg.org

EU WEB SITES

23

UK resources

• National Grid Service http://www.ngs.ac.uk• Grid Operations Support Centre

http://www.grid-support.ac.uk• National e-Science Centre http://www.nesc.ac.uk

• UK Training Roadmap http://www.nesc.ac.uk/training

• ALSO: regional centres, centres of excellence and NIEeS, NCeSS

• UK AHM – 2004: http://www.allhands.org.uk/programme/programme.html– 2005: http://www.allhands.org.uk/

24

And finally….

25

The NGS

• Is providing a production service• Currently has core resources, procedures and

operations in place• Is developing and expanding

– Both organisationally and in middleware

• Is a “SERVICE”– Organised to respond to your requirements!!! – What do YOU want of the NGS?

• Tell GOSC !

• GOSC: exists to support you!!!

26

• Last chance for questions… and feedback.

27

Background slides

28

NGS- Production service

• Operating a production grid means valuing robustness and reliability over fashion.

• NGS cares about:– alignment/compatibility with leading international Grid efforts– special requirements of UK e-Science community– easy migration/upgrade paths– proven robustness/reliability– based on standards or standards-track specifications

• NGS cannot support everything• Everyone wants service-oriented grids

– but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite

• Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility

29

Certificate Authorityhttp://ca.grid-support.ac.uk