next steps
DESCRIPTION
Next Steps. Mike Mineter [email protected]. Acknowledgements. Most slides are from GOSC / NGS: Stephen Pickles Neil Geddes Andy Richards. Goal of talk. Thus far the emphasis has been on what the NGS is, and how to use its core services. - PowerPoint PPT PresentationTRANSCRIPT
http://www.ngs.ac.ukhttp://www.grid-support.ac.uk
http://www.eu-egee.org/http://www.pparc.ac.uk/http://www.nesc.ac.uk/
Next StepsMike Mineter
3
Goal of talk
• Thus far the emphasis has been on what the NGS is, and how to use its core services.
• The goal of this talk is to ensure that intending users of the NGS know what support services and procedures are provided by GOSC.
4
Overview
• Story so far
• The Grid Operations Support Centre
• Joining the NGS
• More training??!
• Information sources
5
The story so far
• The National Grid Service is providing a production service
• It is a developing, dynamic service!– Core services in place: data, computation, portal– New middleware en route– More sites joining – International perspectives – EGEE, Teragrid
• Grid Operations Support Centre is poised to help you…
6
GOSC
The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme.
7
ETF
Audit Board
Management Board
Steering Committee
DirectorGOSC
Operations Board
Operations Manager/Technical Director
Development Manager
TRAININGOperations Board
Security NGSNetworking GOC GSC
USERS
8
GOSC Roles UK Grid Services
National Services Authentication, authorization, certificate management, VO management,
security, network monitoring, help desk + support centre. [email protected]
NGS Services Job submission, data transfer, data access and integration, resource
brokering, monitoring, grid management services, operations centre,… NGS core-node Services
CPU, (meta-) data storage, key software Services coordinated with others (eg OMII, NeSC, LCG):
Integration testing, compatibility & Validation Tests, User Management, training
Administration: Policies and acceptable use conditions Resource providers: service level agreements,… Coordinate deployment and Operations
9
• Access Grid• Certification• Condor• ETF• For Information• General• GT2• GT3• GT4• Globus-MDS• GridFTP
• Internal• Maillist• Myproxy• NGS• OGSA-DAI• Project Registration• RA• Security• SRB• Support Notices• Training• Unicore
11
End-users: what to do
• You need a current UK e-Science Certificate– http://ca.grid-support.ac.uk/ – See your local Registration Authority
• Complete the application form on the NGS web site, and read the conditions of use:– http://www.ngs.ac.uk/apply.html
• Wait 1-2 weeks for peer review• You gain access to all core nodes automatically (incl
SRB)• Contact GOSC to gain access to OGSA-DAI and Oracle• Use the NGS and GSC web sites and help-desk• Happy computing!
12
User Registration (Process)
User Applies(Via Website)
Application Submitted to Peer Review Panel
Application QC
Approved ?
Rejected(User Notified)
Accepted(User Notified)
User added to NGS VO
(includes SRB account)
User added NGS-USER and
NGS-ANNOUNCEMailing lists
13
Projects and VOs• Just need access to compute and data resources for users in your
project?– Currently, mainly applications from individuals– project-based applications being dealt with case-by-case, as procedures
are established– if in doubt, talk to us!
• Want to host your data on NGS?– consider GridFTP, SRB, Oracle, or OGSA-DAI– NGS maintains infrastructure– you populate and manage data
• Want to use NGS resources to provision services, portals for a community of users?– next slide
14
Providing services for a VO
• NGS resources can be used to provide a portal (or portlets) or other service for your community
• Deployment and security scenarios are negotiable• NGS policies (core nodes):
– your portal can present its own, or a delegated user’s credential to NGS, but tasks should be traceable to initiating end-user
– you should not run your own services in user space without prior agreement of NGS and hosting site
• we need to know that services are secure, will not jeopardise operation of other NGS services, or consume too much precious resource on head nodes
• Talk to GOSC!
15
UofA
HPCx
UofD
GOSC
NGS Core Nodes: Host core services, coordinate integration, deployment and support+free to access resources for all VOs. Monitored interfaces + services
NGS Partner Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services
NGS Affiliated Sites: Integrated with NGS, support for some VO’sMonitored interfaces (+security etc.)
RAL Oxford
LeedsMan. CSAR
UofB
UofC
CommercialProvider
PSRE
Resource providers
16
Resource providers
Resource providers join the NGS by• Defining level of service commitments • Adopting NGS acceptable use and security policies• Run compatible middleware
– as defined by NGS Minimum Software Stack– and verified by compliance test suite
• Support monitoring and accounting
Two levels of membership1. Affiliates run compatible stack, integrated support2. Partners also contribute “significant resources”
17
Affiliation
Affiliates commit to:• running NGS-compatible middleware
– as defined in NGS Minimum Software Stack– this means users of affiliate’s resources can access these using same
client tools they use to access NGS
• a well-defined level of service and problem referral mechanisms– SLD approved by NGS Management Board and published on NGS web-
site
• providing technical, administrative, and security (CERT) contacts• providing an account and mapping for daily compliance tests
(GITS++)• accepting UK e-Science certificates• maintaining baseline of logs to assist problem resolution
18
Partnership
Partners commit to same as affiliates, plus:• making “significant” resources available to NGS users
– creation of accounts/mappings– in future, VO support, pool accounts, etc
• recognise additional CAs with which UK e-Science programme has reciprocal agreements
• publish/provide additional information to support resource discovery, brokering
• ability to compile code for computational resources
Bristol and Cardiff going through certification process now.• supported by “buddies” and NGS-Rollout list• useful feedback on viability of NGS Minimum Software Stack
19
More training?
• Watch http://www.nesc.ac.uk/training• Also
• Globus Week, NeSC : 4-8 April via http://www.nesc.ac.uk/esi/esi.html
• http://egee.nesc.ac.uk/ for EGEE events and materials – repository.
• TELL US WHAT YOU WANT !!!!– In future versions of this course– In application developer courses– …..
20
NeSC UK Training
• Establishing set of core courses:– Induction, sysadmin, application devel.,…
• For EGEE (current and gLite), NGS• Cooperating with OMII
– Fundamentals: WS, WS-RF
• In NeSC national role:– Building collaborations to support/co-deliver training with UK e-
science centres and VO’s– Establishing repository and website
http://www.nesc.ac.uk/training
• In NeSC’s regional role, providing: – events in Scotland– Training and support for potential & current users of grids
22
EGEE www.eu-egee.orgTraining activity homepage: http://egee.nesc.ac.uk/Roadmap: training events since the start of EGEE http://www.egee.nesc.ac.uk/schedreg/index.html
LCG lcg.web.cern.ch/LCG/
NeSC www.nesc.ac.uk
The Grid Cafe www.gridcafe.org
•More EU sites:
•http://www.cordis.lu/ist/grids/fp6_grid_projects.htm
•http://www.gridstart.org/concertation_mtg.shtml
•“Concertation event” and EGEE conferencehttp://public.eu-egee.org/conferences/2nd/programme/outline.html
•e-Infrastructures Reflection Group http://www.e-irg.org
EU WEB SITES
23
UK resources
• National Grid Service http://www.ngs.ac.uk• Grid Operations Support Centre
http://www.grid-support.ac.uk• National e-Science Centre http://www.nesc.ac.uk
• UK Training Roadmap http://www.nesc.ac.uk/training
• ALSO: regional centres, centres of excellence and NIEeS, NCeSS
• UK AHM – 2004: http://www.allhands.org.uk/programme/programme.html– 2005: http://www.allhands.org.uk/
25
The NGS
• Is providing a production service• Currently has core resources, procedures and
operations in place• Is developing and expanding
– Both organisationally and in middleware
• Is a “SERVICE”– Organised to respond to your requirements!!! – What do YOU want of the NGS?
• Tell GOSC !
• GOSC: exists to support you!!!
28
NGS- Production service
• Operating a production grid means valuing robustness and reliability over fashion.
• NGS cares about:– alignment/compatibility with leading international Grid efforts– special requirements of UK e-Science community– easy migration/upgrade paths– proven robustness/reliability– based on standards or standards-track specifications
• NGS cannot support everything• Everyone wants service-oriented grids
– but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite
• Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility