www.egi.eu egi-inspire ri-261323 egi-inspire ri-261323 european grid infrastructure: status and...
TRANSCRIPT
www.egi.euEGI-InSPIRE RI-261323 www.egi.euEGI-InSPIRE RI-261323
European Grid Infrastructure: status and services for users
04/11/2011 1
Gergely SiposUser Community Support Officer
www.egi.euEGI-InSPIRE RI-261323
Outline
• The European Grid Infrastructure• The EGI-InSPIRE project• User support services• Evolution of EGI• Get involved as a user community• Conclusions
2
www.egi.euEGI-InSPIRE RI-261323
European Grid Infrastructure(July 2011)
3
Logical CPUs (cores)• 337,608
106.7 PB disk and 112.8 PB tapeResource Centres
• 346• 93 supporting MPI jobs
Countries (+11.5% since April 2010)• 57
Resource Providers:•38 National Grid Infrastructures from Europe•1 European Inter-governmental Research Organisation (CERN)•19 countries in 4 non-European Operations Centres
www.egi.euEGI-InSPIRE RI-2613234
EGI-InSPIREproject
EGI Ecosystem
Public Funding Bodies
European Commission
National Research Councils
Service & Resource Providers
EGI.eu (Amsterdam)
Resource Infrastructure
Providers (NGIs)
Technology Providers
Open Source Providers
Commercial Providers
User Community
HUC
www.egi.euEGI-InSPIRE RI-261323
EGI-InSPIRE Project
Objectives:• Provide a sustainable, federated
e-Infrastructure– Resource providers in Europe and worldwide – With new technologies as they mature
• Support structured international research
– Attract new international user communities– Technical services to ease wider adoption
A 4-year €72M project ~190FTE with €25M EC contribution with
~€330M additional activities May 2010 April 2014
Project Partners (50):•EGI.eu (coordinator, Amsterdam)•38 National Grid Infrastructures,•2 EIROs (CERN, EBML)•9 partners from Asia Pacific
5
Integrated Sustainable Pan-European Infrastructure for Researchers in Europe
www.egi.euEGI-InSPIRE RI-2613236
The EGI virtuous cycle
Used by Researchers
Gathering New
Requirements
New Technology Assessed
Deployed Infrastructure
Services
EGI.eu
NationalResource Providers
Current User Communities
New User Communities
MoUsMoUs & OLAs
Technology Providers
MoUs & SLAs LoIs
MoU: Memorandum of UnderstandingLoI: Letter of IntentSLA: Service Level AgreementOLA: Operation Level Agreement
www.egi.euEGI-InSPIRE RI-261323
Stakeholders of user support
EGI User Support
Life sciences, structural biology, hidrolometeorology, …
Research leader
Researchers and
scientists
Scientificprogrammers
Local System administrators
Scientific communities
Research group
EGI.eu Community
Outreach and Support
Software services for
EGI User Community
Support
National and specialist
user support teams
Teams are available across 50 countries
www.egi.euEGI-InSPIRE RI-2613238
Community outreach and support
• Gathering and resolving community requirements • Users’ requirements drive the evolution of EGI
• Mobilising resoruces for user communities• Resources and technical experts in ~50 countries, at ~300 institutes
• Organising community events• Forums, topical workshops (workflows; portals; HPC/MPI; ...)
• Dissemination & marketing• Newsletters, blog, articles, interviews, exhibition booths
• Technical support for scientific programmers• National and specialised support teams in NGIs
www.egi.euEGI-InSPIRE RI-261323
Software serviceswww.egi.eu
• Helpdesk– To deal with bugs, downtimes, etc.
• Requirements tracker– Request changes to EGI services or
provide solutions for others
• Applications Database– Ready-to-use scientific applications
including Astro applications– Tools for scientific programmers
(workflow systems, frameworks, portals, etc.)
• Training marketplace– Search, browse and request training
resources (events, materials, etc.)
• Virtual Organisation services– Monitor EGI sites and software
services from your perspective
9
www.egi.euEGI-InSPIRE RI-261323
Software serviceswww.egi.eu
• Helpdesk– To deal with bugs, downtimes, etc.
• Requirements tracker– Request changes to EGI services or
provide solutions for others
• Applications Database– Ready-to-use scientific applications
including Astro applications– Tools for scientific programmers
(workflow systems, frameworks, portals, etc.)
• Training marketplace– Search, browse and request training
resources (events, materials, etc.)
• Virtual Organisation services– Monitor EGI sites and software
services from your perspective
10
EGI web gadgetsCustomise and embed EGI software services into your website!
Go to www.egi.eu/user-support/gadgets
www.egi.euEGI-InSPIRE RI-261323
User support teams
11
User Support Teams
Consultancy
Training
Software access
Application integration
Develop software
Collect requirement
Documen-tations
Helpdesk
National and technology-specific
support teams:• Consultancy & training• Application porting and integration• Developing software services for users• Collecting requirements• Documentation & helpdesk
Contact:• EGI Helpdesk• Contact list (National support teams)• EGI.eu User Community Support Team (
www.egi.euEGI-InSPIRE RI-261323
Evolution of EGI...
• Supporting services encapsulated into Virtual Machines
• Virtualisation layer enables the integration of resources, monitoring, accounting and change notification
• No ‘big-bang’ migration– Gradual change transparent to
the end-user
12
Infrastructure
Platforms
Software
Current middleware (gLite, ARC, UNICORE, dCACHE, Globus)
Central Services
Domain Services
Community Services
Virtual Research Communities
NGI NGI EIRO NGI NGI
Virtualised services
Virtualisation layer
...towards a virtualised pan-European e-infrastructure
Related activities:https://wiki.egi.eu/wiki/EGI_Virtualisation_Activities
www.egi.euEGI-InSPIRE RI-26132313
Virtual Research Community model
Benefits of a VRC:1. Defined communication
channels: named contact points between VRC & EGI
2. Confirmed links to NGIs: partnership with sustainable national entities
3. UCB membership: involvement in the prioritisation of requirements
4. Dissemination: sharing of news, breakthroughs, best practice and innovation
User Community Board • VRC representatives: Life Sciences Grid Community; Structural Biology, Hydrometerology• HUC representatives: Astronomy & Astrophysics, Earth Sciences, Computational Chemistry,
Arts & Humanities, Fusion, etc.• http://www.egi.eu/user-support/vrc_gateways/
VO: a group of researchers and developers accessing EGI EGI
Helpdesk
Other Helpdes
k
EGI.eu
NGI
Training
Virtuli-sation
SoftwareServices
Applic. support
Diss. & marketing
User Community
Board
User Community
VRC: a multi-national research collaboration with a joint workplan with EGI
HUC
HUC: a “heavy”, experienced user group. (often with multiple VOs)
www.egi.euEGI-InSPIRE RI-261323
How to get involved as a VRC?
• A VRC is– an organisational grouping that represents a community of
users with common interests– a self-organising group that collects the interests of a
focussed collection of researchers across a clear and well-defined field
• A VRC isn’t – a hierarchical structure with a single leader– a layer that separates researchers from EGI services– the exclusive contact point from a research field
• VRC Memorandum of Understanding– Defines the framework of collaboration with EGI.eu and the VRC
representative– Template is available at https://documents.egi.eu/document/205– See LSGC MoU, WeNMR MoU and Hydromet. MoU as examples
14
EGI VRC MoU template:
www.egi.euEGI-InSPIRE RI-261323
Conclusions
• EGI establishes and runs integrated, secure, interoperable services with distributed support teams
• EGI Virtual Research Community (VRC) model is available for astro communities
– Participate in User Community Board
– Contribute to requirements collection and prioritisation processes
– Receive resources and support from NGIs and EGI.eu
• Virtualisation will increase EGI software flexibility
15
EGI can help the astro community establish a sustainable e-Infrastructure
www.egi.euEGI-InSPIRE RI-261323 www.egi.euEGI-InSPIRE RI-26132316
EGI Community ForumMunich, Germany
26-30 March 2012
• Online abstract submission is open
• Tracks:
• Users and communities
• Software services for users and communities
• Middleware services
• Operational services and infrastructure
• Coordination and communication