egi support for scientific communities
DESCRIPTION
European Grid Infrastructure. EGI support for scientific communities. Gergely Sipos EGI.eu Technical Outreach Manager [email protected]. Joint agINFRA and SCI-BUS workshop Budapest, 30/May/2013. Outline. EGI overview Strategic activities, contributors, users - PowerPoint PPT PresentationTRANSCRIPT
www.egi.euEGI-InSPIRE RI-261323
EGI-InSPIRE
www.egi.euEGI-InSPIRE RI-261323
EGI support for scientific communities
Gergely SiposEGI.eu
Technical Outreach [email protected]
European Grid Infrastructure
Joint agINFRA and SCI-BUS workshopBudapest, 30/May/2013
www.egi.euEGI-InSPIRE RI-261323
Outline
• EGI overview– Strategic activities, contributors, users
• Services for scientific communities– Software services and frameworks– Computing and storage services (grid & cloud)– User support & community building
• Summary
2
www.egi.euEGI-InSPIRE RI-261323
European Grid Infrastructure
• European– Over 35 countries
• Grid– Secure sharing of
IT resources• Infrastructure
– Computers (clusters)– Data– Applications– …. and beyond!!
• Technologies to – Federate resources– Access resources
3
Coordinator: EGI.eu,
Amsterdam
www.egi.euEGI-InSPIRE RI-261323
EGI’s strategic activities
Operational Infrastructure
Virtual Research EnvironmentsCommunity
& Coordination
•Operate a European wide grid infrastructure•Build a federated cloud infrastructure
•Integration & operation of scientific environments
• Governance• Communication
(inreach, outreach)
4
www.egi.euEGI-InSPIRE RI-261323
EGI community: contributors
National Grid Infrastructures
(NGIs)
Grid and cloud technologies:•EMI, • IGE,•EDGI, ...
Science domain specific:•agINFRA,•wLCG,•WeNMR,•ScalaLife•HMRC,...
High level technologies:•SCI-BUS, •SHIWA,•MAPPER,• ...
EGI.eu
Lega
l ent
ities P
rojectsSoftware + support(based on MoUs, SLAs)
European Intergovernmental
Research Organisations(CERN, EBI) Linking
infrastructures:•CHAIN•EUDAT...
5
www.egi.euEGI-InSPIRE RI-261323
Useservices
Createservices
Operateservices
EGI services forscientific communities
Operation tools, dashboards
Collab. & communic.
services
Scientific applications
7Research
infrastructure clusters
Application porting / hosting frameworks
Capacity (grid/cloud)
Research collaborations
Research infrastructures...
Individual researchers
www.egi.euEGI-InSPIRE RI-261323
Useservices
Createservices
Operateservices
EGI services forscientific communities
5. Operation tools,
dashboards
4. Collab. & communic.
services
1. Scientific applications
8Research
infrastructure clusters
3.Application porting /
hosting tools
2 .Capacity (grid/cloud)
Research collaborations
Research infrastructures...
Individual researchers
NGI and EGI.eu Support Teams
www.egi.euEGI-InSPIRE RI-261323
Software services: http://appdb.egi.eu
• Registered in EGI Applications Database http://appdb.egi.eu – Browse by scientific discipline
or software type: middleware, workflow tool, science gateway, scientific application
• Various types of access:– Via portal (username/pwd)– Register in a VO (X.509 cert)– Download to client side– ...
• Interact– Follow updates (RSS, Atom)– Rate & Comment– Contact provider/supporter
By discipline
9
By type
www.egi.euEGI-InSPIRE RI-261323
Science gateway (framework)
Community-specific Virtual Research Environments
...App. 1 App. 2
Scientific applications AdministratorPower UserBasic User
Job / service management
engine
Data transfer engine
EGI grid EGI Federated Cloud
Authentiation&
Authorization
Local data (logs, authz, tmp,
cache,...)
10
Batch computing
App. porting tools
Service hosting
e.g. WS-PGRADE from SCI-BUS
www.mosgrid.de
Example: MosGrid portalhttps://mosgrid.de/portal
11
Job submission
engine
Data transfer engine
HPC access with UNICOREQuantum Chemical Calculations
based on approximated solutions of the Schrödinger equation
Average scalabilityGaussian, NWChem, Turbomole, …
Molecular Dynamicsbased on forcefields describing molecular interactionsGood scalabilityGromacs, NWChem, Amber, …
DockingBased on simplified forcefieldsExcellent scalabilityCADDSuite, FlexX, …
Authentication
www.egi.euEGI-InSPIRE RI-261323
Example: Digital library - gLibrary http://glibrary.ct.infn.it
3TByte in totalTIFF (100MB/A3 page)PDF (40-400MB/work)
(1) Digitalise
(2) Store
(3) Catalogue+
Meta-data
(4) BrowseDe Roberto, an Italian writer of the XIX/XX century, born in Naples, but spending his life in Catania
12
13
Example: IGI Portal for the EGI Federated Cloud (portal.italiangrid.it, http://go.egi.eu/cloud)
Domain specific service inside a Virtual Machine
www.egi.euEGI-InSPIRE RI-261323
Recent trends in Virtual Research Environments
14
• More specialised VREs (each with a small nb. of users)
• Mixed grid and cloud use
• Transparent auth:– Robot certificates– Identity federations
• Mobile access• Entry point on
Facebook – Africa Grid Science Gateway
(based on Catania SG Framework)
www.egi.euEGI-InSPIRE RI-261323
Operation Tools & dashboards
NGI-EGI services:• Service registry• Accounting• Service Availability Monitor• Helpdesk
15
Services to operate Research Infrastructure services...
Local NGIs
Service
Service Service
Service
RegistryAccountingMonitoring
Heldesk
Research infrastructure Scientific
services
Infrastructureservices
Community portals
Operation portals
www.egi.euEGI-InSPIRE RI-261323
Human support network http://www.egi.eu/about/ngis/
• NGI: single point of contact as regards ICT services for e-science.
• Manage the computing resources and support services provided to the European Grid Infrastructure.
• Has named contact for:– Support (User)– Operation (Infrastructure)– International liaison
16
www.egi.euEGI-InSPIRE RI-261323
Community building• Virtual Team projects
– Short (up to 6 month) project with multiple NGIs involved– Setup through NGI international liaisons by EGI.eu– https://wiki.egi.eu/wiki/Virtual_Team_Projects
• Current VT projects that build Research Communities:– NGI - ELIXIR ESFRI collaboration (Started in October)– Technology study for CTA ESFRI (Started in January)– Towards a Chemistry, Molecular & Materials Science and
Technology Virtual Research Community (Started in February)
17
www.egi.euEGI-InSPIRE RI-261323
Summary
• EGI is based on a federated model– NGIs and various projects provide resources and support
• Established grid, emerging cloud infrastructure• EGI is not just computing and storage
– Ready-to-use scientific applications– Application porting and hosting frameworks, portals– Infrastructure operation tools and dashboards– Human support network
EGI and SCI-BUS helps the agINFRA community evolve
18
www.egi.euEGI-InSPIRE RI-261323
EGI-InSPIRE
www.egi.euEGI-InSPIRE RI-261323
Thank you
19