the science gateway paradigm manuel rodríguez-pascual & rafael mayo-garcía ciemat
DESCRIPTION
The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT On behalf of the development team at University of Catania and INFN – Italy ([email protected] ). Outline. Considerations on the number of users of e-Infrastructures The Science Gateway paradigm: - PowerPoint PPT PresentationTRANSCRIPT
www.gisela-grid.eu www.chain-project.eu
The Science Gateway paradigm
Manuel Rodríguez-Pascual & Rafael Mayo-García
CIEMAT
On behalf of the development team at
University of Catania and INFN – Italy
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Outline
• Considerations on the number of users of e-Infrastructures
• The Science Gateway paradigm:– Architecture– Authentication and Authorisation– The «Grid Engine»
• The Science Gateway
• Summary and conclusions
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
A «global» scale
>340 sites in 57 countries
~337,000 CPU cores
>220 PB of storage
~1 million jobs/day
~20,000 users in ~280 VOs
Are 20,000 users a big number ?
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Some interesting figures
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The reason is that using Gridsis not straightforward
• Barriers in the adoption of Grids
– Changes on Grids means changes on applications– Time required to adapt usual workflows– Lack of structure to support anonymous access– Download and installation of applications– Interface– Slow to get to compared to other resources– Difficult to use in the beginning– Time spent to get the application compiled and running
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The reason is that using Gridsis not straightforward
Users have to cope with complex security
procedures, execution scripts, job description
languages, command line based interfaces
and lack of standards. This makes the learning
curve very steep and keeps non IT-experts
away.
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Another consideration…
VRCs
# o
f u
sers
There is a huge number of people out there who do not
belong to any constituted Virtual Research Community.
How can we attract them ?
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The Science Gateway
“A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is further customized to meet the needs of a specific community.”
Teragrid
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Building Science Gatewaysshould be like playing with
Sc.
Gtw
y E
Sc.
Gtw
y D
Sc.
Gtw
y C
Sc.
Gtw
y B
Sc.
Gtw
y A
• Standards• Simplicity• Easiness of use• Re-usability
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Our reference model
Scien
ce G
ateway
Scien
ce G
ateway
Appl 1Appl 1 Appl 2Appl 2 Appl NAppl N
Grid ServicesGrid Services
Embedded ApplicationsAdministratorPower UserBasic User
Users from different
organisations having different
roles and privileges
Users from different
organisations having different
roles and privileges
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Liferay(www.liferay.com)
• Highly-configurable, scalable, open source portal framework;
• Compatible with JSR 168/268 standards and based on modern web 2.0 technologies;
• Examples of Liferay services:– Portal;– CMS;– eCollaboration and “social” software.
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
AuthN & AuthZ Schema
AuthorisationAuthorisationAuthorisationAuthorisationScience GatewayScience Gateway
GrIDP(“catch-
all”)
GrIDP(“catch-
all”)
IDPCT(“catch-
all”)
IDPCT(“catch-
all”)IDP_yIDP_y
LDA
PLD
AP
....
.....
....
.....
1. Register to a Service
2. Sign in
Authentication
Authentication
Social Networks’ Bridge IdP
Social Networks’ Bridge IdP
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The Grid IDentity Pool (GrIDP)(http://gridp.ct.infn.it)
This is a “catch-all” Identity
Federation
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Identity Federations (https://refeds.org)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
A Generic Grid Engine for SGbased on SAGA/JSAGA
Grid Engine
UsersTracking
DB
Science GW Interface
SAGA/JSAGA API
Job EngineData Engine UsersTrack &Monit.
ScienceGW 1
ScienceGW 2
ScienceGW 3
Grid MWs
Liferay Portlets
eTokenServer
DONE By end of AprilBy mid AprilDONE DONE
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Data Engine - Requirements
• A file browser shows Grid files in a tree
• File system exposed by the Science Gateway is virtual
• Easy transfers from/to Grid (through the SG at the moment) are done in a few clicks
• Users do not need to care about how and where their files are really located
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
SG developed at Catania
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The registration procedure
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
«catch-all» Identity ProviderIdentity Federations’ discovery service
The authentication procedure
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (1/6)(http://gisela-gw.ct.infn.it)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (2/6)(http://gisela-gw.ct.infn.it)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (3/6)(http://gisela-gw.ct.infn.it)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (4/6)(http://gisela-gw.ct.infn.it)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (5/6)(http://gisela-gw.ct.infn.it)
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The GISELA SG (6/6)(http://gisela-gw.ct.infn.it)
• Current Bioinformatics applications integrated in the GISELA Science Gateway– ClustalW– GATE– Phylogenetics (MrBayes)
• Bioinformatics applications which are being integrated in the Science Gateway– jModelTest– ProtTest3
• Biomed project which make use of SG– DECIDE
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
The CHAIN Application DB
• Project-specific Science Gateways can be accessed from the CHAIN Applications Data Base– www.chain-project.eu/applications
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Summary and conclusions
• Science Gateways and Identity Federations can revolutionize the way Grid infrastructure are used, hugely widening the potential user base
• The adopion of standards (JSR 286, SAGA, SAML, etc.) represents a concrete investment towards sustainability
• Now that millions of users can potentially access and use the GISELA Science Gateway, we are working on integrating a portfolio of «appealing» applications to attract them
• If you want to integrate your applications in the Science Gateways, or simply enable your websites with the used authentication tools, please contact
www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu
Credits & Acknowledgments
• Valeria Ardizzone (COMETA);• Roberto Barbera (U. Catania)• Riccardo Bruno (COMETA);• Antonio Calanducci
(COMETA);• Marco Fargetta (COMETA)• Elisa Ingrà (GARR);• Giuseppe La Rocca (INFN)• Salvatore Monforte (INFN);• Fabrizio Pistagna (INFN);• Rita Ricceri (INFN);• Riccardo Rotondo (INFN)• Diego Scardaci (INFN)
Credits Acknowledgments