the science gateway paradigm manuel rodríguez-pascual & rafael mayo-garcía ciemat

28
www.gisela-grid.eu www.chain-project.eu The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT On behalf of the development team at University of Catania and INFN – Italy ([email protected] )

Upload: zarek

Post on 26-Jan-2016

25 views

Category:

Documents


0 download

DESCRIPTION

The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT On behalf of the development team at University of Catania and INFN – Italy ([email protected] ). Outline. Considerations on the number of users of e-Infrastructures The Science Gateway paradigm: - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.eu www.chain-project.eu

The Science Gateway paradigm

Manuel Rodríguez-Pascual & Rafael Mayo-García

CIEMAT

On behalf of the development team at

University of Catania and INFN – Italy

([email protected] )

Page 2: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Outline

• Considerations on the number of users of e-Infrastructures

• The Science Gateway paradigm:– Architecture– Authentication and Authorisation– The «Grid Engine»

• The Science Gateway

• Summary and conclusions

Page 3: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

A «global» scale

>340 sites in 57 countries

~337,000 CPU cores

>220 PB of storage

~1 million jobs/day

~20,000 users in ~280 VOs

Are 20,000 users a big number ?

Page 4: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Some interesting figures

Page 5: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The reason is that using Gridsis not straightforward

• Barriers in the adoption of Grids

– Changes on Grids means changes on applications– Time required to adapt usual workflows– Lack of structure to support anonymous access– Download and installation of applications– Interface– Slow to get to compared to other resources– Difficult to use in the beginning– Time spent to get the application compiled and running

Page 6: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The reason is that using Gridsis not straightforward

Users have to cope with complex security

procedures, execution scripts, job description

languages, command line based interfaces

and lack of standards. This makes the learning

curve very steep and keeps non IT-experts

away.

Page 7: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Another consideration…

VRCs

# o

f u

sers

There is a huge number of people out there who do not

belong to any constituted Virtual Research Community.

How can we attract them ?

Page 8: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The Science Gateway

“A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is further customized to meet the needs of a specific community.”

Teragrid

Page 9: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Building Science Gatewaysshould be like playing with

Sc.

Gtw

y E

Sc.

Gtw

y D

Sc.

Gtw

y C

Sc.

Gtw

y B

Sc.

Gtw

y A

• Standards• Simplicity• Easiness of use• Re-usability

Page 10: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Our reference model

Scien

ce G

ateway

Scien

ce G

ateway

Appl 1Appl 1 Appl 2Appl 2 Appl NAppl N

Grid ServicesGrid Services

Embedded ApplicationsAdministratorPower UserBasic User

Users from different

organisations having different

roles and privileges

Users from different

organisations having different

roles and privileges

Page 11: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Liferay(www.liferay.com)

• Highly-configurable, scalable, open source portal framework;

• Compatible with JSR 168/268 standards and based on modern web 2.0 technologies;

• Examples of Liferay services:– Portal;– CMS;– eCollaboration and “social” software.

Page 12: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

AuthN & AuthZ Schema

AuthorisationAuthorisationAuthorisationAuthorisationScience GatewayScience Gateway

GrIDP(“catch-

all”)

GrIDP(“catch-

all”)

IDPCT(“catch-

all”)

IDPCT(“catch-

all”)IDP_yIDP_y

LDA

PLD

AP

....

.....

....

.....

1. Register to a Service

2. Sign in

Authentication

Authentication

Social Networks’ Bridge IdP

Social Networks’ Bridge IdP

Page 13: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The Grid IDentity Pool (GrIDP)(http://gridp.ct.infn.it)

This is a “catch-all” Identity

Federation

Page 14: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Identity Federations (https://refeds.org)

Page 15: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

A Generic Grid Engine for SGbased on SAGA/JSAGA

Grid Engine

UsersTracking

DB

Science GW Interface

SAGA/JSAGA API

Job EngineData Engine UsersTrack &Monit.

ScienceGW 1

ScienceGW 2

ScienceGW 3

Grid MWs

Liferay Portlets

eTokenServer

DONE By end of AprilBy mid AprilDONE DONE

Page 16: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Data Engine - Requirements

• A file browser shows Grid files in a tree

• File system exposed by the Science Gateway is virtual

• Easy transfers from/to Grid (through the SG at the moment) are done in a few clicks

• Users do not need to care about how and where their files are really located

Page 17: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

SG developed at Catania

Page 18: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The registration procedure

Page 19: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

«catch-all» Identity ProviderIdentity Federations’ discovery service

The authentication procedure

Page 20: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (1/6)(http://gisela-gw.ct.infn.it)

Page 21: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (2/6)(http://gisela-gw.ct.infn.it)

Page 22: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (3/6)(http://gisela-gw.ct.infn.it)

Page 23: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (4/6)(http://gisela-gw.ct.infn.it)

Page 24: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (5/6)(http://gisela-gw.ct.infn.it)

Page 25: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The GISELA SG (6/6)(http://gisela-gw.ct.infn.it)

• Current Bioinformatics applications integrated in the GISELA Science Gateway– ClustalW– GATE– Phylogenetics (MrBayes)

• Bioinformatics applications which are being integrated in the Science Gateway– jModelTest– ProtTest3

• Biomed project which make use of SG– DECIDE

Page 26: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

The CHAIN Application DB

• Project-specific Science Gateways can be accessed from the CHAIN Applications Data Base– www.chain-project.eu/applications

Page 27: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Summary and conclusions

• Science Gateways and Identity Federations can revolutionize the way Grid infrastructure are used, hugely widening the potential user base

• The adopion of standards (JSR 286, SAGA, SAML, etc.) represents a concrete investment towards sustainability

• Now that millions of users can potentially access and use the GISELA Science Gateway, we are working on integrating a portfolio of «appealing» applications to attract them

• If you want to integrate your applications in the Science Gateways, or simply enable your websites with the used authentication tools, please contact

[email protected]

Page 28: The Science Gateway paradigm Manuel Rodríguez-Pascual & Rafael Mayo-García CIEMAT

www.gisela-grid.euwww.gisela-grid.eu www.chain-project.eu

Credits & Acknowledgments

• Valeria Ardizzone (COMETA);• Roberto Barbera (U. Catania)• Riccardo Bruno (COMETA);• Antonio Calanducci

(COMETA);• Marco Fargetta (COMETA)• Elisa Ingrà (GARR);• Giuseppe La Rocca (INFN)• Salvatore Monforte (INFN);• Fabrizio Pistagna (INFN);• Rita Ricceri (INFN);• Riccardo Rotondo (INFN)• Diego Scardaci (INFN)

Credits Acknowledgments