san diego supercomputer center nucri advisory board meeting november 9, 2006 science gateways on the...

SAN DIEGO SUPERCOMPUTER CENTER

Science Gateways on the TeraGrid

Nancy Wilkins-DiehrTeraGrid Area Director for Science Gateways

SDSC Director of Consulting, Documentation, TrainingSan Diego Supercomputer Center

[email protected]


What is the TeraGrid?

• NSF-funded facility to offer high end compute, data and visualization resources to the nation’s academic researchers


TeraGrid Technology

Data

18.8 Petabytes StorageMemory Intensive

Resources

Computation Visualization

100+ Teraflops Computation

40gigabit/second cross-country network


Over 100 Tflops in Computing Power

55

20.4

15.611

10.23

10.23

10

6.6

6.55

6

5.7345.7 3.12.2 20.610.340.310.17

TACC Lonestar

IU Big Red

SDSC DataStar

Purdue Radon

NCSA Mercury

NCSA Tungsten

PSC BigBen

Purdue Lear

NCSA Cobalt

PSC Lemieux

NCAR Frost

SDSC BlueGene

SDSC IA64

IU IA-32

NCSA Copper

UC ANL IA64

ORNL IA32

PSC Rachel

IU Tiger


TeraGrid Resources Available to Academic Researchers at No Cost

• TeraGrid creates integrated, persistent, and pioneering computational resources that significantly improve our nation’s ability and capacity to gain new insights into our most challenging research questions and societal problems.

• Proposal-based access, researchers can use resources at no cost– Collaborative opportunities, but

Principal Investigators must be from the U.S.


TeraGrid PI’s By Institution as of May 2006

TeraGrid PI’s

Blue: 10 or more PI’sRed: 5-9 PI’sYellow: 2-4 PI’sGreen: 1 PI


Gateways are part of TeraGrid’s 3-pronged strategy to further science

• DEEP Science: Enabling Terascale Science– Make science more productive

through an integrated set of very-high capability resources

• Advanced Support for TeraGrid Applications (ASTA) projects

• WIDE Impact: Empowering Communities– Bring TeraGrid capabilities to the

broad science community• Science Gateways

• OPEN Infrastructure, OPEN Partnership– Provide a coordinated, general

purpose, reliable set of services and resources

• Grid interoperability working group


Science GatewaysA new initiative for the TeraGrid

• Increasing investment by communities in their own cyberinfrastructure, but heterogeneous:

• Resources• Users – from expert to K-12• Software stacks, policies

• Science Gateways– Provide “TeraGrid Inside”

capabilities– Leverage community investment

• Three common forms:– Web-based Portals – Application programs running on

users' machines but accessing services in TeraGrid

– Coordinated access points enabling users to move seamlessly between TeraGrid and other grids.

Workflow Composer


Gateways are growing in numbers

• 10 initial projects as part of TG proposal• >20 Gateway projects today• No limit on how many gateways can use TG resources

– Prepare services and documentation so developers can work independently

• Open Science Grid (OSG)• Special PRiority and Urgent Computing Environment

(SPRUCE)• National Virtual Observatory (NVO)• Linked Environments for Atmospheric Discovery

(LEAD)• Computational Chemistry Grid (GridChem)• Computational Science and Engineering Online (CSE-

Online)• GEON(GEOsciences Network)• Network for Earthquake Engineering Simulation (NEES)• SCEC Earthworks Project• Network for Computational Nanotechnology and

nanoHUB• GIScience Gateway (GISolve)• Biology and Biomedicine Science Gateway• Open Life Sciences Gateway• The Telescience Project• Grid Analysis Environment (GAE)• Neutron Science Instrument Gateway• TeraGrid Visualization Gateway, ANL• BIRN• Gridblast Bioinformatics Gateway• Earth Systems Grid• Astrophysical Data Repository (Cornell)

• Many others interested– SID Grid– HASTAC


What Did We Learn About Common Gateway Requirements?

• Accounting– Support for accounts with

differing capabilities– Ability to associate compute job

to a individual portal user– Scheme for portal registration and

usage tracking– Dynamic accounts

• Security– Community account privileges– Need to identify human

responsible for a job for incident response

– Acceptance of other grid certificates

• Web Services – Many will build on the Globus

Toolkit, but additional interfaces may be needed

– Web Service security– Interfaces to scheduling and

account management are common requirements

• Software– Interoperability of software stacks

between TeraGrid and peer grids– Software installations for

gateways across all TG sites– Community software areas– Management (pacman, other

options)


National Virtual ObservatoryFacilitating Scientific Discovery

• Access to telescope images from around the world

• NVO provides access to combined sky surveys– Different views of the same

cosmological phenomenon can reveal new insights

• New science enabled by enhancing access to data and computing resources– Data correlation– Understanding of physical

processes– Identification of new phenomenon

• NVO is a set of tools used to exploit the data avalanche


Linked Environments for Atmospheric Discovery•Providing tools that are needed to make accurate predictions of tornados and hurricanes

•Meteorological data•Forecast models•Analysis and visualization tools

•Data exploration and Grid workflow


Would development of a gateway help your research?

• Think about your current bottlenecks– What would you like to explore if only you had

• Lots of disk• Lots of compute resources• Powerful analysis capabilities• A nice interface to information

• www.teragrid.org

• Nancy Wilkins-Diehr, [email protected]

san diego supercomputer center nucri advisory board meeting november 9, 2006 science gateways on the...

Documents