Gary Bertoline, Assistant Dean for Graduate Studies and Professor – Computer Graphics, Purdue

UniversityScott Lathrop, Education, Outreach &

Training/External Relation TeraGrid, University of Chicago and Argonne National Labs

Charlie Catlett, TeraGrid Director, University of Chicago and Argonne National Labs

MANY Others

Developing TeraGrid Campus PartnershipsAn Initial Collaboration between TeraGrid, Internet2, and Open Science Grid

Fall Internet2 Member Meeting

TeraGrid Mission

•TeraGrid provides integrated, persistent, and pioneering computational resources that will significantly improve our nation’s ability and capacity to gain new insights into our most challenging research questions and societal problems. –Our vision requires an integrated approach to the scientific workflow including obtaining access, application development and execution, data analysis, collaboration and data management.

–These capabilities must be accessible broadly to the science, engineering, and education community.

TeraGrid A National Production CI Facility

SDSC

TACC

UC/ANL

NCSA

ORNL

PU

IU

PSC

NCAR

USC/ISI

Caltech UNC

UW

Phase I: 2001-2004 Design, Deploy, Expand Phase II: 2005-2010 Operation & Enhancement

20+ Distinct Computing Resources (>150TF today; ~600TF by 8/2007)100+ Data Collections

Resource Provider Software Partner

TeraGrid Objectives

•DEEP Science: Enabling Petascale Science– Make Science More Productive through an

integrated set of very-high capability resources– Address key challenges prioritized by users

•WIDE Impact: Empowering Communities– Bring TeraGrid capabilities to the broad science

community– Partner with science community leaders -

“Science Gateways”

•OPEN Infrastructure, OPEN Partnership– Provide a coordinated, general purpose, reliable

set of services and resources– Partner with campuses and facilities

TeraGrid Projects by Institution

Blue: 10 or more PI’sRed: 5-9 PI’sYellow: 2-4 PI’sGreen: 1 PI

1000 projects, 3200 users

Open Science Grid (OSG)

•The Open Science Grid is a distributed computing infrastructure for large-scale scientific research, built and operated by a consortium of universities, national laboratories, scientific collaborations and software developers.

•The OSG Consortium's unique community alliance brings petascale computing and storage resources into a uniform grid computing environment.

•Members of the OSG Consortium contribute effort and resources and reap the benefits of a shared infrastructure that integrates computing and storage resources from more than 50 sites in the United States, Asia and South America.

OSG Sites

Internet2

• Internet2 is an advanced networking consortium led by the research and education community since 1996.

• Internet2 promotes the missions of its members by providing both leading-edge network capabilities and unique partnership opportunities that together facilitate the development, deployment and use of revolutionary Internet technologies.

•By bringing research and academia together with technology leaders from industry, government and the international community, Internet2 promotes collaboration and innovation that has a fundamental impact on the future of the Internet.

NSF’s Views on Partnerships•“NSF will also promote the development of partnerships to facilitate the sharing and integration of distributed technological components deployed and supported at national, international, regional, local, community, and campus levels. “– “Significant resources already exist at the academic

institution level. It is important to integrate such resources into the national cyberinfrastructure fabric.”

– “NSF will promote the integration of campus-based cyberinfrastructure through interactions with campus CIOs and their organizations as well as with departments and individual faculty, to achieve holistic end-to-end cyberinfrastructure systems.”“NSF’S CYBERINFRASTRUCTURE VISION FOR 21ST CENTURY DISCOVERY,” July 2006 (v 7.1)

See http://www.nsf.gov/oci (Office of Cyberinfrastructure)

Broader Engagement

•How can TeraGrid engage the broader science, engineering, and education communities?

•TeraGrid Strategies for Engagement–Science Gateways

•Empower community-designed, led, supported infrastructure

–Education and Training Initiatives•Create and support a community of educators and faculty

–Campus Partnerships• New partnership programs (TeraGrid, OSG, Internet2, others)

TeraGrid Objectives

•Campus Partnership “Requirements Analysis Team (RAT)”– Facilitators Gary Bertoline (Purdue University) and

Scott Lathrop (University of Chicago)

•Partnership Goals– Frameworks for collaboration in key areas of

cyberinfrastructure– Embedded and operating within their natural

habitats (e.g. EDUCAUSE, Internet2, OSG, campus infrastructure)

– Designed, facilitated, and guided by Campus and national grid leaders together

Partnership Areas to Explore (1 of 2)

•Integrated Authorization & Authentication– Improve CI usability for scientists and engineers on

campuses, while increasing the security of CI•S. Goasguen (Clemson), J. Kyriannis (NYU), C. McMahon (LSU)

•Integrated HPC and Data Management– Develop and deploy frameworks to support access to

the increasingly powerful campus and national HPC investments, providing both capability and capacity services, and a storage and data management infrastructure to support open, extensible, evolvable science and engineering data collections•J. Boisseau (TACC), V. Agarwala (PSU), S. Corbato (Utah/Internet2)

Partnership Areas to Explore (2 of 2)

• Integrated Data Collections and Digital Assets– Develop and deploy frameworks for assembly,

management, access to, and curation of digital assets. •R. Moore (SDSC), S. Sivagnanam (SDSC), A. Doyle (UM/Internet2)

•Expand CI Beyond only R1 Institutions– Develop and Cultivate an Affiliate Partnership Program to

foster partnerships with and participation from underrepresented people, groups, and institutions.•J. Arnold (Internet2), G. Fox (Indiana), A. Ramirez (HACU), Gwen Jacobs (Montana State)

•Expanded CI Education and Training Capabilities– Develop and harvest best-of-breed education and training

materials; facilitate expanded education and training opportunities.•M. Sheddon (SDSC), K. Madhavan (Clemson), P. Teller (UTEP)

A Few Recommendations from the TeraGrid Campus Partnership RAT

•Authentication & Authorization– It is recommended that TeraGrid enable attribute-

based authorization to provide a growing community of users with access to computing and storage resources across all TeraGrid sites.

•User Types:– Portal-based communities– InterGrid-based communities– Individual users from campuses (allocation on

TeraGrid)– Users with individual credentials (no allocation on

TeraGrid)– Educational users

A Few Recommendations from the TeraGrid Campus Partnership RAT

• Cooperative Sharing of Digital Assets / Data Collections

– Data Grids to support shared collections that reside on TeraGrid storage as well as campus storage. The shared collections are then available for analysis under Teragrid computer allocations.

– Digital Libraries for publishing research data. This improves the ability to conduct research by improving access. Again the digital libraries can be distributed between campuses and the TeraGrid.

– Persistent Archives for preserving records. Scientific data that are assessed as the digital holdings needed to support future research should be preserved. An example project is Chronopolis, a collaboration between UCSD, NCAR, U Md.

A Few Recommendations from the TeraGrid Campus Partnership RAT

• Affiliates Partner Program– Organizational Affiliate: Affiliates like TeraGrid itself that naturally

organize or create the National Cyberinfrastructure. – Industry Affiliate: Companies with interest in Cyberinfrastructure.– Centers of Excellence: An Affiliate that provides expertise to help

others enhance their participation in the National Cyberinfrastructure, such as a supercomputer center

– National Cyberinfrastructure Grid Operations Center: The set of affiliates providing distributed support to the distributed operation of the National Cyberinfrastructure. It works with dedicated support teams of resource providers.

– Campus Partner: A campus affiliate.– Resource Provider: An affiliate providing National

Cyberinfrastructure data, compute, sensor, instrument or network resources.

– Access Site: An affiliate that accesses the National Cyberinfrastructure.

– Community Affiliate: An affiliate or set of affiliates with a common interest. For example, one can expect individual MSI’s to be campus affiliates while organizations like MSICIEC, AIHEC, HACU and NAFEO are community affiliates.

– Emerging communities: Communities that historically have been underrepresented in the high performance computing and Cyberinfrastructure arenas.

A Few Recommendations from the TeraGrid Campus Partnership RAT

•Affilliates Partner Program– The TeraGrid should work with all players in the

National Cyberinfrastructure – Centers of Excellence are required to advise and

support Campus Partners – A broad pro-active program to enable Emerging

Communities to become equal participants in the National Cyberinfrastructure

A Few Recommendations from the TeraGrid Campus Partnership RAT

•Other recommendations related to MSI’s and emerging communities include:– Need for “Centers of Excellence” to help

Cyberinfrastructure-enable emerging communities. Need a Nation Cyberinfrastructure Operations Center to help production use of the National Cyberinfrastructure by institutions that will initially not have local expertise to cope with complexity of problems in using distributed resources.

– Need for a “simpler” “more robust” CI-Lite software stack as current Grid software requires significant staff to support, although the level of support that is needed appears not to be clearly documented.

– Need for a plan to provide Systemic education and training at faculty, graduate and undergraduate levels. One should integrate Cyberinfrastructure into institutional curricula but the requisite content is not well defined.

A Few Recommendations from the TeraGrid Campus Partnership RAT

•Education & Training- There will need to be a “Suite of Products” approach to introducing TeraGrid and recommendations include:– Champion at each partner site– Training for champions to help them chart a course to

campus adoption– Demonstrations of capabilities and benefits of HPC to

convince colleagues and administration of value of HPC– Campus IT person to act as campus ombudsman for HPC

resources– Campus teams (IT, scientist, HPC champion) who could lead

workshops for colleagues and share TeraGrid activities with them. This could be a prerequisite for becoming a TeraGrid Campus Partner.

– Champions could get a DAC account to get their colleagues started. Then their colleagues will not need to go through the allocation process to get started.

A Few Recommendations from the TeraGrid Campus Partnership RAT

•Education & Training- There will need to be a “Suite of Products” approach to introducing TeraGrid and recommendations include:– If champion does not have time to do these things, they might

host the TeraGrid EOT team to come to their campus to provide training.

– TeraGrid Speakers Bureau should become part of the training suite

– Cyberinfrastructure Days on campuses could put together a series of activities if the campus champion would take care of marketing it on campus. Cyberinfrastructure Days would be a cooperative venture that would include TeraGrid, OSG, and Internet2.

– Cyberinfrastructure Days will help to define the roll of the campus liaison (or champion)

– CIP Science Seminar Series on computational science issues might be replicated TeraGrid-wide.

– Access Grid and Webcasts should be used to train many users at multiple sites

TeraGrid, OSG, & Internet2 Discussions

•There have been a series of meetings over the last few months between the leadership of TeraGrid, OSG, and Internet2.

•The discussions have centered on the interest in forming a national cyberinfrastructure federation between the groups.

•A few goals include:– a common authentication and authorization schema,– assist campuses with their cyberinfrastructure

challenges– access to and sharing of resources– Campus Cyberinfrastructure Days to raise

awareness and provide training

Major Challenges & Opportunities

•Authentication & Authorization•Accounting•Campuses wanting to contributing resources•User support for campus faculty and staff•Inclusion of less cyber-enabled campuses•Campus Cyberinfrastructure Days to promote and raise awareness

Contributors

•Miron Livny- OSG and University of Wisconsin•Ruth Pordes- OSG and Fermi Labs•Jill Arnold- Internet2•Doug Van Houweling- Internet2•Ken Klingenstein- Internet2•Scott Lathrop- TeraGrid•Charlie Catlett- TeraGrid•Dane Skow- TeraGrid

Seeking Input

•We are seeking your input from the user community

•We have created an online survey for you to give us input: http://www.zoomerang.com/survey.zgi?p=WEB225XK47DJJC

•Contacts if you wish to follow-up with more in depth discussions:– Gary Bertoline- bertoline@purdue.edu– Scott Lathrop- lathrop@mcs.anl.gov

Call for Participation

Papers, tutorials, posters, BOFs, and demonstrations are being accepted through January 12 in three tracks: Science, Technology, and Education, Outreach and Training

Submissions are being accepted for three competitions for high school, undergraduate and graduate students:

•Impact of Cyberinfrastructure

•Research posters

•On-site advancing scientific discovery