sura nmi utility grid: sharing resources, sharing results sura cyberinfrastructure workshop:
DESCRIPTION
Southeastern Universities Research Association. SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation January 5-7, 2005. Art Vandenberg [email protected] Director, Advanced Campus Services - PowerPoint PPT PresentationTRANSCRIPT
SURA NMI Utility Grid: Sharing Resources, Sharing Results
SURA Cyberinfrastructure Workshop:
Grid Application Planning & ImplementationJanuary 5-7, 2005
Art Vandenberg [email protected]
Director, Advanced Campus Services Georgia State University
Southeastern Universities Research Association
Southeastern Universities Research Association
2SURA Cyberinfrastructure Workshop
January 5-7, 2005
The NMI Integration Testbed
• Managed by SURA under NSF ANI-0123937• Testbed Sites evaluate NMI components• Real life research and enterprise contexts• www.nsf-middleware.org/testbed
NMI Participation
DEVELOPERS
SUPPORTERS
CONTRIBUTORS
?
futureexpansion
UABUAHUFLFSUGSU
UMichTACCUVA
Sites
NMI Integration Testbed
(USC)
REUStudents
Testbed Grid
USERS
Implementers
Target Communities
NMI Integration Testbed
Southeastern Universities Research Association
3SURA Cyberinfrastructure Workshop
January 5-7, 2005
SURA NMI Testbed Grid
• Initiated as a sub-project in September 2003
• Captured dispersed activity into meaningful deliverables• Integrate NMI grid components into the enterprise
• Leverage the NMI Testbed experience
• Identified leads for key areas:• Georgia State University
– “Grid-building” (identifying participants, resources)
– application development (cataloging, exploration)
• University of Virginia– Scaling the Grid
– Technology & policies for cross-certification
– Secure inter-institutional access
Southeastern Universities Research Association
4SURA Cyberinfrastructure Workshop
January 5-7, 2005
SURA NMI Testbed GRID: vision & action
• Vision – build a model of future grid• Address interoperation - Bridge CA
• Persistent, available resources
• Applications run transparently
• Policy is one of cooperative computing
• SURA NMI Testbed Grid• Continuing NMI Integration Testbed work
• Persistent resources for research and education
• Research, learning, outreach
Southeastern Universities Research Association
5SURA Cyberinfrastructure Workshop
January 5-7, 2005
What we’ll review…
• Catalog of Grid Applications: data
• SURA NMI Testbed GRID: participants & resources
• Applications: value proposition / outreach
• Portals: eye of the beholder
• Authentication: BridgeCA
• Policy: boundary conditions
• Current status
Southeastern Universities Research Association
6SURA Cyberinfrastructure Workshop
January 5-7, 2005
Catalog of Grid Applications: data
• Information is a resource– researchers, grids, applications (existing & potential)– 20 Universities, 475 researchers as of Oct 28, 2004…
http://art12.gsu.edu:8080/grid_cat/index5.jsp
Southeastern Universities Research Association
7SURA Cyberinfrastructure Workshop
January 5-7, 2005
Query: computational fluid dynamics
• Search by name, institution, keywords
Southeastern Universities Research Association
8SURA Cyberinfrastructure Workshop
January 5-7, 2005
Possible collaboration, information exchange
• Computational fluid dynamics + parallel computing
Southeastern Universities Research Association
9SURA Cyberinfrastructure Workshop
January 5-7, 2005
Grid Catalog: Coming up
• Online submission of information
• Additional search function: clustering around target info
• Information on resources
Southeastern Universities Research Association
10SURA Cyberinfrastructure Workshop
January 5-7, 2005
SURA NMI Testbed GRID: participants…
GSU
UAH
UAB
UMICH
UVA
USC
TACC
LSU
GPN
GaTech
SC
DUKE
GMU
Tulane
UARK
TTU
Southeastern Universities Research Association
11SURA Cyberinfrastructure Workshop
January 5-7, 2005
Southeastern Universities Research Association
12SURA Cyberinfrastructure Workshop
January 5-7, 2005
Applications: multiple genome alignment
Computation time of multiple sequence alignment program - varying number of elements per processor in different configurations - using 9 processors in each config (cluster, grid cluster, multi-grid cluster)NOTE improvement using MPICH-G2 across multiple clusters (research follow up…?)
Multiple Genome Alignment
Grid-enabled algorithm
Nova Ahmed, Masters CS (Ph.D. student as of Jan 2005); Dr. Yi Pan, Computer Science
UAB Clusters and collaboration
0
20
40
60
80
100
120
140
160
0 10 20 30 40 50
Number of elements per processor
Computation time (sec)
Single Cluster
Single Clustered Grid
Multi Clustered Grid
Southeastern Universities Research Association
13SURA Cyberinfrastructure Workshop
January 5-7, 2005
Task Farming & Cross Certification
• LSU: Center for Computation & Technology
• Supercomputing 2004 –demonstration
• Explore parameter space for black hole simulation
• Task farming• Submit tasks to grid• Tasks run on various available nodes• Tasks can be transitioned to another node “if needed”
• Cross certification at SURA NMI Testbed Grid BridgeCA• Enables transparent authentication
Southeastern Universities Research Association
14SURA Cyberinfrastructure Workshop
January 5-7, 2005
Information Technology & Systems Center Global Hydrology Resource Center
• Interactive data search by product, instrument, platform, and date
• Multiple views of data, e.g. search, ftp or calendars
• Automated order packaging for FTP delivery
• Direct FTP access to online data sets
• Subsetting capability
• Shopping cart style order creation
• DODS/OPeNDAP data access
DISCOVER - Distributed Information Services for Climate and Ocean Products and Visualizations for Earth Research
http://datapool.nsstc.nasa.gov
Southeastern Universities Research Association
15SURA Cyberinfrastructure Workshop
January 5-7, 2005
• Dr. Xiaochun He, Georgia State, Physics – research, outreach...
Muon-detector Grid – Georgia high schools, middle schools
Georgia State Cosmic Ray Lab
Southeastern Universities Research Association
16SURA Cyberinfrastructure Workshop
January 5-7, 2005
• Dr. Amy Apon – Grid Education• International Workshop on Grid Education
– Grid.Edu 2004 (April 2004) • NSF CCLI: Adaptation of GT3 Tutorials for undergrad CS
– Collaborative with Jens Mache, Lewis & Clark College– http://csce.uark.edu/~aapon/courses/gridcomputing/
• Member TCSC subcommittee on grid computing education
• Great Plains Network Consortium, Extending the Reach Project
• Goal: region-wide collaboration• Goal: middleware infrastructure to share resources• Deployment of Shibboleth (model for Grid AuthN/AuthZ?)• http://archie.csce.uark.edu/gpn/
• Grid resources for graduate education
University of Arkansas
Southeastern Universities Research Association
17SURA Cyberinfrastructure Workshop
January 5-7, 2005
• University of Alabama – BLAST• Texas Tech – math and statistics, approximation theory• George Mason University – geospatial data services• Texas Advanced Computing Center – computational fluid dynamics• Tulane – computational fluid dynamics• UMich – ATLAS, G4Sims• Georgia State – particle simulation• Georgia Tech – network end-to-end performance
And more application potentials…
Southeastern Universities Research Association
18SURA Cyberinfrastructure Workshop
January 5-7, 2005
Portals: eye of the beholder
•OGCE – http://www.collab-ogce.org/nmi/index.jsp
Southeastern Universities Research Association
19SURA Cyberinfrastructure Workshop
January 5-7, 2005
UTGrid: http://www.utgrid.utexas.edu/
Southeastern Universities Research Association
20SURA Cyberinfrastructure Workshop
January 5-7, 2005
Mgrid: http://www.mgrid.umich.edu/
Southeastern Universities Research Association
21SURA Cyberinfrastructure Workshop
January 5-7, 2005
U. Alabama at Birmingham: http://uabgrid.uab.edu/
Southeastern Universities Research Association
22SURA Cyberinfrastructure Workshop
January 5-7, 2005
Georgia State: http://acsgridhead.gsu.edu
Southeastern Universities Research Association
23SURA Cyberinfrastructure Workshop
January 5-7, 2005
U. of Southern California: http://www.usc.edu/uscgrid
Southeastern Universities Research Association
24SURA Cyberinfrastructure Workshop
January 5-7, 2005
Portal considerations…• Common portal for SURA NMI Testbed Grid
or
• Portal of Portals
• Integration with Authentication
• “Just give me a command line!”
• Identity for SURA NMI Testbed Grid• Our policy• Our members• Our resources• Our applications
Southeastern Universities Research Association
25SURA Cyberinfrastructure Workshop
January 5-7, 2005
Typical Hierarchical PKI
Typical Bridge PKI
Authentication: Bridge CA
Southeastern Universities Research Association
26SURA Cyberinfrastructure Workshop
January 5-7, 2005
AuthN: BridgeCA it works!
• Jim Jokl, UVA, supports BridgeCA
• LSU Center for Computation & Technology – Task farming demo Supercomputing 2004
• Tasks submitted to various grid-enabled clusters• LSU submitted to UVA cluster with cross-certification• LSU credential accepted by UVA cluster via BridgeCA
• Current Status cross-certification with BridgeCA:• UVA, UAB, LSU (completed)• TACC, USC are nearly done• UAH, UARK, GSU, UMICH next phase
• Next: automatic provisioning of Globus Grid Mapfile
Southeastern Universities Research Association
27SURA Cyberinfrastructure Workshop
January 5-7, 2005
AuthN: additional links
• SURA NMI Testbed cross certification processhttps://www.pki.virginia.edu/nmi-bridge/
• PKI-Lite policy, practices, profileshttp://middleware.internet2.edu/hepki-tag/#PKI_Lite
• CA Software (Options for Enterprise CA)http://middleware.internet2.edu/hepki-tag/opensrc.html
• SURA “Thinking Group” report: SURA Certificate AuthorityJan. 26 – Mar 29, 2004See Appendix A at:
http://www2.gsu.edu/~wwwacs/GRID_Group/min2Dec2004.htm
Southeastern Universities Research Association
28SURA Cyberinfrastructure Workshop
January 5-7, 2005
Policy: from Formal…
• Policies vary around the Testbed
• Formal policy – USC (http://www.usc.edu/hpcc/)• “The use of rcf-01 and hpc is controlled by the HPCC Allocations
Committee, under the authority of the HPCC Steering Committee. You must fill out an application and submit it to the Allocation Committee to obtain permission to use these facilities.
• HPCC Allocation Policy • HPCC Allocation Request Forms”
• See also http://www.usc.edu/isd/services/accounts/
• Formal policy – Grid3 (http://www.ivdgl.org/grid3/userinfo/)• Project specific (ATLAS, LIGO, iVDGL…)
• General Grid3 user registration (1 page guide)
Southeastern Universities Research Association
29SURA Cyberinfrastructure Workshop
January 5-7, 2005
Policy: … In-process, informal, none…
• In-Process Policy – UAB• “UABGrid is currently available to members of the UAB community
and we are working on extending its availability across partner institutions and beyond.” http://uabgrid.uab.edu/
• No Grid specific policy – default user account policies
• No formal policy, but may have consequences:
Southeastern Universities Research Association
30SURA Cyberinfrastructure Workshop
January 5-7, 2005
Policy: evolving model…
• What is SURA NMI Testbed Site policy?
• Observation on Policy for Grid based resources• Must address assumption of local use only
• Absent Grid policy, default to “computer usage” policy
• Cross-boundary use of local credentials not norm
• Social factors (Sharing resources – Yours? vs. Mine?)
• Current SURA NMI Testbed Model• Contribute some, use some
• Cross certify via BridgeCA
• Allow over-subscribing and then address how to handle
• Cooperative Computing – self-organizing/regulating?
• Demonstrate value…
Southeastern Universities Research Association
31SURA Cyberinfrastructure Workshop
January 5-7, 2005
Post-NMI Integration Testbed Award
• SURA “Grid Think” Working Groups (Jan 2003)• Authentication/CA recommendations
• Grid application analysis
• Workshop planning (Like this event!)
• NMI Submission for “Utility Grid” (May 2004)• Grids for broad, shared use across institutions (not just “big science”)
• Focus on education, research, outreach
• No award, but important development of concepts
• Foundational resource for SURA HPC-Grid Planning Group
Southeastern Universities Research Association
32SURA Cyberinfrastructure Workshop
January 5-7, 2005
• Dedicated cluster• Persistence is important• Number of nodes: whatever you can manage
• Linux• Globus• Compiler• Cross certification with BridgeCA preferred (other options ok)
• [email protected] list• Biweekly conference calls• Minutes: http://www2.gsu.edu/~wwwacs/GRID_Group/NMI.html
• Join US
SURA Testbed Grid: Basic approach…
Southeastern Universities Research Association
33SURA Cyberinfrastructure Workshop
January 5-7, 2005
Q&A?
Art Vandenberg [email protected]
Director, Advanced Campus Services
Georgia State University