strategic applications to drive strategic technologies for the 21st century

National Computational Science Alliance

Strategic Applications to Drive Strategic Technologies for the 21st Century

• Keynote Talk at the RCI Annual Member Management Executive Conference

• Arlington, Virginia October 13, 1998.


The Emerging Concept of a National Scale Information Power Grid

http://science.nas.nasa.gov/Groups/Tools/IPG

Imagine a national computing and information infrastructure that allowed everyone to access the information resources of the nation in much the same way that one accesses electrical power today -- an “Information Power Grid” “Information Power Grid” -- NASA


The Grid Links People with Distributed Resources on a National Scale

http://science.nas.nasa.gov/Groups/Tools/IPG


The Grid - “Dependable, Consistent, Pervasive Access to [High-end] Resources”

• Dependable: – Can Provide Performance and

Functionality Guarantees

• Consistent: – Uniform Interfaces to a Wide

Variety of Resources

• Pervasive: – Ability to “Plug In” From Anywhere

Source: Ian Foster, ANL


The Grid:Blueprint for a New Computing Infrastructure

Ian Foster, Carl Kesselman (Eds), Morgan Kaufmann, 1999• Available July 1998;

ISBN 1-55860-475-8 • 22 chapters by expert authors

including: – Andrew Chien, – Jack Dongarra, – Tom DeFanti, – Andrew Grimshaw, – Roch Guerin, – Ken Kennedy, – Paul Messina, – Cliff Neuman, – Jon Postel, – Larry Smarr, – Rick Stevens, – Charlie Catlett– John Toole– and many others

http://www.mkp.com/grids

“A source book for the historyof the future” -- Vint Cerf


The National Computational Science Alliance

www.ncsa.uiuc.edu


The National Partnership for Advanced Computational Infrastructure

www.npaci.edu


The National Science Foundation’s vBNS - Topology October 1998

Source: R. Patterson, R. Butler, NCSA-NLANRb


vBNS Connected Alliance Site

vBNS Alliance Site Scheduled for Connection

NCSANCSA

Assembling the Links in the Gridwith NSF’s vBNS Connections Program

StarTAPStarTAP

27 Alliance sites running...

vBNS Backbone Node

Source: Charlie Catlett, Randy Butler, NCSA Grid Team

NCSA runs NLANR Distributed Applications Support Team for vBNS

1999: Expansion via Internet2 -- AbilenevBNS & Abilene at 2.4 Gbit/s

Indiana UniversityAbilene NOC

…19 more in progress.


Qwest Nationwide Network -Backbone for Internet2 Abilene - More Links

Source: Randy Butler, NCSAhttp://www.qwest.net/network/Mainmaps.html

Qwest Partnering with Cisco and Nortel


Grid EnabledWorkshop and Training Facilities

Being Deployed Across the Alliance

Jason Leigh and Tom DeFanti, EVL; Rick Stevens, ANL


New Alliance Center for Collaboration, Education, Science, and Software (ACCESS)

• 7000 Square Feet in the Wash D.C. Metropolitan Area - Construction Completed Sept ‘98

• Remote and Local Access to Alliance Technologies, Leaders, Researchers, and Partners

• Collaborative Demonstrations, Training, Digital Video Teleconferencing, and Visitors

• Immersadesk, Power Wall, Projected Advanced High Bandwidth Applications

• Initiated Using State of Illinois Cost Sharing

• FY99 -- Extend Access Centers Throughout the Alliance


Colliding Galaxies (Smithsonian IMAX)-Donna Cox, Bob Patterson, NCSA-From “Cosmic Voyage”-Nominated for Academy Award 1997

• Virtual Director in CAVE for Choreography of Data• 1000 Hour SDSC Supercomputer Run to Generate Data• Tens of Thousands of Hours of NCSA SGI Time to Render Data• Cross-Country Transfer to IMAX Film of Massive Amounts of Data

Supercomputers, Networks, and Virtual Reality -- From the Heroic to the Routine


The Grid Links Remote Sensors With Supercomputers, Controls, & Digital Archives

Starburst Galaxy M82

• Creating Remote Super Telescopes– BIMA and NRAO– Collaborative Web Interface– Real Time Control and Steering

Alliance Scientific Instrument Applications Team


Using the Grid to Create Super-Biomedical Instruments

www.npaci.edu/Research/index.html

NPACI Neurosciences Research Thrust


User Web BrowserOutput to User

User Input

Format Translator, Query Engine and Program Driver

Workbench Server

Results to User

User Instructions and queries

Application Programs

(May have varyinginterfaces and be written in different

languages)Results

Instructions

Information Sources(May be of

varying formats)

Information

Queries

NCSA Computational Biology Group

The NCSA Information Workbench - An Architecture for Web-Based Computing


Structure & Function

Pathways & Physiology

Populations& Evolution

Ecosystems

Genomes

Gene Products

Using a Web Browser to Run Programs and Analyze Data Worldwide

NCSA Biology WorkbenchHas Over 6,000 Users From Over 20 Countries


Alliance Chemical Engineering TeamDeveloping the Chemical Engineer’s Workbench

O(km) O(cm) O(nm)O(m)

Couple Supercomputer Models For All These Scales Together

Access From a Web Browser!


ProcessProcess

DataData

Process Process ModelModelPlant-wide Control

Measurements andExperimental Design

Parameter Estimation

Process

ControlControlSignalsSignals

Using the Grid to Optimize Chemical Plant Operations

Grid Coupling: SensorsNetworksDataHPC ModelsControls

Alliance Chemical Engineering Applications Team


Goal-Create Collaborative Interface to Link Multiple Investigators With the Grid

ReactorReactorSimulationSimulationReactorReactor

SimulationSimulation

InteractiveInteractiveDiscussionDiscussionInteractiveInteractiveDiscussionDiscussion

DetailedDetailedVisualizationVisualization

DetailedDetailedVisualizationVisualization

CurrentCurrentparameters parameters in solutionin solution

CurrentCurrentparameters parameters in solutionin solution

Status ofStatus ofSimulationSimulationStatus ofStatus of

SimulationSimulation

Ken Bishop, U Kansas Using NCSA Habanero


The Killer Application for the Grid -Collaborative Tele-Immersion

CAVE ImmersaDesk

Image courtesy: Electronic Visualization Laboratory, UIUC

Different Physical Implementations of the Alliance CAVE Software Libraries


Using the vBNS to Link Alliance Virtual Reality Devices

Image by Robert Patterson, NCSA


Environmental Hydrology Collaboration: From CAVE to Desktop

Pietrowicz/NCSA-LES; Hibbard/Wisconsin

Using Java and Java3d to Bring Collaboration and CAVE Capabilities To the Desktop

Java Port of Cave5D, Enhanced With Java3D, Wand Control and Flock-of-birds Position Tracking Using NT


A Working Model-Caterpillar’s Collaborative Virtual Prototyping Environment

Real Time Linked VR and Audio-Video Between NCSA, Peoria, Houston, and Germany


Goal-Global Enterprise Management

Customer

ManufacturingFacility

Supplier

Designer ATM/IP Network


Bringing the Grid to the Virtual Battlefield

NCSA, Beckman Institute, Army Research Lab


The Continuing Exponential Agent of Change

1985 1998

100x

100xParallelism

100x

100xVectors

1x

IBM PC/AT(1-processor)

Compaq Desktop (2-processors)Pentium II 333 Mhz

Cray X-MP(2-processors)

SGI Origin(128 Processors)

10,000x


Development of Computational Methods in Chemistry Awarded the 1998 Nobel Prize for Chemistry

• Walter Kohn– University of California at Santa Barbara, USA

• John A. Pople– Northwestern University, Evanston, Illinois, USA

• “to Walter Kohn for his development of the density-functional theory and to John Pople for his development of computational methods in quantum chemistry”

www.nobel.se/announcement-98/chemistry98.html

Freon and Ozone


The Evolution of Shared Memory Parallel & Distributed Computing

Vector SMPsto

Microprocessor SMPsto

Clustered Microprocessor SMPsto

Microprocessor DSMs to

Clustered Microprocessor DSMs

1985

1993

1995

1997

1999

Alliance LES


Clustered Shared Memory Computers are Today’s High End

NCSA has 6 x 128 Origin ProcessorsASC has 4 x 128ARL has 3 x 128CEWES has 1 x 128NAVO has 1 x 128

Los Alamos ASCI Blue Will Have 48 x 128!

Livermore ASCI Blue has 1536x4 IBM SP


Evolution of a Red Giant with White Dwarf Core- How High Speed Networks Enhance Analysis

Porter, Anderson, Habermann, Ruwart, & Woodward , LCSE,Nov. 1997www.lcse.umn.edu/RedGiant/

Data Moved From NCSA over vBNS to U Minnesota-Visualization at SC97 While Week-Long Simulation Runs at NCSAvBNS Gives 500-Fold Thruput Increase Over Commercial Internet!

Surface View

128-processor SGI Origin

Run for One Week

Generated Terabytes of

Data


Storm and Mesoscale Ensemble Experiment 1998 - Center for Analysis and Prediction of Storms

http://origin.caps.ou.edu/~samex/arps/19980524/12Z_nc9/13h/refl-2km.gif

Kelvin Droegemeier, Univ. of Oklahoma,Director, CAPS

Run in Morning - Compare with Reality

in the Afternoon!

CAPS Collaborators:NCARNSSL

AFWANCEP

Ran on PSC T3D-512


s fn

Predicting Spring Storms in 1999 and Beyond -- A Grid Based Computational Science Experiment

Kelvin Droegemeier, Director CAPS, Univ. Oklahoma

• NCSA and Regional Models Running Concurrently• Local NEXRAD Doppler Radars to Initialize Models• Models Accessed Over Web

NCSA Requirement:5 Hr./day on Origin 128

Lasting Two Months

Spring ‘99

20-30 km Resolution Ensemble Domain

Storm and Mesoscale Ensemble Experiment (SAMEX)—1999 and Beyond

Pacific Northwest

California Coast

Central and Southern

Great Plains

Inter-Mountain

Florida Coast

Great Lakes

Southeast

NortheastNorthern Great Plains


Globus Ubiquitous Supercomputing Testbed (GUSTO)

• Alliance Middleware for the Grid• GII Next Generation Winner• SF Express-- Synthetic Theatre of War Simulation

– Multi-site-DARPA, DOE, DOD Mod and NSF PACI– Largest Distributed Interactive Simulation Ever Performed– 100,000 vehicle simulation

– Tanks, Fighting Vehicles, Armored Personnel Carriers, Trucks – 1386 processors on 13 computers at 9 sites


Quantum Simulations Using WebFlow - a High Level Visual Interface for Globus

E. Akarsu, G. Fox, W. Furmanski, T.Haupt (NPAC, Syracuse U), L. Mitas (NCSA)

Now Co-Funded by Sun Microsystems

Alliance • Distributed Computing ET Team• Nanomaterials AT Team


Harnessing the Unused Cycles of Networks of Workstations

Condor Cycles

University of Kansas is Installing Condor

Alliance Nanotechnologies TeamUsed Univ. of Wisconsin Condor Cluster -

Burned 1 CPU-Year in Two Weeks!


NT Workstation Shipments Rapidly Surpassing UNIX

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1995 1996 1997

Wo

rkst

atio

ns

Sh

ipp

ed (

Mill

ion

s)

UNIX

NT

Source: IDC, Wall Street Journal, 3/6/98


NCSA / AllstateNT Cluster Data Refinery

Source: Allstate & Tilt Thompkins, NCSA

Visualization Stations

CompaqNT

Server

External Networks

CompaqNT

Server

1000 Gigabytes of Allstate Claims Data

Data Mine on Cleaned Gigabyte Samples

Parallel Compute Cluster

Terabyte

“Smart Bucket”


192 Hewlett Packard 300 MHz

64 Compaq 333 MHz

• Andrew Chien, CS UIUC-->UCSD • Rob Pennington, NCSA• Myrinet Network, HPVM, Fast Messages• Microsoft NT OS, MPI API

“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft

Creating Scalable NT/Intel Servers


0

1

2

3

4

5

6

7

0

10

20

30

40

50

60

Processors

Gig

afl

op

s

Origin-DSM

Origin-MPI

NT-MPI

SP2-MPI

T3E-MPI

SPP2000-DSM

Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems

Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner

(2D 1024x1024)

Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD)

VariousApplicationsSustaining

7 GF on 128 Processors

NT Supercluster


The Road to Intel’s MercedThe Convergence of Scientific and Commercial Computing

http://developer.intel.com/solutions/archive/issue5/focus.htm#FOUR

IA-64 Co-Developed by Intel and Hewlett-Packard

strategic applications to drive strategic technologies for the 21st century

Documents