“ high performance collaboration – the jump to light speed " invited talk national center...
TRANSCRIPT
![Page 1: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/1.jpg)
“High Performance Collaboration –The Jump to Light Speed"
Invited Talk
National Center for Supercomputing Applications
University of Illinois, Urbana-Champaign
Urbana, IL
May 4, 2006
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technology;
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
![Page 2: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/2.jpg)
Abstract
NCSA has been a leader in innovation of new modes of networked collaboration for over fifteen years.
The vision painted in the 1989 Science by Satellite demonstration at Siggraph in which distance becomes
eliminated is finally nearing reality. I will review highlights of NCSA's pioneering work and then describe some recent experiments that Calit2 has been involved in. With the emergence of dedicated 10 gigabit/s optical
backplanes on a planetary scale, the notion of shared telepresence is becoming achievable.
![Page 3: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/3.jpg)
Long-Term Goal: Dedicated Fiber Optic Infrastructure Using Analog Communications to Prototype the Digital Future
“We’re using satellite technology…to demowhat It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.”
― Al Gore, SenatorChair, US Senate Subcommittee on Science, Technology and Space
Illinois
Boston
SIGGRAPH 1989
ATT & Sun
“What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.”― Larry Smarr, Director, NCSA
• Televisualization:– Telepresence– Remote Interactive
Visual Supercomputing– Multi-disciplinary
Scientific Visualization
![Page 4: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/4.jpg)
NCSA Collage-a Cross Platform Desktop Collaboration Tool-Led to Mosaic
Source: Susan Hardin
![Page 5: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/5.jpg)
The Move to a Single Software Platform Collaboration Tool
“HabaneroTM was written to facilitate the use of real-time multi-user software tools in education and the sciences.
Unlike earlier projects (such as NCSA Telnet, NCSA Collage, NCSA Mosaic),
where different source code was used for each supported hardware platform,
the Habanero framework supports multiple hardware platforms by virtue of implementation in the Java programming language
from Sun Microsystems.”
![Page 6: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/6.jpg)
Supercomputing ‘95 I-WAY ProjectFirst Working Prototype of a National-Scale Science Grid
• 60 National & Grand Challenge Computing Applications
• I-Way Featured:– IP over ATM with an OC-3 (155Mbps) Backbone– Large-Scale Immersive Displays– I-Soft Programming Environment
– Led Directly to Globus
UIC
http://archive.ncsa.uiuc.edu/General/Training/SC95/GII.HPCC.html
CitySpace
Cellular Semiotics
Source: Larry Smarr, Rick Stevens, Tom DeFanti
![Page 7: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/7.jpg)
PACI is Prototyping America’s 21st Century Information Infrastructure
The PACI Grid Testbed
National Computational Science
1997
![Page 8: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/8.jpg)
Layered Software Approach to Building the Planetary Grid
Science Portals & Workbenches
Twenty-First Century Applications
Computational Services
Performance
Networking, Devices and Systems
Grid Services(resource independent)
Grid Fabric(resource dependent)
Access Services & Technology
Access Grid
Computational Grid
Edited by Ian Foster and Carl Kesselmanwww.mkp.com/grids
“A source book for the historyof the future” -- Vint Cerf
1998
![Page 9: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/9.jpg)
From Telephone Conference Calls to Access Grid International IP Multicast
Access Grid Lead-ArgonneNSF STARTAP Lead-UIC’s Elec. Vis. Lab
National Computational Science
1999
![Page 10: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/10.jpg)
Alliance 1997: Collaborative Video Productionvia Tele-Immersion and Virtual Director
Alliance Project Linking CAVE, ImmersaDesk, Power Wall, and Workstation
UIC Donna Cox, Robert Patterson, Stuart Levy, NCSA Virtual Director Team
Glenn Wheless, Old Dominion Univ.
Alliance Application TechnologiesEnvironmental Hydrology Team
![Page 11: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/11.jpg)
NCSA and Industrial Partner Caterpillar Prototyping Global Virtual Manufacturing
Customer
ManufacturingFacility
Supplier
Designer ATM Network
Source: Kem Ahlers, Caterpillar
1997
![Page 12: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/12.jpg)
HyperComputiCations—a Joint Project of NCSA/Motorola/ TRECC
Mirage II concept
Source: Gerry Labedz, Motorola
2003
![Page 13: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/13.jpg)
Two New Calit2 Buildings Provide New Laboratories for “Living in the Future”
• Over 1000 Researchers in Two Buildings– Linked via Dedicated Optical Networks– International Conferences and Testbeds
• New Laboratories– Nanotechnology– Virtual Reality, Digital Cinema
UC Irvine
www.calit2.net
Preparing for a World in Which Distance is Eliminated…
UC San Diego
![Page 14: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/14.jpg)
Calit2 is Experimenting with Open Reconfigurable Work Spaces to Enhance Collaboration
Photos by John Durant; Barbara Haynor, Calit2
Over Two Dozen Departments in the Building
![Page 15: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/15.jpg)
The Calit2@UCSD Building is Designed for Prototyping Extremely High Bandwidth Applications
1.8 Million Feet of Cat6 Ethernet Cabling
150 Fiber Strands to Building;Experimental Roof Radio Antenna Farm
Ubiquitous WiFiPhoto: Tim Beach,
Calit2
Over 10,000 Individual
1 GbpsDrops in the
Building~10G per Person
UCSD is Only UC Campus with
10GCENIC
Connection for ~30,000 Users
UCSD is Only UC Campus with
10GCENIC
Connection for ~30,000 Users
24 Fiber Pairs
to Each Lab
![Page 16: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/16.jpg)
From “Supercomputer–Centric” to “Supernetwork-Centric” Cyberinfrastructure
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1985 1990 1995 2000 2005
Ba
nd
wid
th (
Mb
ps
)
Megabit/s
Gigabit/s
Terabit/s
Network Data Source: Timothy Lance, President, NYSERNet
32x10Gb “Lambdas”
1 GFLOP Cray2
60 TFLOP Altix
Bandwidth of NYSERNet Research Network Backbones
T1
Optical WAN Research Bandwidth Has Grown Much Faster Than
Supercomputer Speed!
Co
mp
utin
g S
peed
(G
FL
OP
S)
![Page 17: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/17.jpg)
National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers
NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout
Links Two Dozen State and Regional Optical
Networks
DOE, NSF, & NASA
Using NLR
San Francisco Pittsburgh
Cleveland
San Diego
Los Angeles
Portland
Seattle
Pensacola
Baton Rouge
HoustonSan Antonio
Las Cruces /El Paso
Phoenix
New York City
Washington, DC
Raleigh
Jacksonville
Dallas
Tulsa
Atlanta
Kansas City
Denver
Ogden/Salt Lake City
Boise
Albuquerque
UC-TeraGridUIC/NW-Starlight
Chicago
International Collaborators
NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone
![Page 18: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/18.jpg)
States are Acquiring Their Own Dark Fiber Networks -- Illinois’s I-WIRE and Indiana’s I-LIGHT
Source: Larry Smarr, Rick Stevens, Tom DeFanti, Charlie Catlett
Today Two Dozen State and Regional Optical Networks
1999
![Page 19: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/19.jpg)
The OptIPuter Project – Linking Global Scale Science Projects to User’s Linux Clusters
• NSF Large Information Technology Research Proposal– Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI– Partnering Campuses: USC, SDSU, NCSA, NW, TA&M, UvA, SARA,
NASA Goddard, KISTI, AIST
• Industrial Partners– IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
• $13.5 Million Over Five Years
NIH Biomedical Informatics NSF EarthScope and ORIONResearch Network
![Page 20: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/20.jpg)
What is the OptIPuter?
• Applications Drivers Interactive Analysis of Large Data Sets
• OptIPuter Nodes Scalable PC Clusters with Graphics Cards
• IP over Lambda Connectivity Predictable Backplane
• Open Source LambdaGrid Middleware Network is Reservable
• Data Retrieval and Mining Lambda Attached Data Servers
• High Defn. Vis., Collab. SW High Performance Collaboratory
See Nov 2003 Communications of the ACM for Articles on OptIPuter Technologies
www.optiputer.net
![Page 21: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/21.jpg)
End User Device: Tiled Wall Driven by OptIPuter Graphics Cluster
![Page 22: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/22.jpg)
September 26-30, 2005Calit2 @ University of California, San Diego
California Institute for Telecommunications and Information Technology
Borderless CollaborationBetween Global University Research Centers at 10Gbps
iGrid
2005T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y
Maxine Brown, Tom DeFanti, Co-Chairs
www.igrid2005.org
100Gb of Bandwidth into the Calit2@UCSD BuildingMore than 150Gb GLIF Transoceanic Bandwidth!450 Attendees, 130 Participating Organizations
20 Countries Driving 49 Demonstrations1- or 10- Gbps Per Demo
![Page 23: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/23.jpg)
Building a Global Collaboratorium
Sony Digital Cinema Projector
24 Channel Digital Sound
Gigabit/sec Each Seat
![Page 24: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/24.jpg)
First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium
Keio University President Anzai
UCSD Chancellor Fox
Lays Technical Basis for
Global Digital
Cinema
Sony NTT SGI
![Page 25: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/25.jpg)
Using Digital Cinema ProjectorsTo Create the Next Generation of Virtual Reality
4KAVE—24 Megapixel Virtual RealityDesign: Greg Dawe, Calit2
![Page 26: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/26.jpg)
iGrid Lambda Visualization Services: 3D Videophones Are Here! The Personal Varrier Autostereo Display
• Varrier is a Head-Tracked Autostereo Virtual Reality Display– 30” LCD Widescreen Display with 2560x1600 Native Resolution– A Photographic Film Barrier Screen Affixed to a Glass Panel
– The Barrier Screen Reduces the Horizontal Resolution To 640 Lines
• Cameras Track Face with Neural Net to Locate Eyes• The Display Eliminates the Need to Wear Special Glasses
Source: Daniel Sandin, Thomas DeFanti, Jinghua Ge, Javier Girado, Robert Kooima, Tom Peterka—EVL, UIC
![Page 27: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/27.jpg)
PI Larry Smarr
![Page 28: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/28.jpg)
Evolution is the Principle of Biological Systems:Most of Evolutionary Time Was in the Microbial World
You Are
Here
Source: Carl Woese, et al
Much of Genome Work Has
Occurred in Animals
![Page 29: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/29.jpg)
Marine Genome Sequencing ProjectMeasuring the Genetic Diversity of Ocean Microbes
CAMERA will include All Sorcerer II Metagenomic Data
![Page 30: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/30.jpg)
Flat FileServerFarm
TeraGrid Backplane(10000s of CPUs)
W E
B
PO
RT
AL
Web
Local Cluster
DirectAccess LambdaCnxns
DedicatedCompute Farm(1000 CPUs)
Data-BaseFarm 10 GigE
Fabric
Calit2’s Direct Access Core Architecture Will Create Next Generation Metagenomics Server
Source: Phil Papadopoulos, SDSC, Calit2
+ W
eb S
ervi
ces
UserEnvironment
CAMERAComplex
![Page 31: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/31.jpg)
Interactive Remote Data and Visualization Services
• Multiple Scalable Displays• Hardware Pixel Streaming• Distributed Collaboration
• Scientific-Info Visualization• AMR Volume Visualization• Glyph and Feature Vis• Visualization Services
•Data Mining for Areas of Interest•Analysis and Feature Extraction•Data Mining Services
NCSA Altix Data and Vis Server
An SDSC/NCSA Data Collaboration
National Laboratory for Advanced Data Research
Linking to OptIPuter
![Page 32: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/32.jpg)
Alliance National Technology GridVision For Workshop and Training Facilities
Being Deployed Across the Alliance
Jason Leigh and Tom DeFanti, EVL; Rick Stevens, ANL
1998
![Page 33: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/33.jpg)
OptIPuter Scalable Adaptive Graphics Environment Enables Integration of HD Streams into Tiled Displays
Image Source: David Lee, NCMIR, UCSD
SAGE Developed
by Jason
Leigh et al. EVL, UIC
![Page 34: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/34.jpg)
The OptIPuter Enabled Collaboratory:Remote Researchers Jointly Exploring Complex Data
OptIPuter will ConnectThe Calit2@UCI
200M-Pixel Wall tothe 100M-Pixel Display
at Calit2@UCSDWith Shared Fast Deep Storage
“SunScreen” Run by Sun Opteron Cluster
UCI
UCSD
![Page 35: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/35.jpg)
Calit2 and the Venter Institute Will Combine Telepresence with Remote Interactive Analysis
OptIPuter Visualized
Data
HDTV Over
Lambda
Live Demonstration
of 21st Century National-Scale Team Science
25 Miles
Venter Institute
ACCESS DC?
![Page 36: “ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign](https://reader030.vdocuments.mx/reader030/viewer/2022032804/56649e585503460f94b514ce/html5/thumbnails/36.jpg)
Ten Years Old Technologies--the Shared Internet & the Web--Have Made the World “Flat”
• But Today’s Innovations– Dedicated Fiber Paths– Streaming HD TV– Large Display Systems– Massive Computing and Storage
• Are Reducing the World to a “Single Point”