"The OptIPuter: an IP Over Lambda Testbed"

Invited Talk

NREN Workshop VII: Optical Network Testbeds (ONT)

NASA Ames Research Center

Mountain View, CA

August 9, 2004

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technologies

Harry E. Gruber Professor,

Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

The OptIPuter Project – Removing Bandwidth as an Obstacle In Data Intensive Sciences

• NSF Large Information Technology Research Proposal– Cal-(IT)2 and UIC Lead Campuses—Larry Smarr PI– USC, SDSU, NW, Texas A&M, Univ. Amsterdam Partnering Campuses

• Industrial Partners– IBM, Sun, Telcordia, Chiaro Networks, Calient, Glimmerglass, Lucent

• $13.5 Million Over Five Years• Optical IP Streams From Lab Clusters to Large Data Objects NIH Biomedical Informatics NSF EarthScope

and ORION

http://ncmir.ucsd.edu/gallery.html

siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml

Research Network

What is the OptIPuter?

• Applications Drivers Interactive Large Data Objects

• OptIPuter Nodes Scalable PC Cluster LambdaGrid “Browser”

• IP over Lambda Connectivity Predictable Backplane

• Open Source LambdaGrid Middleware Network is Reservable

• Data Retrieval and Mining Global Virtual Disk Drives

• High Defn. Visualization, Collaboration “Ultra-Reality TV”

See Nov 2003 Communications of the ACM for Articles on OptIPuter Technologies

www.optiputer.net

UCSD Packet Test BedOptIPuter Year 2

4 1

OptIPuter UCSD / San Diego Network and Nodes -- 2004

2

ChiaroEnstara

SDSC JSOE

CSE

4 4

Bonded GigE 1

8-nodecluster

(shared)

IBM 9-node Viz cluster

SIO

SOM

IBM 48-node storage cluster

IBM 128-node CPU cluster

Sun 128-node computecluster

Sun 24-32-node

compute cluster

CRCA

6th College

3-node Viz cluster

1

IBM 9 mpixeldisplay pairs

Geowall 2Tiled Display

10

Sun 22-node

Viz cluster

10

Extreme 400Extreme 400

1

1To UCI and ISI via

CalREN-HPR

DellGeowall

Preuss

IBM 9 mpixeldisplay pairs

Dell Viz

Dell 5224

Dell 5224

Dell 5224

Dell 5224

Dell 5224

Dell 5224

Juniper T320 Cisco 6509

HP28-nodecluster

(shared)

HP4-nodecontrol

Sun 24-32-node

computecluster

Infiniband4 nodes

Infiniband64 nodes

Sun 5-node cluster

Sun24-32-node

cluster

9-nodecluster

(shared)

Extreme 400

7-node cluster(shared)

UCSD Quartzite Core at Completion (Year 5 of OptIPuter)

QuartziteCore

CalREN-HPRResearch

Cloud

Campus ResearchCloud

GigE Switch withDual 10GigE Upliks

.....To cluster nodes

GigE Switch withDual 10GigE Upliks

.....To cluster nodes

GigE Switch withDual 10GigE Upliks

.....To cluster nodes

GigE

10GigE

...Toothernodes

Quartzite CommunicationsCore Year 3

ProductionOOO

Switch

Juniper T320

4 GigE4 pair fiber

Wavelength Selective

Switch

To 10GigE clusternode interfaces

..... To 10GigE clusternode interfaces and

other switches

Chiaro Enstara

32 10GigE

• Recommended for Funding

• Physical HW to Enable Optiputer and Other Campus Networking Research

• Hybrid Network Instrument

Currently Under Review

by NSF

Edge and Core OptIPuter Nodes: Using Parallel Lambdas to Prototype a Bandwidth-Rich World

Int’l GE, 10GE

Nat’l GE, 10GE

I-WIRE OC-192

16x1 GE 16x10 GE?

16-dual Xeon Cluster

16x1GE

OMNInet 10GEs

128x128 Calient

64x64GG

Original Plan -- More Now in Place

UIC/EVLNortel, SBC Partnership

With UIC &NU

@ NU

EVL

10GE OptIPuter CAVEWAVEon the National LambdaRail

Next Step: Coupling NASA Centers

to NSF OptIPuter Source: Tom DeFanti, OptIPuter co-PI

OptIPuter Software Architecture from Grid to LambdaGrid

Layer 4: XCPNode Operating Systems

-configuration, Net Management

Grid and Web Middleware – (Globus/OGSA/WebServices/J2EE)

Physical Resources

DVC #1

OptIPuter Applications

DVC #2 DVC #3

Layer 5: SABUL, RBUDP, Fast, GTP

Real-Time Objects

Security Models

Data Services:DWTP

Higher Level Grid Services

VisualizationDVC/

Middleware

High-Speed Transport

Optical Signaling/Mgmt

Source: Andrew Chien, UCSDOptIPuter Software Systems Architect

DVC=Distributed Virtual Computer

Ultra-Resolution OptIPuter Displays Utilizing Photonic Multicasting --Scaling to 100 Million Pixels

GlimmerglassSwitch Used to

Multicast and Direct TeraVision Stream

from One Tile to Another on the

Geowall-2

Glimmerglass Switch

Driven by

Linux Graphics Clusters

30 Megapixel High-Resolution Visualizations= ~1 Gigapixel at 30fps = ~30Gb/s Bandwidth

UIC-EVL

Source: Jason Leigh, OptIPuter co-PI

The OptIPuter Will be Used to Enhance Collaboration

OptIPuter Will ConnectFalko Kuester’s Cal-(IT)2@UCI

Smart Classroom and The 50M-Pixel Display

At UCSD Ellisman’sBIRN Laboratories

OptIPuter Organization Chart

Larry SmarrPrincipal Investigator

Maxine BrownProject Manager

Frontier Advisory Board (FAB)

Network and Hardware

Infrastructure

Tom DeFanti and Phil Papadopoulos

Co-PIs

Software Architecture

Andrew Chien

Data, Visualization and Collaboration

Jason LeighCo-PI

Applications and Outreach

Mark Ellisman, co-PI

John OrcuttDebi Kilb/Tom

Moher

Campus Testbeds

SoCal Testbed (network, clusters, storage)

Chicago/ Int’l. Testbed (network, visualization clusters and displays)

National Testbed

Optical Signaling Protocols

Middleware/DVC

Real-Time OS

Data Storage

Security

Application Performance Modeling

Transport Protocols

Data

Visualization/ Collaboration

Volume Visualization

High-Performance Visualization and Data Analysis

Photonic Multicast

LambdaRAM

Bioscience (NCMIR/BIRN)

Geoscience (EarthScope, Oceanographic)

Education & Outreach

Cyberinfrastructure in Design Phase--

Fiber Optic CablesSatelliteWireless

Future OptIPuter Driver: Gigabit Fibers on the Ocean FloorORION-Ocean Research Interactive Ocean Network

www.neptune.washington.edu

Currently Under Review by NSF