![Page 1: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/1.jpg)
Using Photonics to Prototype the Research Campus Infrastructure of the Future:
The UCSD Quartzite Project
Philip Papadopoulos
Larry Smarr
Joseph Ford
Shaya Fainman
Brian Dunne
University of California, San Diego
![Page 2: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/2.jpg)
Interconnecting Regional Optical NetworksIs Driving Campus Optical Infrastructure Deployment
http://paintsquirrel.ucs.indiana.edu/RON/fiber_map_draft.pdf
CENIC2008
1999
![Page 3: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/3.jpg)
CENIC Switched Ethernet NetworkHPRng-L2 Design
Source: Jim Dolgonas, CENIC
![Page 4: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/4.jpg)
CENIC Switched Optical NetworkHPRng-L1 design
Source: Jim Dolgonas, CENIC
![Page 5: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/5.jpg)
Source: Jim Dolgonas, CENIC
Campus Preparations Needed to Accept CENIC CalREN Handoff to Campus
![Page 6: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/6.jpg)
Current UCSD Experimental Optical Core:Ready to Couple to CENIC L1, L2, L3 Services
Source: Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)
Funded by NSF MRI
Grant
Lucent
Glimmerglass
Force10
OptIPuter Border Router
CENIC L1, L2Services
Cisco 6509
Goals by 2008:
>= 50 endpoints at 10 GigE
>= 32 Packet switched
>= 32 Switched wavelengths
>= 300 Connected endpoints
Approximately 0.5 TBit/s Arrive at the “Optical” Center
of CampusSwitching will be a Hybrid
Combination of: Packet, Lambda, Circuit --OOO and Packet Switches
Already in Place
![Page 7: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/7.jpg)
Calit2 SunlightOptical Exchange Contains Quartzite
10:45 am Feb. 21, 2008
![Page 8: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/8.jpg)
Block Layout of Quartzite/OptIPuter Network
Quartzite
~30 10 Gbps Lightpaths16 More to Come
Glimmerglass
OOO Switch
Application Specific Embedded Switches
![Page 9: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/9.jpg)
Calit2 Microbial Metagenomics Cluster Production System
512 Processors ~5 Teraflops
~ 200 Terabytes Storage 1GbE and
10GbESwitched/ Routed
Core
~200TB Sun
X4500 Storage
10GbE
![Page 10: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/10.jpg)
Straightforward Use CaseQuartzite Connected Computational Science
• Needed to Run a Large Number of Pre-computed BLAST Sequence Alignments for JCVI Fragment Recruitment Viewer (FRV)
• CAMERA Development and Batch Clusters Oversubscribed• Had Spare Capacity in SDSC Cluster Connected to Quartzite
• Reconfigure Private Side of Network to “Attach” Nodes in SDSC Rockstar Cluster to CAMERA Ikelite Cluster for Batch Processing– Direct Network Connection to CAMERA X4500 Thumper Storage– No Changes to Application Software or Paths– Rockstar Nodes Reconfigured to Support FRV Needs
• Rockstar (SDSC) Nodes Integrated as Part of Ikelite (Calit2) Batch System– ~2000 CPU-Days Dedicated Computing over Previous 14 Days– O(2TB) of Output– Running Right Now
Source:Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)
![Page 11: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/11.jpg)
Green Modular Datacenters Optically ConnectedUCSD Installing Two Sun Microsystems Boxes
UCSD Structural Engineering
Dept. Conducted Tests
May 2007
![Page 12: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/12.jpg)
Initial Deployment of UCSDDWDM Reconfigurable Lambda Mesh
16 Connected Pairs at 10GbE
Source:Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)
![Page 13: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/13.jpg)
N x 10 GbitN x 10 Gbit
10 Gigabit L2/L3 Switch
Eco-Friendly Storage and Compute
Microarray
Your Lab Here
Wide-Area 10G• Cenic/HPR
• NLR Cavewave• Cinegrid• …
Quartzite – Influencing Next-Generation UCSD Network
On-Demand Physical Connections
“Network in a box “• > 200 Connections
• DWDM or Gray Optics
Active Data Replication
Source:Phil Papadopoulos, SDSC/Calit2
![Page 14: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/14.jpg)
UCSD Planned Optical NetworkedBiomedical Researchers and Instruments
Cellular & Molecular Medicine West
National Center for
Microscopy & Imaging
Biomedical Research
Center for Molecular Genetics Pharmaceutical
Sciences Building
Cellular & Molecular Medicine East
CryoElectron Microscopy Facility
Radiology Imaging Lab
Bioengineering
Calit2@UCSD
San Diego Supercomputer
Center
• Connects at 10 Gbps :– Microarrays
– Genome Sequencers
– Mass Spectrometry
– Light and Electron Microscopes
– Whole Body Imagers
– Computing
– Storage
![Page 15: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/15.jpg)
Creating a UC Cyberinfrastructure of Campus OptIPuter “On-Ramps” to NLR, I2, and TeraGrid Resources
UC San Francisco
UC San Diego
UC Riverside
UC Irvine
UC Davis
UC Berkeley
UC Santa Cruz
UC Santa Barbara
UC Los Angeles
UC Merced
OptIPuter + CalREN-XD + TeraGrid = “OptiGrid”
Source: Fran Berman, SDSC , Larry Smarr, Calit2
Creating a Critical Mass of End Users on a Secure LambdaGrid
![Page 16: Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project](https://reader037.vdocuments.mx/reader037/viewer/2022110318/55d54f4dbb61ebbb488b45f1/html5/thumbnails/16.jpg)
Summary
• Quartzite Deployment is Nearly Complete• More Than ½ Terabit/s (Unidirectional) Aggregate
Bandwidth• Twenty 10Gbit DWDM-Connected Pairs (40 Optics)
(400 Gbit/S)• 4x4x8lambda WSS• Has Already Influenced CAMERA Project Design• Has Already Influenced Next-Generation Campus
Research Cyber-infrastructure• Room for Expansion Within the Core