dwdm-ram:enabling grid services with dynamic optical networks
DESCRIPTION
Packet-switching technology Great solution for small-burst communication, such as email, telnet, etc. Data-intensive grid applications Involves moving massive amounts of data Requires high and sustained bandwidth DWDM Basically circuit switching Enable QoS at the Physical Layer Provide High bandwidth Sustained bandwidth DWDM based on dynamic wavelength switching Enable dedicated optical paths to be allocated dynamicallyTRANSCRIPT
![Page 1: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/1.jpg)
1
DWDM-RAM:Enabling Grid Services with Dynamic Optical
NetworksS. Figueira, S. Naiksatam, H.
Cohen,D. Cutrell, P. Daspit, D. Gutierrez,D. Hoang, T. Lavian, J. Mambretti,
S. Merrill, F. Travostino
![Page 2: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/2.jpg)
2
DWDM-RAM
DARPA-funded projectSanta Clara, CA
Nortel NetworksSanta Clara University
Chicago, ILiCAIR / Northwestern University
AustraliaUniversity of Technology, Sydney
![Page 3: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/3.jpg)
3
DWDM-RAM
GoalMake dynamic optical network usable
by grid applicationsProvide lightpaths as a serviceDesign and implement in prototype a
new type of grid service architecture optimized to support data-intensive grid applications through advanced optical network
![Page 4: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/4.jpg)
4
Why Dynamic Optical Network?
Packet-switching technologyGreat solution for small-burst
communication, such as email, telnet, etc.
Data-intensive grid applicationsInvolves moving massive amounts of
dataRequires high and sustained bandwidth
![Page 5: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/5.jpg)
5
Why Dynamic Optical Network?
DWDMBasically circuit switchingEnable QoS at the Physical LayerProvide
High bandwidthSustained bandwidth
![Page 6: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/6.jpg)
6
Why Dynamic Optical Network?
DWDM based on dynamic wavelength switchingEnable dedicated optical paths to be
allocated dynamically
In a few seconds…
A B A
C
![Page 7: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/7.jpg)
7
Why Dynamic Optical Network?
Any drawbacks?The overhead incurred during end-to-
end path setup
Not really a problemThe overhead is amortized by the
long time taken to move massive amounts of data
![Page 8: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/8.jpg)
8
Why Dynamic Optical Network?
Setup time = 48 sec, Bandwidth=920 Mbps
0%10%20%30%40%50%60%70%80%90%
100%
100 1000 10000 100000 1000000 10000000
File Size (MBytes)
Se
tup
tim
e /
To
tal T
ran
sfe
r T
ime
500GB
When dealing with data-intensive applications, overhead is
insignificant!
![Page 9: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/9.jpg)
9
Why Grid Services?
Applications need access to the networkTo request and release lightpaths
Grid servicesCan provide an interface to allocate
and release lightpaths
![Page 10: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/10.jpg)
10
DWDM-RAM Architecture
DataCenter
1
n
1
n
DataCenter
Data-Intensive Applications
Dynamic Lambda, Optical Burst, etc., Grid services
DataTransfer Service
Basic NetworkResource
Service
NetworkResource Scheduler
Network Resource Service
DataHandlerService
Information S
ervice
Application MiddlewareLayer
Network ResourceMiddlewareLayer
Connectivity and Fabric Layers
OGSI-ification API
NRS Grid Service API
DTS API
Optical path control
![Page 11: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/11.jpg)
11
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 12: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/12.jpg)
12
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 13: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/13.jpg)
13
DWDM-RAM Architecture
OMNInet - photonic testbed networkFour-node multi-site optical metro
testbed network in Chicago -- the first 10GE service trial!
All-optical MEMS-based switching and advanced high-speed services
Partners: SBC, Nortel, iCAIR at Northwestern, EVL, CANARIE, ANL
![Page 14: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/14.jpg)
14
4x10GE
Northwestern U
OpticalSwitchingPlatform
Passport8600
ApplicationCluster
OMNInet Core Nodes
ApplicationCluster
OpticalSwitchingPlatform
Passport8600
4x10GE
StarLight
OPTera Metro5200
ApplicationCluster
OpticalSwitchingPlatform
Passport8600
4x10GE8x1GE
UIC
CA*net3--Chicago
OpticalSwitchingPlatform
Passport8600
Closed loop
4x10GE8x1GE
8x1GE
8x1GELoop
![Page 15: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/15.jpg)
15
DWDM-RAM Architecture
ODIN - Optical Dynamic Intelligent NetworkSoftware suite that controls the OMNInet
through lower-level API callsDesigned for high-performance, long-term
flow with flexible and fine grained controlStateless server, which includes an API to
provide path provisioning and monitoring to the higher layers
![Page 16: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/16.jpg)
16
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 17: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/17.jpg)
17
DWDM-RAM Architecture
Communication ProtocolsCurrently, using standard off-the-shelf
communication protocol suites Provide communication between application
clients and DWDM-RAM services and between DWDM-RAM components
Communication consists of mainly SOAP messages in HTTP envelopes transported over TCP/IP connections
![Page 18: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/18.jpg)
18
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 19: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/19.jpg)
19
DWDM-RAM Architecture
Network Resource SchedulingEssentially a resource management
serviceMaintains schedules and provisions
resources in accordance with the schedule
Provides an OGSI compliant interface to request the optical network resources
![Page 20: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/20.jpg)
20
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 21: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/21.jpg)
21
DWDM-RAM Architecture
Data Transfer SchedulingDirect extension of the NRS service,
provides an OGSI interfaceShares the same backend scheduling
engine and resides on the same hostProvides a high-level functionalityAllow applications to schedule data
transfers without the need to directly reserve lightpaths
The service also perform the actual data transfer once the network is allocated
![Page 22: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/22.jpg)
22
Data Transfer Scheduling
Uses standard ftpUses NRS to allocate lambdasUses OGSI calls to request network resources
λData Receiver Data Source
FTP client FTP server
DTS NRS
Client App
![Page 23: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/23.jpg)
23
DWDM-RAM Architecture
Applications
Data Transfer Scheduling
Network Resource Scheduling
Communication Protocols
ODIN
OMNInetFabric
Connectivity
Resource
Collective
Application
![Page 24: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/24.jpg)
24
DWDM-RAM Architecture
ApplicationsTarget is data-intensive applications
since their requirements make them the perfect costumer for DWDM networks
![Page 25: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/25.jpg)
25
DWDM-RAM Modes
Applications may request a data transfer
Applications
Data Transfer Scheduling
Network Resource Scheduling
![Page 26: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/26.jpg)
26
DWDM-RAM Modes
Applications may request a network connection
Applications
Network Resource Scheduling
![Page 27: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/27.jpg)
27
DWDM-RAM Modes
Applications may request a set of resources through any resource allocator, which will handle the network reservation
Applications
Network Resource Scheduling
Resource Allocator
![Page 28: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/28.jpg)
28
The Network Service
The NRS is the key for providing network as a resourceIt is a service with an application-level
interfaceUsed for requesting, releasing, and
managing the underlying network resources
![Page 29: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/29.jpg)
29
The Network Service
NRSUnderstands the topology of the
networkMaintains schedules and provisions
resources in accordance with the schedule
Keeps one scheduling map for each lambda in each segment
![Page 30: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/30.jpg)
30
The Network Service
4 Scheduling maps:Each with a vector of time intervals for keeping the reservations
![Page 31: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/31.jpg)
31
The Network Service
4 scheduling maps for each segment
![Page 32: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/32.jpg)
32
The Network Service
NRSProvides an OGSI-based interface to
network resourcesRequest parameters
Network addresses of the hosts to be connectedWindow of time for the allocationDuration of the allocationMinimum and maximum acceptable bandwidth
(future)
![Page 33: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/33.jpg)
33
The Network Service
NRS Provides the network resource
On demandBy advance reservation
Network is requested within a windowConstrainedUnder-constrained
![Page 34: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/34.jpg)
34
The Network Service
On DemandConstrained window: right now!Under-constrained window: ASAP!
Advance ReservationConstrained window
Tight window, fits the transference time closely
Under-constrained windowLarge window, fits the transference time looselyAllows flexibility in the scheduling
![Page 35: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/35.jpg)
35
The Network ServiceUnder-constrained window
Request for 1/2 hour between 4:00 and 5:30 on Segment D granted to User W at 4:00
New request from User X for same segment for 1 hour between 3:30 and 5:00
Reschedule user W to 4:30; user X to 3:30. Everyone is happy.
Route allocated for a time slot; new request comes in; 1st route can be rescheduled for a later slot within window to accommodate new request
4:30 5:00 5:304:003:30
W
4:30 5:00 5:304:003:30
X
4:30 5:00 5:304:003:30
WX
![Page 36: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/36.jpg)
36
Experiments
Experiments have been performed on the OMNInetEnd-to-end FTP transfer over a 1Gbps
linkGoal
Exercise the network to show that the full bandwidth can be utilized
Demonstrate that the path setup time is not significant
![Page 37: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/37.jpg)
37
End-to-End Transfer Time
0.5s 3.6s 0.5s 174s 0.3s 11s
OD
IN S
erve
r P
roce
ssin
g
File
tra
nsfe
r do
ne,
path
re
leas
ed
File
tra
nsfe
r re
ques
t ar
rives
Pat
h D
eallo
cati
on
req
ues
t
Dat
a T
ran
sfer
20 G
B
Pat
h ID
re
turn
ed
OD
IN S
erve
r P
roce
ssin
g
Pat
h A
lloca
tio
n
req
ues
t
25s
Net
wo
rk
reco
nfi
gu
rati
on
0.14sF
TP
set
up
ti
me
![Page 38: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/38.jpg)
38
Application Level Measurements
File size: 20 GB
Path allocation: 29.7 secs
Data transfer setup time:
0.141 secs
FTP transfer time: 174 secs
Maximum transfer rate: 935 Mbits/sec
Path tear down time: 11.3 secs
Effective transfer rate: 762 Mbits/sec
![Page 39: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/39.jpg)
39
20GB File Transfer
![Page 40: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/40.jpg)
40
Current Status
Allocation of one-segment lightpathOn demand allocation has been
tested at the OMNInetAdvance reservation has been
implemented but not tested at the OMNInet
![Page 41: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/41.jpg)
41
Future Work
Nortel Networks / SURFnetLightpath allocationMultiple-segment lightpathsOptimized allocation when more than one
path is available
Scheduling in large-scale networks Involves different administrative and/or
geographic domainsRequires a distributed approach
![Page 42: DWDM-RAM:Enabling Grid Services with Dynamic Optical Networks](https://reader036.vdocuments.mx/reader036/viewer/2022062514/55918b091a28ab70148b4608/html5/thumbnails/42.jpg)
42
Conclusion
Dynamic optical network is a key technology for data-intensive grid computingDWDM-RAM’s network service enables lightpaths to be provided as a primary resource