© ciena confidential and proprietary intelligent optical networking for flexible ethernet lightpath...

© Ciena Confidential and Proprietary

Intelligent Optical Networking for Flexible Ethernet Lightpath Delivery in Research Networks

TERENA 2007, Session 4B

Dr John-Paul Hemingway

Office of the CTO, Ciena

22nd May 2007

© Ciena Confidential and Proprietary 2

Agenda

Flexible Light Paths– What do we mean?

Single Domain Networking

UltrascienceNet Application Example

Multi Domain Interworking

Future Directions

OTN Networking

Connection Oriented Ethernet Networking


SDH / IP/ Ethernet

Research NetworksThe Need for Flexible Lightpaths

Connectivity Requirements

Guaranteed Deterministic Bandwidth (10s Mbps – 10Gbps+)

Scheduled-Demand Bandwidth; Hours, Days, Weeks

Low Latency

Data Replication

Multi-site correlation

High Availability

Data Collection Data Crunching Data Storage

Scarce Resources

Mulitple Communities of Interest

10Gb

200Mb

10Mb1Gb (FC)

500Mb


MPLS

Research NetworksGlobalisation is a reality

Global, Multi-Domain Connectivity

Service definition across Protocol boundaries

Service Creation across domains

Network Element Interworking functions

Data Collection Data Crunching Data Storage

10Gb

200Mb10Mb

SDH SONET


Domain Control Plane Technologies

SDH/SONET

IP

Ethernet

WDM/Optical

Converged Ethernet-TDM

CIRCUIT SWITCHED

• Deterministic

• Guaranteed Bandwidth

• High Availability

GMPLS/ASON

PACKET SWITCHED

• Granular Bandwidth

• Bandwidth Sharing

• Statistical Multiplexing

MPLS - GMPLS


Example Switched Network InfrastructureUltraScience Net (USN)

4-Node Switched Network using Ciena CoreDirector CI

Parallel OC-192 SONET links

Alternate Path over MPLS

Excellent Testbed Facility

Looped SONET XC to increase effective Transmission Length

Comparison of IP performance over EthoTDM and EthoMPLS

E2E VLAN Testing over EthoTDM and EthoMPLS

Scripted B/W reservationCourtesy of Nageswara S. Rao, Oak Ridge National Laboratory


UltraScience Net (USN)

1GbE mapped into OC-12c

Infiniband Storage protocol mapped from IB Switch into OC-12c

OC-12c cross-connected into mulitple loops

Longest effective length of 34400 miles (Around the Earth once)

Without performance degradation of GbE

Infiniband over 8600 miles

Effective flat throughput compared to back-back


Multi-Domain Control PlanesKey Points:

Two Main Options within the Standards Bodies

GMPLS (IETF)

ASON (ITU-T and OIF extensions)

Challenges

Nodal Interworking

Scalability

Security & Policy

R&E Network A

NE NE

R&E Network B

NE NE

R&E Network C

NE NE

ClientDevice

ClientDevice

Global Networking

ClientDevice

NE

NE

NE

NE

NE

NE

NE

NE

NE


ITU-T ASON Control Plane ModelKey Points:

Multiple Domains within a network

Common UNI and E-NNI border interfaces

Flexibility to establish domain boundaries

Policy control over the interfaces between domains

R&E Network A

NE NE

R&E Network B

NE NE

R&E Network C

NE NE

ClientDevice

ClientDevice

Global Networking

ClientDevice

UNI E-NNI UNI

E-NNI

UNI

E-NNI

I-NNI

I-NNI

I-NNI

R&E Network A

NE NE

R&E Network B

NE NE

R&E Network C

NE NE

ClientDevice

ClientDevice

ClientDevice

UNI E-NNI UNI

E-NNI

UNI

E-NNI

OTN

SDH

SONET

Domain GMPLS Virtual Node

ASON and GMPLS control planes can work together

GMPLS virtualized networks

E.g. DRAGON


OIF

E-NNI Routing 1.0 Approved Jan’07

OSPF extensions for ASON

UNI 2.0 in progress

adds Ethernet, Connection Modification and G.709 support

E-NNI 2.0 progressing in parallel

ITU-T

Signaling Specifications Stable

Routing extensions planned

Will be done jointly with OIF and IETF work on OSPF

ASON management work in progress

G.7718.1 object model (Dec’06)

G.7716 control plane initialization

Standards Are Still MaturingIETF

Basic Specifications Stable

RFCs for basic signaling and routing for GMPLS

Some extensions in progress

Joint work on OSPF extensions with OIF and IETF members

Other work includes MPLS-GMPLS integration, control of Ethernet and PBB-TE, and Inter-domain signaling and routing

© Ciena Confidential and Proprietary 11© Ciena Confidential and Proprietary

Control Plane Future Directions


WDM is now an unmanaged network “Server” to many transport “Clients” (which now includes SONET/SDH)

Evolution of the Client-Server Network

WDM

Alien Wavelengths

FC

ESCON

IP

IP

Ethernet

Ethernet

IPIPTDMVoice

TDMPL

ATM

SONET/SDH

SONET/SDH is Managed Transport “Server” layer for existing service “clients”

WDM augments SONET/SDH capacity

IP builds over WDM

… so does Ethernet

… and ESCON, FC, services

Animated Slide

OTN

OTN provides the necessary Managed Transparent Service for all Transport Clients


Emergence of Connection Oriented Ethernet Driven by Demand for packet focused replacement of SDH

Robust as SDH

Less Complex than MPLS

Less Costly than either

Connection oriented for deterministic B/W

Disable MAC learning, Broadcast Unknown, STP

Explicit Paths and CAC for guaranteed QoS and Restoration

High Availability

Transparent L2 Aggregation

Mux Efficiency

WDM

Alien Wavelengths

FC

ESCON

IP

IP

COE*

Ethernet

IPIPTDMVoice

TDMPL

ATM

SONET/SDH

OTN

*COE: Connection-oriented Ethernet


Optical Transport Network (OTN)ITU Standards G.709 “Digital Wrapper”, G.872, G.873.1

Defines line/muxing rates, Optical Transport Unit (OTU)

ODU-1/2/3 payload in OTU-1/2/3 = 2.5/2.7Gbps, 10/10.7Gbps, 40/43.0Gbps

OTU-2 supports 10GbE LAN PHY (Extensions to include Preamble, Over-clocked for IFG)

OTN & SONET/SDH share same foundation

Similar framing with addition of OTN FEC

Powerful OA&M capabilities (GCC0 akin to DCC)

Asynchronous and Transparent

Services with different clock sources integrated side-by-side

Secure; Client OAM channels maintained

Overheadfor

OA&M

Traffic Payload

ForwardError

CorrectionODU

FAS OTUOPU

Client Payload FEC

1

2

3

4

1 7 8 14 15 16 17 3824 3825 4080

1

2

3

4

1 7 8 14 15 16 17 3824 3825 4080FAS: Frame Alignment SignalOTU: Optical Transport UnitODU: Optical Data UnitOPU: Optical Payload Unit


Extension of Control Plane to OTN

OTN Electrical Signals

OPVC, ODU1, ODU2

Similar to SONET/SDH

Overhead bytes for monitoring, alarms, signaling (GCC)

Extension of control plane should be straight-forward

UNI-2.0 incorporating G.709 Interface definitions


Emerging COE Implementations

Two data plane implementation efforts are in progress

Ethernet-based: PBB-TE (Being defined by IEEE 802.1ah)

MPLS-based: T-MPLS (Being defined by ITU G.8110)

PBB-TE and T-MPLS are addressing the same problem in different ways and promise to provide roughly equivalent results

PBB-TE is providing connection-oriented, deterministic behavior to Ethernet

T-MPLS is integrating packet transport into transport equipment

Currently no clear “winner”

PBB-TE plans have been publicized by BT

T-MPLS standards are advancing in ITUPBB-TE T-MPLS

?


T-MPLS“Transport – Multi-Protocol Label Switching”

T-MPLS is a “carrier-grade” packet transport protocol

Operated by Transport Layer Equipment (not Routers)

Architecture Standardized in ITU G.8110

Connection-oriented subset of IETF’s IP/MPLS

Any packet type supported (in principle)

Current focus on Ethernet

Consistent with existing transport networks

Convergence focus with OTN/WDM and SONET/SDH

Integration of packet transport requirements into existing transport promises lower cost

Avoid cost associated with IP routing


PBB-TE“Provider Backbone Bridging with Traffic Engineering”

PBB-TE is a connection-oriented enhancement to Ethernet

Based on IEEE’s “Provider Backbone Bridging” standard 802.1ah

PBB Mac-in-Mac approach segregates provider networking domain from end users

Transparent client connectivity

Packet forwarding is consistent with existing Ethernet switching equipment

VLAN and Destination MAC Address

Aligns with high growth in Ethernet services

Use of existing Ethernet technology for transport promises lower cost

Avoid cost associated with IP routing


PBB-TE differences from Ethernet

Predictable & deterministic Connection-oriented behavior

Switch off bridging, broadcast and STP on per VLAN basis

“Static” forwarding & connection provisioning

OSS-driven traffic and bandwidth management (incl. call admission control)

Unique, Traceable & Scalable Address Space

Source MAC Address + Destination MAC Address + VLAN ID

16 million (theoretically)

New Ethernet OAM

Connectivity Fault Management: 802.1ag/Y.1731

Performance Management: Y.1731/MEF10

New Ethernet service protection

Ethernet 1+1/1:1 Automatic Protection Switching: G.8031


Extension of Control Plane to PBB-TE

G.ASON/GMPLS control plane is directly applicable to PBB-TE

Connection-oriented, point-to-point

ietf draft-fedyk-gmpls-ethernet-pbt-00.txt

GELS – GMPLS controlled Ethernet Label Switching

Network Scaling Not a Big Concern

Influenced by number of links in network not number of connections

Connection Restoration May be Challenged

PBB-TE has potentially a lot more connections to process than SDH/SONET

Speed is influenced by number of connections requiring simultaneous restoration

10G SONET OC192 link / 51Mbps per connection =< 192 connections per link

10G PBB-TE 10GE link / 1Mbps per connection =< 10,000 connections per link


PBB-TE Tunnel Connection Setup

Distributed Database of PBB-TE connection attributes

Includes home, actual and diverse route information

ASON/GMPLS signaling

Signaled tunnel creation from OSS

Update forwarding tables after path confirmation

PBBTEDB

PBBTEDB

PBBTEDB

Creation

CACSETUP

CAC

(PROCEEDING)

CAC

SETUP

Update Fwd Table(PROCEEDING)

CONNECT

CONNECT

Home, actual & diverse route connection

attributes state information

Update Fwd Table

Update Fwd Table

Connection attributes state

information

Connection attributes state

information


Summary

Dynamic Lightpaths achievable through control plane networks

Circuit Switched networks provide robust infrastructure (USN)

Interoperation possible though ASON/GMPLS

Future Directions for Control Plane Networks

OTN for multi-service networks

COE for Ethernet focussed networks

GASON/GMPLS look applicable for both


Thank-youQuestions?

© ciena confidential and proprietary intelligent optical networking for flexible ethernet lightpath...

Documents