new asian ip backbone architecture hideo ishii vice ... · design concept • no longer traditional...
TRANSCRIPT
![Page 1: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/1.jpg)
New Asian IP Backbone Architecture Hideo Ishii Vice President, Product Strategy & Management, IP & Cloud Services Pacnet
MyNOG 16th January 2012
![Page 2: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/2.jpg)
Who is Pacnet?
2
![Page 3: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/3.jpg)
International Connectivity in Asia
Countries in the Asia Pacific region connect to each other primarily using subsea cables – over 95% of intra-Asia traffic is through subsea cables
Primary gateway for US – Asia traffic is Japan
• Countries in the Asia Pacific region connect to each other primarily using subsea cables – over 88% of intra-Asia traffic is through subsea cables
• Primary gateway for US – Asia traffic is Japan
![Page 4: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/4.jpg)
International Connectivity in Asia
• Unique Positioning – Intra-Asia IP communications is mainly over subsea cable
systems – Typically a RING topology bridging multiple countries is
used – Cable length between cable landing stations is not too long,
for example, between 1,800km – 3,400km (EAC)
![Page 5: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/5.jpg)
Asia <> US IP Backbone Design
A. Layer 3 backbone circuits in Asia connect to US via Cable Landing Stations in Japan
B. Layer 3 backbone circuits connect to Tokyo/Osaka POPs from Asian countries, then both POP connect to US IP POPs
C. A + B combination
![Page 6: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/6.jpg)
Subsea Network Operations
![Page 7: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/7.jpg)
SDH Ring Protection
• Unidirectional 1+1 subnetwork connection protection (SNCP)
• Multiplex Section-Dedicated Protection Rings (MS-SD Ring)
• Multiplex Section-Shared Protection Rings (MS-SP Ring)
![Page 8: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/8.jpg)
SDH Ring Protection
• MS-SP Ring Protection
Working Protec-on
( Normal Condi-on)
![Page 9: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/9.jpg)
• MS-SP Ring Protection + TOP (TransOceanic Protocol)
Cable Cut!!
SDH Ring Protection
Working Protec-on
![Page 10: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/10.jpg)
Power Feeding (Normal)
-Xv
+Xv Feeding Voltage
0 Virtual Earth
Constant Current
STATION A STATION B
PFE Repeater
PFE
Sea Earth Sea Earth
+
+ -
-
![Page 11: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/11.jpg)
Cable Fault
PFE: Power Feeding Equipment
-Xv
0
+Xv
Power Feeding in Cable Fault
Feeding Voltage
Constant Current
STATION A STATION B
PFE Repeater
PFE
Sea Earth Sea Earth
+
+ -
-
Constant Current
![Page 12: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/12.jpg)
Fault location (1)
STATION A STATION B Repeater
1. Shunt Fault DC current into the ocean → Voltage measurement
Opt.Equip. Opt.Equip.
PFE PFE
![Page 13: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/13.jpg)
1. Cable cut (1) Fiber Break → Optical measurement (2) DC current into the ocean → Voltage measurement
Fault location (2)
Repeater Amp.
Station
Rx
Tx Test Signal
55-75km
Fiber break
![Page 14: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/14.jpg)
COTDR (Coherent Optical Time Domain Reflectance)
![Page 15: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/15.jpg)
Network Topology of Subsea Cable
Point to Point Branching
Ring
Festoon
![Page 16: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/16.jpg)
IP Backbone in Asia
![Page 17: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/17.jpg)
Design Challenges in Asia
• Internet traffic volume, as well as traffic direction from each Asian country is different – therefore Internet backbone design is not efficient now
• Not easy to change “traffic aggregation point” • Low statistical multiplexing effect on international circuits
due to backbone bandwidth and customer port bandwidth being the same
![Page 18: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/18.jpg)
Design Challenges in Asia
Korea
Rest of Asia
![Page 19: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/19.jpg)
IP Backbone Design
Tokyo
San Jose
LAX
Seoul
HKG
Singapore
Simple Layer3 Network Connec5vity
As commonly known, IP architects can see topology using traceroute easily. (But SP can hide actual topology using MPLS-‐TE anyway)
![Page 20: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/20.jpg)
IP Backbone and Layer 1 Backbone
SLTE DWDM SLTE
DWDM
SLTE DWDM
SLTE DWDM
SLTE DWDM
SLTE DWDM
SLTE DWDM
SLTE DWDM
IP IP
LSR
LSR
LSR
LSR
LSR
LSR
LSR
LSR
LSR
MPLS
Each Layer has each network topology and restoration and rerouting technology
![Page 21: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/21.jpg)
Traditional Asia <> US IP Backbone Architecture
Due to Ring Protection, all paths are going through DWDM/ADM equipment
Cable Landing Station
- Backhaul -
City POP
Hong Kong Korea Japan US
Not efficient due to bandwidth demands being unique at each country
Ping Pong traffic between POP and Cable Landing Station is not efficient and adds latency
DWDM ADM
DWDM ADM
SLTE SLTE
DWDM ADM
DWDM ADM
DWDM ADM
DWDM ADM
DWDM ADM
DWDM ADM
SLTE
Router in Japan handles Asia-US traffic due to traffic aggregation purpose
Router Router Router Router
SLTE
![Page 22: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/22.jpg)
NEW Asia <> US IP Backbone Architecture
Ability to manage traffic flow and capacity utilization
Cable Landing Station
- Backhaul -
City POP
Hong Kong Korea Japan US
Router
DWDM ADM
DWDM ADM
Router handles traffic that drop to Tokyo or go to US
Router Router Router
Router Router Router
![Page 23: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/23.jpg)
Circuit Protection by Router
STM64 SDH Interface
10GE WAN-PHY
SLTE
SLTE
SLTE
SLTE
SLTE
SLTE
SLTE
SLTE
Router Router
Router Router IP POP
IP POP
IP POP
IP POP
Cable Landing Station
EAC
C2C
JAPAN
KOREA
Hong Kong
TAIWAN
Protection Route Fast Reroute path
![Page 24: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/24.jpg)
Backhaul Configuration
SLTE
SLTE
Router
Cable Landing Station
IPPOP
STM64 SDH Interface
10GE WAN-PHY
10GE LAN-PHY
x Km – 1xKm
BFD 50ms
BFD is possible solution and also IEEE802.1ag (CC) is also other way to maintain 10GE LAN-PHY Backhaul Circuits.
![Page 25: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/25.jpg)
Router Configuration
• Interface carrier-delay – Backhaul side : 100ms – Subsea side : 0ms
• Backbone Circuits (n x 10Gbps) – Link Aggregation
• Reduce IPv4 allocation /30 • LACP Hello can help failure detection
![Page 26: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/26.jpg)
Design Concept
• No longer traditional Ring Protection mechanism on top of subsea cable system
• Use 10GE WAN-PHY since WAN-PHY Interface detects alarm of subsea portion from OTN
• MPLS LSR will perform FRR (Active and Standby LSPs) instead of Ring Protection – Subsea is basically 1+1 conf, Active + standby LSPs therefore is reasonable.
• Traffic monitoring will be based on LSP traffic data
• LSP hierarchy
• Additional RR hierarchy
• No GMPLS/ASON, “no c-place and d-plane separation”
![Page 27: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/27.jpg)
Network Advantages
• Contingency plan – City POP failure and cable cut by earthquake
• Route Flexibility – Explicit LSP allows us to utilize alternative active paths
using “Protection Path” • Better traffic aggregation by Cable Landing Station routers
– Eliminate SDH level hierarchy, aggregation is LSP level with flexible BW
• Easy to upgrade subsea portion to 40G or 100G in near future • Eliminate SDH related CAPEX at Cable Landing Station
![Page 28: New Asian IP Backbone Architecture Hideo Ishii Vice ... · Design Concept • No longer traditional Ring Protection mechanism on top of subsea cable system • Use 10GE WAN-PHY since](https://reader034.vdocuments.mx/reader034/viewer/2022042306/5ed1bb7421276e370023b48e/html5/thumbnails/28.jpg)
Operational Preparation
At Cable Landing Stations • High performance Router with redundancy • No Virtual Router • Single Interface card will be used as much as possible
– Spare and reusable purpose
• Of course, IPv6 is enabled