Fiber in Data Centers
What’s Next?
Srinivasan B, RCDD
Hubbell Fiber Systems
10G / 40G / 100G / 400G
Standards, Applications and
Practices
Agenda Part 1: Current Technologies
▪ Standards Review
• IEEE 802.3: Ethernet Fundamentals
• TIA-568.3-D: Telecommunications Fiber Cabling
• TIA-942-A: Data Center Standard Overview
▪ IEEE 802.3ba: Fiber 40G and 100G Channel Overview
▪ Migration: 10G - 40G - 100G - 400G
▪ IEEE 802.3bs: 400G Draft Standard
▪ Singlemode 40G/100G
▪ Summary: Evolution and Migration Strategy
Agenda Part 2: New Developments, 2017
▪ IEEE 802.3by: Introduction of 25Gb/s
▪ IEEE 802.3bm: Application of 25Gb/s to 40G and 100G Protocols
▪ IEEE 802.3bm: New 40G Singlemode Application
▪ Impact of 25Gb/s on Future Migration: 40G/100G/400G
▪ Emergence of Wide Band OM5 Multimode
▪ OM5 applications and impact on 100G/400G migration
▪ Maintaining MPO 12-Fiber Infrastructure
▪ Conclusion
IEEE 802.3
Networking Standards:
Basic Overview
Local Area and Metro Networking Standards
IEEE 802.3 Ethernet Standard
IEEE 802.3: Carrier Sense Multiple Access with Collision Detection (CSMA/CD)
▪ IEEE 802.3 is a “Living Document” defining the Physical Layer and Data Link
Layer Ethernet specifications for Local Area and Metro Networks.
▪ CSMA/CD is the “traffic control” technology for network access and signaling.
▪ New Technologies are continually published on 802.3 addenda.
▪ Current Multimode short wave Ethernet protocols:
▪ 1 Gb/s: 1000BASE-SX (1 fiber pair)
▪ 10 Gb/s: 10GBASE-S (1 fiber pair)
▪ 25 Gb/s: 25GBASE-S (1 fiber pair)
▪ 40 Gb/s: 40GBASE-SR4 (4 X 10G pairs = 8 Fibers)
▪ 100 Gigabit Ethernet: 100GBASE-SR10 (10 X 10G pairs = 20 Fibers)
IEEE 802.3 Ethernet Standard
Basic Elements of Ethernet Message Transfer
▪ Devices on a network have a MAC and IP address
▪ Ethernet frames travel between MAC devices through network cabling,
switches, and routers
▪ Frame “collisions” at a node are detected and sequenced
▪ Collision Detection is the fundamental concept of Ethernet
Basic Network Elements Defined
▪ LAN: Switch-based network, single broadcast domain in a building
▪ WAN: Router-based network, multiple broadcast domains
▪ SAN: Switch-based network, storage equipment domains
▪ MAC: Medium Access Control (protocol for access network devices)
▪ IP Address: Internet protocol (for internet access to network devices)
IEEE 802.3 Ethernet Standard
LAN-WAN-SAN Campus Network Example
WAN
Router
Building #1 Building #2
IEEE 802.3 Ethernet Standard
Contents of an Ethernet Medium Access Control (MAC) frame
PreambleDestination
Address
Source
Address
Length/
Type
Data
Packets
Frame
Check
Sequence
Start of
Frame
Delimiter
Packet Errors affect
network performance
Impact of Cabling on Data Rate
Transport Layer and Quality of Data Transfer
▪ Impacted by cabling, components, and installation
▪ Primary cause of Optical Bit Errors:
• Insertion loss, modal dispersion, and back reflections
▪ Impact of Bit Errors
• Corruption of data packets
• Packet rejection by the Transport Layer (Delay)
• Result: Slow network speeds
High Bit Error Rate = DELAY
TIA-568.3 Standard: Key Developments
Current Revision: TIA-568.3-D (December, 2015)▪ Replaces TIA-568-C.3
▪ Incorporates 24-fiber MPO connector
• Two rows of 12 fibers
• Supports 100GBASE-SR10
▪ Defines MPO Polarities for 10G, 40G, and 100G
• A Polarity: Straight-through, 1-1 mapping
• B Polarity: Reversed sequence, 1-12 mapping
• C Polarity: Crossed pairs, 1-2, 2-1 mapping
12-Fiber MPO 24-Fiber MPO
TIA-568.3 Standard: Key Specifications
Connector Mated Pair: Insertion Loss▪ 0.75 dB Maximum (Note: 0.5 dB is typically recognized)
Connector Mated Pair: Minimum Return Loss
▪ OM3 and OM4: 20 dB
▪ Singlemode UPC: 35 dB
▪ Singlemode APC: 55 dB
OM3 and OM4 Multimode Cable Loss
▪ 3.0 dB/km @ 850 nm
▪ 1.5 dB/km @ 1300 nm
OS2 Singlemode Cable Loss @ 1310, 1383, and 1550 nm
▪ Indoor: 1.0 dB/km
▪ Indoor/Outdoor: 0.5 dB/km
▪ Outside Plant: 0.4 dB/km
TIA-568.3: 10G MPO Infrastructure
10GBASE-S MPO Cabling: 4-Connector Channel
▪ OM3 Channel Limits:
• 300 meters, 2.6 dB Max
▪ OM4 Channel Limits:
• 550 meters, 3.1 dB Max
Switch
or
Server
Switch
or
Server
MPO Female
Trunk
LC Duplex
Patch Cord
LC Duplex
Receptacle
MPO to LC
Cassettes
LC Duplex
Receptacle
LC Duplex
Patch Cord
TIA-568.3: 10G Polarity Management
Rules for 10G Channel Polarity
▪ Must have one overall pair crossing, end to end
▪ In general: Must have an odd number of pair crossings, end to end
▪ Pair Crossings are managed in the patch cords, cassettes, or MPO trunk
Switch
or
Server
Switch
or
Server
MPO Female
Trunk
LC Duplex Cord
Straight Polarity
MPO to LC
CassettesLC Duplex Cord
Reversed Polarity
Multimode Fiber Evolution
VCSEL Laser Optimized Multimode Fiber: OM3 and OM4
▪ VCSEL = Vertical Cavity Surface Emitting Laser
▪ Longer distances / Higher bandwidth at 850 nm
OM3 Laser-Based Multimode Distances
▪ 1Gb/s: Up to 1,000 meters
▪ 10Gb/s: Up to 300 meters
▪ 40G/100G: Up to 100 meters
OM4 Laser-Based Multimode Distances
▪ 1Gb/s: Up to 1,100 meters
▪ 10Gb/s: Up to 550 meters
▪ 40G/100G: Up to 150 meters
IEEE 802.3 Physical Layer Data Link
10 GbE Fiber Transceivers are Laser Based
▪ Transmitter: Converts digital to optical by laser modulation
▪ Receiver: Converts optical to digital by photo detection
Fiber 10/25 Gb/s Physical Layer Data Link
TX RXOP OP
RX TXOP OP
Digital
Input VCSEL Laser
850 nm
DetectorDigital
Output
Digital
Output Detector VCSEL Laser
850nm
Digital
Input
Multimode Fiber Evolution
Bend Insensitive Laser Optimized OM3 and OM4
▪ New bend radius performance introduced by ITU, TIA, and IEC standards
• Modified cladding index band around core
• New cladding chemical formulation
▪ Performance Advantages:
• Longer cable fatigue life under bend loading
• Lower dB loss at a smaller bend radius 50 Micron Core
Graded Index
Cladding
125 Micron
Modified Refractive
Index Band Around
Core
Tight Bend
Radius:
5 to10 mm
Multimode Fiber
Cross Section
Singlemode Fiber Evolution
Bend Insensitive Singlemode Fiber: OS2 Grade
▪ OS2 singlemode replaces legacy OS1
▪ OS2 improvements similar to multimode:
• Modified cladding refractive index band around core
• New cladding chemical formulation
• Improved fatigue life and lower dB bend loss
9 Micron Core,
Step Index
Cladding
125 Micron
Modified Refractive
Index Band Around
Core
Tight Bend
Radius:
5 to10 mm
Singlemode Fiber
Cross Section
Data Center: TIA-942 Update
TIA-942-A: Telecommunications Infrastructure Standard for Data
Centers
▪ Replaces TIA/EIA-942
▪ Incorporates two addenda:
• AD1: Coaxial cable (T-3, E-1 and E-3) and distances
• AD2: Energy efficiency: wider range of temp and humidity, 3-level lighting,
Cat 6A, noise sources, updated tier structure
▪ Terminology: Harmonized with 568-C series and ISO/IEC
▪ Added references to TIA-569-C, TIA-606-A and TIA-607
▪ New Infrastructure elements added for large data centers:
• IDA - Intermediate Distribution Area
• ICC - Intermediate Cross Connect
Data Center: TIA-942 Topologies
Key Elements of the Data Center using Fiber Cabling
▪ Equipment Distribution Area (EDA)
▪ Main Distribution Area (MDA)
Switch
Servers
Switch
Servers
Switch
Servers
Switch
Servers
MDA
MC, Router, Switch, PBX
Data Center
TR
Entrance
Room APOutside
TR’s
EDA
Computer
Room
Data Center Overview
What is a Data Center?
A large group of networked computer servers used for remote
storage, processing, and distribution of large volumes of data.
Data Center Overview
ANSI/BICSI 002-2014: Data Center Design and Best Practices
▪ BICSI is a publication of general guidelines
Data Center: ANSI/BICSI 002-2014
Key Topics Covered by ANSI/BICSI 002-2014
▪ Site Selection
▪ Space Planning
▪ Architectural
▪ Structural
▪ Electrical Systems
▪ Mechanical
▪ Fire Protection
▪ Management and Building Automation Systems
▪ Cabling Infrastructure, Pathways and Spaces
▪ Security and Disaster Recovery
▪ Commissioning
▪ Data Center Maintenance
Fiber Data Center Applications
Fundamental Cabling Topologies▪ Server Fabric / SAN Fabric
▪ Switch/SAN to Servers
▪ Servers to MDA/LAN
Basic Fiber Infrastructure▪ Equipment and Patch Cords
▪ Local Interconnect Units (LIU’s)
▪ Interconnect MPO Trunk Cable
EQUIP EQUIP
Patch
Cords
Patch
CordsLIU LIU
MPO
Trunk
(Link)
Data Center: Key Fiber Products
▪ Interconnect Enclosures
▪ Pre-Terminated MPO cassettes
▪ MPO Trunk assemblies
▪ LC duplex patch cords
What is an MTP (MPO) Connector?
“MTP” or “MPO” is a 12 or 24 Fiber Array Connector
▪ MTP* = Multi Fiber Termination Push-on
▪ MPO = Multi Fiber Pull Off
Key Characteristics
▪ Rectangular ferrule with fibers equally spaced
▪ Keyed connector body for orientation
▪ Precision flat polish end face
▪ Male connectors have two alignment pins
1 2 3 4 5 6 7 8 9 10 11 12
Connector
BodyFerrule
Key
Fibers
*MTP is a registered trademark of US Connec
MPO 12-Fiber Connector Polarity
Type ‘A’ Polarity: Straight-Through, No pair crossing▪ Most universal termination
▪ Pin 1 to Pin 1 direct mapping, end to end
Advantages▪ 10G pair crossing managed externally in the patch cords
▪ Compatible with 10G or 40G applications
1 2 3 4 5 6 7 8 9 10 11 12
MPO Near End: Key Up MPO Far End: Key Up
1 2 3 4 5 6 7 8 9 10 11 12
MPO 12-Fiber Connector Polarity
Type ‘B’ Polarity: Reversed Sequence
▪ Key-wise reversal: Pin 1 to Pin 12 mapping
Advantages
▪ Provides 40G-ready B-polarity flip in the MPO trunk
▪ Sequential reversal provides individual pair crossing
1 2 3 4 5 6 7 8 9 10 11 12
MPO Near End: Key Up MPO Far End: Key Up
12 11 10 9 8 7 6 5 4 3 2 1
MPO 12-Fiber Connector Polarity
Type ‘C’ Polarity: Crossed pairs▪ All pairs crossed end to end▪ Pin 1 to Pin 2 / Pin 2 to Pin 1 mapping▪ Not compatible with 40G migration
Advantages▪ 10G channel pair crossings are managed in the trunk▪ Can use standard polarity patch cords (no reversing)
1 2 3 4 5 6 7 8 9 10 11 12
MPO Near End: Key Up MPO Far End: Key Up
2 1 4 3 6 5 8 7 10 9 12 11
New Developments in MPO Technology
24-Fiber MPO Connector
▪ Two rows of 12 fibers in the same MPO footprint
▪ Supports 100GBASE-SR10
▪ Supports 10G and 40G channel consolidation
MPO Near End: Key Up
Receive fibers across top row
Transmit fibers across bottom row
4 outer fibers not used
MPO 10G Fiber Interconnect Trunks
Manufactured in 12-Fiber Multiples
▪ A, B, or C polarities are user-defined
▪ MPO on each end (no pins)
▪ Cassettes have pinned male MPO receptacles
▪ MPO transceivers are also pinned male
12-Strand
24-Strand
48-Strand
MPO Transition Assemblies
Transition from MPO to LC Connector Fan-Out
▪ Known as a “Hydra” assembly
▪ MPO 12-strand to (6) LC X 10G pairs
▪ Used for LC backbone channel consolidation
▪ Also used for 40G 8-fiber to 10G pair break-out
▪ MPO Reduces Tx/Rx congestion at the equipment
IEEE 802.3ba:
40G and 100G Ethernet
(Original Standard Release)
40G and 100G Overview
IEEE 802.3ba: 40 Gb/s Overview
40GBASE-SR4: Ratified Addendum IEEE 802.3ba, 2008
▪ Optics: 850 nm over 8 multimode fibers (4 pairs / 4 lanes)
▪ Transceivers: MPO male, 12-fiber interface
▪ 40G Multimode distance Limits:
• OM3: 100 meters
• OM4: 150 meters
▪ Strictly MPO cabling channel, end to end
40GBASE-SR4 MPO Transceiver
Lane Assignments
(4) Un-used middle fibers
NOTE: 1 Lane = 1 Pair
IEEE802.3ba: 40 Gb/s Overview
40 GbE Fiber Cabling Channel and dB Attenuation Limits
▪ OM3: 1.9 dB max
▪ OM4: 1.5 dB max
▪ IEEE suggests a maximum 2-connector channel (shown below)
▪ NOTE: Beyond 2 mated pairs may exceed dB insertion loss limits
▪ No migration from legacy LC/SC cabling
40GbE: 4 Pair, 2-Connector MPO Channel
4 Pairs 4 Pairs 4 Pairs
IEEE 802.3ba: 40 Gb/s Overview
Why use an MPO/MTP connector interface?
▪ Maximum fiber density in a small foot print
▪ MPO/MTP connectors are well recognized
▪ Equal fiber lengths minimize delay skew
40GBASE-SR4 Lane Assignments
Polished fibers,
equal in length
40Gb/s Overview: Channel Polarity Rule
There must be one Type ‘B’ (key-wise) polarity reversal end to end
▪ In general: Must have an odd number of key-wise polarity reversals end to end
Managing 40G Channel ‘B’ Polarity Reversal▪ In the MPO patch cord - either end
▪ In the MPO trunk
▪ Or - Use a polarity-reversed MPO adapter panel in LIU #1 or LIU #2
▪ Polarity-reversed MPO adapters are available, with a gray color
MPO 12-Fiber Trunk
MPO Patch CordMPO PanelsMPO Patch Cord
F M M F
LIU #1 LIU #2
IEEE 802.3ba: 40Gb/s Summary
Native 40G is a Pre-Terminated 8-Fiber MPO Channel, End to End
▪ Supported by legacy 10G 12-fiber MPO cabling
▪ Positioned for new applications (see “New Developments”)
40G Cabling Design and Implementation
▪ Adhere to a 2-connector channel, distance, and dB loss limits
▪ Use a consistent channel polarity scheme, end to end
▪ Consider 40G/100G migration strategy
IEEE802.3ba: 100 GbE Overview
100GBASE-SR10: Established in addendum IEEE 802.3ba, 2008
▪ Optics: 850 nm over 20 fibers in parallel (10 pairs / 10 lanes)
▪ Transceivers: 24-fiber MPO male (Departure from 12-fiber MPO)
▪ 100G Multimode channel distance limits:
• OM3: 100 meters
• OM4: 150 meters
▪ Strictly an MPO channel, end to end
100GBASE-SR10 Transceiver
Lane Assignments
(4) Un-used outer fibers
24-Fiber MPO Connector
IEEE802.3ba: 100 GbE Overview
100 GbE Fiber Cabling Channel dB Attenuation Limits
▪ OM3 Channel: 1.9 dB max
▪ OM4 Channel: 1.5 dB max
▪ IEEE suggests a maximum 2-connector channel (shown below)
▪ NOTE: Beyond 2 mated pairs may exceed dB insertion loss limits
▪ No migration from legacy LC/SC cabling
100GbE: 10-Pair, 2-Connector MPO Channel
10 Pairs 10 Pairs 10 Pairs
100Gb/s Overview: Channel Polarity Rule
There must be one Type ‘B’ (key-wise) polarity reversal end to end
▪ In general: Must have an odd number of key-wise polarity reversals end to end
▪ 100G polarity is similar to the 40G polarity rule
Managing 100G Channel ‘B’ Polarity Reversal
▪ In the MPO patch cord - either end
▪ In the MPO trunk
▪ Use a polarity-reversed MPO adapter panel in LIU #1 or LIU #2
▪ In the consolidation module if migrating legacy 12-fiber MPO cabling **
MPO 12-Fiber Trunk
MPO Patch CordMPO PanelsMPO Patch Cord
F M M F
LIU #1 LIU #2
** Not Recommended
40G/100G Overview: Notes on Gender
All MPO Junctions are Male to Female
▪ Male MPO connectors have alignment pins
▪ MPO adapters only facilitate pre-alignment
General Guidelines for Native 40G/100G Cabling
▪ Transceiver receptacles are always pinned MPO male
▪ MPO patch cords should be female, both ends
▪ MPO trunks should be pinned male both ends to create a receptacle
▪ In general, the “permanent” side of any MPO receptacle should be pinned male
MPO Trunk
MPO Patch CordMPO PanelsMPO Patch Cord
F F F F
LIU #1 LIU #2
** Not Recommended
M M
IEEE 802.3ba: 100GbE Summary
802.3ba 100G is an Independent 24-fiber MPO Channel, End to End
▪ Direct equipment interconnect only, “chip to chip”
▪ Supported by legacy 24-fiber MPO cabling only (see “Migration Strategies”)
100G Cabling Design and Implementation
▪ Adhere to a 2-connector channel, distance and dB loss limits
▪ Consolidation of legacy 12-fiber MPO infrastructure is not recommended **
▪ Add 100G 24-fiber MPO channels separately to simplify administration
▪ Consider a 100G – 400G migration strategy (see “New Developments”)
** 4-connector channel = dB loss violation
40G/100G: Worst Case 100m Channel Loss
For a 2-Connector MPO Channel (2 LIU’s), per TIA-568.3 Loss Spec of 0.75 dB:
▪ Total Mated Pair Insertion Loss = 0.75 X 2 = 1.50 dB (Worst Case)
▪ Add 0.3 dB for 100 meter channel length: Total channel loss = 1.80 dB
▪ OM3 Channel dB Loss Limit = 1.90 dB @ 100 m
▪ OM4 Channel dB Loss Limit = 1.50 dB @ 150 m
➢ The worst case 2-connector channel loss is marginal
➢ Reducing the mated pair loss specification to 0.5 dB becomes necessary
MPO 12-Fiber Trunk
MPO Patch Cord
MPO Panels
(2 Mated Pairs)MPO Patch Cord
F M M F
LIU #1 LIU #2
40G/100G: “Typical” 100m Channel Loss
For a 2-Connector MPO Channel (2 LIU’s), Using a Loss Spec of 0.50 dB:
▪ Total Mated Pair Insertion Loss = 0.50 X 2 = 1.00 dB
▪ Add 0.3 dB for 100 meter channel length: Total channel loss = 1.30 dB
▪ OM3 Channel dB Loss Limit = 1.90 dB @ 100 m
▪ OM4 Channel dB Loss Limit = 1.50 dB @ 150 m
➢ The 2-connector channel loss is robust at 0.50 dB per mated pair
➢ Adding one mated pair junction at 0.50 dB in the channel becomes marginal
MPO 12-Fiber Trunk
MPO Patch Cord
MPO Panels
(2 Mated Pairs)
MPO Patch Cord
F M M F
LIU #1 LIU #2
40G/100G: Low Loss MPO Connections
4-Connector, 100m MPO Channel (4 LIU’s), Using 0.35 dB Specification
▪ Total Mated Pair Insertion Loss = 0.35 dB X 4 = 1.50 dB
▪ Add 0.3 dB for 100 meter channel length: Total channel loss = 1.80 dB
▪ OM3 Channel dB Loss Limit = 1.90 dB
▪ OM4 Channel dB Loss Limit = 1.50 dB
➢ The 4-Connector channel is marginal with low loss MPO connectors
MPO Trunk
MPO Patch Cord
0.35 dB
Low Loss
MPO “Elite” MPO Patch Cord
F M M F
LIU #1 LIU #3LIU #2M F
LIU #4F M F F
Summary: Low Loss MPO Connectors
Low loss connectivity is required for a 4-connector MPO channel
▪ (4) Low loss MPO junctions increases cost, administration, and points of failure
▪ Low loss MPO connectors will permit a robust 3-connector channel
▪ A 3-connector channel permits one consolidation or polarity-changing module
➢ Best design is a 2-connector channel with standard loss connectors
MPO Trunk
MPO Patch Cord
MPO “Elite”
JunctionsMPO Patch Cord
F M M F
LIU #1 LIU #3LIU #2
M F
LIU #4
F M F F
10G to 40G Migration Methods
Method 1: De-Commissioning Legacy 10G MPO Cabling
▪ Requires substantial elimination of existing cabling infrastructure
➢ Scrap everything end to end, except the MPO trunk
10G
Switch
or
Server
10G
Switch
or
Server
MPO 10G
Female Trunk
LC Duplex
Patch Cords
LC Duplex
Receptacles
MPO to LC
Cassettes
LC Duplex
Receptacles
LC Duplex
Patch Cords
10G to 40G Migration: Method 1
After Elimination of LC Cords and MPO Cassettes, Both Ends
▪ Add: MPO feed-through panels and MPO 40G patch cords (Note Gender)
▪ NOTE 40G Polarity Rule: One Type ‘B’ reversal, end to end
40G
Tx/Rx
40G
Tx/Rx
Existing MPO
Female Trunk
MPO 40G Female
to Male Patch Cord
A-Polarity
40G MPO Male
Tx/Rx Receptacle
MPO Feed-Through
Adapter Panel
40G MPO Male
Tx/Rx Receptacle
MPO 40G Female
to Male Patch Cord
B-Polarity
F M M F
10G to 40G Migration: Method 2 - Native
Method 2: Add 40G Channels Separately: No De-Commissioning 10G
▪ Add: MPO trunk, MPO panels and MPO 40G patch cords (Note Gender)
▪ 40G Polarity Rule: One Type ‘B’ reversal, end to end
40G
Tx/Rx
40G
Tx/RxNew 40G MPO Trunk
MPO 40G Female
Patch Cord
A-Polarity
40G MPO Male
Tx/Rx Receptacle
MPO Feed-Through
Adapter Panel
40G MPO Male
Tx/Rx Receptacle
MPO 40G Female
Patch Cord
B-Polarity
F F F FM M
40G to 100G Migration: Method 1
Method 1: De-Commissioning Existing 40G 12-Fiber Cabling
▪ Replace: 40G MPO patch cords with 100G MPO patch cords, both ends
▪ Replace: MPO adapter panels with consolidation modules (Note Gender)
▪ Consolidate: 40G 12-strand MPO trunks: 2 into 1 (Note: only 12-strand will work)
100G
Tx/Rx
100G
Tx/Rx
Consolidated
MPO Trunks
MPO 100G Female
Patch Cord 24
Strand
100G MPO Male
Tx/Rx Receptacle
MPO 2 into 1
Consolidation
Modules
100G MPO Male
Tx/Rx Receptacle
MPO 100G Female
Patch Cord
24-Strand
F F F F
40G to 100G Migration
What is a 100G MPO “Consolidation Module” ?
▪ A CM combines two 12-fiber MPO inputs into one 24-fiber MPO output
▪ Also known as a “2 into 1 conversion cassette”
▪ CM’s are also used to “re-map” polarities into 100G format.
▪ NOTE: A CM creates a 4-connector MPO channel – Not Recommended
2 x 12-Fiber
MPO Cords
MPO 100G Female
Patch Cord
24-Fiber
MPO 12-Fiber Male
Receptacle Inputs
MPO 100G Female
Patch Cord
24-Fiber
CMCM
MPO 100G Male
Receptacle
24-Fiber Output
MPO 100G Male
Receptacle
24-Fiber Output
40G to 100G Migration: Method 2 - Native
Method 2: Add 100G Channels Separately: No De-Commissioning 40G
▪ Add: MPO male trunk, MPO panels, and MPO 100G patch cords (Note Gender)
▪ 100G Polarity Rule: One Type ‘B’ reversal, end to end
100G
Tx/Rx
100G
Tx/RxNew 100G MPO Trunk
MPO 100G Female
Patch Cord
A-Polarity
100G MPO Male
Tx/Rx Receptacle
MPO Feed-Through
Adapter Panel
100G MPO Male
Tx/Rx Receptacle
MPO 100G Female
Patch Cord
B-Polarity
F F F FM M
40G to 100G Migration: Summary
Notes Regarding Migration to 100 GbE
▪ A 2-Connector channel is recommended due to channel loss budgets
▪ Consolidation Modules create a 4-connector channel – Not Recommended
▪ 100G cabling should be a native new installation, using OM4 fiber
➢ See “New Developments” for further evolution of this technology
100G
Tx/Rx
100G
Tx/RxNew 100G MPO Trunk
MPO 100G Female
Patch Cord
100G MPO Male
Tx/Rx Receptacle
MPO Feed-Through
Adapter Panels
100G MPO Male
Tx/Rx Receptacle
MPO 100G Female
Patch Cord
F F F FM M
IEEE 802.3ba: Singlemode 40 Gb/s
40GBASE-LR4: Long Range Singlemode 40 Gb/s
▪ Optics: (4) WDM 10G wavelengths over a single lane (1 or 2 fibers)
▪ Transceivers: LC Duplex
▪ Utilizes conventional simplex or duplex cabling channel
▪ 40GBASE-LR4 Max operating distance: 10 km
IEEE 802.3ba: Singlemode 40 Gb/s
40GBASE-ER4: Extended Range Singlemode 40 Gb/s
▪ Optics: (4) WDM 10G wavelengths over a single lane (1 or 2 fibers)
▪ Transceivers: LC Duplex
▪ Utilizes conventional simplex or duplex cabling channel
▪ 40GBASE-ER4 Max operating distance: 30 km
IEEE 802.3ba: Singlemode 40 Gb/s Cabling
IEEE 802.3ba: Singlemode 40G Cabling Model
▪ Simplex or duplex fiber channel
▪ Can migrate from legacy singlemode fiber plant
▪ IEEE 802.3ba power budgets apply
▪ Transceivers utilize conventional LC duplex
40GBASE-LR4/ER4 Singlemode Cabling Model
IEEE 802.3ba: Singlemode 100 Gb/s
100GBASE-LR4 and 100GBASE-ER4
▪ Optics: (4) WDM 25G wavelengths over a single lane (1 or 2 fibers)
▪ Transceiver Interface: LC Duplex
▪ Max operating distance for 100GBASE-LR4: 10 km
▪ Max operating distance for 100GBASE-ER4: 30 km
IEEE 802.3ba: Singlemode 100 Gb/s Cabling
IEEE 802.3ba: Singlemode 100 Gb/s Cabling Model
▪ Full duplex transmission over a single or duplex fiber
▪ Same cabling model as 40GBASE-LR4/ER4
▪ Can migrate from legacy cabling plant
▪ Standard LC Transceiver interface
100GBASE-LR4/ER4 Singlemode Cabling Model
Fiber 40/100 Gb/s Singlemode Summary
Migration of Singlemode Cabling from 10 GbE to 40/100 Gb/s
▪ Legacy singlemode cabling can migrate from 10 Gb/s to 40/100 Gb/s
▪ Transceivers have a conventional LC duplex interface
▪ Cabling test parameters of IEEE 802.3ba apply
• Full Duplex over a single fiber
• Full Duplex over a pair of fibers
▪ See “New Developments” for Singlemode Advancements
IEEE 802.3bs: 400G Baseline (2018)
400GBASE-SR16 Lane Assignments
▪ Defined as (4) 100GBASE-SR4 Channels
▪ Total 32-fiber channel: 16 X 25G pairs
▪ Employs a new 32-fiber MPO connector – Two rows of 16 fibers
▪ Direct-connect or 2-connector MPO channel only
▪ Departure from standard MPO interface:
• Key shift off-center
32-Fiber MPO
Connector
Will this be adopted?
See “New Developments”
IEEE 802.3bs: Timeline for 400 Gb/s
Published Standard Anticipated in Q4, 2017
▪ 400GBASE-SR16 for OM3/OM4 multimode
▪ PSM4 Singlemode: 4 x 100G singlemode lanes
▪ NOTE: New Developments may impact adoption of 400GBASE-SR16 !!!
Part 2: New Developments, 2017 Update
▪ IEEE 802.3by: Introduction of 25Gb/s
▪ IEEE 802.3bm: Application of 25Gb/s to 40G and 100G Protocols
▪ Impact of 25Gb/s on “Legacy” Migration: 40G/100G/400G
▪ Non-IEEE 40G Singlemode Applications
▪ Emergence of Wide Band OM5 Multimode (WBMMF)
▪ IEEE 802.3cd Task Force – Future Applications
▪ Maintaining MPO 12-Fiber Infrastructure
▪ Conclusion
Introduction of 25 Gb/s: IEEE 802.3by
IEEE 802.3by: Introduction of 25GBASE-SR, June, 2016
▪ Basic Objectives:
▪ Increase 1-lane throughput from 10 Gb/s to 25 Gb/s
▪ Reduce energy consumption
▪ Preserve Ethernet protocols
▪ Support IEEE 802.3bm objectives
▪ Establish a cost-optimized path to 100GBASE-SR4
▪ Optics: 850 nm / 25 Gb/s full duplex over 2 fibers (1 lane)
▪ Transceivers: LC Duplex
▪ 25GBASE-SR Multimode channel distance limits:
• OM4: 100 meters
• OM3: 70 meters
New 100 Gb/s Standard: IEEE 802.3bm
IEEE 802.3bm: Evolution to 100GBASE-SR4, March, 2015
▪ Basic Objectives:
▪ Reduce 100GBASE-SR10 lane count from 10 to 4 lanes (20 to 8 fibers)
▪ Extend 40GBASE-ER4 to 40 km
▪ Further reduce energy consumption
▪ Preserve Ethernet protocols
▪ Facilitate migration from 40GBASE-SR4
▪ Optics: 850 nm 100G full duplex over 8 fibers ( 4 lanes)
▪ Transceivers: MPO 12-Fiber (multimode)
▪ 100GBASE-SR4: New multimode channel distance limits:
• OM4: 100 meters
• OM3: 70 meters
Impact of IEEE 802.3bm on 100G Migration
Lanes Reduced to 12-Fiber MPO Channel
▪ Enables 40G and 100G operation over legacy 12-fiber MPO channel
▪ Supersedes “Legacy” 100GBASE-SR10
▪ Eliminates 24-fiber MPO connectors for 100G
▪ Migration simplified to MPO polarity and gender management
40G
Or
100G
Tx/Rx
40G
Or
100G
Tx/Rx
12 Fiber MPO Trunk
MPO 12-Fiber
Patch Cord
A-Polarity
MPO Male
Receptacle
MPO Feed-Through
Adapter Panel
MPO Male
Receptacle
MPO 12 Fiber
Patch Cord
B-Polarity
F F F FM M
IEEE 802.3bm: Singlemode 40 Gb/s
40GBASE-ER4: Extended Range Singlemode 40 Gb/s
▪ Objective: Extend 40GBASE-ER4 from 30 km to 40 km
▪ Optics: 4 x 25G WDM wavelengths over 2 fibers (1 lane), full duplex
▪ Transceivers: LC Duplex
▪ New singlemode channel distance: 40 km
Non-IEEE Singlemode 100 Gb/s Apps
100GBASE-PSM4: Parallel Singlemode 4-Lane
▪ Objectives: Longer 100G reach, reduce cable cost and congestion
▪ Optics: 4 x 25G lanes (8 fibers), 1310 nm full duplex
▪ Supported Transceivers: MPO 12-fiber APC
▪ Channel Distance: 500 m
▪ Application: Data Center interconnect
100G PSM4 Lane Assignments
1 2 3 4 4 3 2 1
Non-IEEE Singlemode 100 Gb/s Apps
100G-CWDM4 MSA: Coarse Wavelength Division Multiplexing
▪ Objectives: Longer 100G reach, reduce cable cost and congestion
▪ Multi-Source Agreement (MSA): Compatibility across vendors
▪ Optics: 4 x 25G CWDM lanes over 2 fibers (1 lane)
▪ Supported Transceivers: LC Duplex
▪ Channel Distance: 2 km
▪ Application: Extended Data Center interconnect
Non-IEEE Singlemode 100 Gb/s Apps
100G-CWDM4 OCP: Coarse Wavelength Division Multiplexing
▪ Objectives: Lower cable cost, extended 100G reach, reduced congestion
▪ Open Compute Platform (OCP): Compatibility across vendors
▪ Optics: 4 x 25G CWDM lanes over 2 fibers (1 lane)
▪ Supported Transceivers: LC Duplex
▪ Channel Distance: 500 m
▪ Application: Data Center interconnect
Emergence of Wide Band Multimode Fiber
WBMMF: Ratified by the Telecommunications Industry Association
▪ TIA-492-AAAE: Published in June, 2016
▪ Supports low cost wavelengths from 850 nm to 950 nm range
▪ Application: Multiplexing 4 x CWDM short wavelengths
▪ Backward compatible with OM3 and OM4 multimode
▪ Official ISO/IEC 11801 Designation: OM5
Emergence of OM5 WBMMF
Future Objective: 100 Gb/s Through One Pair of MM Fibers
Non-IEEE Emerging OM5 Applications
▪ 100GBASE-SWDM4 (4 x 25G SWDM wavelengths)
▪ 200GBASE-SWDM4 (4 x 50G SWDM wavelengths)
▪ SWDM Wavelengths: 850 nm, 880 nm, 910 nm, 940 nm
▪ Full duplex over 1 WBMMF lane (2 fibers)
▪ Future Transceivers: LC Duplex, SWDM
Emergence of OM5 WBMMF
Advantages of OM5 WBMMF Using SWDM Technology
▪ Achieves maximum throughput per single MM fiber
▪ Reduces 100GBASE-SR4 lane count to 1 lane (2 fibers)
▪ Supports 100G over a single pair (4 x 25G SWDM)
▪ Enables future multiplexing schemes
▪ Longer reach than OM4 for 100GBASE-SR4
▪ 150 m vs. 100 m
Emergence of OM5 WBMMF
Disadvantages of OM5 WBMMF Using SWDM Technology
Compared to 100GBASE-SR4 over OM4 MMF:
▪ More costly than OM4 cabling (Up to 50% added cost)
▪ SWDM transceivers also 50% more costly
▪ SWDM not being considered by IEEE for next-gen MM app’s
▪ 100G SWDM cannot break out to individual 25G channels
▪ Singlemode solutions are less costly and supported by IEEE
▪ IEEE 802.3cd task force not considering OM5 or SWDM
▪ Migration from OM3/OM4 cabling not supported
IEEE 802.3cd Task Force - Future
Objectives for Future 50G/100G/200G IEEE Applications
50 Gb/s: Single Lane (2 fibers)
▪ OM4 Multimode: 100 m
▪ Singlemode: 2 to 10 km
100 Gb/s
▪ OM4 Multimode: 100 m, 2 lane (4 fibers)
▪ Singlemode: 500 m, 1 lane (2 fibers, consistent with IEEE 802.3 bs)
200 Gb/s: 4 lane (8 fibers)
▪ OM4 Multimode: 100 m
Maintaining MPO Infrastructure
Contamination is the #1 Cause of Optical Network Failures
Good cleaning and inspection practices are critical
▪ Contamination will permanently damage polished fiber ends
▪ Avoid costly replacement of pre-terminated cabling
Airborne Accumulation Mating Dirty Connectors
Maintaining MPO Infrastructure
Protecting Cable Infrastructure Investment
To extend the life of MPO cabling for future migration:
▪ Advanced cleaning practices are required
▪ Use recognized cleaning and inspection products
➢ RULE #1: “Clean and inspect before you connect”
Maintaining MPO Infrastructure
Protecting Cable Infrastructure Investment
Advanced cartridge cleaning instruments are available
▪ MPO male or female – connector or ports
▪ LC connectors or ports
Maintaining MPO Infrastructure
Protecting Cable Infrastructure Investment
Use advanced inspection devices
▪ Microscope for connectors
▪ Probe for blind ports
Conclusions
▪ Migration of MPO cabling evolves with new IEEE developments
▪ Increasing data rates to reduce fiber count remains a key IEEE objective
▪ Emergence of 25 gb/s has reduced MPO fiber count and cabling costs
▪ Migration to 100GBASE-SR4 can now utilize 12-fiber MPO cabling
▪ Current 100G standards impacted by 25GBASE-SR:
▪ 100GBASE-SR10: Can be replaced by 100GBASE-SR4
▪ 400GBASE-SR16: Will this change in Draft IEEE 802.3bs???
Conclusions
▪ OM5 WBMMF may not be supported due to costly cabling and SWDM
▪ Singlemode cabling in data centers will compete with OM5
▪ Risk with OM5: IEEE may not recognize SWDM in future standards
▪ Standards evolution continues with IEEE 802.3cd task force
▪ New 50G, 100G, 200G under development
▪ Maintenance and cleaning fiber infrastructure
▪ Increasingly important to preserve installed MPO connectivity
Thanks for Your Participation