245 cisco low latency collateral

7/30/2019 245 Cisco Low Latency Collateral

1/33

2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 1

Cisco Low Latency

SolutionAbhishek Sharma,

CORBU PLM.


2/33


High Frequency Trading - enable traders to graspopportunities only available for fractions of a second.

Cloud Services - interactive Web-based applications

Business Continuity and Disaster Recovery - diskmirroring and synchronous replication of missioncritical data between a primary and a remote,secondary data center

Consolidated data centers - for processing power,storage, and IT staffing.


3/33


Source: TowerGroup 2007

Inability of human

trader to keep up

Faster receipt,

translation, and

distribution of

market data

Trade and

quote volume

Electronic

Trading


4/33


Local NetworkLatency Latency - key in SP/supplierdecision making.

Two components ofLatency

Intra Server - Software and uPInter Server - Local and Access

Network

Good progress being madein reducing Intra-ServerLatency

Multicore processors & customHW/SW

Network Latency - theemerging bottleneck

Fragmented Liquidity.Global distributed trading - any

pool any time

Access NetworkLatenc

y

ProximityService

Intra-Server Latency

Local Network Latency

Access Network Latency

Every Millisecond of latency

eliminated equates to $100million annually in revenue

opportunity

Goldman Sachs

A Network capable of delivering the lowest latency to any Liquidity pool is a

disruptive weapon in the fight for position in the new era of Electronic

Trading4


5/33


Network Links

Propagation/

Serialisation

Regulations/

Compliance

Example: 20-70s

typical for FW

Server/

OS Architecture

NIC, OS driver

Network Node

Latency

Processing,

Queuing, Buffering

~15 uSec

MiddlewareLayer

ApplicationLayer

PolicyLayer

Server/OSLayer

NetworkLayer (LAN)

NetworkLayer(MAN/WAN)

End-to-End Latency

Microseconds

Milliseconds

Seconds

Many variables involvedkey is to profile end-to-end trading process

TransportLayer


6/33


Latency is the amount of delay a signal experiences inreaching its destination.

Although Latency can be introduced at each layer of theTCP/IP stack, keeping transmission at L1 for as much as

possible helps to lower latency. The primary elements that add latency at the physical

layer:

1. The Fiber.

2. The Network Elements.

3. The Line Rate.

Among these the fiber contributes to more than 98%of the total latency.


7/33 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

Three components of Network Latency:

1. Propagation Delay - simple function of distance and

speed of light

2. Serialization Delay - simple function of packet size

and link speed

3. Queuing Delay - complex function of traffic, network

speed mismatch, queue scheduling, and link speed



Traditional network designs are generally optimized forcost.

Managed service design will not work if lowest latency is

desired.

A low latency network design requires:

Direct connection from LAN port on server to WAN link.

Simplified network topologiesPoint to point instead of

hierarchical ( traditional 3 tiered )

shortest route, excellent slack management and novel dispersionmanagement.



How much of your annual spend is for building lowlatency infrastructure ?

a. < 10%

b. 11-30%

c. 31-50%

d. > 50%



Low Latency Transponders.

Passive Multiplexer/De-Multiplexer.

Low Latency Amplifier.

Regenerators.

Low Latency Dispersion Compensation Units.



10-ports SFP+ based and one 100G CXP based port.

Each of the 10Gbps SFP+ based port can supportOC-192/STM-64, 10GE WAN PHY, 10GE LAN PHY,

8G FC, 10G FC and OTU-2.

Working modes:

a. 5 x 10G Transponder equipping client card with SFP+ DWDM

b. Fan-Out for 100G into 10x10G signals coming from external device

c. Ultra Low latency Transponder using Grey / DWDM SFP+

Latency is 3ns in ultra low latency mode.



4-Port 10 Gbps Muxponder Card.

Muxponding Latency:

G.709 - Standard FEC5 us G.709 - Enhanced FEC50 us

40 Gbps Transponder Card.

Transponding Latency:

G.709 - Standard FEC11.5 us

G.709 - Enhanced FEC - 52.9 us

CD Tolerance - 29,000 ps/nm

10 port SFP+ Muxponder coupled to 100G

DWDM Line card

Muxponding Latency - 12.41 us (with Std.FEC)

100 Gbps Transponder Card

Transponding Latency:

G.709 - Standard FEC1 us

G.709HG-FEC 7% - 44 us

G.709UFEC 20% - 74 us

CD Tolerance70,000 ps/nm



40 / 48 channels at100GHz on the Odd and

on the Even ITU grid.

40 / 48 bi-directional

LC-LC ports and one trunk

port (plus monitor ports)

Slot for interleaver module for upgrade to 80 / 96 channels at 50GHz

via the even channel version

Cost-effective for DWDM terminal / hub applications and also simplepoint to point Data Center Interconnections.

Very low latency through the patch panels.


14/33


Erbium Doped Fiber Amplifier (EDFA) add latency due to thephotons traveling along the erbium doped fiber path.

The latency optimized Mal-less EDFAscan be used in place of the

regular EDFA wherever applicable.

Wherever possible, one should leverageRAMAN Amplifiers which have thelowest latency as the amplificationoccurs along the length of the fiber.


15/33


16/33


Latency below 25 ns

which is three orders

lower than the

alternative DCF.

Insertion loss less than 4.5 dB.


17/33


Are you willing to replace your existing fiber DCUnetwork at 10G with FBG DCU to achieve lower latency?

a. Yes

b. No

c. Not sure


18/33


Fiber based

DCU

FBG DCU

(fixed)Coherent

Passive Yes Yes No

C Band Yes ITU-Grid Single Channel

Any Rate / Grid Yes No Yes

Mixed Rates Yes Yes Yes

Latency High Low Very Low


19/33


20/33


2020

Router/Switch pluggable interface produces WDM signal

Transceiver is cabled directly into passive mux/demux

No active intermediate devices

Catalyst

6500

MDS

9000

Nexus

7000

Passive xWDM

Mux/Demux

Catalyst

6500

MDS

9000

Nexus

7000

Passive xWDM

Mux/Demux

10GigE


21/33


RX

TX

TX

RX

TX

RX

Client(router, switch, etc.)

TXP/MXP/XP Multiplexer /

Demultiplexer

Amplifier(s)ROADM

Physical Network

Topology is a Ring

(3+ nodes) or a Mesh

ONS Chassis

same chassis

ONS Chassis ONS Chassis

Services require

Transponding,

Muxponding, or Xponding

Distance and/or loss is

too high for passive


22/33


The existing network had a combination of 10G and40G CP-DQPSK MUX w/EFEC. Fiber DCUsused at sites for CD compensation. EDFA-C andRAMAN were used at OLA sites.

In the redesigned DCU-less network,10G wavelengths were multiplexed using40G CP-DQPSK MUX w/EFEC. At some sites the EDFA-C were replaced withMAL-less EDFA.

Same network was again redesigned using FBG DCUs in place of the FiberDCUs.

Conclusion - An FBG DCU based design is ideal in case lowest latency is desiredwhereas the coherent design is ideal for a cost optimization.

Network Latency (ms) Cost

Existing w/ Fiber DCUs 9.2 N.A

Redesigned w/o DCUs 8 Lower than existing

Redesigned w/ FBG DCU 7.1 Marginally higher than existing


23/33


Which of the following solutions are you willing to use tobuild your low latency network ?

a. 10G solution with low latency FBG DCUs.

b. Coherent (DCU less) solution using 40G MXP.

c. Coherent (DCU less) solution using 100G MXP.


24/33


Increasing demand for bandwidth for applications likeVoD, r.t video processing, financial services, medical

imaging, storage and scientific computing.

Multi-hop networks used in data-centers are based on

Fat tree or Butterfly topologies use commodity switchesthat employ store-and-forward paradigm that incur high

latencies and high power consumption.

Low-latency networking for financial players has

continued to evolve and innovate at such a relentlesspace that today 250ns can make the difference between

winning and losing a trade.


25/33


Network diversity with self healing topology.

Support for ever increasing bandwidth and deliver guaranteedhigh performance data solution.

Speed, reliability and security to receive and transmit volumes

of critical data to market centers.

Shortest routes between major exchange locations for point topoint transmission.

Specialized DWDM network with guaranteed round trip

performance between key Data Center locations.


27/33


Exchange

Server

ExchangeSwitch

Customer A Customer B Customer C Customer D

CustomerServer

Customer

Switch

QuickestResponse

Gets Trade


28/33


Cisco Confidential

Exchange Owned

Firm Owned

Passive OpticalSwitch

ExchangeX-Connect

Concept

Reduce impact of buffering, microbursts,and multicast issues

Use switch for order execution entry

Bypass switch for near elimination of

ingress Market Data traffic latency

SolutionPassive Optical Switch almost totally

eliminates receive traffic latency and

inherent issues with ingress market data

Value Latency cut down drastically to less than

20 ns.

Nexus 3064

HFT Servers

Send Single fiber strandReceive Single fiber strand

Switch Receive Single

fiber strand to complete

switch connections.

Send Single fiber strands

Receive Single fiber strands


29/33



30/33


Customer A

Exchange

Server

ExchangeSwitch

WAN

WAN

WAN

Info fromOther Exchanges

Info fromCorporate

Info fromFinancial Feeds

HFT ServersRequire External

Information to MakeSmart Trades

Is your WANOptimized for

Lowest Latency?


31/33


Cisco Confidential

Exchange Owned

Firm Owned

ExchangeX-Connect

1:8Passive Optical

Switch

Dual NIC HFT Servers

Single fiber strands

Nexus 3064

1:8Passive Optical

Switches

Outbound fiber

strands

One per server

Inbound

fiber

strands

One

strand

per

server

ONS 15454

1:8Passive Optical

Switch

Dual NIC HFT Servers

Single fiber strands

Nexus 3064

1:8Passive Optical

Switches

Outbound fiber

strands

One per server

Inbound

fiber

strands

One

strand

per

server

ONS 15454

OPTICAL

WAN

ExchangeX-Connect


32/33


When do you plan to deploy the low latency solution ?a. Within 3 months

b. 3-6 months

c. > 6months

d. Not sure.


33/33

245 cisco low latency collateral

Documents