© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external no softcopy)lwigley Viking 81

Lane Wigley (lwigley@cisco.com)Service Provider Group Technical Marketing Engineering

ASR 9000 Quick Start

Platform Architecture

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 82

ASR 9000 IntroductionEthernet Optimized Aggregation Routers

6 and 10 slot chassis

40 & 80 Gbps line cards

Path to 400 Gbps LCs w/o forklift

Highly Available Hardware

IOS XR Operating System

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 83

Platform Architecture Agenda

Chassis

Route Switch Processor

Line Cards

Switch Fabric

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 84

ASR 9000 - 10 Slot Chassis1/2 Rack 8 Line Cards

Power Power PowerPower Power Power

FansFans

Fabric

Fabric

Fabric

RSP0

RSP18xTenGE(4:3 Oversub)

4xTenGE

40xGE

SIP-700

8xTenGE

16xTenGE(4:3 Oversub)

LineCards

20xGE +2xTenGE

Fabric

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 85

ASR 9000 - 6 Slot Chassis 1/4 Rack 4 Line Cards

Power Power Power

Fans

FabricFabric

FabricFabric

RSP0

RSP1

LineCards

LineCards

LineCards

LineCards

Fans

Rear view showing exhaustand AC power connections

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 86

ASR 9010 Power and Cooling

Power Power PowerPower Power Power

FansFans

Fabric

Fabric

Fabric

Fabric

RSP0

RSP18xTenGE(Oversub)

4xTenGE

40xGE

20GSIP-700

20xGE +2xTenGE8xTenGELine Rate

LineCards

FutureLCs

2.1 kW

2.1 kW

3 kW

DC Supplies

AC Supplies

AB

AB

3 kW

A

B

Fans unique to chassisVariable speed for:

Ambient temperature variationRedundancy

6 & 10 slot use same power suppliesAny supply can power any card

Power draw shared evenlyPlan for both power feed and PS redundancy

1.5kW DC supply also availableAllows reduced breaker rating

AC is 220V Single PhasePower & Fans will support 400G cards

ASR 9010

ASR 9010 Fan Tray

Power Supply

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 87

ASR 9006 Power and Cooling

2.1 kW

2.1 kW

3 kW

DC Supplies

AC Supplies

AB

AB

3 kW

A

B

Power Power Power

Fans

FabricFabric

FabricFabric

RSP0

RSP1

LineCards

LineCards

LineCards

LineCards

Fans

ASR 9006

Fans unique to chassisVariable speed for:

Ambient temperature variationRedundancy

Modular Power Architecture (9006 & 9010)Number of Power Supplies based on

Number of line cardsType of line cardsPower redundancy requirements

Base system is ~1500W40G LCs are max 375W80G Line Rate LC is max 765WTools available for power planning

ASR 9006 Fan Tray

Power Supply

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 88

Path to 400 GbpsInfrastructure designed to support 400 Gbps

Chassis 400G Ready

Power Supplies 400G Ready

Cooling 400G Ready

Fabric RSP3 required

40/80G Line Cards Work in 400G System

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 89

Route Switch Processor

Dual core PowerPC CPU w/ 4GB memory

RP is logically separate from fabric but physically on same board

Main Memory4 GB

Fabric 0

Fabric 1

Fabric 0

Fabric 1

RSP1

Mgmt Eth

Mgmt Eth

Console

Aux

Flash

Hard Drive

Flash

Flash

NVRAM

FabricInterface

ASIC

ControlEthernetSwitch

RSP0

Performs control plane functionsRoutingCreating forwarding tablesNetwork management

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 90

ASR 9000Line Card Architecture

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 91

Line Card Architecture - Big PictureHigh Level Packet Flow

Network Processors perform lookups and features on Ingress and Egress

FabricInterface

ASIC

Network Processor 0PHY

NP2PHY

NP3PHY

BRIDGENP1PHY

BRIDGE

Fabric 0

Fabric 1

Fabric 0

Fabric 1

RSP0

RSP1FabricInterface

ASIC

NP0PHY

NP2PHY

NP3PHY

BRIDGENP1PHY

BRIDGE

All traffic passes through switch fabric

Ingress CEF, ACL, QoS, & Stats

Egress CEF, ACL, QoS, & Stats

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 92

40G Line Card Family

FIA

NP0PHY 3

NP2PHY 1

NP3PHY 0

NP1PHY 2

FIA

NP0PHY 3

NP2

NP3

NP1

PHY 7

PHY 2PHY 6

PHY 1PHY 5

PHY 0PHY 4

FIA

NP0

NP2

NP3

NP1

FIA

NP0PHY

NP2

NP3

NP1PHY

Oversubscribed 8xTenGE

4xTenGE 2xTenGE + 20xGE

40xGE

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 93

80G Line Rate & 160G OS Line Cards

FabricInterface

ASICPHY

PHY

PHY

PHY

PHY

PHY

PHY

FabricInterface

ASIC

NP2

NP1

NP0

NP6

NP5

NP4

NP7

NP3PHY

Line Rate 8xTenGE

FabricInterface

ASIC

FabricInterface

ASIC

NP2

NP1

NP0

NP6

NP5

NP4

NP7

NP3

Oversubscribed 16xTenGE

PHYPHY

PHYPHY

PHYPHY

PHYPHY

PHYPHY

PHYPHY

PHYPHY

PHYPHY

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 94

20G SPA Carrier High Touch Line Card

FIA

NPEgress

NPIngress

New High Touch NP for additional feature capabilitiesNPs mapped to Ingress & Egress (vs. per port)

SPA

SPA

SPA

SPA

SPAMgr

SPAMgr

20G SPA Carrier (XR 4.0)

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 95

Line Card Scale Options

Line Card High Medium Low40xGE All SW All SW 3.94xTenGE All SW All SW 3.98xTenGE Oversubscribed All SW All SW 3.92xTenGE+20xGE 3.9 3.9 Future8xTenGE Line Rate 3.9 Future 3.916xTenGE Oversubscribed Future 3.9.1 Future20G SPA Carrier Future

Software support for line cards

3 options for line card scalability

High (-E), Medium (-B), & Low (-L) Queue CardsDifferent LC hardware not sw license

High queue cards have additional memory

Details in QoS Architecture presentation Low

Medium

High

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 96

Line Card Family Photo

8xTenGE4xTenGE 2xTenGE+ 20xGE40xGE 16xTenGE

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 97

Optics

TenGE XFP OpticsLR, ZR, & ER

GE - SFP OpticsT, S, L, & Z

Standard, CWDM, & DWDM XFPs/SFPs available

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 98

ASR 9000Switch Fabric

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 99

Switch Fabric Data Plane

NP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIA

FIA

FIA RP0

RP1

NPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHYFIA

FIARP0

RP1

RSP0

SFA0

SFA1

RSP1

SFA0

SFA1

LCs & RPs have FabricInterface ASICs (FIA)

80G Line Rate Cardshave 2 FIAs

2 Fabric planes x2 SFAs per plane = 4 SFAs4 x 23 = 92 Gbps in/out per FIA

Switch Fabric ASIC provides crossbar23 Gbps data path

FIA

FIA

FIA

SFANP

NP

NP

NP

PHY

PHY

PHY

PHY

Ingress Egress (same card as left side)

FIA

FIA

FIA

FIA

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 100

Switch Fabric Control Plane

NP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIA

FIA

FIA RP0

RP1

NPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIA

FIA

FIARP0

RP1

RSP0

Arbiter

RSP1

Arbiter

NPPHY

NPPHY

NPPHY

NPPHY

NP

NP

NP

NP

PHY

PHY

PHY

PHY

SFA0

SFA1

SFA0

SFA1

Each fabric planehas 1 Arbiter

Arbiter fairly allocates fabricBandwidth to and from each NP

ArbiterFIA

FIA

FIA

FIA

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 101

FIANP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIA

FIA

FIA RP0

FIA RP1

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIA

FIA

FIARP0

FIARP1

RSP0

Arbiter

RSP1

Arbiter

NPPHY

NPPHY

NPPHY

NPPHY

NP

NP

NP

NP

PHY

PHY

PHY

PHY

SFA0

SFA1

SFA0

SFA1

Data plane providesActive/Active redundancy

Control Plane providesActive/Standby redundancy

Both Arbiters work in parallel both answer all requestsFIAs follow active ArbiterFIAs switch to backup if needed

Both planes and all 4 SFAsare used under normal operation

All available paths are used under failure conditions

SFA

Arbiter Arbiter

SFA

SFA

SFASwitch Fabric Redundancy

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 102

Switch Fabric Multicast

NP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIANP PHY

NP PHY

NP PHY

NP PHY

FIA

FIA

FIA RP0

RP1

NPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIANPPHY

NPPHY

NPPHY

NPPHY

FIA

FIA

FIARP0

RP1

RSP0

Arbiter

RSP1

Arbiter

NPPHY

NPPHY

NPPHY

NPPHY

NP

NP

NP

NP

PHY

PHY

PHY

PHY

SFA0

SFA1

SFA0

SFA1

Fabric supports multicast replication

Multicast packets queued andscheduled separately

Additional replication performed byegress LC (FIAs & NPs)

Fabric Group IDs (FGIDs) areprogrammed into fabric by controlplane

FGIDs provide a set of egress NPsfor each multicast group

FIA

FIA

FIA

FIA

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 103

ASR 9000 Platform Strengths

Optimized Aggregation Routers

Best in Class Infrastructure400G LC Ready

Flexible Forwarding Architecture

Advanced Switch Fabric

Flexible Optics options

© 2009 Cisco Systems, Inc. All rights reserved. Cisco Confidential (NDA Required for external )lwigley Viking 104