decca design brand review has checked your presentation and noted the following items: in the...

Decca Design brand review has checked your presentation and noted the following items:

• In the correct widescreen Cisco Live 2015 template: Yes. Removed all the “template slides”

• Presentation ID filled in: 8

Readability issues: Please note on a few slides (10 and others), the content runs into the headers and/or footers. Please resize the content as needed. You can try using the layout titled ''Title Only 4 Heavy Graphics’’ or “Title and Subtitle 4 Heavy Graphics”. These layouts have a little more space for your graphics. Visit decdesign.com/ciscolive2015 to get the easy steps on how to reset Layouts. This also will repair problems such as pagination, title color, and presentation ID placement.

Remember to run spell check on your presentation.

Delete any Certification slides (slides 30-40 in the master template) that are not relevant.

Delete this green note after review.

http://www.decdesign.com/ciscolive2015

Overlay Transport Virtualization

Brian Farnham Technical Marketing EngineerBRKDCT-2049

© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-2049

Agenda

• Introduction

• Distributed Data Centers: Goals and Challenges

• OTV Architecture Principles

• Principles of Interconnecting Networks at Layer-2

• OTV New Features

3

© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-2049 4

OTV – Overlay Transport VirtualizationSimplifying Data Center Interconnect

Any Workload Anytime Anywhere


Session Objectives• The main goals of this session are:

• This session features a detailed analysis of the architectural aspects and deployment benefits behind OTV

• The attendees will learn how OTV is aimed at providing Layer 2 connectivity beyond the Layer 3 boundary while maintaining the failure containment and operational simplicity that the Layer 3 boundary provides

• The attendees will get a deep knowledge of how the OTV control-plane and data-plane work to provide the VLAN extension


Session Non-objectives• This session does not include:

• In depth discussion of Path Optimization technologies (DNS, LISP, etc.)

• Storage extension considerations associated to DCI deployments

• Workload mobility application specific deployment considerations


Related Cisco Live Events

Session-ID Session NameBRKDCT-2131 Mobility and Virtualization in the Data Center with LISP and OTV

BRKDCT-3060 Deployment Considerations with Interconnecting Data Centers

BRKDCT-3103 Advanced OTV – Configure, Verify and Troubleshoot OTV


Agenda

• Introduction

• Distributed Data Centers: Goals and Challenges



• OTV New Features

8


Distributed Data Centers Goals• Ensure business continuity

• Distributed applications

• Seamless workload mobility

• Maximize compute resources


EoMPLS

VPLSDark Fiber

Data Center InterconnectTraditional Layer 2 Extensions

VSS & vPC or FabricPath• Applies easily for dual site interconnection• Over dark fiber or protected D-WDM• Easy crypto using end-to-end 802.1AE

OTV – Overlay Transport Virtualization• MAC in IP

EoMPLS & VPLS & A-VPLS & H-VPLS• PE style• Multi-tenants• Most deployed today

Ethernet

MPLS

IP


Challenges in Traditional Layer 2 VPNsFlooding Behavior Pseudo-wire Maintenance Multi-Homing

- Unknown Unicast for MAC propagation- Unicast Flooding reaches all sites

- Full mesh of Pseudo-wire is complex- Head-End replication is a common problem

- Requires additional Protocols & extends STP- Malfunctions impacts multiple sites


Technology Pillars


No Pseudo-WireState Maintenance

Optimal MulticastReplication

Multipoint Connectivity Point-to-Cloud Model

Dynamic Encapsulation


Preserve Failure Boundary Built-in Loop Prevention

Automated Multi-Homing Site Independence

Protocol Learning




• Nexus 7000 First platform to support OTV (since 5.0 NXOS Release)

• ASR 1000 Now also supporting OTV (since 3.5 XE Release)


Agenda• Introduction

• Distributed Data Centers: Goals and Challenges• Control Plane and Data Plane• Failure Isolation• Multi-homing• Mobility• L2 Multicast Forwarding• QoS and Scalability• Path Optimization



• OTV New Features16


Terminology

• Edge Device• Performs all OTV functionality• Usually located at the Aggregation Layer or at the

Core Layer• Support for multiple OTV Edge Devices (multi-homing)

in the same site

• Internal Interface• Site facing Interfaces of the Edge Devices• Carry VLANs extended through OTV • Regular Layer 2 interfaces• No OTV configuration required• Supports IPv4 & IPv6

OTV Devices and Interfaces

Core Device

OTV Edge Device

OTV Internal Interface

OTV Join Interface

Aggregation Device

OTV Overlay Interface

OTV Edge Device

OTV Internal Interfaces


Terminology

• Join Interface• One of the uplink of the Edge Device• Point-to-point routed interface (physical interface,

sub-interface or port-channel supported)• Used to physically “join” the Overlay network• No OTV specific configuration required• IPv4 only

• Overlay Interface• Virtual interface with most of the OTV configuration• Logical multi-access multicast-capable interface• Encapsulates Layer 2 frames in IP unicast or

multicast

OTV Devices and Interfaces

Core Device

OTV Edge Device

OTV Internal Interface

OTV Join Interface

Aggregation Device

OTV Overlay Interface

OTV JoinInterface

Overlay Interface


OTV Control Plane

No unknown unicast flooding (selective unicast flooding in 6.2)

Control Plane Learning with proactive MAC advertisement

Background process with no specific configuration

IS-IS used between OTV Edge Devices

Building the MAC Tables

West

OTV

IP A IP B

IP C

East

South

MAC AddressesAdvertisements OTV

OTV


OTV Control Plane

Before any MAC address can be advertised the OTV Edge Devices must: ‒ Discover each other‒ Build a neighbor relationship with each other

Neighbor Relationship built over a transport infrastructure:‒ Multicast-enabled (all shipping releases)‒ Unicast-only (from NX-OS release 5.2 & IOS-XE 3.9)

Neighbor Discovery and Adjacency Formation


End Result• Adjacencies are maintained

over the multicast group

• A single update reaches all neighbors

Mechanism• Edge Devices (EDs) join an

multicast group in the transport, as they were hosts (no PIM on EDs)

• OTV hellos and updates are encapsulated in the multicast group

OTV

West

OTVOTV Control Plane

IP AEast

OTV

OTV Control Plane

IP B

Multicast-enableTransport

OTV Control PlaneNeighbor Discovery (over Multicast Transport)


West

OTV

South

East

OTV

OTV

OTV

OTV Control Plane

OTV Control Plane OTV Control Plane

IP A IP B

IP C

Encap Decap

Decap

OTV Hello

OTV Hello

OTV Hello

IGMP Join G

IGMP Join G

IGMP Join GMulticast state for group G established throughout transport

Transport natively replicates multicast to all OIFs

All edge devices join OTV control-group G

1

2

3

4

5

6

6

7

7

IP A GIP A GOTV Hello



OTV Hello IP A GIP A GOTV Hello

OTV Hello IP A GIP A GOTV Hello

Neighbor IP AddrWest IP A

Neighbor IP AddrWest IP ANeighbor IP Addr

Multicast-enabled Transport

OTV Control Plane (Multicast Transport)


OTV Control Plane (Multicast Transport)

23

South

EastWest

OTV

OTV

OTV

OTV

OTV Control Plane

OTV Control Plane OTV Control Plane

IP A IP B

IP C

Decap Decap

Encap

OTV Hello

IP C GIP C GOTV Hello

IP C GIP C GOTV Hello IP C GIP C GOTV Hello

OTV Hello OTV Hello

OTV Hello IP C GIP C GOTV Hello OTV Hello IP C GIP C GOTV Hello

Neighbor IP AddrWest IP A

Neighbor IP AddrWest IP ASouth IP C

Neighbor IP AddrSouth IP C

1

2

3

4 4

55Bidirectional adjacency formed

The South Site creates its hello with West’s address

in the TLV


© 2015 Cisco and/or its affiliates. All rights reserved. Cisco PublicBRKDCT-2049 24South

EastWest

OTV

OTV

OTV

OTV

VLAN MAC IF 100 MAC A IP A 100 MAC B IP A 100 MAC C IP A


VLAN MAC IF 100 MAC A e1/1 100 MAC B e1/1 100 MAC C e1/1

VLAN MAC IF 100 MAC A e1/1 101 MAC B e1/1 102 MAC C e1/1

Update A



New MACs learned in VLANs that are OTV extended

Craft OTV update with new MACs

IP A GIP A GUpdate A

Update A

Update A



Update A IP A GIP A GUpdate A

Update A IP A GIP A GUpdate A

Encap Decap

Decap1

2

3

4

5

5

6

6


7

7

Add MACs learned through OTV

Add MACs learned through OTV

MAC Table

MAC Table

MAC Table


OTV Control PlaneMAC Advertisements (over Multicast Transport)


Multicast Transport

• Use a High-Available Multicast Rendez-Vous Point (RP) configuration

‒ PIM Anycast (RFC4610) or MSDP (Multicast Source Discovery Protocol)

• Requirements to Control Plane‒ PIM Any-Source-Multicast (ASM) Sparse-Mode

• Requirements to Data Plane‒ PIM Source-Specific-Multicast (SSM) or BiDir

OTV Control and Data Plane over Multicast Transport

feature pim!interface loopback 0 ip pim spare-mode ip address 192.168.1.100/32!interface loopback 1 ip pim sparse-mode ip address 10.254.254.n1-x/32!ip pim rp-address 192.168.1.100 group-list 239.1.1.1ip pim anycast-rp 192.168.1.100 10.254.254.n1 ip pim anycast-rp 192.168.1.100 10.254.254.n2ip pim ssm range 232.239.1.0/24!interface port-channel1# This Interface peers with the OTV Join Interface ip igmp version3

Example:Multicast for OTV on

Nexus 7000

* “n” in the last Octet reflects a unique IP address per Router joining the PIM Anycast Group


OTV Control Plane

• Ideal for connecting a small number of sites

• With a higher number of sites a multicast transport is the best choice

Neighbor Discovery (Unicast-only Transport)

OTV

West

OTVOTV Control Plane

IP AEast

OTV

OTV Control Plane

IP B

Unicast-only Transport

End Result• Neighbor Discovery is automated

by the “Adjacency Server”

• All signaling must be replicated for each neighbor

• Data traffic must also be replicated at the head-end

Mechanism• Edge Devices (EDs) register with

an “Adjacency Server” ED

• EDs receive a full list of Neighbors (oNL) from the AS

• OTV hellos and updates are encapsulated in IP and unicast to each neighbor

Release 5.2 and above


Establishment of control plane adjacencies between OTV Edge Devices (multicast or unicast transport):

Unicast MAC reachability information:

Remote Site MAC

Local Site MAC

dc1-agg-7k1# show otv adjacency

Overlay Adjacency databaseOverlay-Interface Overlay100 :Hostname System-ID Dest Addr Up Time Adj-Statedc2-agg-7k1 001b.54c2.efc2 20.11.23.2 15:08:53 UP dc1-agg-7k2 001b.54c2.e1c3 20.12.23.2 15:43:27 UP dc2-agg-7k2 001b.54c2.e142 20.22.23.2 14:49:11 UP

dc1-agg-7k1# show otv routeOTV Unicast MAC Routing Table For Overlay100VLAN MAC-Address Metric Uptime Owner Next-hop(s)---- -------------- ------ -------- --------- -----------2001 0000.0c07.ac01 1 3d15h site Ethernet1/12001 0000.1641.d70e 1 3d15h site Ethernet1/22001 0000.49f3.88ff 42 2d22h overlay dc2-agg-7k12001 0000.49f3.8900 42 2d22h overlay dc2-agg-7k2

OTV Control PlaneCLI Verification


OTV

TransportInfrastructure

OTV OTV OTV OTV

MAC TABLE

VLAN MAC IF

100 MAC 1 Eth 2

100 MAC 2 Eth 1

100 MAC 3 IP B

100 MAC 4 IP B

MAC 1 MAC 3

MAC TABLE

VLAN MAC IF

100 MAC 1 IP A

100 MAC 2 IP A

100 MAC 3 Eth 3

100 MAC 4 Eth 4

Layer 2Lookup

6

IP A IP BMAC 1 MAC 3MAC 1 MAC 3Layer 2Lookup

2 Encap

3Decap 5

MAC 1 MAC 3West SiteServer 1 Server 3

EastSite

4

7

IP A IP B

1

IP A IP BMAC 1 MAC 3

OTV Data PlaneInter-Site Packet Flow


OTV Data Plane

• 42 Bytes overhead to the packet IP MTU size (IPv4 packet)• Outer IP + OTV Shim - Original L2 Header (w/out the .1Q header)

• 802.1Q header is removed and the VLAN field copied over to the OTV shim header

• Outer OTV shim header contains VLAN, overlay number, etc.• Consider Jumbo MTU Sizing

Encapsulation

20B + 8B + 14B* = 42 Bytes of total overhead

6B 6B 2B 20B 8B

DMAC SMACEther Type IP Header

Payload 4B

CRCOTV Shim

802.1QDMAC SMAC

EtherType

802.1Q

VLAN ID, Overlay#

14B*

Original L2 Frame

L2 Header

802.1Q header removed

* The 4 Bytes of .1Q header have already been removed


Spanning-Tree and OTV

• Site transparency: no changes to the STP topology

• Total isolation of the STP domain

• Default behavior: no configuration is required

• BPDUs sent and received ONLY on Internal Interfaces

Site Independence

L2

L3

OTV

OTV

OTV

The BPDUsstop here

The BPDUsstop here


L2

L3

OTV

OTV

OTV

Unknown Unicast and OTV

• No requirements to forward unknown unicast frames

• Assumption: end-host are not silent or uni-directional

• Default behavior: no configuration is required

No Longer Unknown Unicast Storms Across the DCI

MAC TABLE

VLAN MAC IF

100 MAC 1 Eth1

100 MAC 2 IP B

- - -

MAC 1 MAC 3

No MAC 3 in theMAC Table


Unknown Unicast and OTV

• Some Application requirement to forward unknown unicast frames

• Selective Unicast Flooding can be enabled per mac address

• Default behavior: no unknown unicast forwarding

Selective Unicast Flooding

NewRelease 6.2

L2

L3

OTV

OTV

OTV

MAC 1 MAC 3VLAN 100

MAC 6 MAC 7VLAN 102

Enable Flooding for MAC .0101

Unknown Unicast

MAC State IF

.0000 Blk Overlay1

.0101 Blk Overlay1

.1111 Fwd Overlay1✔

OTV-a # confEnter configuration commands, one per line. End with CNTL/ZOTV-a(config)# otv flood mac 0000.2102.1111 vlan 172


Controlling ARP Traffic

• ARP cache maintained in Edge Device by snooping ARP replies• First ARP request is broadcasted to all sites. Subsequent ARP requests are

replied by local Edge Device• Timeout can be adjusted (as per NX-OS 6.1(1))• Drastic reduction of ARP traffic on DCI• ARP spoofing can be disabled• IPv4 only feature• Default behavior: no configuration is required

ARP Neighbor-Discovery (ND) Cache

OTV-a(config)# interface overlay 1OTV-a(config-if-overlay)# no otv surpress-arp-nd

# Allows ARP requests over an overlay network and disables ARP caching on edge devices. This command does not support IPv6.

OTV-a(config)# interface overlay 1OTV-a(config-if-overlay)# otv arp-nd timeout 70

# Configures the time, in seconds, that an entry remains in the ARP-ND cache.The time is in seconds varying from 60 to 86400. The default timeout value is 480 seconds.

New:Release 6.1


OTV Multi-homing

• No additional protocols required (i.e. BGP)

• OTV site-vlan used to discover OTV neighbor in the same site

• Authoritative Edge Device (AED) Election takes place

• Extended VLANs are split across the AEDs

• The AED is responsible for:‒ MAC address advertisement for its VLANs‒ Forwarding its VLANs’ traffic inside and outside the site

Fully Automated Multi-homing

L2

L3

OTV

OTVAED AED

Site Adjacency used for AED election

Site Adjacency


Hardened Multi-homing

• Same site devices must use common site-identifier

• Site-id information is included in the control plane

• Makes OTV multi-homing more robust and resilient‒ Site Adjacency and Overlay Adjacency are now both leveraged for

AED election

• An overlay will not come up until a site-id is configured

‒ Site and Overlay Adjacency are both leveraged for AED election

Introducing OTV Site-identifier

L2

L3

OTV

OTV

feature otvotv site-identifier 0x1otv site-vlan 99

AED AED

Site Adjacency

Overlay Adjacency



OTV Multi-homing

• Automated and deterministic algorithm

• In a dual-homed site:• Lower IS-IS System-ID (Ordinal 0) = EVEN VLANs• Higher IS-IS System-ID (Ordinal 1) = ODD VLANs

VLANs Split across AEDs

OTV

OTV OTV

IP BIP A

Site Adjacency

Overlay Adjacency

OTV-a OTV-b

OTV-a# show otv vlan

OTV Extended VLANs and Edge Device State Information (* - AED)

VLAN Auth. Edge Device Vlan State Overlay---- ------------------ ---------- ------- 100 East-b inactive(Non AED) Overlay100 101* East-a active Overlay100 102 East-b inactive(Non AED) Overlay100

OTV-b# show otv vlan

OTV Extended VLANs and Edge Device State Information (* - AED)

VLAN Auth. Edge Device Vlan State Overlay---- ------------------ ---------- ------- 100* East-b active Overlay100 101 East-a inactive(Non AED) Overlay100 102* East-b active Overlay100

AEDODD VLANs

AEDEVEN VLANs

Remote OTV Device MAC Table

VLAN MAC IF

100 MAC 1 IP A

101 MAC 2 IP B


OTV Multi-homing

1. Broadcast reaches all the Edge Devices within the site2. Only the AED forwards the traffic to the Overlay3. All the Edge Devices at the other sites receive the broadcast4. At the remote sites only the AEDs forward it into the site

AED and Broadcast Handling

Core

OTV

OTV

OTV

OTV

AEDAED

Bcast pkt

Broadcaststops here

Broadcaststops here

OTV


OTV and MAC Mobility

1. Workload moved between Data Center sites

MAC Moving and OTV Updates (1)

Core

OTV

OTV

OTV

OTV

AEDAED

OTVESX ESX

VM Moves

MAC X

MAC X

MAC X

MAC X

MAC X

MAC X



1. Workload moved between Data Center sites2. Workload is detected in East DC and OTV control plane is triggered


Core

OTV

OTV

OTV

OTV

AEDAED

OTVESX ESX

MAC X

MAC X

MAC X

MAC X

MAC X

MAC X

2.1) Server originates a Gratuitous ARP

(GARP) frame2.2) AED detects

MAC X is now local

MAC X

MAC X

MAC X

2.3) AED advertises MAC X with a metric of zero

MAC X

MAC X

2.4) EDs in site West see MAC X advertisement with a better metric from site East and change them to remote

MAC address.



1. Workload moved between Data Center sites2. Workload is detected in East DC and OTV control plane is triggered3. East to West OTV data plane traffic allows to update the MAC tables of the L2

devices in West Site


Core

OTV

OTV

OTV

OTV

AEDAED

OTVESX ESX

MAC X

MAC X

MAC X

MAC X

MAC X

MAC X

MAC X

3.1) AED in site East forwards the GARP broadcast frame

across the overlay

MAC X

3.2) AED in site West forwards the GARP into the site and the L2 switches update

their CAM tables

Note: GARP is used as example traffic, same behavior is achieved with any other L2 broadcast frames exchanged


L2 Multicast Traffic between Sites

• OTV can leverage the multicast support available in the transport network to optimize the delivery of the multicast traffic for the VLANs stretched across sites

• Three steps:1. Automated mapping of the sites’ multicast groups to a range of multicast groups in

the transport network2. Creation of the Multicast state information at the OTV Edge Devices3. Sites’ Multicast traffic delivered over the Overlay

Multicast Enabled Transport


L2 Multicast with Multicast Transport

• The site multicast groups are mapped to a SSM group range in the core• Each (S1,Gs1) maps to a different SSM group in round-robin fashion

Step 1 – Mapping of the Site Multicast Group

S1

OTV

OTV

OTV

IP AIP B

WestEast

Mcast Stream 1

S1 Gs1

IP C

South

OTV

The Mapping is communicated to

the other EDs 3

Mapping to a Delivery Group

2


Mcast Group Mapping

Site Group Core Group

Gs1 Gd1

S2

S2 Gs2

4

Mcast Group Mapping

Site Group Core Group

Gs1 Gd1

Gs2 Gd2

1) The Mcast source starts sending traffic to

the group Gs1

2) The West ED maps (S1,Gs1) to a delivery

group Gd1

3) The West ED communicates the mapping information (including the

source VLAN) to the other EDs

4) Same process happens once source S2 is enabled (sending to

a different group Gs2)


East

L2 Multicast with Multicast TransportStep 2 – Multicast State Creation

S1

OTV

OTV

OTV

IP AIP B

West

S1 Gs1

IP C

South

OTV

Multicast-enabled Transport Client IGMP

report to join Gs1

1Client IGMP snoop

2

GM-Update 3.1

IGMPv3 report to join (IP A,

Gd1) , the SSM group in the

Core.

3.2

Receive GM-Update Update OIL

4

SSM Tree for Gd1

It is important to clarify that the edge devices join the core multicast groups as hosts, not as routers!

OIF-List

Group IF

Gs1 Gd1 Overlay

1) A receiver in the East site sends an IGMP join

for Gs1

2) The OTV ED snoops the IGMP join (without

forwarding it)

3.1) ED Announces the receivers in a Group-

Membership Update (GM-Update) to all other EDs

3.2) ED Sends an IGMPv3 report to join the (IP A, Gd1)

SSM group in the core

4) The source ED adds the Overlay interface to the

Outbound Interfaces (OIF)

5) The SSM tree for Gd1 (rooted at the source ED) is

built in the core)

Receiver (for Gs1)


Receiver (for Gs1)South

East

L2 Multicast with Multicast TransportStep 3 – Multicast Packet Flow

OTV

OTV

OTV

IP AIP B

West

IP C


OTV

Receiver (for Gs1)

OIF-List

Group IF

Gs1 Gd1 Overlay Lookup

1

S1

S1 Gs1

IP A Gd1S1 Gs1

Encap

2

TransportReplication

3

IP A Gd1S1 Gs1

IP A Gd1S1 Gs1

4

4

Decap 5

Decap 5

S1 Gs1

S1 Gs1


L2 Multicast with Multicast Transport

OTV can leverage the benefits of a multicast-enabled transport for both control and data planes. The following summarizes the requirements for a multicast transport:

• Control group – Single PIM-SM or PIM-Bidir group used to form adjacencies and exchange MAC reachability information

• Data groups – Range of SSM groups used to carry multicast data traffic generated by the sites

The right number of SSM groups to be used depends on a tradeoff between the amount of multicast state to be maintained in the core and the optimization of Layer 2 multicast traffic delivery

Multicast Groups in the Core

interface Overlay100 otv join-interface e1/1 otv control-group 239.1.1.1 otv data-group 232.192.1.0/24 otv extend-vlan 100-150


QoS and OTV

• On Encapsulation• CoS bits (802.1p) copied to the OTV shim header • If IP traffic: The original (inner) DSCP value is also copied to “outer” DSCP

Marking on Encapsulation

OTV

OTV

OTV

IP AIP B

WestEast

802.1Q 1

Encap

2

DMAC SMAC 802.1Q ETHERTYPE IP (optional)

Inner DSCPCoS802.1p

IP (optional) OTV Original FrameOuter DSCP OTV

shim



QoS and OTV

• On De-capsulation• CoS value is recovered from the OTV shim and added to the 802.1Q header

• Original CoS and DSCP are both preserved

• OTV Control Traffic is statically marked at CoS = 6/DSCP = 48

Marking on De-capsulation

OTV

OTV

OTV

IP AIP B

WestEast

802.1Q 2

DMAC SMAC 802.1Q ETHERTYPE IP (optional)

Inner DSCPCoS802.1p

IP (optional) OTV Original FrameOuter DSCP OTV

shim

Decap 1



OTV ScalabilityCurrent and Future Supported Values

NX-OS 5.2

NX-OS 6.2

16k

MAC addressesacross all the

extended VLANs

32k

100%

2000

Multicast Data Groups

4000

100%

6*

Sites

8*

+2

256

OTV extendedVLANs

1500

580%

Release 6.2

* two ED per Site


Path OptimizationEgress Routing Optimization

Hot Potato Routing


Path Optimization

• Extended VLANs typically have associated HSRP groups

• By default, only one HSRP router elected active, with all servers pointing to HSRP VIP as default gateway

• Result: sub-optimal routing

Egress Routing with LAN Extension

HSRPActive

HSRPStandby

HSRPListen

HSRPListen

HSRP Hellos

VLAN20

VLAN10

ARP forHSRP VIP

ARP reply

Packet fromVlan 10 to Vlan 20

DMAC = Host Vlan 20

Packet fromVlan 10 to Vlan 20

DMAC = DGW

Routing


Egress Routing Localization

• Filter FHRP with combination of VACL and MAC route filter

• Result: Still have one HSRP group with one VIP, but now have active router at each site for optimal first-hop routing

FHRP Filtering Solution

HSRPActive

HSRPStandby

HSRPListen

HSRPListen

HSRP Hellos

VLAN20

VLAN10

HSRP Hellos✗✗ ✗✗HSRP Filter

HSRPActive

HSRPStandby

ARP forHSRP VIP

ARP reply


Path Optimization

• Layer 2 extensions represent a challenge for optimal routing

• Challenging placement of gateway and advertisement of routing prefix/subnet

Optimal Routing Challenges

WAN

HSRPActive

HSRPStandby

HSRP Filter

HSRPActive

HSRPStandby

East-West /Server-Server

Egress:South-North / Server-Client


Ingress:North-South / Client-Server



Path Optimization

• Logical Data Center or Physical Data Center?

• High Availability or Disaster Recovery?

Is it relevant to my Data Center model?

WAN

East-West /Server-Server





Is this ONE Logical Data Center ?(High Availability)

Or do I have TWO Physical & Logical

…

… separated Data Center?


Specific Use-Case

• IPv6 Unicast Forwarding and Multicast Flooding supported across OTV- Requires to disable optimized multicast forwarding (OMF) in IGMP snooping on OTV ED

• IPv6 Transport Network (Join Interface & Source Interface, not yet supported)

IPv6 and OTV

DCWest

DCEast

OTV

OTV OTV

OTVOTV

vPC/vPC+ Domain

Global (all VLAN):no ip igmp snooping optimise-multicast-flood

Per VLAN with IPv6 Trafficvlan vlan-id vlan configuration no ip igmp snooping optimise-multicast-flood

OTV Edge Device (VDC)



Ingress Routing LocalizationPossible Solutions

Challenge

• Subnets are spread across locations

• Subnet information in the routing tables is not specific enough

• Routing doesn’t know if a server has moved between locations

• Traffic may be sent to the location where the application is not available

Options

• DNS Based

• Route Injection

• LISP – Locator/ID Separation Protocol

For more details on LISP and OTV Deployment see: BRKDCT-2131


OTV Support

• OTV has been introduced in IOS XE 3.5 (Nov 2011)

• To use OTV on ASR1000, you require:• Advance Enterprise Image or Advance IP Service + OTV feature license

• ASR1k <-> N7k Inter-Site Interoperability has been tested• No ASR1k <-> N7k Multihoming Support (Intra-Site Interoperability)

• OTV on ASR1000 Use Cases are:• Legacy Deployments – where DC may still be Catalyst based• New Small Data Center and/or Disaster Recovery Sites – where Main DC is equipped with Nexus 7000 • OTV with Layer-3 Encryption – where MACSec is no option for Inter-DC Encryption

ASR1000


OTV Support

• New Features for IOS-XE 3.9• OTV Adjacency Server (unicast)• OTV with LISP ESM• RPVST STP Support

• New Features for IOS-XE 3.10• Portchannel for join interface• VRF Aware• Subinterface for join interface• Layer 2 portchannel

ASR 1000


Principals of Interconnecting Networks at Layer-2

• Control-Plane• Learn and Distribute MAC information (no

Flood&Learn)

• Multi-Homing• Automated Multi-Homing for Resiliency

• Loop Prevention• Using redundant Path• Providing Loop protection

• Fault Containment• Separate Control-Plane information• Limit Flood (ARP caching)

• Transport Agnostic• Can leverage literally any Transport Technology

67

Core(Layer-3)

Classic Ethernet

vpc

V

V

Classic Ethernetvpc

VV

OTV/VPLS

Principals for Interconnecting NetworksDo Apply for Ethernet, FabricPath and VXLAN


End to End VXLAN

Layer-3Underlay

Layer-3Underlay

Core(Layer-3)

V

V

V

V

vpc

vpc

V V

• One common Control Plane– One failure can affect all sites– No site concept

• Manual Multihoming – BGP and/or vPC config

• Multicast– Multiple multicast groups required

• Reduced Scale– Every VTEP learns all MACs

• Flooding Across Sites– BUM Traffic is flooded

A Very Bad Idea

Switch# show nve peers Interface Peer-IP VNI Up Time ---------- ----------- ------ ---------- nve1 10.10.10.1 30000 03:18:06 nve1 10.10.10.3 30000 05:44:24 nve1 20.20.20.1 30000 02:17:03 nve1 20.20.20.2 30000 03:08:44 nve1 20.20.20.3 30000 02:58:21

Switch# show nve peers Interface Peer-IP VNI Up Time ---------- ----------- ------ ---------- nve1 10.10.10.1 30000 03:18:06 nve1 10.10.10.2 30000 08:06:22 nve1 10.10.10.3 30000 05:44:24 nve1 20.20.20.1 30000 02:17:03 nve1 20.20.20.3 30000 02:58:21


Layer-3Underlay

Layer-3Underlay


• Simplified Transport Requirement• Multicast dependent and independent Forwarding

of BUM* Traffic (no hairpin)

• Multicast Optimization• Offers optimized Multicast Forwarding

• Path Diversity• Flow based Entropy

• Multi-Site• Provides Site to Multi-Site connectivity

Inter-Pod Connectivity

69

Core(Layer-3)

V

V

V

V

vpc

VV

vpc

V

V

V V

OTV

VXLAN or VXLAN+EVPN

VXLAN or VXLAN+EVPN


Layer-3Underlay

Layer-3Underlay

Interconnecting VXLAN Networks (Layer-3)

• Interconnecting VXLAN/EVPN Pods with VXLAN/EVPN is possible• Control-Plane Domains (EVPN) can be

separated (iBGP/eBGP)

• With Layer-3 interconnect, Data-Plane Encapsulation is separated• Routing decision at DC-Edge results in

Decapsulation• Requires a Transit VNI between Sites

• No Layer-2 Interconnect!


70

Core(Layer-3)

V

V

V

V

vpc

VV

vpc

V

V

V V

VXLAN/EVPNVNI 99000

VXLAN or VXLAN/EVPN

VNI 31000

VXLAN or VXLAN/EVPN

VNI 30000

Not All Principles Satisfied“Good Enough” Solution

FYI



Control-Plane

Multi-Homing

LoopPrevention

FaultContainment

TransportAgnostic

MulticastOptimization

Path Diversity

Multi-Site

GoodFabricPath ✖ ✔1 ✔✔ ✖ ✖ ✖ ✔ ✖

VXLAN (Flood&Learn) ✖ ✔1 ✔2 ✖ ✔ ✔ ✔✔ ✖

BetterVXLAN-EVPN ✔✔ ✔1 ✔2 ✔✔ ✔✔ ✔ ✔✔ ✖

VPLS ✖ ✔1 ✔✔ ✖ ✖ ✖ ✔ ✔

Best OTV ✔✔ ✔✔ ✔✔ ✔✔ ✔✔ ✔✔ ✔✔ ✔✔


1) Only with Multi-Chassis Link Aggregation (MC-LAG / VPC)

2) Limited Overlay Loop Prevention


New Feature for OTV in NX-OS 6.2Nexus 7000 Hardware Support

F1 and F2e support for OTV internal Interface

• F1 and F2e linecards have the ability to be internal interfaces when M series linecard is used for OTV

Aggregation VDC(M-only, M1-F1 or F2/F2e) L2

L3

OTV VDC

Routed Uplinksto Core

Interfaces to Access(Classic-Ethernet or FabricPath)

OTVInternalInterface (CE)

OTVJoinInterface

M-Series interface

F/M-Series interface

F3 Support for OTV in 6.2(6)– Enable OTV on Nexus 7700 Series

– Utilize port-level VLAN Translation on F3

M1 M2 F3

M1

M2

F1

F2e

F3

Inte

rnal

Inte

rfac

e

Join-Interface


New Features for OTV

• Secondary IP command introduced• Configured within interface, not OTV interface

• Introduction of multiple IPs results in tunnel depolarization

Tunnel Depolarization & Secondary IP

OTV-a(config-if)# ip address 2.100.11.1/24 secondaryDisabling IP Redirects on port-channel11 :secondary address configured.OTV-a(config-if)# sh run int po11

!Command: show running-config interface port-channel11!Time: Wed Mar 27 23:05:21 2013

version 6.2(2)

interface port-channel11 no ip redirects ip address 2.100.11.100/24 ip address 2.100.11.1/24 secondary ip ospf network point-to-point ip router ospf 1 area 0.0.0.0 ip igmp version 3

OTV-a (config-if)# sh otv

OTV Overlay InformationSite Identifier 0000.0000.0011

Overlay interface Overlay1

VPN name : Overlay1 VPN state : UP Extended vlans : 25-50 72-227 (Total:182) Control group : 224.1.1.0 Data group range(s) : 232.1.0.0/24 Broadcast group : 224.1.1.0 Join interface(s) : Po11 (2.100.11.100) Secondary IP Addresses: : 2.100.11.1 Site vlan : 1 (up) AED-Capable : Yes1 Capability : Multicast-Reachable

OTV VDC

OTV


New Features for OTV

• When a different VLAN is used at multiple sites

• Usually for 3 or more sites

VLAN Translation: Translation through transit VLAN

DCWest

DCEast

OTV

OTV OTV

OTVOTV

VLAN 100

VLAN 400 VLAN 200

Release 6.2


New Features for OTVVLAN Translation: Translation through transit VLAN

OTV-a(config)# int overlay1OTV-a(config-if-overlay)# otv vlan mapping 100 to 400

OTV-a(config-if-overlay)# sh run int overlay1

!Command: show running-config interface Overlay1!Time: Fri Mar 29 19:01:04 2013

version 6.2(2)

interface Overlay1 otv isis hello-multiplier 9 otv join-interface port-channel11 otv control-group 224.1.1.0 otv data-group 232.1.0.0/24 otv extend-vlan 25-50, 72-497 otv vlan mapping 100 to 400 no shutdown

OTV-a(config-if-overlay)# sh otv vlan-mappingOriginal VLAN -> Translated VLAN-------------------------------- 100 -> 400

OTV-B(config)# int overlay1OTV-B(config-if-overlay)# otv vlan mapping 200 to 400OTV-B(config-if-overlay)# sh run int overlay1

!Command: show running-config interface Overlay1!Time: Fri Mar 29 19:02:29 2013

version 6.2(2)

interface Overlay1 otv isis hello-multiplier 9 otv join-interface port-channel21 otv control-group 224.1.1.0 otv data-group 232.1.0.0/24 otv extend-vlan 25-50, 72-497 otv vlan mapping 200 to 400 no shutdown

OTV-B(config-if-overlay)# sh otv vlan-mappingOriginal VLAN -> Translated VLAN-------------------------------- 200 -> 400

Release 6.2


OTV ConvergenceSmall and Large Scale Targets (Extreme Failures)

Large Scale Small Scale

NewRelease 6.2

<30sec

< 10sec

<10sec

<5sec

• Remember to place join-interface into a dynamic routing protocol (OSPF, EIGRP, etc)

• Configure BFD in site-vlan


Challenges in Traditional Layer 2 VPNsSolved by OTV

Flooding Behavior Pseudo-wire Maintenance Multi-Homing

- Unknown Unicast for MAC propagation- Unicast Flooding reaches all sites

- Full mesh of Pseudo-wire is complex- Head-End replication is a common problem

- Requires additional Protocols & extends STP- Malfunctions impacts multiple sites

✔ ✔ ✔Control-Plane Based

LearningDynamic Encapsulation Native Automated

Multi-Homing


Participate in the “My Favorite Speaker” Contest

• Promote your favorite speaker through Twitter and you could win $200 of Cisco Press products (@CiscoPress)

• Send a tweet and include • Your favorite speaker’s Twitter handle <Speaker—enter your Twitter handle here>• Two hashtags: #CLUS #MyFavoriteSpeaker

• You can submit an entry for more than one of your “favorite” speakers

• Don’t forget to follow @CiscoLive and @CiscoPress

• View the official rules at http://bit.ly/CLUSwin

Promote Your Favorite Speaker and You Could Be a Winner

http://bit.ly/CLUSwin


Complete Your Online Session Evaluation

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at CiscoLive.com/Online

81

• Give us your feedback to be entered into a Daily Survey Drawing. A daily winner will receive a $750 Amazon gift card.

• Complete your session surveys though the Cisco Live mobile app or your computer on Cisco Live Connect.


Continue Your Education• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Table Topics

• Meet the Engineer 1:1 meetings

• Related sessions


Internet of Things (IoT) Cisco Education OfferingsCourse Description Cisco Certification

NEW! CCNA Industrial An associate level instructor led training course designed to prepare you for the CCNA Industrial certification

CCNA® Industrial

Managing Industrial Networks with Cisco Networking Technologies (IMINS)

This curriculum addresses foundational skills needed to manage and administer networked industrial control systems. It provides plant administrators, control system engineers and traditional network engineers with an understanding of the networking technologies needed in today's connected plants and enterprises

Cisco Industrial Networking Specialist

Control Systems Fundamentals for Industrial Networking (ICINS)

For IT and Network Engineers, covers basic concepts in Industrial Control systems including an introduction to automation industry verticals, automation environment and an overview of industrial control networks

Networking Fundamentals for Industrial Control Systems (INICS)

For Industrial Engineers and Control System Technicians, covers basic IP and networking concepts, and introductory overview of Automation industry Protocols.

For more details, please visit: http://learningnetwork.cisco.comQuestions? Visit the Learning@Cisco Booth or contact [email protected]

http://learningnetwork.cisco.com/

mailto:[email protected]


Business Transformation Cisco Education OfferingsCourse Description Cisco Certification

For IT and Network Professionals:

Building Business Specialist Skills • Builds non-technical skills key to ensure business impact and influence. Topics include: business analysis, finance, technology adoption and effective communications.

• Bridges IT and business impacts of mature and emerging solutions including cloud plus Internet of Everything

Cisco Enterprise IT Business Specialist

For Technology Sellers:

Applying Cisco Specialized Business Value Analysis Skills

Builds skills to discover and address technology needs using a business-focused, consultative sales approach

Cisco Business Value Specialist

Executing Advanced Cisco Business Value Analysis and Design Techniques

Enables customer transformation through business architecture and solution selling expertise

Cisco Certified Business Value Practitioner

Performing Cisco Business-Focused Transformative Architecture Engagements

Provides skills and an approach to build a strategic roadmap of IT initiatives, aligned to business priorities

Cisco Transformative Architecture Specialist





Security Cisco Education OfferingsCourse Description Cisco Certification

Implementing Cisco IOS Network Security (IINS)

Implementing Cisco Edge Network Security Solutions (SENSS)

Implementing Cisco Threat Control Solutions (SITCS)

Implementing Cisco Secure Access Solutions (SISAS)

Implementing Cisco Secure Mobility Solutions (SIMOS)

Focuses on the design, implementation, and monitoring of a comprehensive security policy, using Cisco IOS security features

Configure Cisco perimeter edge security solutions utilizing Cisco Switches, Cisco Routers, and Cisco Adaptive Security Appliance (ASA) Firewalls

Deploy Cisco’s Next Generation Firewall (NGFW) as well as Web Security, Email Security and Cloud Web Security

Deploy Cisco’s Identity Services Engine and 802.1X secure network access

Protect data traversing a public or shared infrastructure such as the Internet by implementing and maintaining Cisco VPN solutions

CCNA® Security

Securing Cisco Networks with Threat Detection and Analysis (SCYBER)

Designed for professional security analysts, the course covers essential areas of competency including event monitoring, security event/alarm/traffic analysis, and incident response

Cisco Cybersecurity Specialist

Network Security Product and Solutions Training For official product training on Cisco’s latest security products, including Adaptive Security Appliances, NGIPS, Advanced Malware Protection, Identity Services Engine, Email and Web Security Appliances see www.cisco.com/go/securitytraining


http://www.cisco.com/go/securitytraining




R&S Related Cisco Education OfferingsCourse Description Cisco Certification

CCIE R&S Advanced Workshops (CIERS-1 & CIERS-2) plus Self Assessments, Workbooks & Labs

Expert level trainings including: instructor led workshops, self assessments, practice labs and CCIE Lab Builder to prepare candidates for the CCIE R&S practical exam.

CCIE® Routing & Switching

• Implementing Cisco IP Routing v2.0• Implementing Cisco IP Switched

Networks V2.0• Troubleshooting and Maintaining

Cisco IP Networks v2.0

Professional level instructor led trainings to prepare candidates for the CCNP R&S exams (ROUTE, SWITCH and TSHOOT). Also available in self study eLearning formats with Cisco Learning Labs.

CCNP® Routing & Switching

Interconnecting Cisco Networking Devices: Part 2 (or combined)

Configure, implement and troubleshoot local and wide-area IPv4 and IPv6 networks. Also available in self study eLearning format with Cisco Learning Lab.

CCNA® Routing & Switching

Interconnecting Cisco Networking Devices: Part 1

Installation, configuration, and basic support of a branch network. Also available in self study eLearning format with Cisco Learning Lab.

CCENT® Routing & Switching





Wireless Cisco Education OfferingsCourse Description Cisco Certification

• Conducting Cisco Unified Wireless Site Survey

• Implementing Cisco Unified Wireless Voice Networks

• Implementing Cisco Unified Wireless Mobility Services

• Implementing Cisco Unified Wireless Security Services

Professional level instructor led trainings to prepare candidates to conduct site surveys, implement, configure and support APs and controllers in converged Enterprise networks. Focused on 802.11 and related technologies to deploy voice networks, mobility services, and wireless security.

CCNP® Wireless

Implementing Cisco Unified Wireless Network Essential

Prepares candidates to design, install, configure, monitor and conduct basic troubleshooting tasks of a Cisco WLAN in Enterprise installations.

CCNA® Wireless





Design Cisco Education OfferingsCourse Description Cisco Certification

Designing Cisco Network Service Architectures (ARCH)

Provides learner with the ability to perform conceptual, intermediate, and detailed design of a network infrastructure that supports desired capacity, performance, availability required for converged Enterprise network services and applications.

CCDP® (Design Professional)

Designing for Cisco Internetwork Solutions (DESGN)

Instructor led training focused on fundamental design methodologies used to determine requirements for network performance, security, voice, and wireless solutions. Prepares candidates for the CCDA certification exam.

CCDA® (Design Associate)





Service Provider Cisco Education OfferingsCourse Description Cisco Certification

Deploying Cisco Service Provider Network Routing (SPROUTE) & Advanced (SPADVROUTE) Implementing Cisco Service Provider Next-Generation Core Network Services (SPCORE) Edge Network Services (SPEDGE)

SPROUTE covers the implementation of routing protocols (OSPF, IS-IS, BGP), route manipulations, and HA routing features; SPADVROUTE covers advanced routing topics in BGP, multicast services including PIM-SM, and IPv6;

SPCORE covers network services, including MPLS-LDP, MPLS traffic engineering, QoS mechanisms, and transport technologies;

SPEDGE covers network services, including MPLS Layer 3 VPNs, Layer 2 VPNs, and Carrier Ethernet services; all within SP IP NGN environments.

CCNP Service Provider®

Building Cisco Service Provider Next-Generation Networks, Part 1&2 (SPNGN1), (SPNGN2)

The two courses introduce networking technologies and solutions, including OSI and TCP/IP models, IPv4/v6, switching, routing, transport types, security, network management, and Cisco OS (IOS and IOS XR).

CCNA Service Provider®

Implementing Cisco Service Provider Mobility UMTS Networks (SPUMTS);Implementing Cisco Service Provider Mobility CDMA Networks (SPCDMA);Implementing Cisco Service Provider Mobility LTE Networks (SPLTE)

The three courses (SPUMTS, SPCDMA, SPLTE) cover knowledge and skills required to understand products, technologies, and architectures that are found in Universal Mobile Telecommunications Systems (UMTS) and Code Division Multiple Access (CDMA) packet core networks, plus their migration to Long-Term Evolution (LTE) Evolved Packet Systems (EPS), including Evolved Packet Core (EPC) and Radio Access Networks (RANs).

Cisco Service Provider Mobility CDMA to LTE Specialist;Cisco Service Provider Mobility UMTS to LTE Specialist

Implementing and Maintaining Cisco Technologies Using IOS XR (IMTXR)

Service Provider/Enterprise engineers to implement, verification-test, and optimize core/edge technologies in a Cisco IOS XR environment.

Cisco IOS XR Specialist





Collaboration Cisco Education OfferingsCourse Description Cisco Certification

CCIE Collaboration Advanced Workshop (CIEC) Gain expert-level skills to integrate, configure, and troubleshoot complex collaboration networks

CCIE® Collaboration

Implementing Cisco Collaboration Applications (CAPPS)

Understand how to implement the full suite of Cisco collaboration applications including Jabber, Cisco Unified IM and Presence, and Cisco Unity Connection.

CCNP® Collaboration

Implementing Cisco IP Telephony and Video Part 1 (CIPTV1)

Implementing Cisco IP Telephony and Video Part 2 (CIPTV2)

Troubleshooting Cisco IP Telephony and Video (CTCOLLAB)

Learn how to implement Cisco Unified Communications Manager, CUBE, and audio and videoconferences in a single-site voice and video network.

Obtain the skills to implement Cisco Unified Communications Manager in a modern, multisite collaboration environment.

Troubleshoot complex integrated voice and video infrastructures

CCNP® Collaboration

Implementing Cisco Collaboration Devices (CICD)

Implementing Cisco Video Network Devices (CIVND)

Acquire a basic understanding of collaboration technologies like Cisco Call Manager and Cisco Unified Communications Manager.

Learn how to evaluate requirements for video deployments, and implement Cisco Collaboration endpoints in converged Cisco infrastructures.

CCNA® Collaboration





Data Center / Virtualization Cisco Education OfferingsCourse Description Cisco Certification

Cisco Data Center CCIE Unified Fabric Workshop (DCXUF); Cisco Data Center CCIE Unified Computing Workshop (DCXUC)

Prepare for your CCIE Data Center practical exam with hands on lab exercises running on a dedicated comprehensive topology

CCIE® Data Center

Implementing Cisco Data Center Unified Fabric (DCUFI);Implementing Cisco Data Center Unified Computing (DCUCI)

Obtain the skills to deploy complex virtualized Data Center Fabric and Computing environments with Nexus and Cisco UCS.

CCNP® Data Center

Introducing Cisco Data Center Networking (DCICN); Introducing Cisco Data Center Technologies (DCICT)

Learn basic data center technologies and how to build a data center infrastructure.

CCNA® Data Center

Product Training Portfolio: DCAC9k, DCINX9k, DCMDS, DCUCS, DCNX1K, DCNX5K, DCNX7K

Get a deep understanding of the Cisco data center product line including the Cisco Nexus9K in ACI and NexusOS modes





Network Programmability Cisco Education OfferingsCourse Description Cisco Certification

Integrating Business Applications with Network Programmability (NIPBA);Integrating Business Applications with Network Programmability for Cisco ACI (NPIBAACI)

Learn networking concepts, and how to deploy and troubleshoot programmable network architectures with these self-paced courses.

Cisco Business Application Engineer Specialist Certification

Developing with Cisco Network Programmability (NPDEV); Developing with Cisco Network Programmability for Cisco ACI (NPDEVACI)

Learn how to build applications for network environments and effectively bridge the gap between IT professionals and software developers.

Cisco Network Programmability Developer Specialist Certification

Designing with Cisco Network Programmability (NPDES); Designing with Cisco Network Programmability for Cisco ACI (NPDESACI)

Learn how to expand your skill set from traditional IT infrastructure to application integration through programmability.

Cisco Network Programmability Design Specialist Certification

Implementing Cisco Network Programmability (NPENG); Implementing Cisco Network Programmability for Cisco ACI (NPENGACI)

Learn how to implement and troubleshoot open IT infrastructure technologies.

Cisco Network Programmability Engineer Specialist Certification





Cloud Cisco Education OfferingsCourse Description Cisco Certification

Designing the FlexPod Solution (FPDESIGN); Implementing and Administering the FlexPod Solution (FPIMPADM)

Learn how to design, implement and administer FlexPod solutions FlexPod Design Specialist; FlexPod Implementation & Administration Specialist

UCS Director (UCSDF) Learn how to manage physical and virtual infrastructure using orchestration and automation functions of UCS Director.

Cisco Prime Service Catalog Learn how to deliver data center, workplace, and application services in an on-demand, automated, and repeatable method.

Cisco Intercloud Fabric Learn how to implement end-to-end hybrid clouds with Intercloud Fabric for Business and Intercloud Fabric for Providers.

Cisco Intelligent Automation for Cloud Learn how to implement and manage cloud deployments with Cisco Intelligent Automation for Cloud




decca design brand review has checked your presentation and noted the following items: in the...

Documents

cisco andor

cisco publicbrkdct

cisco systems

correct widescreen cisco

headers andor footers

speaker notes

heavy graphics

otv controlplane