1. NJEDge.Net DRG/VRG Video QoS NEXT GENERATION NETWORK Walter King[email_address] Account System Engineer

2. Agenda

QoS Technologies Review

NJEDGE Model

3. QoS Technologies Review

QoS overview

Classification Tools

Scheduling Tools

Policing and Shaping Tools

CAC - Call Admission control

4. Different Types of Traffic Have Different Needs

Real-time applications especially sensitive

• Interactive voice

• Videoconferencing

Causes of degraded performance

• Congestion

• • Convergence

• • Peak traffic load

• Link speed & capacity differences

Set application service level objectives

Sensitivity N N N Bulk Data Email File Transfer N N Y Transactional/ Interactive Y Y N Streaming Video Y Y Y Interactive Voice and Video Packet Loss Jitter Delay Application Examples 5. Video QoS Requirements Provisioning for Interactive Video

Latency 150 ms

Jitter 30 ms

Loss 1%

Minimum priority bandwidth guarantee required is

• Video-stream + 1020%

• e.g., a 384 kbps stream could require up to 460 kbps of priority bandwidth

CAC must be enabled

Video

Bursty

Drop sensitive

Delay sensitive

UDP priority

One-Way Requirements 6. Video QoS Requirements Video Conferencing Traffic Example (384 kbps)

I frame is a full sample of the video

P and B frames use quantization viamotion vectors and prediction algorithms

P and B Frames 128256 Bytes I Frame 10241518Bytes I Frame 10241518 Bytes 15pps 30pps 450Kbps 32Kbps 7. Video QoS Requirements Video Conferencing Traffic Packet Size Breakdown 65128 Bytes 1% 129256 Bytes 34% 5131024 Bytes 20% 10251500 Bytes 37% 257512 Bytes8% 8. Problems in non-CoS Network Scenario

• Central to Remote Site Speed Mismatch

• Remote to Central Site Over-subscription

• Predictable (contractual) sharing of bandwidth

Remote Sites 1000M Central Site METRO-E Frame Relay, ATM 10M 20M 30M 50M 100M Result: Buffering = Delay or Dropped Packets 9. Quality of Service Operations How Do QoS Tools Work? Classificationand Marking Queuing and (Selective) Dropping Post-Queuing Operations 10. QoS Technologies Review

QoS overview

Classification Tools

Scheduling Tools

Policing and Shaping Tools

CAC - Call Admission control

11. Classification Tools Ethernet 802.1Q Class of Service

802.1p user priority field also called Class of Service (CoS)

Different types of traffic are assigned different CoS values

CoS 6 and 7 are reserved for network use

TAG 4 Bytes Data FCS PT SA DA SFD Pream. Type Ethernet Frame Three Bits Used for CoS (802.1p User Priority) 802.1Q/p Header PRI VLAN ID CFI 1 2 3 4 5 6 7 0 Best Effort Data Bulk Data Critical Data Call Signaling Video Voice Routing Reserved CoS Application 12. Classification Tools IP Precedence and DiffServ Code Points

IPv4 : three most significant bits of ToS byte are called IP Precedence (IPP)other bits unused

DiffServ : six most significant bits of ToS byte are called DiffServ Code Point (DSCP)remaining two bits used for flow control

DSCP is backward-compatible with IP precedence

ID Offset TTL Proto FCS IP SA IP DA Data Len VersionLength ToS Byte IPv4 Packet 7 6 5 4 3 2 1 0 DiffServ Code Point (DSCP) IP ECN IP Precedence Unused Standard IPv4 DiffServ Extensions 13. Classification Tools MPLS EXP Bits

Packet class and drop precedence inferred from EXP (three-bit) field

RFC3270 does not recommend specific EXP values for DiffServ PHB (EF/AF/DF)

Used for frame-based MPLS

Payload Frame Encapsulation Label Header Label Header Label Stack Layer-2 Header 0123 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 LabelEXP STTL MPLS Shim Header EXP 3 2 1 0 MPLS EXP S 14. Classification Tools DSCP Per-Hop Behaviors

IETF RFCs have defined special keywords, called Per-Hop Behaviors, for specific DSCP markings

EF: Expedited Forwarding (RFC3246)

• (DSCP 46)

CSx: Class Selector (RFC2474)

• Where x corresponds to the IP Precedence value (1 7)

• (DSCP 8, 16, 24, 32, 40, 48, 56)

AFxy: Assured Forwarding (RFC2597)

• Where x corresponds to the IP Precedence value(only 14 are used for AF Classes)

• • And y corresponds to the Drop Preference value (either 1 or 2 or 3)

• • • With the higher values denoting higher likelihood of dropping

• (DSCP 10/12/14, 18/20/22, 26/28/30, 34/36/38)

BE: Best Effort or Default Marking Value (RFC2474)

• (DSCP 0)

15. Classification Tools Network-Based Application Recognition

Identifies over 90 applications and protocols TCP and UDP port numbers

• Statically assigned

• Dynamically assigned during connection establishment

Non-TCP and non-UDP IP protocols

Data packet inspection for matching values

ToS Source IP Addr Dest IP Addr Src Port Sub-Port/Deep Inspection Dst Port Protocol TCP/UDP Packet Data Area IP Packet Stateful and Dynamic Inspection 16. Cisco Service Control Engine Traffic Shaper (All QoS Tools) State of the Art Performanceand Carrier-grade Reliabilty

4-GB Ethernet interfaces

System bypass mechanism

Deep Packet Inspection for up to 2 million concurrent unidirectional application flows

Up to 4Gbps throughput

Up to 80,000 concurrent subscribers

Support for redundant topologies

FRU AC or DC power supplies/fans

Redundant management interfaces

SCE 2000 Series

2-GB Ethernet interfaces

System bypass mechanism

Deep Packet Inspection for up to 2 million concurrent unidirectional application flows

Up to 2Gbps throughput

Up to 40,000 concurrent subscribers

FRU AC or DC power supplies/fans

Redundant management interfaces

SCE 1000 Series 17. TrafficReportsBi-DirectionalBandwidth per Video Service Global ConcurrentSession per VoIP/Video Service Global Hourly Call Minutes per VoIP/Video Service Hourly SIP/H323 Top Talkers Top SIP Domains by Volume Understand Usage Trends of VoIP Service and Other Offerings Voice ExperienceReports (Part of 3.0.X) 18. Voice ReportsExample Top SIP Domains by Volume Voice ExperienceReports (Part of 3.0.X) Bi-DirectionalBandwidth per VoIP Service Global ConcurrentSession per VoIP Service Global Hourly Call Minutes per VoIP Service Hourly SIP Top Talkers ExampleCall Minutes Usage My Broadband Customers Are Using Skype for 500min of Call Time per Hour 19. QoS Technologies Review

QoS overview

Classification Tools

Scheduling Tools

Policing and Shaping Tools

CAC - Call Admission control

20. Scheduling Tools Queuing Algorithms

Congestion can occur at any point in the network where there are speed mismatches

Routers use Cisco IOS-based software queuing

• Low-Latency Queuing (LLQ) used for highest-priority traffic (voice/video)

• Class-Based Weighted-Fair Queuing (CBWFQ) used for guaranteeing bandwidth to data applications

Cisco Catalyst switches use hardware queuing

Voice Video Data 3 3 2 2 1 1 21. TCP Global Synchronization:The Need for Congestion Avoidance

All TCP flows synchronize in waves

Synchronization wastes available bandwidth

Time BandwidthUtilization 100% Tail Drop Three Traffic FlowsStart at Different Times Another Traffic Flow Starts at This Point 22. Scheduling Tools Congestion Avoidance Algorithms

Queueing algorithms manage thefrontof the queue

• Which packets gettransmitted first

Congestion avoidance algorithms manage thetailof the queue

• Which packets getdropped firstwhen queuing buffers fill

Weighted Random Early Detection (WRED)

• WRED can operate in a DiffServ-compliant mode

• Drops packets according to their DSCP markings

• WRED works best with TCP-based applications, like data

TAIL DROP Queue 3 1 2 3 0 2 0 2 1 2 0 1 3 3 3 WRED 0 1 0 1 0 3 23. Scheduling Tools DSCP-Based WRED Operation Average Queue Size 100% 0 Drop Probability Begin Dropping AF13 Drop All AF11 Max Queue Length (Tail Drop) Drop All AF12 Drop All AF13 Begin Dropping AF12 Begin Dropping AF11 50% AF = (RFC 2597) Assured Forwarding 24. Congestion Avoidance

IP header Type of Service (ToS) byte

Explicit Congestion Notification (ECN) bits

ECT Bit: ECN-Capable Transport CE Bit: Congestion Experienced 7 6 5 4 3 2 1 0 ID Offset TTL Proto FCS IP SA IP DA Data Len Version Length ToS Byte DiffServ Code Point (DSCP) CE IPv4 Packet ECT RFC3168: IP Explicit Congestion Notification 25. QoS Technologies Review

QoS overview

Classification Tools

Scheduling Tools

Policing and Shaping Tools

CAC - Call Admission control

26. Policing Tools RFC 2697 Single Rate Three Color Policer Action Action Overflow BTp B>Tc Exceed Violate PBS CBS PIR Yes Yes No No Conform Action Packet of Size B CIR 28. Traffic Shaping

Policers typically drop traffic

Shapers typically delay excess traffic, smoothing bursts and preventing unnecessary drops

Very common on Non-Broadcast Multiple-Access (NBMA) network topologies such as Frame Relay and ATM

Line Rate Shaped Rate Traffic Shaping Limits the Transmit Rate to a Value Lower Than Line Rate With Traffic Shaping Without Traffic Shaping 29. QoS Technologies Review

QoS overview

Classification Tools

Scheduling Tools

Policing and Shaping Tools

CAC - Call Admission Control

30. IntroductionWhy Is Call Admission Control (CAC) Needed? PSTN Circuit-SwitchedNetworks Packet-SwitchedNetworks PBX Physical Trunks STOP IP WAN Links LLQ Is Provisioned for Two Calls (Equivalent to Two Virtual Trunks) Third Call Rejected No Physical Limitation on IP Links; Third Call Can Go Through, but Voice Quality of All Calls Degrades Call Admission Control Blocks Third Call IP WAN Link IP WAN Router/ Gateway Call Manager 31. Gatekeeper ZonesBasics

Cisco IOS feature, based on H.323 RAS protocol

Can be used between Cisco CallManager clusters, H.323 gateways and H.323 endpoints

Provides CAC using concept ofzonesand associated bandwidth counters

Static configuration approach limits supported topologies (mainly hub-and-spoke)

gatekeeper zone local A abc.com 10.10.10.10 zone local B abc.com zone remote C abc.com 10.10.20.20 zone remote D abc.com bandwidth interzone zone A 384 bandwidth interzone zone B 256 bandwidth remote 512 GK 32. Gatekeeper Zones Zone Concept GK 1s Local Zones GK 1 GK 2s Local Zones GK 2 Zone B Zone A Zone D Zone C . Zones A Logical Representation of a Physical Location Gatekeeper A Physical Device Gatekeeper A Physical Device GK GK 33. Gatekeeper Zones Bandwidth Configuration Zone B Zone A Zone D Zone C GK 1s Local Zones GK 1 GK 2s Local Zones GK 2 bandwidthinterzonezonexyzmax-bw This Is the Total Bandwidth Allowed in/out ofthe Zone bandwidth total zone xyz max-bw The Total Bandwidth Allowed Within a Zone as Well as in/out of the Zone bandwidthsessionzone xyz max-bw This Is the Maximum Bandwidth Allowed per Session GK GK Bandwidth Remote bandwidthremote max-bw The Total Bandwidth Allowed in/outof the Physical GK 34. Gatekeeper Zones Bandwidth Calculations GK2 Remote = 48K In Use = 0 Zone C InterZone = 32K In Use = 0 Total = 32K In Use = 0 Zone D InterZone = 32K In Use = 0 Total = 32K In Use = 0 Session = 16K GK1 Remote = 32K In Use = 0 Zone A InterZone = 32K In Use = 0 Total = 48K In Use = 0 Zone B InterZone = 48K In Use = 0 Total = 48K In Use = 0 Session = 16K Zone B Zone A Zone D Zone C GK 1s Local Zones GK 2s Local Zones Blue TextRepresentsConfiguredBandwidth Assume Requested Bandwidth for Each Call Equals 16K GK 1 GK 2 X 16 16 32 16 16 GK GK 16 32 48 16 0 0 16 16 32 32 48 32 32 32 16 16 35. Gatekeeper Zones Bandwidth Provisioning Provision LLQ PQ with These Values For More Details, Refer to the QoS SRND and IP Telephony SRND at:www.cisco.com/go/srnd 420 Kbps (384K + est. L2/L3 Headers) 24 Kbps (8K + Header) 80 Kbps (64K + Header) L3 Bandwidth 25.6 Kbps (24K + L2 Hdr) 16 Kbps (8K x 2) G.729 Audio 768 Kbps (384K x 2) 384K Video 81.6 Kbps (80K + L2 Hdr) 128 Kbps (64K x 2) G.711 Audio L2 Bandwidth (Frame Relay) Gatekeeper 36. Agenda

QoS Technologies Review

NJEDGE Model

37. 38. SES EVC VLAN Internet Purchased Rate Policed Rate Inherited SubRates Based on Usage Traffic Classes Internet2 NJEDge Video Extranet Other SES EVC VLAN Internet Purchased ClassBest Effort Policed Rate Purchased Rate Policed Rate Inherited SubRates Based on Usage Traffic Classes Internet2 NJEDge Video Purchased ClassPriority Data Policed Rate Extranet Other Class Marking 2 Class Marking 0 EVC Full Policed Rate EVC Full Policed Rate Purchased ClassBest Effort Policed Rate Purchased ClassPriority Data Policed Rate Class Marking 0 Class Marking 2 SES EVC RATES and CLASSES TODAY 39. Classifying Traffic from Internal Networkip access-list extendednjedge-allother-traffic permit ip any any ip access-list extendedmc-control-acl permit ip any 224.0.0.0 15.255.255.255 ip access-list extendednjedge-VoIP permit udp any any range 16384 32768 ip access-list extendednjedge-h323-VC permit tcp any any eq 1720 permit udp any any eq 1719 permit tcp any any eq 1719 permit udp any any eq 1718 permit ip host 155.246.1.10 any permit tcp any any eq 1718 class-map match-anyin-EF match ip dscp efmatch ip precedence 5match access-group namenjedge-VoIP class-map match-allin-CS4 match access-group namemc-control-acl class-map match-anyin-af41 match ip precedence 4match access-group namenjedge-h323-VC class-map match-allin-best-effort match access-group namenjedge-allother-traffic Applying Classificationfrom Internal Network policy-mapin-SETDSCP classin-EF set ip dscp ef classin-af41 set ip dscp af41 classin-CS4 set ip dscp cs4 classin-best-effort set ip dscp default ! interface GigabitEthernet 0/3 ip address 155.246.1.1 255.255.255.0 ip pim sparse-mode load-interval 30 duplex auto speed auto media-type rj45 no negotiation auto service-policyinput in-SETDSCP

Interface GigabitEthernet 0/3

Interface GigabitEthernet0/0

Packets

1 2 Video1 ToS = 4802.1p=0 HTTP ToS = 0802.1p=0 Video2 ToS = 0802.1p=0 40. Classifying Traffic out to SES class-map match-allout-ROUTING match ip dscp cs6class-map match-allout-VOICE match ip dscp efclass-map match-anyout-INTERACTIVE-VIDEO match ip dscp af41af42af43matchprecedence 4class-map match-allout-STREAMING-VIDEO match ip dscp cs4class-map match-anyout-DEFAULT-BEST-EFFORT match ip dscp defaultpolicy-mapSCHOOL-EDGE-TWO-CLASS-SES classout-ROUTING bandwidth percent 1 setcos 2 classout-VOICE priority percent 4 setcos 2 classout-INTERACTIVE-VIDEO priority percent 12 set ip dscp cs4 setcos 2 classout-STREAMING-VIDEO setcos 0 classout-DEFAULT-BEST-EFFORT bandwidth percent 83 random-detect setcos 0 Applying Classificationon to SES Interfacepolicy-mapSHAPE-PARENT class class-default shape average percent 4 service-policySCHOOL-EDGE-TWO-CLASS-SES Interface GigabitEthernet0/2 no ip address load-interval 30 duplex auto speed auto media-type rj45 no negotiation auto ! interface GigabitEthernet 0/2.93 description to CORE (I1) NJEDGEI1 VRF encapsulation dot1Q93 ip address 130.156.250.94 255.255.255.252 ip pim sparse-mode no snmp trap link-status service-policy outputSHAPE-PARENT

Interface GigabitEthernet 0/3

Interface GigabitEthernet 0/2.93

Packets

3 4 Video1 DSCP=af41 802.1p=2 HTTP DSCP = 0 802.1p=0 Video2 DSCP = af41 802.1p=2 41. 2006 Cisco Systems, Inc. All rights reserved. 42. DESIGN Phase I NJEDgeINSTITUTIONEDGE 43. NJEDge IIApplications and Network ServicesInternet2 Internet Video Conferencing National Lambda Rail National Research Foundation Apps Weather Modelling GRID Clustering GRID HPC Disaster Recovery Storage Video on Demand/Streaming Video DVI HDTV /Very High Bandwidth VideoMulticast/Streaming Video Community Medical Computing VoIP IP Telephony VoIP Peering 1Mbps - 10Gbps and 40Gbps Access/Transport Ability Evolutional Growth Tiered Classified Site Models/Modularity Full Manageability/A-Z Provisioning Ability to bring on any service Rapid Enablement Shared Secure Access Any-to-Any AccessSeparation Segmentation Virtualization MPLS SecurityScaling IPv6 QoS Redundancy/Resiliency/Multi-paths Non-Stop Forwarding Applications Network Services 44. NJEDge IIApplications and Network Services Next GenImpact

Segmentation Differentiation

How

PVC

VLAN

MPLS

QoS

ATM vs SES vs Fiber: 1.544Mbps -1GE - 10GE: QoS:

Implementation

How

Classification

Shaping

Policing

Sharing

BGP or Not Default Routing General Routing Full Routes- Specific routingBGP: T1 1.5Mbps 10Mbps,20Mbps,50Mbps OC-3,100Mbps,200Mbps 1GE10 GE Dark Fiber, GE, WDM 45. NJEDge IIApplications and Network Services Next GenImpact Institutional Routing Separation of I1 vs I2 vs DR vs Intra-campus bond traffic MPLS at the Edge: I2 Multicast Streams VPNIPv4 vs IPv6: PIX6.3 vs 7.0 FWSM 2.3 vs 3.1 Traffic Control with RPs and QoS RPs Inside and Out Multicast: Regulatory : CLEA SOX HIPPA High Speed Synchronous Replication Moderate Asynchronous Replication Jumbo Frames Encryption Storage over IP : 46. NJEDgeConnectivity School Site CE Change Receiver for 10.3.245.238 Intranet/Internet 2 ATM PVCInternet ATM PVCSchoolX Internet ATM PVCIntranet /Internet2 ATM PVCVerizonMPLS CORE Commodity Internet Internet2 Receiver for 10.3.245.238 Intranet/Internet 2 VRF under single PVCInternetVRF under singlePVCInternetVRFIntranet /Internet2 VRFSchoolX ATMManaged Service todayATMManaged ServiceTomorrowVerizon ATM CORE 165 Halsey St.Carrier Hotel Commodity Internet MAGPIInternet 2 OR CE PE PE PE CE 10G 32Lambda GK GK 47. NJEDge IIConnectivity School Site CE Change Receiver for 10.3.245.238 Intranet/Internet 2 VRF under single PVCInternetVRF under singlePVCInternet VLANVRFIntranet /Internet2 VLAN VRFSchoolX GEManaged Service or Dark Fiber Tomorrow165 Halsey St.Carrier Hotel Commodity Internet MAGPIInternet 2 OR 100Mbps/1000Mbps Rate3845NS,7200 NPE-G1/2 or 7301/4 Router 100Mbps/1000/10000Mbps Rate3400 3750M 3750 6500/Sup32 1GE/10GEAccess MethodDirect Fiber 100Mbps and Multiple 100Mbps Rates10G 32Lambda GK GK CE CE CE CWDM and/or DWDM CE SES or Direct Fiber-Ethernet 48. NJEDge II ConnectivityExampleInternet and DMZ DesignDe-aggregationSchool DMZ Design IPS GUARD XT DDOS SSL /IPSEC VPN Public Servers Application Servers Database Servers Institution/Internet Edge Router Firewall IPS Global Loadbalancer Server LoadBalancer SSL Offload Content Engine WAAF Shown are de-aggregated functions of combination appliance as wellappliance functions various switch and firewall functions are virtual CS-MARS SCE Service Control Engine NJEDgeNet CoreGK 49. 50. 51. 52. 53. 54. 55. 56.