paris: proactive routing in scalable data centers
DESCRIPTION
PARIS: ProActive Routing In Scalable Data Centers. Dushyant Arora , Theophilus Benson, Jennifer Rexford Princeton University. Data Center Network Goals. Scalability. Data Center Network Goals. Scalability Virtual machine migration. Data Center Network Goals. Scalability - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/1.jpg)
PARIS: ProActive Routing In Scalable Data Centers
Dushyant Arora, Theophilus Benson, Jennifer Rexford
Princeton University
![Page 2: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/2.jpg)
Data Center Network Goals
• Scalability
Dushyant Arora PARIS 2
![Page 3: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/3.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration
Dushyant Arora PARIS 3
![Page 4: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/4.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing
Dushyant Arora PARIS 4
![Page 5: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/5.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing • Easy manageability
Dushyant Arora PARIS 5
![Page 6: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/6.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing • Easy manageability • Low cost
Dushyant Arora PARIS 6
![Page 7: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/7.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing • Easy manageability• Low cost• Multi-tenancy
Dushyant Arora PARIS 7
![Page 8: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/8.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing • Easy manageability• Low cost• Multi-tenancy• Middlebox policies
Dushyant Arora PARIS 8
![Page 9: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/9.jpg)
Data Center Network Goals
• Scalability• Virtual machine migration• Multipathing • Easy manageability• Low cost• Multi-tenancy• Middlebox policies
Dushyant Arora PARIS 9
![Page 10: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/10.jpg)
Let’s try Ethernet
Dushyant Arora PARIS 10
![Page 11: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/11.jpg)
Let’s try Ethernet
Dushyant Arora PARIS 11
SCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST
ETHERNET
A
B
![Page 12: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/12.jpg)
Mix some IP into it
Dushyant Arora PARIS 12
SCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST
ETHERNET
![Page 13: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/13.jpg)
Mix some IP into itCORE
AGGREGATION
EDGE
POD POD
10.16.0/24 10.16.1/24 10.16.2/24 10.16.3/24
10.16.0/22
10.16.4/24 10.16.5/24 10.16.6/24 10.16.7/24
10.16.0/22 10.16.1/22 10.16.1/22
Virtual Switch
10.16.0.1 10.16.0.5 10.16.0.9
SERVER
Virtual Switch
10.16.6.2 10.16.6.4 10.16.6.7
SERVER13
![Page 14: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/14.jpg)
Mix some IP into it
Dushyant Arora PARIS 14
SCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST
ETHERNET ETHERNET+IP ~
![Page 15: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/15.jpg)
Thought Bubble
• What if we treat IP as flat address?
Dushyant Arora PARIS 15
![Page 16: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/16.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it
Dushyant Arora PARIS 16
Thought Bubble
![Page 17: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/17.jpg)
CORE
AGGREGATION
EDGE
Virtual SwitchVirtual Switch
10.0.0.1 10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
POD POD
17
Thought Bubble
![Page 18: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/18.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer
Dushyant Arora PARIS 18
Thought Bubble
![Page 19: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/19.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer
Dushyant Arora PARIS 19
Thought BubbleSo, Aggregate!
![Page 20: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/20.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer• Virtual prefixes (VP)
– Divide host address space eg. /14 into 4 /16 prefixes
Dushyant Arora PARIS 20
Thought Bubble
![Page 21: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/21.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer• Virtual prefixes (VP)• Appointed Prefix Switch (APS)
– Each VP has an APS in the core layer– APS stores forwarding information for all IP addresses within
its VP
Dushyant Arora PARIS 21
Thought Bubble
![Page 22: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/22.jpg)
Virtual Prefix & Appointed Prefix Switch
CORE
AGGREGATION
EDGE
Virtual SwitchVirtual Switch
10.0.0.1 10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
10.0.0.0/16 10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
POD POD
22
![Page 23: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/23.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer• Virtual prefixes (VP)• Appointed Prefix Switch (APS)
Dushyant Arora PARIS 23
Thought Bubble
![Page 24: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/24.jpg)
• What if we treat IP as flat address? – Have each switch store forwarding information for
all hosts beneath it– Scales within a pod but not at the core layer• Virtual prefixes (VP)• Appointed Prefix Switch (APS)
– Proactive installation of forwarding state
Dushyant Arora PARIS 24
Thought Bubble
![Page 25: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/25.jpg)
10.0.0.0/16
No-Stretch
Virtual Switch
CORE
AGGREGATION
EDGE
10.0.0.1
1 2
3
14
5 86 7
2 3DIP: 10.0.0.1 3DIP: 10.0.0.2 3DIP: 10.1.0.2 3…Low priorityIP {1,2}
DIP: 10.0.0.1 5DIP: 10.0.0.2 5DIP: 10.1.0.2 5DIP: 10.2.0.4 7DIP: 10.3.0.2 7DIP: 10.1.0.5 7….Low priorityDIP: 10.0.0.0/16 1DIP: 10.1.0.0/16 2DIP: 10.2.0.0/16 3DIP: 10.3.0.0/16 4
Virtual Switch
10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
1 2
3
DIP: 10.3.0.2 2DIP: 10.3.0.9 4….….
12 3 4
1 4
5 8
2 3
6 7
Src IP: 10.0.0.1, Dst IP: 10.3.0.9
DIP: 10.0.0.4 3DIP: 10.2.0.7 3DIP: 10.3.0.9 3Low priorityIP {1,2}
DIP: 10.0.0.4 7DIP: 10.2.0.7 7DIP: 10.3.0.9 7……
Low priorityDIP: 10.0.0.0/16 1DIP: 10.1.0.0/16 2DIP: 10.2.0.0/16 3DIP: 10.3.0.0/16 4
25
![Page 26: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/26.jpg)
No-Stretch
Dushyant Arora PARIS 26
SCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST
ETHERNET ETHERNET+IP NO-STRETCH ~
![Page 27: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/27.jpg)
10.0.0.0/16
We want Multipathing!
CORE
AGGREGATION
EDGE
10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
27
![Page 28: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/28.jpg)
AGGREGATION
EDGE
CORE10.0.0.0/16
10.1.0.0/16
10.2.0.0/16
10.3.0.0/16
We want Multipathing!
28
![Page 29: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/29.jpg)
AGGREGATION
EDGE
CORE10.0.0.0/16
10.1.0.0/16
10.2.0.0/16
10.3.0.0/16
We want Multipathing!
29
![Page 30: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/30.jpg)
High-Bandwidth
AGGREGATION
EDGE
CORE
Virtual Switch
10.0.0.1
Virtual Switch
10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
Src IP: 10.0.0.1, Dst IP: 10.3.0.9
10.0.0.0/16C0
10.1.0.0/16 C1
10.2.0.0/16C2
10.3.0.0/16C3
2
3
DIP: 10.0.0.1 3DIP: 10.0.0.2 3DIP: 10.1.0.2 3…Low priorityIP {1,2}
1
63
1 2
DIP: 10.0.0.1 3DIP: 10.0.0.2 3DIP: 10.1.0.2 3DIP: 10.2.0.4 5DIP: 10.3.0.2 5DIP: 10.1.0.5 5….Low priorityIP {1,2}
54
DIP: 10.0.0.1 4DIP: 10.0.0.2 5DIP: 10.0.0.4 PUSH_MPLS(25), 3…..Low priorityDIP: 10.1.0.0/16 1DIP: 10.2.0.0/16 2DIP: 10.3.0.0/16 3 1
2
34 5
DIP: 10.3.0.2 4DIP: 10.3.0.9 5MPLS(25) POP_MPLS(0x800), 5…..Low priorityDIP: 10.0.0.0/16 1DIP: 10.1.0.0/16 2DIP: 10.2.0.0/16 3
1 23
4 5
30
![Page 31: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/31.jpg)
Dushyant Arora PARIS 31
Multipathing in the Core Layer
![Page 32: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/32.jpg)
• Implement Valiant Load Balancing (VLB)– Better link utilization through randomization
Dushyant Arora PARIS 32
Multipathing in the Core Layer
![Page 33: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/33.jpg)
• Implement Valiant Load Balancing (VLB)• How do we implement VLB?
Dushyant Arora PARIS 33
Multipathing in the Core Layer
INGRESS
APS
EGRESS
![Page 34: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/34.jpg)
• Implement Valiant Load Balancing (VLB)• How do we implement VLB?– First bounce• Ingress core switch to APS
Dushyant Arora PARIS 34
Multipathing in the Core Layer
INGRESS
APS
EGRESS
![Page 35: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/35.jpg)
• Implement Valiant Load Balancing (VLB)• How do we implement VLB?– First bounce• Ingress core switch to APS
Dushyant Arora PARIS 35
Multipathing in the Core Layer
V VV
INGRESS
APS
EGRESS
![Page 36: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/36.jpg)
• Implement Valiant Load Balancing (VLB)• How do we implement VLB?– First bounce• Ingress core switch to APS
– Second bounce• APS to egress core switch
Dushyant Arora PARIS 36
Multipathing in the Core Layer
INGRESS
APS
EGRESS
![Page 37: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/37.jpg)
• Implement Valiant Load Balancing (VLB)• How do we implement VLB?– First bounce• Ingress core switch to APS
– Second bounce• APS to egress core switch
Dushyant Arora PARIS 37
Multipathing in the Core Layer
V VV
INGRESS
APS
EGRESS
![Page 38: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/38.jpg)
Dushyant Arora PARIS 38
High-BandwidthSCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST
ETHERNET ETHERNET+IP NO-STRETCH ~
HIGH-BW+VLB
![Page 39: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/39.jpg)
Performance Evaluation
• Compare No-Stretch and High-BW+VLB on Mininet-HiFi• 32 hosts, 16 edge, 8 aggregation, and 4 core switches (no
over-subscription)– 106 and 126 µs inter-pod RTT
• Link bandwidth– Host-switch: 1Mbps– Switch-Switch: 10Mbps
• Random traffic pattern– Each host randomly sends to 1 other host– Use iperf to measure sender bandwidth
Dushyant Arora PARIS 39
![Page 40: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/40.jpg)
Dushyant Arora PARIS 40
Performance Evaluation
Avg: 633 kbpsMedian: 654 kbps
Avg: 477 kbpsMedian: 483 kbps
![Page 41: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/41.jpg)
Data Center Network Goals Scalability Virtual machine migration Multipathing Easy manageability Low cost– Multi-tenancy– Middlebox policies
Dushyant Arora PARIS 41
![Page 42: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/42.jpg)
Multi-tenancy
Dushyant Arora PARIS 42
![Page 43: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/43.jpg)
Multi-tenancy
• Each tenant is given a unique MPLS label
Dushyant Arora PARIS 43
![Page 44: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/44.jpg)
CORE
AGGREGATION
EDGE
10.0.0.0/16 10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
Virtual Switch
10.0.0.1
Virtual Switch
10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
POD POD
44
MPLS Label = 16 MPLS Label = 17 MPLS Label = 18
![Page 45: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/45.jpg)
Multi-tenancy
• Each tenant is given a unique MPLS label• Server virtual switches push/pop MPLS header
Dushyant Arora PARIS 45
![Page 46: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/46.jpg)
Multi-tenancy
• Each tenant is given a unique MPLS label• Server virtual switches push/pop MPLS header• All switches match on both MPLS label and IP
address
Dushyant Arora PARIS 46
![Page 47: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/47.jpg)
CORE
AGGREGATION
EDGE
Virtual Switch
10.0.0.1 10.0.0.2 10.1.0.2
Virtual Switch
10.2.0.4 10.3.0.2 10.1.0.5
10.0.0.0/16 10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
Src IP: 10.0.0.1, Dst IP: 10.0.0.4
1
2 3 4
High priorityin_port:2, DIP: 10.1.0.2 4in_port:4, DIP: 10.0.0.1 2Defaultin_port: 2 PUSH_MPLS(16), 1in_port: 3 PUSH_MPLS(17), 1in_port: 4 PUSH_MPLS(16), 1in_port: 1, MPLS(16), DIP:10.0.0.1 POP_MPLS(0x800), 2in_port: 1, MPLS(17), DIP:10.0.0.2 POP_MPLS(0x800), 3in_port: 1, MPLS(16), DIP:10.1.0.2 POP_MPLS(0x800), 4
47
MPLS Label = 16 MPLS Label = 17 MPLS Label = 18
![Page 48: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/48.jpg)
Multi-tenancy
• Each tenant is given a unique MPLS label• Server virtual switches push/pop MPLS header• All switches match on both MPLS label and IP
address• Forwarding proceeds as usual
Dushyant Arora PARIS 48
![Page 49: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/49.jpg)
Data Center Network Goals Scalability Virtual machine migration Multipathing Easy manageability Low cost Multi-tenancy– Middlebox policies
Dushyant Arora PARIS 49
![Page 50: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/50.jpg)
Middlebox Policies
Dushyant Arora PARIS 50
![Page 51: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/51.jpg)
Middlebox Policies
– Place MBs off the physical network path• Installing MBs at choke points causes network partition on
failure• Data centers have low network latency
Dushyant Arora PARIS 51
![Page 52: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/52.jpg)
CORE
AGGREGATION
EDGE
Virtual Switch
10.0.0.1 10.0.0.2 10.1.0.2
Virtual Switch
10.2.0.4 10.3.0.2 10.1.0.5
10.0.0.0/16 10.1.0.0/16 10.2.0.0/16 10.3.0.0/16
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
FIREWALL
LOAD BALANCER
52
MPLS Label = 16 MPLS Label = 17 MPLS Label = 18
![Page 53: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/53.jpg)
Policy Implementation
– Place MBs off the physical network path
Dushyant Arora PARIS 53
![Page 54: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/54.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing
Dushyant Arora PARIS 54
![Page 55: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/55.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing• Install policies in server virtual switch
Dushyant Arora PARIS 55
![Page 56: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/56.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing• Install policies in server virtual switch• Virtual switches can support big flow tables
Dushyant Arora PARIS 56
![Page 57: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/57.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing• Install policies in server virtual switch• Virtual switches can support big flow tables• Provides flexibility
Dushyant Arora PARIS 57
![Page 58: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/58.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing
Dushyant Arora PARIS 58
![Page 59: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/59.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing• Each MB is assigned a unique MPLS label (220-1 max)
Dushyant Arora PARIS 59
![Page 60: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/60.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing• Each MB is assigned a unique MPLS label (220-1 max)• Edge and Aggregation switches store forwarding
information for MBs beneath them
Dushyant Arora PARIS 60
![Page 61: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/61.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing• Each MB is assigned a unique MPLS label (220-1 max)• Edge and Aggregation switches store forwarding
information for MBs beneath them• Aggregate flat MPLS labels in core layer
Dushyant Arora PARIS 61
![Page 62: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/62.jpg)
CORE
AGGREGATION
EDGE
10.0.0.0/1632/17
10.1.0.0/1640/17
10.2.0.0/1648/17
10.3.0.0/1656/17
FIREWALL (46)
LOAD BALANCER (33)
62
MPLS Label = 16 MPLS Label = 17 MPLS Label = 18
Virtual Switch
10.0.0.1 10.0.0.2 10.1.0.2
Virtual Switch
10.2.0.4 10.3.0.2 10.1.0.5
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
![Page 63: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/63.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing
Dushyant Arora PARIS 63
![Page 64: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/64.jpg)
Policy Implementation
– Place MBs off the physical network path– Use source routing– Use MPLS label stack for source routing– Pre-compute sequence of MBs for each policy and
install rules proactively
Dushyant Arora PARIS 64
![Page 65: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/65.jpg)
Virtual Switch
10.0.0.1 10.0.0.2 10.1.0.2
1
2 3 4
LOAD BALANCER (33)
FIREWALL (46) CORE
AGGREGATION
EDGE
Virtual Switch
10.2.0.4 10.3.0.2 10.1.0.5
10.0.0.0/1632/17
10.1.0.0/1640/17
10.2.0.0/1648/17
10.3.0.0/1656/17
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
Highest priorityin_port:2, DIP: 10.16.0.17 PUSH_MPLS(16), PUSH_MPLS(33), PUSH_MPLS(46), 1….High priorityin_port:2, DIP: 10.1.0.2 4….Defaultin_port: 2 PUSH_MPLS(16), 1….in_port: 1, MPLS(16), DIP:10.0.0.1 POP_MPLS(0x800), 2
{TID:16, DIP: 10.16.0.17:80} FW LB WebServer
Src IP: 10.0.0.1, Dst IP: 10.16.0.17:80
MPLS Label = 16 MPLS Label = 17 MPLS Label = 18
{TID:16, DIP: 10.16.0.17:80} 46 33 WebServer
65
![Page 66: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/66.jpg)
Conclusion
• Proposed new data center addressing and forwarding schemes Scalability Multipathing Virtual machine migration Easy manageability Low cost Multi-tenancy (independent) Middlebox policies (independent)
• NOX and Openflow software switch prototype
Dushyant Arora PARIS 66
![Page 67: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/67.jpg)
Dushyant Arora PARIS 67
Related WorkSCHEME SCALABILITY MULTIPATHING VM MIGRATION MANAGEABILITY LOW COST MULTI-
TENANCYMIDDLEBOX
NO STRETCH ~
HIGH BW+VLB
VL2 ~ ? ?PORTLAND* ?
TRILL ?SPAIN ?
![Page 68: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/68.jpg)
Thank You
Questions?
Dushyant Arora PARIS 68
![Page 69: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/69.jpg)
Scalability Evaluation
• 512 VMs/tenant• 64 VMs/physical server • ~40% of network appliances are middleboxes• 64 x 10Gbps Openflow switches• NOX controller
Dushyant Arora PARIS 69
![Page 70: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/70.jpg)
No-Stretch Scalability Evaluation
Dushyant Arora PARIS 70
4000 16000 32000 640000
200000
400000
600000
800000
1000000
1200000Hosts Vs Flow table size
Flow table size
Host
s
128 ports*
![Page 71: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/71.jpg)
High-BW+VLB Scalability Evaluation
Dushyant Arora PARIS 71
6000 16000 24000 2000000
100000
200000
300000
400000
500000
600000Hosts Vs Flow table size
Flow table size
Host
s
![Page 72: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/72.jpg)
Virtual Switch
LOAD BALANCER (33)
Virtual Switch
FIREWALL (46)
Virtual Switch
CORE
AGGREGATION
EDGE
10.0.0.1
Virtual Switch
10.0.0.2 10.1.0.2 10.2.0.4 10.3.0.2 10.1.0.5
10.0.0.0/1632/17
10.1.0.0/1640/17
10.2.0.0/1648/17
10.3.0.0/1656/17
Virtual Switch
10.0.0.4 10.2.0.7 10.3.0.9
1
2 3 4
Highest priorityin_port:2, DIP: 10.16.0.17 PUSH_MPLS(16), PUSH_MPLS(33), PUSH_MPLS(46), 1….High priorityin_port:2, DIP: 10.1.0.2 4….Defaultin_port: 2 PUSH_MPLS(16), 1….in_port: 1, MPLS(16), DIP:10.0.0.1 POP_MPLS(0x800), 2
POLICY{TID:16, DIP: 10.16.0.17:80} FW LB WebServer
7
123456
MPLS_BOTTOM(16) MPLS_POP(0x8847), 5MPLS_BOTTOM(17) MPLS_POP(0x8847), 1MPLS_BOTTOM(18) MPLS_POP(0x8847), 3in_port:2 7in_port:4 7in_port:6 7
Src IP: 10.0.0.1, Dst IP: 10.16.0.17:80
![Page 73: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/73.jpg)
Performance Evaluation
• Compare No-Stretch and High-BW+VLB on Mininet-HiFi• 64 hosts, 32 edge, 16 aggregation, and 8 core switches
(no over-subscription)– 106 and 126 µs inter-pod RTT
• Link bandwidth– Host-switch: 1Mbps– Switch-Switch: 10Mbps
• Random traffic pattern– Each host randomly sends to 1 other– Use iperf to measure sender bandwidth
Dushyant Arora PARIS 73
![Page 74: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/74.jpg)
Dushyant Arora PARIS 74
Performance Evaluation
Avg: 681 kbpsMedian: 663 kbps
Avg: 652 kbpsMedian: 582 kbps
![Page 75: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/75.jpg)
Performance Evaluation
• Compare three forwarding schemes using Mininet-HiFi– No-Stretch, High-BW and High-BW+VLB
• 64 hosts, 32 edge, 16 aggregation, and 8 core switches– 106, 116, 126 µs inter-pod RTT
• Link bandwidth– Host-switch: 10Mbps– Switch-Switch: 100Mbps
• Random traffic pattern– Each host randomly sends to 4 other – Senders send @ 4096 kbps for 10s
Dushyant Arora PARIS 75
![Page 76: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/76.jpg)
Dushyant Arora PARIS 76
Evaluation
![Page 77: PARIS: ProActive Routing In Scalable Data Centers](https://reader036.vdocuments.mx/reader036/viewer/2022062411/568166e5550346895ddb2082/html5/thumbnails/77.jpg)
Dushyant Arora PARIS 77
Performance Evaluation
Avg: 633 kbpsMedian: 654 kbps
Avg: 477 kbpsMedian: 483 kbps