qfabric deep dive - home - j-net...
TRANSCRIPT
![Page 1: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/1.jpg)
QFABRIC DEEP DIVE Masum Mir Director, Product Line Management Campus & Data Center Business Unit
![Page 2: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/2.jpg)
2 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
AGENDA
Vitalizing the DC network for Virtualized servers
How do we design DC network with QFabric
![Page 3: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/3.jpg)
3 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
NETWORK & RESOURCE POOLS IN DATA CENTER
USERS/TENANTS
Tenant-1
Tenant-2
Tenant-3
Tenant-450
Compute & data pools Virtualized workloads
Servers & compute capacity outpacing infrastructure growth Network needs to enable flexible resource pools and scale on the same time
Core IT System
![Page 4: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/4.jpg)
4 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
PERFORMANCE OBSTACLES IN THE ARCHITECTURE
Ethernet
Servers NAS
Multi Tier Architecture
Scale
Latency Scale vs. Latency
Scale
Bandwidth Scale vs. Bandwidth
Location dependent adjacencies & tenancy Silo of compute, storage & service resources
1 2 3 4
1 2
1 2
1 3
1 3
1 4
1 4
>100 µSec
100:1 OS Red Network
Green Network
![Page 5: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/5.jpg)
5 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
IMPROVING APPLICATION PERFORMANCE AT SCALE
Scale
Latency
Scale
Bandwidth
Traditional design
QFabric
Traditional design
QFabric
Ethernet
Servers NAS
Multi Tier Network>100 µSec
100:1 OS
<5 µSec
Wirespeed 3:1 OS 6:1 OS
Servers NAS
1 2 3 4
1 2
1 2
1 3
1 3
1 4
1 4
1 2
1 2
1 3
1 3
1 4
1 4
Scale vs. Latency
Scale vs. Bandwidth
![Page 6: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/6.jpg)
6 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC MAINTAINING NETWORK BOUNDARY & ISOLATION
VM VM VM
VM VM VM
VM VM VM
Tenant B
VM VM VM
VM VM VM
VM VM VM
Tenant A
VM VM VM
VM VM VM
VM VM VM
Tenant C
Blue Network
Red Network
Green Network
QFabric Director
DB
Fabric Admin
Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>
TOR:Rack23xe-0/0/47 {unit 0 {
family inet {address 10.1.1.254/24;}
}}
![Page 7: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/7.jpg)
7 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC EFFICIENCY GAIN WITH LARGER & AGILE COMPUTE POOL
VMVM VM
VMVM VM
VMVM VM
Tenant B
VMVM VM
VMVM VM
VMVM VM
Tenant A
VMVM VM
VMVM VM
VMVM VM
Tenant C
Blue Network
Red Network
Green Network
VR-A
VR-B
VR-C
Servers Storage Idle Servers Can optimize Power
![Page 8: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/8.jpg)
8 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC EFFICIENCY GAIN WITH STORAGE CONVERGENCE
VMVM VM
VMVM VM
VMVM VM
Tenant B
VMVM VM
VMVM VM
VMVM VM
Tenant A
VMVM VM
VMVM VM
VMVM VM
Tenant C
Blue Network
Red Network
Green Network
VR-A
VR-B
VR-C
Servers NAS FC Storage
FC SAN -A
FC SAN -B
FC
FC
FCoE
FCoE
![Page 9: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/9.jpg)
9 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC SIMPLIFYING NETWORK OPERATION AT SCALE
Traditional QFabric
Aggregation Switches
Core Switch
Generic Switch …
..…
Management System Management System
Many devices to manage Multiple OS to manage
Many device and OS to integrate & orchestrate
Single system to manage Single OS
Single system to integrate & orchestrate
OS 4.0 OS 5.0
OS 4.0 OS 5.0
OS 12.3 OS
12.4
OS 12.2 OS
12.4 OS 4.0 OS 5.0
OS 12.3 OS
12.4
11.3
OS 12.3 OS
12.4
OS 12.3 OS
12.4 OS
12.3 OS
12.4
QFabric Director
DB
Fabric Admin
Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>
TOR:Rack23xe-0/0/47 {unit 0 {
family inet {address 10.1.1.254/24;}
}}
![Page 10: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/10.jpg)
10 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION
Network Application Platform
QFabric Director
Standard API (SNMP, Syslog, NETCONF, etc)
Management System (3rd Party)
Management Client
Management Console
Admin
Admin
CLI/GUI
GLI/GUI
VM1 VM2
Virtual n/w
VM2 VM3VM1Server Admin
Network Admin
Virtual Control
![Page 11: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/11.jpg)
11 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC END TO END INFRASTRUCTURE DESIGN
vGW
SRX
MX
QFabric
SRX
MX
VRF-A
VRF-B VRF-C
VMVM VM
VMVM VM
VMVM VM
VR-A
VMVM VM
VMVM VM
VMVM VM
VR-B
VMVM VM
VMVM VM
VMVM VM
VR-C
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
vGW
![Page 12: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/12.jpg)
12 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DATA CENTER INTERCONNECT
WAN & Core
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
![Page 13: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/13.jpg)
13 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC : QFX3000-M VS QFX3000-G
Latency ~3us end-end Latency ~5us end-end
768-6,144 10G ports 48-768 10G ports
Small QFabric/Interconnect Modular chassis QFabric/Interconnect
Managed & operated as 1 switch
Runs Junos
Common QFabric/Node (QFX3500, QFX3600) & Director (QFX3001)
Storage Convergence: Lossless & DCB supported. FCoE & FC-Gateway
![Page 14: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/14.jpg)
14 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC FUNCTIONAL ELEMENTS
Interconnect
Fabric switches
Node
I/O devices
Director
Control devices
![Page 15: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/15.jpg)
15 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC DATA & CONTROL PLANE
QFabric Data Plane QFabric Control Plane
![Page 16: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/16.jpg)
16 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
8 x 10GbE LAG
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
![Page 17: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/17.jpg)
17 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
QFX3500 QFX3500
40GbE
![Page 18: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/18.jpg)
18 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
QFX3500 QFX3500 QFX3500 QFX3500
40GbE
![Page 19: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/19.jpg)
19 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
ARCHITECTURE MIGRATION TO QFABRIC
QFX3500
QFabric
Pod 1 Pod 2 4
![Page 20: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/20.jpg)
20 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DESIGN EXAMPLE (5K PORTS, 75% GBE, 25% 10GBE)
EX4200 #1
EX4200 #10
EX4200 #79
3,750 x 1GbE @ 2:1 OS 1,250 x 10GbE @ 3:1 OS
MX
Security/Services
MPLS
QFabric
VC#1 VC#8
12 x 10GbE
![Page 21: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/21.jpg)
21 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DESIGN EXAMPLE (5K PORTS, 25% GBE, 75% 10GBE)
EX4200 #1
EX4200 #10
EX4200 #26
1,250 x 1GbE @ 2:1 OS 3,750 x 10GbE @ 3:1 OS
MX
Security/Services
MPLS
QFabric
VC#1 VC#3
32 x 10/40GbE
![Page 22: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/22.jpg)
![Page 23: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/23.jpg)
23 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
SLIDE TITLE HERE, ALL CAPS, WITH ENOUGH ROOM FOR TWO LINES
Click to edit Master text styles Second level Third level
– Fourth level - Fifth level
![Page 24: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform](https://reader030.vdocuments.mx/reader030/viewer/2022041023/5ed47bf29d1d745fda5e21e7/html5/thumbnails/24.jpg)