Build Reliable Cloud Networks with SONiC and ONE

Wei Bai 白巍Microsoft Research Asia

1OCP China Technology Day, Shenzhen, China

54REGIONS WORLDWIDE

100K+MILES OF FIBER AND SUBSEA CABLE

130+EDGE SITES

$15B+Investments

Two Open Source Cornerstones for High Reliability

3

Networking OS: SONiC

Network Verification: ONE

Networking OS: SONiC

4

Switch Abstraction Interface (SAI)

SONiCSONiC SONiC SONiC

Monitoring, Management, Deployment Tools, Cutting Edge SDN

MerchantSilicon

A Solution to Unblock Hardware Innovation

6

частный 你好 Bonjour

Hello

Network

Applications

Network

Applications

Switch Abstraction Interface

Network Applications

नमस्ते

Simple, consistent, and stable network application stack

Help consume the underlying complex, heterogeneous hardware easily and faster

https://github.com/opencomputeproject/SAI

Switch Abstraction Interface (SAI)

SONiC High-Level Architecture

Switch State Service (SWSS)

• APP DB: persist App objects

• SAI DB: persist SAI objects

• Orchestration Agent: translation between apps and SAI objects, resolution of dependency and conflict

• SyncD: sync SAI objects between software and hardware

8

Key Goal: Evolve components independently

SONiC Containerization

9

SONiC Containerization

• Components developed in different environments

• Source code may not be available

• Enables choices on a per-component basis

10

SONiC – Powering Microsoft At Cloud Scale

11

T2-1-1 T2-1-2 T2-1-8

T3-1 T3-2 T3-3 T3-4

Tier 1 – Row Leaf

T2-4-1 T2-4-2 T2-4-4Tier 2 - Spine

T1-1 T1-8T1-7…

T1-2

… …

Tier 3 - Regional Spine

…

T1-1 T1-8T1-7…

T1-2 T1-1 T1-8T1-7…

T1-2

Tier 0 - Rack…

T0-1 T0-2 T0-20

Servers

…T0-1 T0-2 T0-20

…T0-1 T0-2 T0-20

SONIC SONIC SONIC SONIC SONIC SONIC SONIC SONIC SONIC SONIC SONIC SONIC

SONIC SONIC SONIC SONIC SONIC SONICSONIC SONIC SONIC

Servers Servers

Features and Roadmap

Current: BGP, ECMP, ECN, WRED, LAG, SNMP, SYSLOG, ACL, LLDP, NTP, VLAN, DHCP,AD, TACACS+, VLAN Trunk, CoPP, IPv6, Everflow, Fast reboot, RDMA, PFC WD, QoS, Telemetry, Warm reboot, OOM, VxLAN, VRF

Roadmap: FRR, L3 MLAG, sFLOW, BGP EVPN, NAT

Application & Management tools

SONiC [Software For Open Networking in the Cloud]

SAI [Switch Abstraction Interface]

Sil

ico

n/A

SIC

Sw

itch

Inviting Contributions in All Areas

13

• New ideas on white/open network devices

• New features, applications and tools

• Download it, test it and use it!

• Website: https://azure.github.io/SONiC/

• Mailing list: sonicproject@googlegroups.com

• GitHub: https://github.com/Azure/SONiC/

• Wiki: https://github.com/Azure/SONiC/wiki/

Network Verification: ONE

14

Astronauts use high-fidelity emulators to practice complex, high-risk missions

15

Azure engineers use Open Network Emulator (ONE) to practice complex, high-risk network operations

16

Change manager

WAN manager

Optical link manager

Routing protocol coordinator

Open Network Emulator

Fastnetwork with 1000s of devices created in minutes

Seamlesspush-button deployment

High fidelity devices work exactly as production

support from multiple vendors

17

Production

Network

Configuration

Software

Hardware

Configuration

Software

Hardware

Configuration

Software

Hardware

Emulated Production

Network

Configuration

Software

vHardware

Configuration

Software

vHardware

Configuration

Software

vHardware

Virtual LinksPhysical Links

Physical Switch Virtual Machine / Container

ONE typical usage scenario

18

Network engineer describes desired change

An emulated replica is created

Health verified by Z3 theorem prover

Pass/Fail(with feedback,

including counter-examples)

SONiC

SONiC

SONiC

SONiC

SONiC

More Details

• Mailing list: crystalnet-dev@microsoft.com

• Publication

19

Acknowledgements

• Xin Liu

• Ze Gan

• Guohan Lu

• Yongqiang Xiong

• Lihua Yuan

20

Thanks!

21

Cloud Priorities

22

Fast

Supportable

Reliable

SecureBorrow from Albert Greenberg

SONiC: Software for Open Networking in the Cloud

• Switch Abstraction Interface (SAI)• Cross-ASIC portability

• Modular Design with Switch State Service (SwSS)• Decoupling software components• Consistent application development model

• Containerization of SONiC• Serviceability• Cross-platform portability

23

SONiC: Software for Open Networking in the Cloud

• Switch Abstraction Interface (SAI)• Cross-ASIC portability

• Modular Design with Switch State Service (SwSS)• Decoupling software components• Consistent application development model

• Containerization of SONiC• Serviceability• Cross-platform portability

24

SONiC High-Level Architecture

25

How Routing Works in SONiC

26

SONiC: Software for Open Networking in the Cloud

• Switch Abstraction Interface (SAI)• Cross-ASIC portability

• Modular Design with Switch State Service (SwSS)• Decoupling software components• Consistent application development model

• Containerization of SONiC• Serviceability• Cross-platform portability

27

Demo: SONiC + ONE

29

Topology

30