belwü 2016+ - terena...~200 backbone router 40 * asr 9000 (9006, 9010) 23 * asr 1000 cat 6509,...

24
BelWü 2016+ NETARCH #3 13.11.2014 Copenhagen, Denmark Tim Kleefass [email protected] 1

Upload: others

Post on 02-Aug-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

BelWü 2016+

NETARCH #313.11.2014

Copenhagen, Denmark

Tim [email protected]

1

Page 2: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Baden-Württemberg Extended LAN

Academic Network of the Federal State of Baden-Württemberg, Germany

We are connecting:

9 Universities

47 Universities for applied sciences, etc.

Numerous schools, libraries, student dormitories and other institutes

And offering services (mostly for Schools):

Webhosting (e.g. Moodle e-learning) and youth protection HTTP proxy

E-Mail, SPAM detection

Network services (DNS, NTP, ...)

2

2

Page 3: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

A short history1987 BelWü was founded

First bridged network, later routed, partially IP over X.25

1989 All (BaWü) Universities are connected to BelWü

1994 Full mesh of all Universities with 2-34 Mbit/s

1998 Upgrade to Cisco 7500 and 155 Mbit/s ATM links

2001 Upgrade to Gbit/s-Network with Cisco 12410/GSR

SRP/DPT rings with 2.4 Gbit/s and 622 Mbit/s

2006 First 10Gbit/s link

2010 Upgrade to 100Gbit/s-ready-Network with Cisco ASR 9000,

own (passive) DWDM and (multiple) 10Gbit/s Ethernet links

2013 June: First 100Gbit/s link

2014 100Gbit/s at each University PoPs3

3

Page 4: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Current BelWü Network

4

Page 5: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

BelWü (Fiber) Footprint

5

Backbone through Baden-Württemberg

> 3.000 km fiber & 10GigE bandwidth

50 POPs, 50 optical amplifiers(spans shorter than 100/120km)

p2p lambdas: >80 * 10G & 10 * 100G(lambdas hop-to-hop only)

60/170 * 10GE260/650 * GE140 * FE - customer/all IP ports

2 * 100GE - Layer 2

~200 backbone router

40 * ASR 9000 (9006, 9010)

23 * ASR 1000

Cat 6509, Cisco 2821, 2921, 3925

~2.500 others like Cisco 8xx DSL/

(C) BelWü-Koordination (Universität Stuttgart), www.belwue.de

(Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org

und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.)

Leitungen

10GE Bandbreite optisches Fenster existierende DF Bandbreite

BelWü-KoordinationUniversität Stuttgart

http://www.belwue.deTue Apr 15 2014

Stand 12/2012

Standorte mit Universität Hochschule Anderer

25

96

42

26

58

5134

40

70

94

51

33

112

25

5015

45

3565

49

68

50

60

2040

23

76

(~250?)

30

42 Leitungslänge in km (ca.)

(~280?) 60

100

33

90

10028

60

50

110?

Böblingen

Freudenstadt

Rastatt

Baden-Baden

Rotten-burg

Biberach

Weingarten

Ravensburg

Friedrichshafen

Sigmaringen

Albstadt

Reutlingen

Nürtingen

Esslingen

GöppingenGeislingen

Heidenheim

AalenSchw. Gmünd

Künzelsau

Schw. HallHeilbronn

Mosbach

Ludwigsburg

Pforzheim

Kehl

Lörrach

Tuttlingen

Trossingen

V-SFurtwangen

HorbOffenburg

Gengenbach

PH FA

Frankfurt

Tübingen

Ulm

Konstanz

Freiburg

Karlsruhe

HohenheimStuttgart

Heidelberg

Mannheim

5

Page 6: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

BelWü optical and IP Network 2014

On fibers:

Static DWDM filter w/ 4-8 Channels and EDFA

Colored 10GigE DWDM transceiver

(Menara w/ FEC) in IP Router (ASR 9000)

Parallel: Ekinops/Opelian 10x10G to 100G Mux

Hop-to-hop, no long-run wavelengths

Today:

Fiber on main paths

Redundancy via rented 10GigE bandwidths

Target Q2/2016:

Continous & redundant fiber-only network

6

Page 7: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

(Big) Campus - today

Nicht eingezeichnet:Dispersionskompensation

7

Page 8: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

BelWü-NeIF10G bandwidths

Paralell to IP Network

10G bandwidths with 10x10G to 100G Mux & 10G matrix

Not redundant

Backbone capacity

Projects

Campus-Campus Links

(Possible 100G backbone links for IP Routers)

“Test” for bandwidths demand ?8

Page 9: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Netztopologie

FA FilmakademiePH Pädagogische HochschuleMANDA, RLP, SWITCH: Wissenschaftsnetze Darmstadt, Rheinland-Pfalz, Schweiz

BelWü-KoordinationUniversität Stuttgart

http://www.belwue.deFri May 09 2014

diversePeerings

100GE DWDM 10GE DWDM, Uni/Core-Netz (potentiell 100GE) 10GE DWDM, Uni/Core-Netz 10GE DWDM oder LWL, Hochschulen 10GE Bandbreite 10GE opt. Fenster über Versatel/RLP-Net 1GE LWL, 1GE Bandbreite, 155Mbit/s POS in Planung

RLP-Net

100G

Router (Name und Cisco Modell)Router (ggf. mit full-routing)fra1

9006

aal9006

Telia

S-IX

kommerzieller UpstreamInternet Exchange

DFN wissenschaftlicher Upstream

NeIF Netzwerk für Innovation und Forschung

KIT Campus Nord

KIT LSDF

URZ

LSDF

NeIF

NeIF

NeIF NeIF

NeIF

NeIF

NeIF

NeIF

NeIF

NeIF

NeIF

Stuttgart

Frankfurt

DE-CIX

Telia

man-schl-19010

Cogent

mos1001

MannheimHeidelberg

KarlsruheKIT

DFN

DFN

kar-rz-19010

kar-bib-19010

Uni Hoh

stu-al30-19010

stu-nwz-19010

ulm-n25-19010

ulm-n26-19010

Ulm

hlb9006

fra-decix-19006

kue9006

aal9006

hdh9006

sgd9006

ess9006

nue9006

reu9006

SWITCH

fdh9006

rav9006

wei9006

sig9006

alb9006

bib9006

kon-bib-19010

kon-rz-19010

hdl21001

shl1001

rot1001

loe1001

tue-wae-19010

tue-mor-19010

frb-rz-19010

frb-kg-19010

tut9006

tro9006

vil9006

fuw9006

hor9006

ofg9006

keh9006

OSIRIS

pfo9006

goe

gei

boe

fds

Freiburg Konstanz

Tübingen

Hohenheim

S-IX

bad1001

ras1001

Mosbach

HeilbronnKünzelsau

Schw. Hall

Schw. Gmünd

Aalen

Heiden-heim

Ludwigsburglbg-fa1001

FAPH

Pforzheim

Esslingen

Göppingen

Nürtingen

Geislingen

Reutlingen

Albstadt

Sigmaringen

Böblingen

HorbRottenburg

Freudenstadt

Kehl

Straßburg

Offenburg

Villingen -Schwenningen

Furtwangen

TuttlingenTrossingen

Kreuzlingen

Friedrichshafen

Ravensburg

Weingarten

Biberach

Rastatt

Baden-Baden

diversePeerings

diversePeerings

MANDA RLP-Net

Uni Hdl

Uni Man

Uni StuUni Ulm

Uni Tue

Uni Kon

Uni Frb

lbg-ph-19006

HS Ess

Level3

hdl-rz-19010

man-rz-19010

Ein Glasfaserpaar

9

Page 10: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

BelWü Services

Services:

IPv4, IPv6

Firewalling (up to 1G, smaller Universities)

Layer 2 VPNs/Bandwidths

1/10G Ethernet over MPLS (via IP/MPLS Router)

10/100G Wavelengths (via DWDM; only few Hops)

10G Bandwidths (10x10G to 100G Mux, BelWü-NeIF)

With very different requirements ...

And of course a lot of Network related Servies ...

10

Page 11: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Ausblick 2014-2016+Outlook BelWü 2016+

11

Page 12: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

12

(C) BelWü-Koordination (Universität Stuttgart), www.belwue.de

(Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org

und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.)

Leitungen Plan 2016+ ?

Bandbreite (10GE) optisches Fenster existierende DF geplant

BelWü-KoordinationUniversität Stuttgart

http://www.belwue.deTue Jul 01 2014

Stand 12/2012

Standorte mit Universität Hochschule Anderer

25

96

42

26

58

5134

40

70

94

51

33

112

25

5015

45

3565

49

68

50

60

2040

23

76

30

42 Leitungslänge in km (ca.)

60

100

33

90

10028

60

50

110?

Böblingen

Freudenstadt

Rastatt

Baden-Baden

Rotten-burg

Biberach

Weingarten

Ravensburg

Friedrichshafen

Sigmaringen

Albstadt

Reutlingen

Nürtingen

Esslingen

GöppingenGeislingen

Heidenheim

AalenSchw. Gmünd

Künzelsau

Schw. HallHeilbronn

Mosbach

Ludwigsburg

Pforzheim

Kehl

Lörrach

Tuttlingen

Trossingen

V-SFurtwangen

HorbOffenburg

Gengenbach

PH FA

Frankfurt

Tübingen

Ulm

Konstanz

Freiburg

Karlsruhe

HohenheimStuttgart

Heidelberg

Mannheim

BelWü (Fiber) Footprint 2016 ???

100G IP Ports for clients at yellow dots

100G IP Routers at few central locations only

100G waves in the core network (red lines)

12

Page 13: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

2014-2016+Tendering for:

1. Fibers (-only Network)

2. Optical Network

3. 100G IP Router (100G access for bigger Universities)

Potential Timeline:

13

Page 14: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Campus - ROADM static

14

Page 15: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Campus - ROADM dynamic

15

Page 16: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Statements / Questions

Buying 100G equipment starting end of 2015 seems to be a good time.

Smaller chips, more 100G port per line-card (optical and IP)

Fixed Questions:

Grid-less ROADMs - to have super channels in the future

(Dispersion Compensation must be aware of that!)

16

Page 17: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Statements / Questions (cont.)

Open:

Distribute ROADMs on two Locations on Campus ?

Dispersion compensation for long-haul 10G waves ?

Or only short-haul 10G waves (e.g., hop-to-hop) ?

(Re-use “old” 10G DWDM transceiver ?)

Big chassis or small chassis for each degree ?

Spectrum sharing w/ participants (“customer”) ?

We have that on some links today w/ static filters

(Swapping wavelengths with $ISP ?)

Less IP router, more latency between participants - problem ?

Is there wavelength rewriting ?

17

Page 18: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Challenge

Catch up your own team

We are new to ROADMs - that took us a while ...

No fancy/graphical NMS system

With optical equipment this would be mandatory ?

Necessary for tiering NOC structur (?)

We overcame ATM/SDH and other circuit switching

Now we are back to wavelength/OTN/Layer 2-VPN/etc. switching... ?

18

Page 19: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

Questions ?

19

Page 20: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

DWDM Karlsruhe - Offenburg

20

Page 21: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

DWDM Karlsruhe - Offenburg

21

Page 22: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

DWDM Karlsruhe - Offenburg

22

Page 23: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

DWDM Karlsruhe - Offenburg

23

Page 24: BelWü 2016+ - TERENA...~200 backbone router 40 * ASR 9000 (9006, 9010) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ (C) BelWü-Koordination (Universität

DWDM Karlsruhe - Offenburg

24