ittc communication networks laboratoryjpgs/courses/nets/lecture... · communication networks...

The University of Kansas EECS 780Programmable Networking with GpENI

Egemen K. Çetinkaya and James P.G. Sterbenz

Department of Electrical Engineering & Computer ScienceInformation Technology & Telecommunications Research Center

The University of Kansas

ekc@ittc.ku.edujpgs@eecs.ku.edu

http://www.ittc.ku.edu/~jpgs/courses/nets

rev. 11.0

04 May 2011 KU EECS 780 – Comm Nets – GpENI NET-L5-2

Network Experimentation with GpENIOutline

L5.1 Motivation and overviewL5.2 Participants and infrastructureL5.3 Node cluster and programmabilityL5.4 Network monitoring

Network Experimentation with GpENIMotivation and Overview

Large-Scale TestbedsMotivation

• Progression of research → deployment– analysis– simulation– emulation– lab prototyping– large-scale field prototyping– field deployment

• Testbeds needed to understand realistic behaviour– but realistic scale needed– essential for experiments in Future Internet architecture

Large-Scale TestbedsHistory

• CNRI Gigabit testbeds– Aurora, Blanca, Casa, Nectar, Vistanet, MAGIC– supported high-speed networking research– technology specific; not programmable

• e.g. ATM, HIPPI

• Active network testbeds– DARPA ABone, EU FP5 FAIN, EPSRC LARA++– dynamically programmable networks (signalling or capsules)– supported research in service and protocol deployment– logical predecessor to GENI

Large-Scale TestbedsCurrent Testbeds

• PlanetLab– international testbed to conduct Internet research– L4–7 programmable: applications and transport– VINI extends to control Internet topology– experiments use a slice of PlanetLab– basis for GENI cluster B

• Emulab: clusters of computing nodes– arbitrary system software– programmable interconnection– basis for GENI cluster C (ProtoGENI)

GENI and FIREOverview

• GENI: Global Environments for Network Innovation– funded by the US NSF and participant institutions– managed by the GPO (GENI Project Office – BBN)– goal: new experimental network infrastructure

• FIRE: Future Internet Research and Experimentation– funded by the EU under FP7– research component (similar to FIND)– experimental component (similar to GENI)

GpENIOverview

• GpENI [dʒɛ’pi ni] Great Plains Environment for Network Innovation– exploiting new fiber infrastructure in KS, MO, and NE– significant international footprint under deployment

Europe

Canada

MOREnetKanREN

GpENIProject Goals

• Programmable research infrastructure– centered on optical infrastructure in Great Plains– undergoing international expansion

• Infrastructure to support future Internet research– NSF FIND PoMo– EU FIRE ResumeNet

• GpENI is part of GENI and affiliated with FIRE– GENI cluster B: PlanetLab control framework– testbed for EU FP7 FIRE ResumeNet project

• Open environment for network research community– GpENI clearinghouse for sharing experiments

Network Experimentation with GpENIParticipants and Infrastructure

GpENIPrincipal Participants: Universities1

• KU: The University of Kansas– James P.G. Sterbenz (lead PI),

Joseph B Evans (co-I), Rick McMullen (co-I),Ronqing Hui, Gary Minden

• KSU: Kansas State University– Caterina Scoglio (PI), Don Gruenbacher (co-PI),

Tricha Anjali

• UMKC: University of Missouri – Kansas City– Deep Medhi (PI), Baek-Young Choi (co-I)

Cory Beard, Khosrow Sohraby, Jim Schonemann

• UNL: University of Nebraska – Lincoln– Byrav Ramamurthy (PI)

GpENIPrincipal Participants: Universities2

• IIT: Illinois Institute of Technology– Tricha Anjali

• Lancaster University (UK)– David Hutchison, Andrew Scott (co-Is),

• ETH Zürich (Switzerland)– Bernhard Plattner (co-I)

GpENIParticipants: Research Networks

• GPN: Great Plains Network (consortium)– Greg Monaco (PI)

• KanREN: Kansas Research and Education Network– Cort Buffington (PI)

• MOREnet: Missouri Research and Education Network– Hank Niederhelm

• JANET• SWITCH• GÉANT2 / DANTE• NORDUnet

GpENIParticipants: Industry

• Ciena– Jeff Verrant (PI), Jim Archuleta (co-I)

• Qwest

GpENIParticipants: L2 Tunnel Fanout

• UK, Ireland, and Iberia– Lancaster

• Switzerland, Germany, Austria, Poland, Turkey– ETH Zürich– Bern (Torsten Braun)– Kaiserslautern / G-Lab (Paul Müller)

• Scandinavia and Russia– Simula Labs Oslo

• Asia– ?

Network Experimentation with GpENINode Cluster and Programmability

GpENINode Cluster Types

• Midwest optical backbone– KU, KSU, UNL, UMKC

• Optically connected islands– Lancaster, Cambridge– ETH Zürich, Bern, Uni Zürich

• L2TPv3 concentration/fanout nodes– Lancaster, Zürich, Bern, Kaiserslautern

• L2TPv3 terminal nodes– IU GMOC, ETH Zürich, Tampere, Simula, KIT, Passau, …

• IP tunneled nodes• Public Internet connected nodes?

GpENI Node ClusterArchitecture: Midwest Optical Node

• GpENI cluster• 5–10 PCs

– GpENI mgt.– L4: PlanetLab– L3: prog. routers

• GbE switch– arbitrary site interconnection– L2: GpENI/GENI VLAN– SNMP cluster monitoring

• Ciena optical switch– L1 GpENI interconnection

Ciena optical

GpENImanagement& control

GpENI optical backboneto Internet2 and KC SPPProtoGENI to MAX

GENIVLANs

PlanetLabGENIwrap

prog. nodes

� �site specificKUAR,

sensor, …

ctl. frwk. aggr. mgr. PLC VINI

GbEnet

prog. routersVINI,

Quagga,XORP, click,…

GpENI Node ClusterArchitecture: Island Optical Node

• L2 optical interconnection– among island tunneled to GpENI

GpENImanagement

& control

GENIVLANs

PlanetLabGENIwrap

prog. nodes

� �site

specificKUAR,

sensor, …

island specific

aggregate manager

GbEnet

prog. routers VINI,

L2TPv3

GpENI Node ClusterArchitecture: Tunneled Node Cluster

• Router terminating tunnels– L2TPv3 recommended

GpENImanagement

& control

GENIVLANs

L2TPv3 or IP tunnelsmultiple for fanout nodes

PlanetLabGENIwrap

prog. nodes

L2TPv3

� �site

specificKUAR,

sensor, …

ctl. frwk. aggr. mgr. PLC VINI

GbEnet

prog. routers VINI,

GpENI Node ClusterManagement and Control

• Management and control processor in each cluster– control‐1.⟨institution⟩.gpeni.net

• General purpose Linux box– runs any software needed by GpENI or local sites– e.g. PlanetLab control framework demo at KSU

• Security services– firewall and NAT for cluster private subnet

• Monitoring services– Cacti port monitoring of GbE switch– Nagios to monitor individual nodes

GpENI ProgrammabilityAll Layers

lightpath

topology

router

end-to-end

application

experiment

RF, photonics

Quagga, XORP, Click, site

PlanetLab

Gush, Raven

site-specific

GpENI Layer Programmability

GpENI ProgrammabilityExperiment

• Software to assistresearcher runGpENI experiments

• Gush: GENI user shell[Albrecht]helps reserve resourcesusing GENI clearinghouse

• Raven provisioning service[Hartman]code and configuration deployment

• GpENI clearinghouse

lightpathVLAN

topologyrouter

end-to-endapplicationexperiment

RF,photonics

VINIQuagga, XORP, Click

PlanetLab

Gush, Raven

site-specific

GpENI ProgrammabilityApplication and End-to-End Transport

• PlanetLab sub-aggregate:upper layer programmability– application and E2E transport

• Shares resources usingslice paradigm

• GENIwrapper version of PlanetLab– SFA (slice facility architecture) exports GENI interfaces

• PLC located at KSU: geni‐myplc.ksu.gpeni.net• Programmable nodes at each institution

– geni‐planetlab‐n.⟨institution⟩.gpeni.net

lightpathVLAN

topologyrouter

photonics

PlanetLab

Gush, Raven

site-specific

GpENI ProgrammabilityNetwork Routers and Switches

• Programmable routersunder control ofVINI sub-aggregate

• GpENI standard software– Quagga– XORP currently being integrated– OpenFlow under investigation– Click possible

• Site-specific routers• Each cluster has at least 2 programmable routers

– geni‐router‐n.⟨institution⟩.gpeni.net

lightpathVLAN

topologyrouter

photonics

PlanetLab

Gush, Raven

site-specific

GpENI ProgrammabilityNetwork Topology

• VINI sub-aggregate:middle layer programmability– topology and router control

• PlanetLab with Trellis extensions– control of topology slices– eventual merge with PL

• Control located at UMKC: geni‐myvini.umkc.gpeni.net• Unification of PlanetLab and VINI underway

– by Princeton PlanetLab group– GpENI now has integrated portal

lightpathVLAN

topologyrouter

photonics

PlanetLab

Gush, Raven

site-specific

GpENI ProgrammabilityVLAN and Lightpath Connectivity

• DCN sub-aggregate:lower layer programmability

• DCN: dynamic circuit networkdeveloped by DRAGON– dynamic creation of

VLANs and lightpaths– GpENI port to Netgear GbE switch– MAX port to Ciena CoreDirector optical switch

• MAX + ISI working on DCN GENIwrapper– will enable unification of PlanetLab and DCN sub-aggregates

lightpathVLAN

topologyrouter

photonics

PlanetLab

Gush, Raven

site-specific

GpENI ProgrammabilityPhotonic and RF

• Site-specificlayer-1 programmability

• Edge– testbed attached to GbE switch

• Core– requires optical

GpENI interconnection– virtual connectivity hoped in future

lightpathVLAN

topologyrouter

photonics

PlanetLab

Gush, Raven

site-specific

GpENIPhysical Topology and Network Infrastructure

KSU – KS KU – KS

UMKC – MO

UNL – NE

GpENI CienaCoreDirector

GpENI CienaCN4200

CCD FlarsheimHall

AveryHall

C-bandn λs

KU/Qwestfiber

NicholsHall

RathboneHall

GpENI nodecluster

WTC fiber

KU/Qwestfiber

SFBB fiberEllsworth

HallPowerPlant

QwestPOP

KU/Qwestfiber

Internet2POP

MOREnetfiber Newcomb

Ethernet

ScottCenter

UNL (L3)fiber

splicepatch

to Smith Ctr. KS (eventual link to CO)

dark fiber

C-bandn λs

• Midwest backbone (phase 3)– multiwavelength optical backbone

• current or imminent deployment

– 4 universities in 3 states• 1 switch/year with current funding

new nodes

GpENILayer 2 Connectivity (mid phase 1)

rapidlyevolving

• Regional GpENI partners: 11– Principal partners

• KU, KSU, UMKC, UNL, IIT

– South Dakota: 3 universities• DSU, SDSMT, USD

– Missouri: UMC– GMOC at Indiana University– Canada

• Waterloo

KSUKU UMKC

GpENIMidwest Expansion

Europe

AsiaIU GMOC

Waterloo

Bucharest

Bilkent

Internet2DANTE

Passau

Lancaster

UC DublinHEAnet

UPCBarcelona

Tampere UT

UppsalaSICS

NORDUnet

Skt. PeterburgIIRAS

TKK Helsinki

Warszawa

GÉANT2

KTH Stockholm

U-ZürichKonstanz

München

GpENIEuropean Expansion

Moscow

SWITCH

Karlstads

ISCTELisboa

KSUKU UMKC

UMC IUAsia IU GMOC

Karlsruhe

Cambridge

toBeijing

Simula

• European GpENI partners– 13 nations– 24 research institutions– ~120 nodes– more under discussion

Kaiserslautern

GpENIAsian Expansion

POSTECH

IIT Mumbai

IISc Bangalore

IIT Guwahati

Internet2

CUC Beijing

Europe

KSUKU UMKC

UMC IUAsia IU GMOC

• Asian GpENI partners– 3 nations– 5 research institutions– 25 nodes– more under discussion

GpENINode Cluster Status1

• Midwest backbone nodes– PlanetLab and VINI operational– UNL switch installed; KU switch this year

• GENI interconnection– physical connection to ProtoGENI in KC I2 POP– connection to MAX– L2TPv3 tunnel to GMOC: gmoc.gpeni.net

• British Iles and Iberia– L2TPv3 tunnel to Lancaster to…

• JANET wavelength to Cambridge (first European node up)• L2TPv3 tunnel to UPC Barcelona (up); ISCTE Lisboa (soon)

• Switzerland, Germany, and Austria– L2TPv3 tunnel to Bern to…

• ETH Zürich (may provide additional fan-out)

– L2TPv3 tunnel to Kaiserslautern / GLab to…• OpenVPN (experimental) to TUMünchen

– L2TPv3 tunnel to Karlsruhe (temporary)

• Nordic and Russia– L2TPv3 tunnel to Simula Norway to…

• Tampere (up)• Karlstad (up)

• European GpENI meeting this year– need UK – Germany/Switzerland/Austria – Nordic backbone

• Asia– IIT Guwahati (soon)

GpENIAggregate Status: PlanetLab

• PlanetLab sub-aggregate (KSU)– MyPLC 4.3– GENIwrapper 8.5 SFA– federated with Princeton PLC

• OpenFlow integration under investigation • Loop demo publicly available (but still fragile)• PlanetLab / VINI sub-aggregate integration

– integrated portal available– waiting for Princeton PL/VINI integration

GpENIAggregate Status: Programmable Router

• Programmable router sub-aggregate (UMKC)• VINI installed

– UMKC will be beta site for 5.0 to unify with PlanetLab

• Quagga running, tested with OSPF and Zebra– currently working on sliceability

• XORP integration underway• Integrating topology creation in map demo

GpENIAggregate Status: DCN Optical Control Plane

• Optical switch sub-aggregate (UNL)– UNL switch installed; KU next

• DCN running on Ciena CoreDirectorand Netgearswitch

• Connectionestablished toMAX through ProtoGENI– interdomain

GpENIStatus: Overall Management

• Overall management, monitoring, administration (KU)• L2TPv3 tunnels coming up

– complex planning given meager funding– working with European partners to provide fanout

• UK, Switzerland, Austria/Germany, Nordic/Russia, Asia

• International optical discussions soon• Nagios management interface begin developed• GMOC node cluster installed

– should provide integration with overall GENI monitoring

• TRIDENTCOM 2010 paper

GpENIStatus: Application and User Community

• Tools– experiment control: Gush running now– code deployment: Raven running now– suggestions for other tools welcome

• User access– Limited access to wider community; Web-based request form– Seattle running

• GpENI community will likely be the first real users– FIND PoMo, EU FIRE ResumeNet, project clearinghouse soon– …but others welcome (build it and they will come?)

• the road to hell is paved with unused testbeds

GpENIStatus: Experiments

• ResiliNets / ResumeNet experiments planned soon– NSF GEW Eager– Resilience and survivability at scale– GpENI WAN + ProtoGENI access networks

• European experiment planning soon

GpENI Node ClusterSystems Software Status

• PlanetLab sub-aggregate (KSU)– MyPLC 4.3 with GENIwrapper SFA federated with PlanetLab

• Programmable router sub-aggregate (UMKC)– VINI installed; will be beta for 5.0 to unify with PlanetLab– Quagga running, XORP integration in progress

• Optical switch sub-aggregate (UNL)– UNL switch installed; KU in summer 2010– DCN running on Ciena CoreDirector and Netgear Enet– coördinating with MAX for interdomain DCN

• Overall management, monitoring, administration (KU)

GpENIUser and Application Status

• Experiment control: Gush running now• Code deployment: Raven running now• User access: external access requests considered• Demo publicly available: control‐1.ksu.gpeni.net/demo

GpENIExperiment Plans

• PoMo: NSF FIND PostModern Internet Architecture– exploring resilient transport over heterogeneous realms

• ResumeNet: EU FIREResilinece and Survivability for Future Networking– GpENI is one of the testbeds– provide ability to experiment with

• new protocols• while investigating topologies and injecting failures

• Other activities– participating in NSF GENI experimenter’s workshop– GpENI clearinghouse for international collaborations

GpENIExperiment Example

• Resilience of network when challenged– cross-verification with KU-LoCGen/TacGen

Network Experimentation with GpENINetwork Monitoring

GpENIMonitoring via Nagios1

• Nagios provides instantaneous view of the GpENI net.

GpENIMonitoring via Nagios2

• http://control‐1.ku.gpeni.net/nagios

GpENINetwork Resource Monitoring via Cacti

• http://control‐1.ku.gpeni.net/cacti

Network Experimentation with GpENIReferences

• James P.G. Sterbenz et. al.“The Great Plains Environment for Network Innovation (GpENI): A Programmable Testbed for Future Internet Architecture Research,”Proc. of TridentCom, Berlin, May 2010, pp. 428 – 441

• R. Cherukuri, X. Liu, A. Bavier, J.P.G. Sterbenz, D. Medhi, “Network Virtualization in GpENI: Framework, Implementation & Integration Experience,” Proc. of IEEE ManFI, Dublin, May 2011

• http://www.gpeni.net

Network Experimentation with GpENIAcknowledgements

• Justin P. Rohrer @KU for Nagios, Cacti, and PlanetLab support• Xuan Liu @ UMKC for MyVINI support

ittc communication networks laboratoryjpgs/courses/nets/lecture... · communication networks...

Documents

ittc © james p.g. sterbenz communication...

06ec-71 computer communication networks - … computer...

ittc © james p.g. sterbenz communication...

fundamentals and design principles - sterbenz

session: leadership commitment doug sterbenz

communication networks

mobile communication networks and digital television ... ·...

doug sterbenz closing remarks

resilience, survivability, heteorgeneity in postmodern ......

self-optimising millimeter mesh networks: architecture...

ittc © james p.g. sterbenz communication networks

ittc © james p.g. sterbenz communication...

ittc © james p.g. sterbenz communication...

towards resilient networks using programmable networking...

doug sterbenz

1 communication networks chapter 1 : introduction to...

resilience and survivability in communication networks:...

ittc © james p.g. sterbenz introduction to communication...

flow robustness of multilevel networks - ku ittc robustness...

ittc © james p.g. sterbenz science of communication...