geni exploring networks of the future

Sponsored by the National Science Foundation

GENIExploring Networks of the Future

www.geni.net

Sponsored by the National Science Foundation 2GENI Introduction – 27 October 2013 www.geni.net

Outline

• GENI – Exploring future internets at scale• The GENI Concept• Building GENI• Experimental and Classroom use of GENI• What’s next for GENI?• GENI: An experimenter’s view


Credit: MONET Group at UIUC

Society IssuesWe increasingly rely on

the Internet but are unsure we can trust its

security, privacy or resilience

Science IssuesWe cannot currently

understand or predict the behavior of complex,large-scale networks

Innovation IssuesSubstantial barriers to

at-scale experimentation with new architectures, services,

and technologies

Global networks are creatingextremely important new challenges


GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.


Multiple GENI Experiments run Concurrently

Resources can be shared

between slices

Experiments live in isolated “slices”


GENI is “Deeply Programmable”

I install software I want throughout my network slice (into routers, switches, …) or control

switches using OpenFlow

Experimenters can set up custom topologies, protocols and switching of flows


GENI Compute Resources

GENI Racks

Existing Testbeds(e.g. Emulab)

GENI Wireless compute nodes


GENI Networking Resources

Networking within a Rack

National Research Backbones(e.g. Internet2)

Regional Networks(e.g. CENIC)

WiMAX Base Stations


Outline



“I have a great idea.”

“That will never work.”

A bright idea


Let’s try it out!

My new architecture worked great in the lab, so now I’m going to try a larger experiment for a few months.

He uses a modest slice of GENI, sharing its infrastructure with many other concurrent experiments.


It turns into a really good idea

His slice of GENI keeps growing, but GENI is still running many other concurrent experiments.

This service looks very useful


“Looks like an app to me.”

“It’s my very own GENI slice.”

Attracts real users


“Boy did I learn a lot!”

“What a cool service.”(I wonder how it works.)

“I always said it was a great idea.”

(But way too conservative.)


If you have a great idea, check out theNSF CISE research programs for current opportunities.

??


Moral of this story

GENI is meant to enable . . .– At-scale experiments– Internet-incompatible experiments– Both repeatable and “in the wild”

experiments– ‘Opt in’ for real users– Instrumentation and measurement

tools

GENI creates a huge opportunity for ambitious research!


Outline



Growing GENI’s footprint


FederationGENI grows by GENI-enabling heterogeneous infrastructure

Avoid technology “lock in” and grow quickly by incorporating existing infrastructure

Backbone #1

Regional

GENI Rack

GENI Rack

Access#1

CommercialClouds

CorporateGENI suites

Non-USTestbeds

ResearchTestbed

Campus

My experiment runs acrossthe evolving GENI federation.

My GENI Slice

This approach looks remarkably familiar . . .


“At scale” GENI prototype

Campus photo by Vonbloompasha

Build GENI at sufficient scale

Infeasible to build a testbed as big as the Internet

GENI-enabled campuses,students as early adopters

HP ProCurve 5400 Switch

NEC WiMAX Base Station

GENI-enabledequipment

GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks


GENI architecture

• Flexible network / cloud research infrastructure

• Also suitable for physics, genomics, other domain science

• Support “hybrid circuit” model plus much more (OpenFlow)

• Distributed cloud (racks) for content caching, acceleration, etc.

MetroResearch

Backbones

InternetISPU N I V E R S I T YU N I V E R S I T Y

U N I V E R S I T YU N I V E R S I T Y

Regional Networks Campus

g

g

gLegend

GENI-enabled hardware

Layer 3Control Plane

Layer 2Data Plane


Toroki LightSwitch 4810

Georgia Tech: a great example

Nick FeamsterPI

Russ Clark, GT-RNOC

Ellen Zegura

Ron Hutchins, OIT

• OpenFlow in 4 GT lab buildings now

• Aware Home

• Students will “live in the future” – Internet in one slice, multiple future internets in additional slices

Trials of “GENI-enabled” commercial equipment

Arista 7124S Switch

HP ProCurve 5400 Switch Juniper MX240 EthernetServices Router

NEC IP8800 Ethernet Switch

NEC WiMAX Base Station HTC Android smart phone

GENI racks


Example regional networkCENIC OpenFlow buildout


GENI on Internet2 A major step towards campus expansion

• Collaboration to implement national-scale infrastructure– sliced and deeply-programmable– incorporating OpenFlow/SDN switches, GENI Racks, etc.– high-speed (10-100 Gbps)

• With software that supports shared use by faculty, students, and campus IT organizations

• In-progress migration from “prototype GENI” to AL2S production system

• Scaling to an envisioned goal of 100-200 GENI campuses

• ION AM to support dynamic provisioning within Internet2


GENI WiMAX Agreements

• Agreement with Clearwire– Clearwire and Rutgers University have signed a master agreement– encompassing all WiMAX sites, to ensure operation in the EBS Band.– An emergency stop procedure, in case of interference with Clearwire

service, has been agreed upon.

• GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and

operate an (MVNO) that serves the academic research community- The effort is led by Jim Martin, Clemson Univ, and is underway with

a 1 year NSF EAGER

Wimax Developer sessionMon: 11am – 12:30pm


GENI Operations

GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation• Monitors most GENI Aggregates

GMOC Google Calendar keeps track of reservations/outages


Current GENI buildout

• More WiMAX base stationswith Android handsets

• GENI-enable 5-6regional networks

• Inject moreOpenFlow switchesinto Internet2 and NLR

• Add GENI Racks to 50-80 locationswithin campuses, regionals, andbackbone networks

GENI Racks serve as programmable routers, distributed clouds, content

distribution nodes, caching or transcoding nodes, etc


Creating and deploying GENI racks

ExoGENI RackInstalled at GPO – Feb 22, 2012

Ilia BaldineRENCIMore resources / rack,fewer racks

Rick McGeerHP Labs

Fewer resources / rack,more racks


GENI WiMAX 2013

• Researcher-owned,• researcher-operated• 4G cellular systems

• 26 Wimax Base Stations in 13 Sites

• Sliced, virtualized and interconnected

On the AirNot On the Air


Outline

• GENI – Exploring future internets at scale• The GENI Concept• Building GENI• Experimental and Classroom use of GENI• Classroom use of GENI• What’s next for GENI?• GENI: An experimenter’s view


Rapid growth in experimentation

GENI tools being developed support complex experiments

• GENI is gaining tractions with experimenters- More experimenters sign up (> 1000)- More experimenters are actively using GENI

• GENI expansion creates opportunities for experienced experimenters to create complex experiments- Better tools to manage

experiments- Tools to monitor - Support of services running

in GENI


ActiveCDNColumbia University

ActiveCDNActiveCDN

KansasUtah

Clemson

Benefits of ActiveCDN:• Dynamic deployment based on load• Localized services such as weather, ads and news

GPO

Jae Woo Lee, Jan Janak, Roberto Francescangeli, SumanSrinivasan, Eric Liu, Michael Kester, SalmanBaset,

Wonsang Song, and Henning SchulzrinneInternet Real-Time Lab, Columbia University

Program content distribution services deep into the network, adapt distribution in real

time as demand shifts


Multi-radar NetCDF Data

Nowcast Processing

1. Spin up system in Amazon commercial EC2 and S3 services on demand

“raw” live data

Generate “raw” live dataViSE/CASA radar nodes

http://stb.ece.uprm.edu/current.jsp

ViSE views steerable radars as shared, virtualized resourceshttp://geni.cs.umass.edu/vise

Nowcast images for display

Weather NowCastingUniversity of Massachusetts

David Irwin et al

Create and run realtime “weather service on demand”as storms turn life-threatening


Virtual Desktop Cloud

Prasad Calyam, Ohio State

Program realtime load-balancing functionality

deep into the network to improve QoE


MobilityFirst: Rutgers et al.

Nikhil Handigol et al, Stanford Univ.

Look for their demo today!Live demo at the plenary tomorrow!

Dipankar (Ray) Raychaudhuri, Rutgers,

leads MobilityFirst

MF Arch is designed to meet emerging mobile/wireless service

requirements at scale


eXpressive Internet Architecture (XIA) CMU, BU, Wisconsin

Nikhil Handigol et al, Stanford Univ.

XIA exploring three concepts to address issues:• Diverse types of end-points• Intrinsic security• Flexible addressing

Peter Steenkiste, CMU leads XIA team


ts

Research Infrastructurefor Computer Scientists

Public-Private Partnershipfor Next-Gen Applications

Future commercialofferings

US Ignite promotes advanced applications and infrastructure leveraging GENI research and technologies.

CS Experiments

Experimental Usage and Demonstrations

Pre-commercial Applications

Regional and backbone networks

Campus and LabApplied Research

Campus networks Municipal andcommercial networks

App creation teams

GENI members, policies, … US Ignite members, policies, …

GE

NI t

echn

olog

y

federation

Service creators

Commercial Applications

GENI US Ignite

CS Research

US Ignite: Builds application of the future


GENI in the Classroom

• Undergrad Classes– Reinforce learning of key concepts

• Graduate classes– Hands-on experience of advanced concepts– Project in GENI

• Classes in:– Computer Networking, Wireless and Mobile

Networking, Distributed Systems, Cloud Computing


Workshops and journalsUsing GENI for research and education

• Special issue on Future Internet Testbeds – Computer Networks, – James P. G. Sterbenz et al, eds. (coming up)

• GENI in Education workshop, Oct 2013– Jay Aikat, UNC, Jeannie Albrecht, Williams

• Curricula for Undergraduate Courses in Distributed Systems– Jeannie Albrecht, Williams

• GENI Research and Educational Experiment Workshop 2013– Kaiqi Xiong, RIT

• TridentCom 2012: Testbeds, Experimentation and Innovation for the Future Internet– Thanassis Korakis, NYU Poly

3rd GREE Workshop on March 2014Submission deadline January 10th


GENI Training

• Tutorials in major conferences– SIGMETRICS, NSDI, ICDCS, TridentCom, SIGCSE– Coming up: SIGCSE 2014, IC2E 2014

• Tutorials at GENI Engineering Conferences

• GENI Camps– 5 days of training– attendees work on their projects

• Online Seminars– Train the TA sessions– Coming up: Train the TA for Spring semester


Outline



GENI campus expansion

“GENI-enabled” means . . .OpenFlow + GENI racks, plus WiMAX on some campuses

Dr. Larry Landweber, U. Wisconsin

Growing Waiting List!


Looking forward

• Building sophisticated tools to support complex experiments:– Setup and manage complex topologies– Monitor and archive experiments

• Expand classroom use of GENI– New documentation and training Projects

• Shakedown Experiments– Run services in GENI (BoF on Monday)– Use of GENI in other domain sciences

• Transition to community governance

Developing GENI Tools Mon 4-5:30pm

Shakedown ExperimentsTue 8:30-10:30 am


Federation Extends the Reach of GENI and International Peer Testbeds

Initial plan to federate testbeds on five continentsCome and see the demo in the plenary!


Outline



GENI: Terms and Definitions

– An experiment uses resources in a slice

– Slices isolate experiments

– Experimenters are responsible for their slices

SliceAbstraction for a collection of resources capable of running experiments


Slice credentials


• Slice authority: Creates and registers slices– GENI slice authorities: PlanetLab, ProtoGENI, GPO Lab

• Aggregate: Provides resources to GENI experimenters– Typically owned and managed by an organization– Examples: PlanetLab, Emulab, GENI Rack on various campuses– Aggregates implement the GENI AM API

Create & Register Slice

Researcher

SliceAuthority

Aggregate Manager API - listResources - createSliver … Aggregate

ManagerAggregate Resources



• Sliver: One or more resources provided by an aggregate– E.g. Bare machines, virtual machines, VLANs

Backbone #1

Backbone #2

Campus#3

Campus#2

Access#1

CommercialClouds

CorporateGENI suites

Other-NationProjects

ResearchTestbed

Campus My GENI Slice

My slice contains slivers from many aggregates.


RSpecs

• RSpecs: Lingua franca for describing and requesting resources– “Machine language” for negotiating resources between experiment

and aggregate– Experimenter tools eliminate the need for most experimenters to

write or read RSpec

<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node></rspec> RSpec for requesting a single node


Sliver Creation using Rspecs and the AM API

• Advertisement RSpec: What does an aggregate have?• Request RSpec: What does the experimenter want?• Manifest RSpec: What does the experimenter have?

AggregateManager

Client

ListResources(…)

Advertisement RSpec

CreateSliver(Request RSpec, …)

Manifest RSpec

ListResources(SliceName, …)

Manifest RSpec


Putting it all Together: Demo

• Demo– Create a slice– Create a sliver at one

aggregate• Two computers (raw PCs),

connected by a LAN– Install and run software

on the machines– View output of software– Delete sliver

• Experimenter tool: Flack

server(raw PC)

client(raw PC)


Start Demo

• Login to GENI Experimenter Portal• Create slice• Launch Flack• Draw topology• Create sliver• Verify sliver creation was successful


The Demo Experiment in Flack


The Request Rspec

<rspec type="request” xsi:schemaLocation=“http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/request.xsd” xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.geni.net/resources/rspec/3"> <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true"> <sliver_type name="raw-pc"> <disk_image name="urn:publicid:IDN+emulab.net+image+emulab-ops//FEDORA10-STD"/> </sliver_type> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> </services> <interface client_id="server:if0” /> </node> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false"> <sliver_type name="emulab-openvz"/> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> </services> <interface client_id="client:if0” /> </node> <link client_id="Lan"> <component_manager name="urn:publicid:IDN+emulab.net+authority+cm"/> <interface_ref client_id="server:if0"/> <interface_ref client_id="client:if0"/> <property source_id="server:if0" dest_id="client:if0"/> <property source_id="client:if0" dest_id="server:if0"/> </link></rspec>


The Manifest Rspec<rspec type="manifest" …> <node client_id="server" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="true" component_id="urn:publicid:IDN+emulab.net+node+pc554" sliver_id="urn:publicid:IDN+emulab.net+sliver+95506"> <sliver_type name="raw-pc"> <disk_image name="urn:publicid:IDN+emulab.net+image+emulab-ops//FEDORA10-STD"/> </sliver_type> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> <login authentication="ssh-keys" hostname="pc554.emulab.net" port="22" username="vthomas"/> </services> <interface client_id="server:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc554:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95509" mac_address="0024e87a46fb"> <ip address="10.10.1.1" type="ipv4"/> </interface> </node> <node client_id="client" component_manager_id="urn:publicid:IDN+emulab.net+authority+cm" exclusive="false" component_id="urn:publicid:IDN+emulab.net+node+pc533" sliver_id="urn:publicid:IDN+emulab.net+sliver+95505"> <sliver_type name="emulab-openvz"/> <services> <execute command="sudo /local/install-script.sh" shell="sh"/> <install install_path="/local" url="http://www.gpolab.bbn.com/experiment-support/HelloGENI//hellogeni-install.tar.gz"/> <login authentication="ssh-keys" hostname="pc533.emulab.net" port="37178" username="vthomas"/> </services> <interface client_id="client:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc533:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95510" mac_address="0262331adfd4"> <ip address="10.10.1.2" type="ipv4"/> </interface> </node> <link client_id="Lan" sliver_id="urn:publicid:IDN+emulab.net+sliver+95508" vlantag="310"> <interface_ref client_id="server:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc554:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95509"/> <interface_ref client_id="client:if0" component_id="urn:publicid:IDN+emulab.net+interface+pc533:eth2" sliver_id="urn:publicid:IDN+emulab.net+sliver+95510"/> <property source_id="server:if0" dest_id="client:if0"/> <property source_id="client:if0" dest_id="server:if0"/> </link></rspec>


Do Try This at Home!

• Tutorials on the GENI wiki– Look for the icon on the GENI wiki and then click on for tutorials

• Participate in the hands-on tutorials at the GEC

• Get a GENI account today!


Student need a professor to create a GENI project

Get a GENI Account Today!

At the GEC: - Experimenter Help Desk - Experimenter drop-in on Mon - Coding sprint on Tue

Online: https://portal.geni.net

Email: [email protected]


Agenda Guide


Birds – of feather dinners

Tomorrow Monday@6pm:• GENI in education• Instrumentation and Measurements• GENI Education and Research workshop• Long running Experiments and Services

in GENI

All is welcome, join us if you are interested!


GENI Engineering ConferencesWe welcome your participation in GENI

• 19th meeting, open to all:March 17-19, 2014, Georgia Tech Atlanta– Planning & discussion for experimenters, software, infrastructure– Tutorials and workshops – Travel grants to US academics for participant diversity


QUESTIONS?

geni exploring networks of the future

Documents

geni introduction

experimentation geni

multiple geni experiments

open innovation

novel applications

topologies protocols

custom topologies

new architectures