sponsored by the national science foundation getting started with your own experiment sarah edwards,...

Sponsored by the National Science Foundation

Getting Started With Your Own Experiment

Sarah Edwards,

GENI Project Office


GENI Accounts and Projects

Advice and Intermediate Topics

Getting Help / Learning More


Sponsored by the National Science Foundation 3IC2E ‘14 – March 10, 2014

Access to GENI

For many experimenters:• no new passwords• familiar login screens

Leverage InCommon forsingle sign-on authentication

Experimenters from 342 educational and research institutions have InCommon accounts

GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.


Projects

Projects organize research in GENI

Projects contain both people and their experiments

A project is led by a single responsible individual: the project lead

Project

Lead

Members

Slice


Project Membership example

Projects have 1 Lead and any number of Admins, Members, and Auditors

http://groups.geni.net/geni/wiki/GENIConcepts#Project

Typical Class

Expiration

Typical Research Project


Populating a Project

1. Member-initiated Each experimenter asks to join a project, approval needed

• Typical for Research projects

2. Admin-initiated Project Lead/Admin bulk-adds experimenters

• Typical for Classrooms or Tutorials


Slice Membership exampleSlices have:

• 1 Lead (person who created the slice)• any number of Admins, Members, and Auditors• Project Lead/Admins added as slice Admins

http://groups.geni.net/geni/wiki/GENIConcepts#Slice

Research AsstSlice Lead

Research AsstSlice Lead

Post-DocSlice Member

ProfessorSlice Admin

ProfessorSlice Admin


Slice Access

Being a member of a slice means you can act on a slice:– Add resources– Check status– Delete resources– Renew resources

With any tool!



Intermediate Topics

Getting Help / Learning More



Designing your experiment

• Decide on compute resources (raw PCs, VMs, memory, etc)

• Decide on networking needs

• Start small– Debug your experiment is small,

isolated topologies that you control all pieces


GENI Compute Resources

ExoGENI, InstaGENI, ProtoGENI are they different and how do I choose?

The important thing is your experiment, so you should always start by designing your experiment

and don’t worry about the aggregate.

ExoGENI, InstaGENI: GENI racks developed by different teams

ProtoGENI: Pre-existing testbeds that are GENI enabled, InstaGENI is based on ProtoGENI software


Inter-aggregate Links

• Stitching– Creates an inter-domain VLAN– Stitcher: Distributed with gcf/omni– Flukes: ExoGENI-only (not via GENI AM API)

• GRE tunnels over control interface– Use Flack to connect IG nodes via a GRE tunnel– Manually configure GRE tunnels between EG nodes

• Shared VLANs– Some pre-configured inter-domain shared VLANs are

available– Some are OpenFlow-enabled


Running your experiment

• Automate your experiment– Make it easy to bring up and run it

• Save the Rspec

• Backup your software– Resources can expire

– Nodes may fail

– Aggregates might go on maintanance


Reproducible Experiments

• Two approaches:– Use existing images with install scripts

http://groups.geni.net/geni/wiki/HowTo/WriteInstallScript

– Use custom images or snapshots• Image creation

– ExoGENI provides a sandbox for image creation• Snapshot images

– InstaGENI provides standard images which are easy to snapshot

Snapshot image: http://groups.geni.net/geni/wiki/HowTo/ManageCustomImagesIns

taGENI

• … or combine the two approaches


Disruptive experiments

Experiments:• with high resource constraints

– e.g. high bandwidth, many compute resources

• OpenFlow experiments with “risky” topologies– e.g with loops traversing national backbones

• requiring performance isolation

Notify resource owners and the community


GMOC

GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation

http://groups.geni.net/geni/wiki/HowTo/PreReserveGENIResources

GMOC Google Calendar keeps track of reservations/outages




Getting Help / Learning More Getting Help / Learning More


Answer is

[email protected]

Have a question?

Sarah Edwards Niky Riga Vic Thomas

which is an email list which only goes to members of the GPO including…

(However, the archive of the list is public)


Ways to Get Help

• Sign Up for :

[email protected]

• Use #geni IRC chatroom

• Go over HowTo pages

http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp

mailto:[email protected]


General debug advice

1. Gather as much information as you can– Be specific about what is not working

• Step-by-step run through usually helps

– Include what you see (screenshots, omni output errors)– Always include:

• type of account you are using (eg portal)• the tool you are using (eg Flack, omni, portal)• your slice name or URN • aggregates you are using• a detailed description of what's wrong including any error messages

2. Contact [email protected] for help

3. Register for resource mailing lists


Finding other resources

• GENI wiki– Pages for Instructors and Experimenters

http://groups.geni.net/geni/wiki


Popular Samples

Tutorials:• Lab Zero

Basic GENI understanding, ensures students setup their environment

http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/GettingStarted_PartI

• Intro To OpenFlowBasic OpenFlow introductory tutorial, students learn how to setup OVS and write simple controllers

http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/OpenFlowOVS

Assignments: • IPv4 Routing

Students understand IPv4 forwarding and how to configure static routes

http://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments/IPRouting/Procedure

• TCP Network AwarenessStudents explore different TCP flavors and TCP parameters

http://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments/TcpAssignment

http://groups.geni.net/geni/wiki/GENIExperimenter/ExampleExperimentshttp://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments


“How To” pages

• Listed under the “Experimenters” section

• Each “How To” is a short descriptions of how to do various tasks

• New entries being added all the time


Ways to Learn MoreSign up for [email protected] to be notified about:• GENI Engineering Conferences, 3x/year, open to all:

– Planning & discussion for experimenters, software, infrastructure– Tutorials and workshops – Travel grants to US academics for participant diversity– GEC19 March 17-19, 2014, Georgia Tech, Atlanta

• GENI Summer Camp • Train-the-TA at the start of each semester (online-only)

Sign up at: http://lists.geni.net/mailman/listinfo/geni-announce


http://tinyurl.com/GENI-IC2E14

Thank you for attending!

Please fill out the survey

http://tinyurl.com/GENI-IC2E14


Backup


Solutions to Common Problems


Common Problems

Problem: Resources disappeared

Possible causes: – Slice expired– Resources (aka slivers) expired

Debug strategy:– Check slice/sliver status– Reserve resources again if expired – Don’t rely on nodes for storage

• Edit scripts locally and scp to your nodes• Copy data off machines


Expiration and renewal

slice expiration time ≤ project expiration time

each resource expiration time ≤ slice expiration time

each resource expiration time ≤ aggregate’s max expiration

project

slice

resource

(optional)project

expiration timeslice

expiration timeresource

expiration timenow

In general, to extend the lifetime of your resource reservation, you must renew the slice and all resources

resourceresource


Extend slice/resource expirations

Slice and Sliver Expiration

$ omni renewslice 01-31-14$ omni renewsliver –a gpo-ig myslice 01-31-14$ omni renewsliver –a renci-eg myslice 01-31-14$ omni renewsliver –a missouri-ig myslice 01-31-14


Common Problems

Problem: Can’t login to a node

Possible causes: – Wrong username– Public key isn’t loaded / Private key is wrong or non-existing– Private key has wrong permissions (it should have 0600)– Slice/sliver expired– Technical issue with node

Debug strategy:– Ask another member of the slice to login to the node

• If successful look for your account – cd ..; ls

• Look for loaded keys – sudo cat <user_path>/.ssh/authorized_keys

– Ask them to use ‘-v’ option• ssh –v [email protected]


Common Problems

Problem: Can’t access AMs

Possible causes: – Firewall issues– AM is down

Debug strategy:– Check the GMOC calendars for planned/unplanned outages

http://globalnoc.iu.edu/gmoc/index/support/gmoc-operations-calendars.html

– Try to telnet to the port:• e.g. telnet www.emulab.net 12369• Complete list of ports: http://groups.geni.net/geni/wiki/KnownGENIPorts

– Frequent issues on Campus Guest WiFi networks

http://groups.geni.net/geni/wiki/KnownGENIPorts




Common Problems

Problem: Slice did not come up (“not green”)

Possible causes: – Did not wait long enough– Problem with RSpec

Debug strategy:– Check slice/sliver status– Use rspeclint on your rspecs

http://www.protogeni.net/wiki/RSpecDebugging

sponsored by the national science foundation getting started with your own experiment sarah edwards,...

Documents

project names

project leads

permanenta project

experimentsa project

geni projects

geni accounts

calend projects

projects advice