sponsored by the national science foundation gmoc support for geni racks kevin bohan, gmoc eldar...
TRANSCRIPT
![Page 1: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/1.jpg)
Sponsored by the National Science Foundation
GMOC Support for GENI Racks
Kevin Bohan, GMOC
Eldar Urumbaev, GMOC
![Page 2: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/2.jpg)
Sponsored by the National Science Foundation 2October 24, 2012
Topics
• Meta-Operations Overview• What’s Changed• Code Examples• What’s Connected• Future Directions
![Page 3: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/3.jpg)
Sponsored by the National Science Foundation 3October 24, 2012
Introduction
• Core set of operational data needed to jointly run the network
• Monitoring of aggregates, resources, and circuits that make up GENI
• Display operational data in a web UI– For Operators– For Experimenters
• Orchestrate Emergency Stop
![Page 4: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/4.jpg)
Sponsored by the National Science Foundation 4October 24, 2012
Meta-Operations Model
Campus ACampus AAggregates/Resources
Meta-operationsDatabase
Slice AuthoritySlice Sliver
Resource
SliverResource
Slice
User Interface
![Page 5: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/5.jpg)
Sponsored by the National Science Foundation 5October 24, 2012
What’s Changed
• API called GMOC Objects– Makes it easier to report data to GMOC– Python module
• Use of URNs• Aggregate Naming• Support for Circuits
![Page 6: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/6.jpg)
Sponsored by the National Science Foundation 6October 24, 2012
GMOC Objects
• Models the state of things in GENI• Loosely couples submission of metadata and
time-series data• Allows partial data submission• Can be instantiated anywhere• Much easier to use than previous solutions
![Page 7: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/7.jpg)
Sponsored by the National Science Foundation 7October 24, 2012
Modeled Network Elements
• POP• Organization• Aggregate• Sliver• Resource• Interface
– IPv4, IPv6, MAC address
– VLANs
• Slice Authority• Slice• Network• Circuit
– Endpoint interfaces– Circuit type
• 1/10/40/100 Gigabit Ethernet
• 802.11• WiMAX
– Provisioned bandwidth
![Page 8: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/8.jpg)
Sponsored by the National Science Foundation 8October 24, 2012
Operational Measurement Objects
• CPUUtilization• VMCount• TargetPingable• AMAPIListResources• AMAPIGetVersion
• DiskUtilization• OpenFlowSliverStats• SliverState• DatapathStats• NetworkStats
![Page 9: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/9.jpg)
Sponsored by the National Science Foundation 9October 24, 2012
Changing Aggregate State
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
agg.state = gmoc.AM_STATE_DOWNclient.store(agg)
![Page 10: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/10.jpg)
Sponsored by the National Science Foundation 10October 24, 2012
Adding a Resource
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
res = gmoc.Resource(“urn:publicid:IDN+openflow:foam:foam7.gpolab.bbn.com+datapath+04:4d:00:12:e2:b8:a5:d0”, “datapath”, pop, agg)
client.store(agg)
![Page 11: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/11.jpg)
Sponsored by the National Science Foundation 11October 24, 2012
Manual Measurements
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
cpu = CPUUtilization()cpu.addData(1349725335, { "cpu_idle": 3.1 })
agg.addMeasurement(cpu)
client.storeMeasurement(pop)
![Page 12: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/12.jpg)
Sponsored by the National Science Foundation 12October 24, 2012
Measurement from RRDs
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
cpu = CPUUtilization()cpu.loadRRD(”/array/moxifoam_node_cpu_idle.rrd”, 1318102932, 1349729656)
agg.addMeasurement(cpu)
client.storeMeasurement(pop)
![Page 13: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/13.jpg)
Sponsored by the National Science Foundation 13October 24, 2012
What’s Connected?
• 20 FOAM aggregates• pgeni SA• GENI Clearinghouse & Portal• ExoGENI
– Metadata– Operational monitoring
• InstaGENI– Metadata– Some operational monitoring
![Page 14: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/14.jpg)
Sponsored by the National Science Foundation 14October 24, 2012
GMOC UI Screenshot
![Page 15: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/15.jpg)
Sponsored by the National Science Foundation 15October 24, 2012
Future Directions?
• Populate the API with data from GMOC– Query current operational data about GENI things
• More measurements• RSpec parser/generator
– Monitoring extension
• Additional languages?• Integration with Active Measurement projects• Use Circuit data operationally
![Page 16: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/16.jpg)
Sponsored by the National Science Foundation 16October 24, 2012
GMOC Support for GENI Racks
• Campus/Racks Team contacts GMOC to announce Outage or upcoming Maintenance- Initially important to include very specific information
(Campus, type of outage/maintenance, what’s affected, outage/maintenance times, who’s working to perform maintenance or resolving an outage, ETR, etc…)
- Eventually through pro-active monitoring. - Contact GMOC as Racks come up.
![Page 17: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/17.jpg)
Sponsored by the National Science Foundation 17October 24, 2012
GMOC Support for GENI Racks
• GMOC tracks racks/campus events and notifies the GENI community:– Initially through the GENI Ops list and Ops Calendars
(Web, RSS, iCal)– Long-term goal is to notify individual GENI
Experimenters via targeted notifications based on which Aggregate is affected and slice ownership
![Page 18: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/18.jpg)
Sponsored by the National Science Foundation 18October 24, 2012
GMOC Operations Calendars
![Page 19: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/19.jpg)
Sponsored by the National Science Foundation 19October 24, 2012
Contact GMOC
• Email: [email protected]• Phone: 317-274-7783• Website: http://gmoc.grnoc.iu.edu• GENI Ops Calendars (Web, RSS, iCal):
http://gmoc.grnoc.iu.edu/gmoc/index/support/gmoc-operations-calendars.html
• GENI Bi-Weekly Operations Report: http://gmoc.grnoc.iu.edu/gmoc/index/support/gmoc-reports/gmoc-reports.html
![Page 20: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/20.jpg)
Sponsored by the National Science Foundation 20October 24, 2012
Some discussion questions…
• How meaningful are current notifications?• How much does the GENI Community care about
a single rack/campus outage?• How important are notifications targeted to
individual experimenters/operators?• What else is important to the Community?
![Page 21: Sponsored by the National Science Foundation GMOC Support for GENI Racks Kevin Bohan, GMOC Eldar Urumbaev, GMOC](https://reader031.vdocuments.mx/reader031/viewer/2022020219/56649f2a5503460f94c43e78/html5/thumbnails/21.jpg)
Sponsored by the National Science Foundation 21October 24, 2012
Contact & Links
• Kevin Bohan: [email protected]• Eldar Urumbaev: [email protected]
• GMOC Database– https://gmoc-db.grnoc.iu.edu/protected
• GMOC Objects API Reference– https://gmoc-db.grnoc.iu.edu/public_docs/gmoc-objects-v1.p
df
• GMOC Objects Python Implementation– https://gmoc-db.grnoc.iu.edu/public_docs/gmoc.py