sponsored by the national science foundation operational monitoring kevin bohan, gmoc...
TRANSCRIPT
Sponsored by the National Science Foundation 2October 23, 2012
Topics
• GMOC Objects API• Operational Measurement Classes• Code Examples• What’s Reporting• Future Directions
Sponsored by the National Science Foundation 3October 23, 2012
GMOC Objects
• Models the state of things in GENI• Integrates submission of metadata and time-
series data• Allows partial data submission• Can be instantiated anywhere• Currently implemented as a Python module• Easy to use correctly, hard to do it wrong
Sponsored by the National Science Foundation 4October 23, 2012
Easy to Use Correctly
• You don’t have to write XML anymore• You don’t have to remember arcane metric names
or tags or intervals or interval modes– foam5.gpolab.bbn.com-node-cpu_idle-
aggregate_foam5.gpolab.bbn.com
• You don’t have to call multiple scripts for different pieces of data
Sponsored by the National Science Foundation 5October 23, 2012
Hard To Do It Wrong
• Data is validated before submission– Identifiers have to be of the correct format– Object hierarchy is enforced– Measurements can only be used with the objects
they’re supposed to report on• You can’t report a vm_count metric for a slice
• Partial submissions– If you don’t have all the information in one place, that’s
okay
• Backward compatible with the past two versions
Sponsored by the National Science Foundation 6October 23, 2012
Modeled Network Elements
• POP• Organization• Aggregate• Sliver• Resource• Interface
– IPv4, IPv6, MAC address
– VLANs
• Slice Authority• Slice• Network• Circuit
– Endpoint interfaces– Circuit type
• 1/10/40/100 Gigabit Ethernet
• 802.11• WiMAX
– Provisioned bandwidth
Sponsored by the National Science Foundation 7October 23, 2012
Operational Measurement Objects
• CPUUtilization• VMCount• TargetPingable• AMAPIListResources• AMAPIGetVersion
• DiskUtilization• OpenFlowSliverStats• SliverState• DatapathStats• NetworkStats
Sponsored by the National Science Foundation 8October 23, 2012
Manual Measurements
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
cpu = CPUUtilization()cpu.addData(1349725335, { "cpu_idle": 3.1 })
agg.addMeasurement(cpu)
client.storeMeasurement(pop)
Sponsored by the National Science Foundation 9October 23, 2012
Measurement from RRDs
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
cpu = CPUUtilization()cpu.loadRRD(”/array/moxifoam_node_cpu_idle.rrd”, 1318102932, 1349729656)
agg.addMeasurement(cpu)
client.storeMeasurement(pop)
Sponsored by the National Science Foundation 10October 23, 2012
Changing Aggregate State
import gmoc
pop = gmoc.POP(“urn:publicid:IDN+gmoc.geni.net+pop+MOXI-Indiana”)
agg = gmoc.Aggregate(“moxifoam.ictc.indiana.gigapop.net:3626”, pop)
agg.state = gmoc.AM_STATE_DOWNclient.store(agg)
Sponsored by the National Science Foundation 11October 23, 2012
Who’s Reporting?
• 20 FOAM Aggregates• pgeni.gpolab.bbn.com SA and GENI
Clearinghouse Portal• ExoGENI Racks
– Metadata– Time-Series Metrics
• InstaGENI Racks– Some Metadata
Sponsored by the National Science Foundation 12October 23, 2012
Future Directions?
• Populate the API with data from GMOC– Query current operational data about GENI things
• More measurements• RSpec parser/generator• Support for additional languages?• Better visualization of data within the UI• Integration with other projects
– GENI Clearinghouse Portal– Active measurement projects
• Use Circuit data operationally
Sponsored by the National Science Foundation 13October 23, 2012
References• “Protected” User Interface
– https://gmoc-db.grnoc.iu.edu/protected/
• Monitoring API – Objects Client– https://gmoc-db.grnoc.iu.edu/public_docs/gmoc.py– Objects API Reference– https://gmoc-db.grnoc.iu.edu/public_docs/gmoc-objects-v1.pdf– Relational Schemahttp
://groups.geni.net/geni/attachment/wiki/GENIMetaOps/gmocv4.rng– Time series statisticshttp://groups.geni.net/geni/wiki/GENIMetaOps/
DraftMonitoringMetrics
Sponsored by the National Science Foundation 14October 23, 2012
Get Involved
Interested in testing the
GMOC Monitoring User Interface?Contact:
GMOC Service Desk <[email protected]>
GENI Help Desk <[email protected]>
Interested in Monitoring?Join the [email protected] mailing list:
http://lists.geni.net/mailman/listinfo/monitoring