end-to-end data management for operational observation systems
DESCRIPTION
End-to-end Data Management for Operational Observation Systems. Presented to the Workshop on the Ecological Impact of Hypoxia on Living Resources. Sharon Mesick Ecosystem Program Manager NOAA Coastal Data Development Center March 2007. Overview. End-to-end data management projects - PowerPoint PPT PresentationTRANSCRIPT
End-to-end Data Management for Operational Observation Systems
Presented to the Workshop on the
Ecological Impact of Hypoxia on Living Resources
Sharon MesickEcosystem Program Manager
NOAA Coastal Data Development CenterMarch 2007
Overview
• End-to-end data management projects
– SEAMAP / Gulf of Mexico Hypoxia Watch
– WCO – NODC Conduit
• Adopting best practices for an Operational
Observation System
Five Data Management Functions
• Discover– Look, find and get data, data products and information
• Access– To data and information
• Archival– Storage and maintenance
• Products– Quality Assurance, development and maintenance
• Outreach– Facilitate stakeholder awareness
SEAMAP / Gulf of Mexico Hypoxia Watch
• Partnership project
– NMFS, CoastWatch, NCDDC
• Manual data development process
– Interoperable standards addressed
• Metadata, geospatial
– Discovery, access, archive requirements
met
• Multiple public access points
Hypoxia Watch Data Management Flow
ProductsGIS & JPEG
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
NCDDC Data Development-------------------------
• Receive / QC data• Geospatially enable• Generate contours• Generate metadata• GIS Integration• Product generation
Multiple Public Access Points
• Direct Data Access
– Ocean Archive System
• Data Access
Applications
– Internet GIS
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– Hypoxia Web site
Gulf of Mexico Hypoxia Watch Program
http://www.ncddc.noaa.gov/ecosystems/hypoxia
West Coast Observing System
• Partnership project– NMSP, CeNCOOS, PISCO, NODC, NCDDC, others
• Operational, end-to-end system– Automated, extensible system
– Interoperable standards addressed• OPeNDAP, metadata, geospatial
– Discovery, access, archive requirements met• Multiple public access points
End-to-End Data Management
Multiple Public Access Points
• Direct Data Access
– NODC OPeNDAP Server
– OPeNDAP.org
– Ocean Archive System
• Data Access
Applications
– Internet GIS
– WCOS Portal
• Metadata Search
– NCDDC Portal
– FGDC Clearinghouse
– Geospatial One Stop
• General Access
– SIMoN (Sanctuary
Integrated Monitoring
Network)
– CeNCOOS OceanObs
Access Catalog Holdings
Publish
HypoxiaCatalogWebsite
NCDDCFTP
Server
NODCRetrievalProcessHypoxia
Catalog
NCDDC WCO-NODC Conduit
-------------------------
HypoxiaWatch
LUMCON
NGoM/CI
Other
NODCOPeNDAP
Server
NODCArchival
NCDDCMetadataCatalog
NCDDCClearinghouse
NodeMERMAid
•Determine new data•Retrieve new data and metadata•Convert data•Call XML-RPC server to generate and publish metadata•Package results and send to FTP site
XML-RPC Server----------------
•Convert metadata to FGDC XML•Publish to various systems
Send Retrieve
Publish
Publish Publish Ingest
Send Metadata forConversion and Publishing
Retrieve newData and Metadata
End-to-End Hypoxia Data Management
Summary
• WCOS – demonstrates an operational, automated system– Readily extensible
• Coral Reef Early Warning System• Flower Garden Banks, other NMS
• Proposed hypoxia data management system ensures a strong integrated approach– Consistent data standards and procedures– Engages regional partners in data assembly– Supports discovery, access, delivery, and archive– Real-time, NRT and collections
References:http://www.ngi.msstate.edu/hypoxia
Contacts:
Russ Beard, NCDDCActing Director
Sharon Mesick, NCDDCEcosystem Program Manager