the observing system monitoring center (osmc)
DESCRIPTION
The Observing System Monitoring Center (OSMC). … steps towards climate data integration. Steve Hankin, NOAA/PMEL. Observing System Monitoring Center. Background: The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system . - PowerPoint PPT PresentationTRANSCRIPT
The Observing System The Observing System Monitoring Center (OSMC)Monitoring Center (OSMC)
… … steps towards climate data steps towards climate data integration integration
Steve Hankin, NOAA/PMELSteve Hankin, NOAA/PMEL
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 22
Observing System Monitoring CenterObserving System Monitoring Center
Background:
The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system.
The heart of the OSMC is a database of the times, locations, platform information, and parameter values.
Background:
The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system.
The heart of the OSMC is a database of the times, locations, platform information, and parameter values.
A partnership:A partnership:
PMELPMEL Steve Hankin PISteve Hankin PINGDCNGDC Ted Habermann PITed Habermann PINDBCNDBC Kevin Kern PIKevin Kern PI
OCOOCO Derrick SnowdenxDerrick Snowdenx
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 33
3 areas of integration under OSMC3 areas of integration under OSMC
1.1. Climate platforms via realtime input from Climate platforms via realtime input from GTSGTS
2.2. Climate archives (‘DACs’ and ‘GDACs’)Climate archives (‘DACs’ and ‘GDACs’)
3.3. Climate products and dataClimate products and data
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 44
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Aug. 22
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 55
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 66
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Colored by platform type
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 77
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Colored by country
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 88
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Colored by age of
observation
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 99
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1010
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Observing system for SST
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1111
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Colored by parameter
value
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1212
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1313
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Moorings observing SST
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1414
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
The geospatial analysis capabilities of the OSMC data base are being developed to track progress on XBT lines.
XBT castsin 1 week (Aug. 16-22)
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1515
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Platform information
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1616
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1717
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1818
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 1919
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2020
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2121
1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2222
GTS data provides just a starting pointGTS data provides just a starting point – – incomplete, minimal QCincomplete, minimal QC
OSMC needs to monitor our stewardship of OSMC needs to monitor our stewardship of the “ocean climate data record”the “ocean climate data record”
Since we’re integrating anyway, lets do it in Since we’re integrating anyway, lets do it in a manner that serves the broadest needs a manner that serves the broadest needs of the science communityof the science community
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2323
Example #1: U. Hawaii Sea Level CenterExample #1: U. Hawaii Sea Level Center
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2424
Example: U. Hawaii Sea Level Center – todayExample: U. Hawaii Sea Level Center – today
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
CF MetadataClimate and Forecast Conventions
A subset were in a community standard format
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2525
inco
min
g
data
Example: U. Hawaii Sea Level Center – standards-based architecture (Jan. ‘09)Example: U. Hawaii Sea Level Center – standards-based architecture (Jan. ‘09)
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Relational data base
Sea level time
series
OPeNDAPserver w/THREDDScatalog
available thru a standard web
service
Research Quality
Pacific Ocean
Lat34N, Long120W
Lat36N.Long: 121W…
Atlantic Ocean…
Fast Delivery
Pacific Ocean
…
...…
all in standard format: netCDF+CF
What do we gain through this standards-based approach?
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2626
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Jan. ’09 milestone:Jan. ’09 milestone:1.1. Through THREDDS human-readable platform info at U. Hawaii becomes Through THREDDS human-readable platform info at U. Hawaii becomes
machine readable … in the OSMCmachine readable … in the OSMC
Jan. ’09 milestone:Jan. ’09 milestone:1.1. Through THREDDS human-readable platform info at U. Hawaii becomes Through THREDDS human-readable platform info at U. Hawaii becomes
machine readable … in the OSMCmachine readable … in the OSMC
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2727
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Jan. ’09 milestone:Jan. ’09 milestone:2.2. “Drilling down” on a U. Hawaii Sea Level station will “Drilling down” on a U. Hawaii Sea Level station will
access the research-quality archives via OPeNDAPaccess the research-quality archives via OPeNDAP
Jan. ’09 milestone:Jan. ’09 milestone:2.2. “Drilling down” on a U. Hawaii Sea Level station will “Drilling down” on a U. Hawaii Sea Level station will
access the research-quality archives via OPeNDAPaccess the research-quality archives via OPeNDAP
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2828
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Jan. ’09 milestone:Jan. ’09 milestone:3.3. Scientists will get desktop access to these data Scientists will get desktop access to these data
in their familiar desktop science toolsin their familiar desktop science tools
Jan. ’09 milestone:Jan. ’09 milestone:3.3. Scientists will get desktop access to these data Scientists will get desktop access to these data
in their familiar desktop science toolsin their familiar desktop science tools
… a Ferret session
… a Matlab session
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 2929
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Jan. ’09 milestone:Jan. ’09 milestone:4.4. Software solutions can be shared. OSMC-developed Software solutions can be shared. OSMC-developed
tools are planned for use in the U.Hawaii system.tools are planned for use in the U.Hawaii system.
Jan. ’09 milestone:Jan. ’09 milestone:4.4. Software solutions can be shared. OSMC-developed Software solutions can be shared. OSMC-developed
tools are planned for use in the U.Hawaii system.tools are planned for use in the U.Hawaii system.
This example shows OSMC tools automatically connecting to a 3rd party site that follows these standards
Menus inferred from THREDDS catalog (XML)
Access to observations via OPeNDAP
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3030
Example #2: Underway ocean carbon obsExample #2: Underway ocean carbon obsSurface Ocean COSurface Ocean CO22 Atlas (SOCAT) Atlas (SOCAT)
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Relational data baseASCII file
Summary in CSML(*)
* Climate Systems Markup Language (XML)
CO2 data viewer
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3131
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Example: Underway ocean carbon obsExample: Underway ocean carbon obs– Takahashi collection today … SOCAT Jan. ‘09– Takahashi collection today … SOCAT Jan. ‘09
Improved metadata in SOCAT will allow OSMC to differentiate cruises
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3232
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
netCDF
cruise plot
cruise log (metadata)
ASCII data
“drill down” will become available Jan.
‘09
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3333
Example #3: IOOS coastal observationsExample #3: IOOS coastal observations(not “climate ‘DACs’ and ‘GDACs’” yet, but …)(not “climate ‘DACs’ and ‘GDACs’” yet, but …)
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Relational data
bases
SOS and O&M(*)“Regional”
observations
* Open Geospatial Consortium (OGC) standards: Sensor Observation Services, Observations & Measurements model
SOS, O&MSOS, O&M
OSMC
HABsforecasts
HurricaneIntensity
CoastalInnundation
IntegratedEcosystem
Analysis
NDBC
US coastal ocean obs
regionA
regionB
Global ocean obs
Global met obs
All global real-time users
Climate
GTS
Sea Level
Underway
Time series
Climate “DAC’s”
…
IOOS - OSMC collaborationIOOS - OSMC collaboration
GTSGTS
Several (by datatype)Several (by datatype)
NDBC customNDBC custom
familiar science tools
COOPS
SOS, O&M
GTS
protocols
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3535
Example #3: IOOS coastal observationsExample #3: IOOS coastal observations
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
IOOS regional platforms
(conceptual plot:feature available
November)
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3636
2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’
Roll-out plan Roll-out plan by platformby platform
OSMC-DAC OSMC-DAC partnershipspartnerships
U. Hawaii sea level time series -- Jan. '09 U. Hawaii sea level time series -- Jan. '09 OceanSites -- use same techniques (thru GDAC at NDBC)OceanSites -- use same techniques (thru GDAC at NDBC)
Carbon underway -- Takahashi collection now. SOCAT Dec. '08Carbon underway -- Takahashi collection now. SOCAT Dec. '08 SAMOS underway -- anticipate June '09SAMOS underway -- anticipate June '09
IOOS – taking shape in the coming monthsIOOS – taking shape in the coming months
other platform programs other platform programs (unscheduled, details tbd)(unscheduled, details tbd)
Argo -- via FNMOC/NRL GDAC Argo -- via FNMOC/NRL GDAC (w/ NOAA funding)(w/ NOAA funding)
VOS -- at NDBCVOS -- at NDBC
Surface drifters - at AOMLSurface drifters - at AOML
SOOP XBTs -- U.S. XBTs only at AOML (International tbd)SOOP XBTs -- U.S. XBTs only at AOML (International tbd)
Repeat hydrography dataRepeat hydrography data
GOSUD -- tbd on completion of SAMOSGOSUD -- tbd on completion of SAMOS
NOAA CO-OPS tide gauges (those not on GTS) NOAA CO-OPS tide gauges (those not on GTS)
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3737
3. Integration of …3. Integration of … climate products and data climate products and data
IPCC AR4 model outputs:
“Graphics such as this from Held and Soden (2006) are so routinely produced from the IPCC AR4 database that we’ve ceased to marvel at it. This is a composite of output from 20 models worldwide….”
V. Balaji, GFDL
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3838
3. Integration of …3. Integration of … climate products and data climate products and data
Tony Barnston -- http://iri.columbia.edu/climate/ENSO/
“Often, the anomalies are provided directly in a graph or a table by the respective forecasting centers for the Nino 3.4 region. In some cases, however, they are given for 1-month periods, for 3-month periods that skip some of the periods in the above table, and/or only for a region (or regions) other than Nino 3.4”
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 3939
3. Integration of …3. Integration of … climate products and data climate products and data
• Publishing images and analyses of data products on Web sites is worthwhile …
• … but it is no longer sufficient. Nor is FTP access to files.
• Making data available through Web services like OPeNDAP and SOS will significantly advance climate science
• It can be done at low effort. Many groups are already doing it.
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4040
3. Integration of …3. Integration of … climate products and data climate products and data
Surface TemperatureSalinity at 105m
Zonal current at 160W
3-month average meridional current in
Atlantic at 24N
Sea Level
Surface Salinity
GODAS
Zonal current averaged 130E to
80W
Salinity ProfileCurrent Vectors Meridional Current
SODA
Sea Level Height
Meridional velocity
Pacific SalinityTime vs longitude
OSCAR
Sea Surface Height
AVISO
ECCO-JPL
GHRSST-JPL
SODA minus COADS COADS minus ECCO-JPL
ECCO-JPL minus SODA
ECCO-JPL minus World Ocean Atlas
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4141
3. Integration of …3. Integration of … climate products and data climate products and data
Many climate products are already available via OPeNDAP(though not all are kept up to date). Why not all of them ?
(GRIB is supported aswell as netCDF-CF)
OSMC can offer toolsto compare and evaluateproducts
Reynolds bias error with ocean obs
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4242
3. Integration of …3. Integration of … climate products and data climate products and data
The OSMC ‘Climate Services’ tab is a work in progress.
Help us succeed bytelling us whatwould be most usefulto you.
IT projects are mostsuccessful when theyget strong input fromusers.
Adequacy of sampling for SST
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4343
Data needs metadata (standard-format documentation) -- both to Data needs metadata (standard-format documentation) -- both to be "discoverable" and to provide essential background informationbe "discoverable" and to provide essential background information
NOAA’s Climate Services plan (short-term goal): a web site NOAA’s Climate Services plan (short-term goal): a web site (“portal”) where users can locate web sites for NOAA data(“portal”) where users can locate web sites for NOAA data(This is not “data integration” as we’ve been discussing it.)(This is not “data integration” as we’ve been discussing it.)
The ocean-climate community needs to submit metadata to this The ocean-climate community needs to submit metadata to this portal.portal.
For nowFor now a single metadata record for each ocean data activity: a single metadata record for each ocean data activity: drifter program, XBT/SOOP program, Argo program, TAO, etc.drifter program, XBT/SOOP program, Argo program, TAO, etc.
Starting point: Many programs have submitted such metadata to Starting point: Many programs have submitted such metadata to NASA GCMD. But much is out of date, incomplete or misleading.NASA GCMD. But much is out of date, incomplete or misleading.
ACTION ITEM: To meet NOAA's short term goals, Derrick Snowden will ACTION ITEM: To meet NOAA's short term goals, Derrick Snowden will be contacting the OCO-funded programs. He’ll try to guess the right be contacting the OCO-funded programs. He’ll try to guess the right contact person …contact person …but better if you contact him firstbut better if you contact him first..
3. One final topic: metadata3. One final topic: metadata
(Thank you Derrick!)(Thank you Derrick!)
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4444
With relatively small amounts of effort we can With relatively small amounts of effort we can make “quantum” improvements in access to make “quantum” improvements in access to data from climate DACsdata from climate DACs
The OSMC project hopes to work in The OSMC project hopes to work in partnership with the DACs 1 by 1 to make this partnership with the DACs 1 by 1 to make this happenhappen
Significant data problems have not been Significant data problems have not been addressed here: QC standards, metadata addressed here: QC standards, metadata quality, and data discovery to name a fewquality, and data discovery to name a few
Those will be tackled too. Don’t let perfect be Those will be tackled too. Don’t let perfect be the enemy of good.the enemy of good.
Author’s message:Author’s message:
Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 4545
DiscussionDiscussion(Thank you)(Thank you)