Redefining the Operational Paradigm
VERONICA LANCE1,2 AND PAUL DIGIACOMO1
1NOAA/NESDIS/STAR/SOCD and NOAA CoastWatch/OceanWatch/PolarWatch Program
2Cooperative Institute for Climate and Satellites, Earth System Science Interdisciplinary Center, University of Maryland
OSO Theme 1:
Operational Satellite Oceanography
Questions:
Where do you (OSO community, intermediate users and others) see gaps in operational ocean data or data products?
◦ At NOAA?
◦ Across all agencies/providers?
What barriers to access and use do stakeholders perceive?
What are the challenges we face to best serve our stakeholders?
How can we fill these gaps, bridge these barriers and overcome these challenges?
OPERATIONAL: Routine and sustained provision of mature, fit for purpose quality data and products in support of both near real time and delayed mode research, applications and services...
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 2
Summary up front (1 of 2)◦ Focus on value chain, users and applications: From observations to knowledge
◦ New paradigm of “Operational”
◦ Parameter (not mission) -based science teams: Multi-mission, sensor agnostic, ocean/aquatic satellite data products (SST, OC, Altimetry, winds, SAR, salinity, sea ice)
◦ Serve cross-NOAA line office mission support (e.g., through CoastWatch Nodes, etc.) as well as external patrons (e.g., governments, NGOs, managers, researchers, commercial users, and international partners, etc.)
◦ Global to regional to coastal and inland (not only “CoastWatch” any more)
◦ Facilitate getting ocean/aquatic satellite data and data products into downstream “operational” applications and decision-making tools
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 3
Summary up front (2 of 2)Gaps, challenges, future directions:
◦ International and cross NOAA collaboration to develop consistent, scientifically validated, long term time series (with quantified uncertainties)
◦ Improving quality for coastal, nearshore and inland waters through R&D and leveraging international partnerships
◦ Bridging barriers (perceived and real) for users through new products and services and through training, education, communication, and outreach
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 4
Value Chain: Data, Products, Information, Knowledge• Satellite Ocean Data (~from bytes to geophysical parameters)
• Satellite Ocean Data Products (~from swath/granule to merged, mapped, anomalies, etc.)
• Information (such as combine data types, outside information, get the full picture)
•Knowledge (to inform actions)
•Coral Reef Watch example
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 5
Environmental Intelligence
Observations Monitoring Assessment Modeling Tools & Services
User needs
Data
Products
Information
Knowledge
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 66
Coral –specific
Sea Surface Temperature
SST Anomaly
HotSpot
Degree Heating WeekBleaching Alert Area
From Mark EakinNOAA Coral Reef Watch5-km Satellite-Based Products
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 7
NOAA Coral Reef WatchSatellite-Based Products
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 8
NOAA Coral Reef WatchSatellite-Based Products
9
Global Isoprene
(April 2014)
Isoprene into
model domains
From Daniel Tong: VIIRS Isoprene applications National and regional air quality forecasting
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 9
10
Global Isoprene
(April 2014)
Isoprene into
model domains
Since June 2018, VIIRS Isoprene product has been incorporated
into ARL emission data to support NWS NAQFC operation.
VIIRS marine isoprene is complementary to terrestrial and anthropogenic emissions currently used in NAQFC.
From Daniel Tong: VIIRS Isoprene applications: National and regional air quality forecasting
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 10
Despite maturity and availability, challenges (real and perceived) remain to achieving more-routine, effective, and sustained uses of satellite oceanographic data.
One Challenge: Changing Perceptions about what “operational” actually means
Operational only if = Near Real-Time?= 99.99 operational availability 24x7?= 24x7 human in the loop operations= COOP capability for 30 days= High impact IT security
Changing the “Operational” paradigm
1118-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
Despite maturity and availability, challenges (real and perceived) remain to achieving more-routine, effective, and sustained uses of satellite oceanographic data.
One Challenge: Changing Perceptions about what “operational” actually means
Operational only if = Near Real-Time?= 99.99 operational availability 24x7?= 24x7 human in the loop operations= COOP capability for 30 days= High impact IT security
Changing the “Operational” paradigm
1218-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
Despite maturity and availability, challenges (real and perceived) remain to achieving more-routine, effective, and sustained uses of satellite oceanographic data.
One Challenge: Changing Perceptions about what “operational” actually means
Operational=
Changing the “Operational” paradigm
13
⮚ Routine and sustained provision of accurate, consistent and fit for purpose quality, well-described and discoverable oceanographic satellite observations spanning different time-scales (i.e., NRT to climate) for multiple users (e.g., research, applications and services)
⮚ Can be high assurance/high-service, or moderate assurance/moderate-service
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
Definitions of terms: Agree or Amend
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 14
End Users:Science end-users who undertake research activities that rely in whole or in part on sustained measurement and observation of the oceans;
Operational end-users who make use of ocean data and information to support operational needs related to safety, economic efficiency and protection of the environment.
Public end-users who have a general interest in the ocean or make use of ocean data and information in support of their leisure activities or recreational pursuits.
Policy end-users who require sustained ocean data and information to support policy formulation, monitoring of policy compliance, and assessment of policy effectiveness;
And I would add: Commercial end-users
Active in International Community OrganizationsProviders of observing system infrastructure; *
Producers of ocean observations; *
Intermediate users who tailor ocean data or information for a specific end-use (from all sectors)
Souce: personal communication Ralph Rayner
Definitions of terms: Product Levels
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 15
For example, see Anne O’Carroll’s GHRSST presentation
Is there a need to label and define more complex products(e.g.: What to call a data product derived from multiple satellite parameter inputs; What is “fusion”) -----------------------------Potential Outcome of OSO (at least for my benefit/education)◦ Is there support and agreement on the need for common terms and
definitions?◦ Which terms have potential for being commonly defined; Are we already
there for some terms? Borrow from broader satellite obs and from broader ocean obs…
◦ Is there a need to formalize a path to do this? At what stage are we jumping in (e.g., working group, socialize, acceptance, finalize, adopt internally, communicate broadly, externally)?
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 16
9-13 December 2019, San FranciscoSession ID: 82635
Session Title: . Oceanography from Space: Applications for
Satellite-based Ocean ObservationsSection: Ocean Sciences
View Session Details: https://agu.confex.com/agu/fm19/gateway.cgi
Session ID: 82733
Session Title: . NOAA Ocean Satellite Data Products
for Science and ApplicationsSection: Town Hall
View Session Details: https://agu.confex.com/agu/fm19/gateway.cgi
Thank you.
Questions?
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 17
NOAA CoastWatch/ OceanWatch/PolarWatch
VERONICA LANCE1,2 AND PAUL DIGIACOMO1
With contributions from theNOAA CoastWatch/OceanWatch/PolarWatch team 1NOAA/NESDIS/STAR/SOCD and
NOAA CoastWatch/OceanWatch/PolarWatch Program2Cooperative Institute for Climate and Satellites, Earth System
Science Interdisciplinary Center, University of Maryland
From satellite ocean data to information and applications:
Ocean Parameters from SPACE
Temperature (SST)
Sea Level Anomaly
Ocean Surface
VectorWind
s
Sea Ice
Ocean Color
Surface Salinity
Imagery
SAR(“roughness
” e.g., ice, winds, oil
spills, etc.)
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 19
NOAA CoastWatch/OceanWatch/PolarWatch
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 20
Facilitate the use of ocean /aquatic satellite data along the value chain from observations to decision-making
CoastWatch.NOAA.gov
• Data Discovery and Access• Value added product distribution• Outreach and education• User engagement, feedback to science
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 21
CW Central
NOAA/NESDIS/
STAR
NESDIS(Satellites and Data)
Commercial
Academia
International
State Agencies
NMFS(Fisheries)
OAR(Research)
NOS(OceanService)
Public
Federal Agencies
NWS(National
Weather Service)
NOAA Users
External Users
Great Lakes OAR
East Coast NOS
Atlantic OceanWatch
OAR
Gulf of Mexico
OAR
Pacific OceanWatch
NMFS
West Coast NMFS
PolarWatch NMFS/NESDIS
NOAA CoastWatch/OceanWatch/PolarWatch Program
“HUB and SPOKES”
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 22
Role of NOAA CoastWatch/OceanWatch/PolarWatch
• Science research• Algorithm/product development• Cal/Val• Quality assessment and monitoring• Reanalysis, reprocessing• Satellite application development & support
NESDIS/STAR(Oceans/SOCD)
• Cross-NOAA program and data framework• Interface between development, users of all
levels and applications• Measurement (vice) mission-based approach
to multi-sensor satellite data• Processing and customization of pre-and/or
post-operational products; “value-added” for CoastWatch users
• NRT & science quality time-series data service• Global and user regions of interest• Quality monitoring• Multiple pathways to data discovery• Intermediate repository• Help desk, project assistance, public outreach• Best effort, 8/5 support
NOAA CoastWatch/OceanWatch
•Data stewardship •Determine archive-worthiness; identify storage requirements• Ensure robust metadata• Data archive; long term storage• Discovery of and access to archived data• Support for users
NESDIS/NCEI
•Routine, robust, operational production and distribution, especially to NOAA users• Dedicated support (8x5 or 24x7 depending upon specific product)
NESDIS/OSPO
•USERS
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 23
Role of NOAA CoastWatch/OceanWatch/PolarWatch
• Science research• Algorithm/product development• Cal/Val• Quality assessment and monitoring• Reanalysis, reprocessing• Satellite application development & support
NESDIS/STAR(Oceans/SOCD)
• Cross-NOAA program and data framework• Interface between development, users of all
levels and applications• Measurement (vice) mission-based approach
to multi-sensor satellite data• Processing and customization of pre-and/or
post-operational products; “value-added” for CoastWatch users
• NRT & science quality time-series data service• Global and user regions of interest• Quality monitoring• Multiple pathways to data discovery• Intermediate repository• Help desk, project assistance, public outreach• Best effort, 8/5 support
NOAA CoastWatch/OceanWatch
•Data stewardship •Determine archive-worthiness; identify storage requirements• Ensure robust metadata• Data archive; long term storage• Discovery of and access to archived data• Support for users
NESDIS/NCEI
•Routine, robust, operational production and distribution, especially to NOAA users• Dedicated support (8x5 or 24x7 depending upon specific product)
NESDIS/OSPO
•USERS
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 24
Timeline of Satellite Oceanographic Dataat CoastWatch
1987 1998 2001 2005 2012 2016 2020
pss pss
Typical Product Lifecycle
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 25
Experimental Pre-operational/Developmental Operational
Reanalysis
Archive Worthy
Data Access by USERS
Example “Snapshot”
Today
2 Jan 2012 1 May 2016
MSL12 NRT
Science-Quality Data replaces 15-day old NRT data
IDPS operational SDRGFS Model
Improved SDR by OC TeamGDAS
NRT
ScienceQuality
2 Weeks Ago
* Reprocessed V1Forward
Stream V1
*Early mission data are not routinely distributed due to quality issues. They can be specially requested but will come with a quality warning.
.
Launch
18-20 June 2019 26
1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 27
Consistent NRT & Science QualityExample from NOAA MSL12 VIIRS Ocean Color
Attribute Near-Real Time Delayed-Mode/Science-Quality
Latency:Best effort, as soon as possible (~12-
24h)Best effort, on a 2-week delay
Processing System:MSL12
(v1.01; will transition to v1.2x)MSL12 (v1.2x)
SDR: IDPS Operational SDR OC-improved SDR
Ancillary Data: Global Forecast System (GFS) Model Science quality (assimilated; GDAS) from NCEP
Spatial Coverage: May be gaps due to various issues Complete global coverage
Processed by: OSPO (operational) NOAA/STAR
Distributed by: CoastWatch , OSPO CoastWatch, NCEI
Archive Plans: Yes, from OSPO to NCEI Yes, from CoastWatch to NCEI
Full Mission Reprocessing: No Yes, every ~2-3 years or as needed
CoastWatch “Value Added” VIIRS Hi-Res Sectors Co-Located for Ocean Color and SST
2818-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
2918-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA
CoastWatch “Value Added” Hi-Res Sectors for OLCI S3 (=VIIRS x9)
CoastWatch Data Access and Monitoring Online Tools
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 30
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 31
Data Portal
Single mapping interface in responsive design◦ NRT Search
◦ Granule Locator
◦ Spatial Search
◦ Unified Shopping cart
◦ Dynamic subsetting of NetCDF data or URL
Metadata and Discovery◦ THREDDS v5.0
◦ ERDDAP
◦ WAF folder
◦ Improved integration with NOAA.gov / Data.gov
◦ Machine-ready query/download
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 32
Ocean Monitor
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 33
Data Performance Tracking
In situ Ocean Color Database
Selection Criteria
Data List (criteria based)
Dynamic Map Display (with polygon option)Download Files
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 34
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 35
CoastWatch.NOAA.gov
Help Desk:
Web Site Home:
NOAA CoastWatch/OceanWatch/PolarWatch
Thank you.
Questions?
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 36
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 37
MOBYat NOAA
on CoastWatch,NOAA.gov
CoastWatch Data Access -- DirectWebsite: https://coastwatch.noaa.gov◦ Satellite Data Products include ‘Data Access’
HTTPS Server◦ https://coastwatch.noaa.gov/data
FTP Servers◦ ftp://ftp.star.nesdis.noaa.gov/pub/
◦ ftp://ftpcoastwatch.noaa.gov/pub/
THREDDS◦ https://coastwatch.noaa.gov/thredds/catalog.html
ERDDAP
Regional Node data access
Queries can be automated for routine download
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 38
“ALL-in-ONE”Single mapping interface in responsive design◦ NRT Search
◦ Granule Locator
◦ Spatial Search
◦ Unified Shopping cart
◦ Dynamic subsetting of NetCDF data or URL
Metadata and Discovery◦ THREDDS v5.0
◦ ERDDAP
◦ WAF folder
◦ Improved integration with NOAA.gov / Data.gov
◦ Machine-ready query/download
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 39
Data Access ToolsGranule Selector
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 40
Data Access ToolsGranule Search
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 41
Data Access ToolsSpatial Search
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 42
Data Access Tools NRT Data Search
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 43
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 44
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 45
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 46
Ocean Satellite Data Parametersat NOAA/NESDIS/STARSatellite Oceanography and Climatology Division
Sea Surface Temperature
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 47
Leads:
Alexander Ignatov (ACSPO physical SST retrievals)
Eileen Maturi (L4 blended analysis products)
Enterprise processing: Advanced Clear Sky Processing for Ocean (ACSPO)
◦ GHRSST conventions/formats
Ocean Color Radiometry
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 48
Lead: Menghua Wang
Enterprise processing: Multi-sensor Level 1 to Level 2 processing system (MSL12)
◦ Radiances
◦ Chlorophyll
◦ Kd490, KdPAR
◦ QA Score
OCView
Laboratory for Satellite Altimetry
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 49
Sea Surface Topography/AltimetryLead: Eric Leuliette
Enterprise processing: Radar Altimeter Database System (RADS)
Global sea level anomaly analysisAlong-track, wave height, wind
Synthetic Aperture Radar (SAR)
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 50
Sea Surface Roughness / Synthetic Aperture Radar (SAR)
Lead: Sean Helfrich
Enterprise processing: SAR Ocean Products Systems (SAROPS)
• Normalized radar crossections • Derived products (e.g., winds, oil
spills, ice, ship detection, whale detection?)
Ocean Surface Vector Winds
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 51
Lead: Paul Chang
Sea Ice
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 52
Lead: Sinead Farrell
Sea Surface Salinity
18-20 June 2019 1ST INT'L OPERATIONAL SATELLITE OCEANOGRAPHY SYMPOSIUM, COLLEGE PARK, MD USA 53
CoastWatch in collaboration with NWS/CPC/OMB