DVB-S2 Transmission

CADU Stream GenerationAOS Space Packets

GOES-R User Data Types and StructuresAndrew Royle GOES-R Ground Segment Project NASA Goddard Space Flight Center

Andrew.W.Royle@nasa.govPresentation #IN41B-1498

 Network Common Data Format (NetCDF4) forms a standard underlying structure for all GOES-R data products

GOES Rebroadcast (GRB) provides near real-time data to users via satellite downlink from GOES-R

Series spacecraft

National Weather Service receives L2+ sectorized cloud and moisture imagery via the Advanced Weather Interactive

Processing System (AWIPS)

NOAA’S Comprehensive Large Array-Data Stewardship System (CLASS) enables archive of GOES-R data for

retrieval and retrospective analysis

Authorized users subscribe to or conduct ad hoc searches for GOES-R end products through the Environmental Satellite Processing and Distribution System (ESPDS)

Product Distribution and Access (PDA) capability

GOES Rebroadcast Characteristics•31Mbps of Level 1b (L1b) data from all GOES-R instruments•New types of data (lightning, space weather, additional imager bands)•Increased spatial and temporal resolution•Data formatted into NetCDF4•GRB Information Packets sent every 5 minutes and include schedule, operational status, INR, and other information relevant to the user community

Current GOES GVAR GOES Rebroadcast (GRB)Full Disk Image 30 minutes 5 minutes (Mode 4)

15 min (Mode 3)Other modes Rapid Scan,

Super Rapid Scan3000 km x 5000 km CONUS: 5 min1000 km x 1000 km Mesoscale: 30 sec

Polarization None Dual circular polarizedReceive Frequency 1685.7 MHz (L-band) 1686.6 MHz (L-band)Packetization GVAR Blocks CCSDS 133.0-B-1Data Compression None Lossless compressionData Rate 2.11 Mbps ~31 MbpsAntenna Coverage Earth coverage to 5° Earth coverage to 5°Data Sources Imager and Sounder ABI (16 bands), GLM, SEISS, EXIS, SUVI,

MAGSpace Weather None ~2 MbpsLightning Data None ~0.5 Mbps

AWIPS Data and Interface Characteristics•Low latency data delivered directly to NWS via dedicated interface•Configurable based on selected parameters (bit depth, projection, geographic coordinates, periodicity, and spatial resolution)•Data transferred in tiles which are individual netCDF4 files that together comprise the entire end product

CCSDS Space Packets

GRB Data GRB Hdr CCSDS Hdr

CLASS Data and Interface Characteristics•Long-term archive for GOES-R data•Unique source of certain GOES-R data types (L0 data, algorithm packages)•Data is sent to CLASS Receipt Nodes at each GOES-R facility and is then ingested and maintained by NOAA’s National Climatic Data Center (NCDC) and National Geophysical Data Center (NGDC)

GOES-R data and metadata characteristics are documented in: GOES-R Product Definition and Users’ Guide

Separate volumes for L0, L1b, GRB, and L2+ Ground Segment Interface Control Documents for AWIPS, CLASS,

and PDA GOES-R Metadata Model GRB Downlink Specification for Users

See www.goes-r.gov for further details and to obtain copies of selected GOES-R documentation

Data Type Data FormatProduct Data Elements

Level 0 Data CCSDS in NetCDF4

Level 1b Data NetCDF4Level 2+ Data NetCDF4Non-Product Data ElementsAncillary Data Native FormatL0 Instrument Calibration Data NetCDF4L1b Instrument Calibration Data BinaryL1b Processing Parameters BinaryL2+ Processing Parameters .zip filesAlgorithm Packages .zip filesGRB Information Packets XML ISO Series Level Metadata XMLDelivery NotificationsSubmission Manifest Files XMLFile Activity Reports XMLManifest Activity Reports XMLError Notifications SOAP message

Data is sent from GOES-R to CLASS Receipt Nodes at each GS facility

L1b and L2+ GOES-R Products available through PDA (and CLASS)

GOES-R GS Product Distribution CDR

PDA Data and Interface Characteristics•Subscription and ad hoc query service available to registered users•Provides most recent seven days of data for ad hoc queries and retrieval•Primary distribution pathway for L2+ end-products other than Cloud and Moisture Imagery•Products sent from GOES-R in NetCDF4; PDA has McIDAS translation capability

PDA Interface Characteristics•Low latency distribution for all GOES-R End Products•Subscription and ad hoc query capability •Application Programming Interface for users•Limited to authorized NOAA users•Data in NetCDF format; translation capability to McIDAS

#

# Also distributed from PDA in FITS format

GRB Block (compressed)

GRB Data GRB Hdr CCSDS Hdr

GRB Data GRB Hdr CCSDS Hdr

L1b ABI BlockDecompression

GRB Block (compressed)GRB Block (compressed)GRB Block (compressed)GRB Block (compressed)GRB Block (compressed)

GLM, SEISS, SUVI, MAG, EXIS data

(each separately delivered)

NetCDF Files

L1b ABI BlockL1b ABI Block

NetCDF Files

NetCDF4 Characteristics•Machine-independent format for representing science data in an array structure•Self-describing format enabling user-defined data types•Appendable to include metadata alongside science data•Built-in zlib algorithm enables compression transparent to user•NetCDF4 enables use of HDF5 data format

More information on NetCDF4 available at: http://www.unidata.ucar.edu/software/netcdf/

Unidata NetCDF4 Data Model

Current GOES satellites switch to geographically constrained modes of operation to cover storms such as 2012’s Hurricane Sandy. GOES-R Series satellites will be able to provide 1000 x 1000 km images every 30 seconds while maintaining routine scanning schedules

GOES-R Series satellites will carry a series of advanced space weather instruments capable of generating solar imagery such as the above, from NASA’s Solar Dynamic Observatory (SDO)

Credit: NASA Credit: NASA

Colors correspond to GOES-R instruments

Wallops Command and Data Acquisition

Station, Wallops VA

Remote Backup, Fairmont WV

NOAA Satellite Operations Facility, Suitland MD

National Climatic Data Center, Asheville NC

National Geophysical Data Center, Boulder CO

L2+ Products (other than KPP and GLM)L0, L1b, L2+ KPP

& GLM productsGRB Info PktsInst. Cal. Data

CLASS Receipt Nodes (at each facility)

CLASS Nodes

NOAA Satellite Operations Facility, Suitland MD

AWIPS Product MetadataData sourceChannel ID Satellite IDLatitude/LongitudeMap Projection TypeBit DepthSpatial ResolutionObservation TimeProjection-specific MetadataPosition within End Product File (specific to tile-files)

GRB Product Metadata• Contained in NetCDF Markup

Language (NcML) files• Instrument specific• ABI metadata includes

Projection type, time, coordinates, scaling, and per-pixel data quality flag images

• GLM metadata includes the numbers of events, groups, and flashes; their locations, time, intensity, and size; and data quality information

Wallops Command and Data

Acquisition Station, Wallops VA

Remote Backup, Fairmont WV

AWIPS Network Control Facility,

Silver Spring MD

AWIPS Backup Network Control Facility, Fairmont, WV

Distributed to NWS field offices via AWIPS

OC-3 (155 Mbps) per line