an enterprise approach for meeting satellite data and product distribution and access requirements...

An Enterprise Approach for Meeting Satellite Data and Product Distribution and Access

Requirements

Reginald Lawrence, NOAA/NESDIS/OSD

NOAA Direct Readout Conference

April 2011

Presentation Outline

• What is GAS?

• Operational Distribution & Access Systems to Satellite Data and Products – Current Subsystems

• Operational Distribution & Access Systems to Satellite Data and Products – Future Subsystems

• Evolutionary Path

• Impacts

• Schedule

2

What is GAS?

• GAS, by definition, is the GOES R-Series Ground Segment Access Subsystem

• GAS will become a part of the consolidated enterprise solution for the Environmental Satellite Processing Center (ESPC) future operational Product Distribution and Access (PDA) subsystem

3

NESDIS Operations - CURRENT

USERS

SatelliteAcquisition

Satellite Applications & Research

SatelliteOperations

Data Processing

& Distribution

Data Centers

New Products

NearReal-Time

Data

RawData

Long-TimeSeriesData

Satellites

New Products

In SituData

Non-NOAA

Satellite Data

USERS

USERS

SatelliteAcquisitionSatellite

Acquisition



SatelliteOperationsSatellite

Operations

Data Processing

& Distribution

Data Processing

& Distribution

Data CentersData

Centers

New Products

NearReal-Time

Data

RawData

Long-TimeSeriesData

Satellites

New Products

In SituData

In SituData

Non-NOAA

Satellite Data

Non-NOAA

Satellite Data

NESDIS

ESPC

GOES - Geostationary Observational Environmental Satellite POES - Polar-orbiting Observational Environmental Satellite

4

Environmental Satellite Processing Center (ESPC) Segments

Distributionand Access

Satellite Data

Users Community

Ancillary Data

Archive (CLASS)

Data & Products

Ingest

Environmental SatelliteProcessing Center (ESPC)

ProductGeneration

Infrastructure

5

Current/Planned Distribution and Access

• Current GOES and POES (both NOAA and non-NOAA assets) distribution and access of data and products are provided via several legacy operational ESPC subsystems including SATEPSDIST systems and the Data Distribution System (DDS)– GOES data to the NWS is primarily through the GOES Ingest and

NOAAPORT Interface (GINI)– SATEPDIST subsystems are Man Computer Interactive Data Access

System (McIDAS) based, allowing users to pull data via McIDAS Abstract Data Distribution Environment (ADDE) commands

– DDS subsystems provide primary access and distribution of POES data and products

6

Current/Planned Distribution and Access

• Previous plans called for the new GOES R-Series (GOES-R) and Joint Polar Satellite System (JPSS) missions to provide their own separate distribution and access systems: GOES-R Access Subsystem (GAS) and NPOESS Data Exploitation (NDE), respectively

• Plans are now to consolidate legacy and future mission distribution subsystems into an enterprise solution for ESPC operations

7

User

Ingest Product

Generatio

n

• NESDIS understood that uncoordinated project development activities conducted without consideration of legacy operations leads to operational ‘stove pipes’

• Parallel development of an enterprise solution creates risks for the Project Manager because project success is dependent on the success of the enterprise effort

Issues

8

Moving to an Enterprise Solution

• Decision made to incorporate all required distribution and access functionality within an enterprise solution: Product Distribution and Access (PDA)– Identify PDA enterprise and project-unique requirements from

the comprehensive set of the legacy, GOES-R, and NDE requirements

– Capture project schedule needs and constraints (e.g., reviews, integration and test, operational capability)

• Derived enterprise PDA services– Receive Data (push and pull)– Route Data (to users and storage)– Subscription Services– Distribute Data (includes user interface)– Store Data (internal short term and interface to CLASS)– Support Future Data and Product Enhancements (additional

external data processing)9

Moving to an Enterprise Solution

• System acquisition planned through the NESDIS Office of System Development (OSD) Environmental Satellite Processing and Distribution System (ESPDS) Development contract

• Acquisition approach focused on ensuring planned project schedule needs are met– Phased enterprise evolution– Incremental development and delivery

• Service oriented architecture planned to accommodate new missions or new mission needs

10

Product Distribution and Access (PDA) Phase 1

NDE PDA Prototype


NDE and GOES-R Increment 1 (including Legacy as Phase 2.5)


NDE, GOES-R Increment 2, Legacy


NDE, GOES-R, Legacy and New Missions

2013-15

2011-13

2015-16

2016 -

PDA Evolution Plan

Notes:1. The first operational PDA will be delivered

in Phase II. The Phase 1 PDA prototype will be used operationally for NDE. Components of the Phase 1 NDE PDA prototype are planned to be used in the Phase II PDA design.

2. NDE (NPP) and Legacy operations will transition to the Phase II PDA after GOES-R check out and operations. 11

NESDIS & NWS Satellite Product Data Flow – As Is

SATDIST

DDS

WEBSERVER

GINI

13

NESDIS & NWS Satellite Product Data Flow – Planned 2013

NSOF Suitland, MD

SVALBARD

WALLOPS CDA

NWS AWIPSSilver Spring, MD

NCEP

Environmental Satellite Processing Center (ESPC)

DOMSAT

DOD

NOAA POES

NOAA GOES

JASON-2

DMSP

NOAA SERVER

JASON-2SUBSYS

FTPSERVER

INGEST PROCESS DISTRIBUTE

SATPROD

NCF

EOSSUBSYS

NOAA Weather Wire ServiceSilver Spring, MD

AWC, Kansas City, MOSPC, Norman, OKSWPC, Boulder, COTPC, Miami, FL

AWC, Kansas City, MOCPC, Camp Springs, MDEMC, Camp Springs, MDNCO, Camp Springs, MDHPC Camp Springs, MDOPC, Camp Springs, MDOCCS, Gaithersburg, MDOCCS, Fairmont, WVSPC, Norman, OKTPC, Miami, FL

NWS Telecommunication GatewaySilver Spring, MD

NWS Hydrometeorological Automated Data System (HADS), Silver Spring, MD

NGDCBOULDER, CO

NCDCASHEVILLE. NC

NODCSILVER SPRING,

MD

GOES

POES

JASON-2

EMWIN

POES, METOP, DMSP

GOES GVAR

LRIT

DAPS/DCS

FEMA

NASA

USGS

POES, JASON-2

NON-NOAAGOES

METOP

POES

DMSP

JASON-2

JASON-2 PULL

AMSU A, B

JASON-2 PULL

EOSQuikSCAT

EOS(QuikSCAT)

EMWIN

WEATHER WIRE

POES, METOP, DMSP

AMSU A, B

GOES, NON-NOAA GOES

EMER. MSG

GOES

DCP

DCP

EMER. MSG

JASON-2

JASON-2

EMWINNWS LRIT CDA/GOES

DARMSTADT

ARGOSDCP

LINE OF DEMARCATION

UCAR

BOULDER, CO

COSMIC

COSMIC

NOAA DATA CENTERS

CLASSGOESPOESDMSP

JASON-2

GOES

DCP

DMSP

DMSP

FEDERAL GOVT INTERFACES

NWS INTERFACES

LEGEND

- Non-NOAA Facility

- Non-NOAA Interface

- NWS Interface

EOS

METOP

POES

GOES, NON-NOAA GOES

GOES, NON-NOAA GOES

GOES, NON-NOAA GOES

EOS

SSGPSERVER

GINI

GOES, NON-NOAA GOES

EOS

GOES SUBSYS

GOES GVAR

- NESDIS Facility

POES, METOP, DMSP

POES, METOP, DMSP

POES, METOP, DMSP

POES, DMSP

POESSUBSYS

WEBSERVER

GOES

GOES

TBUS

TBUS

COSMIC

SABTROPICWORKSTATION

NOAA SCIENCE CENTER

SABWILDFIREWORKSTATION

TROP BLTN

FIRE, VOLC VGF

FIRE, VOLC VGF

WINDS, ASOS SCP, SFOVTEXT, TROP,VOLC BLTN

NAWIPS, NOAA SCIENCE CENTERCAMP SPRINGS, MD

VOLC, TROP, PCPN BLTNs

Planned 2013 NESDIS & NWS Satellite Product Data Flow

GOES LRITGVAR BROADCAST

POES HRPT BROADCAST

DMSP

JPSS

EUMETSAT

EMER. MSG

VOLC, TROP, PCPN BLTNs

COSMIC

GOES

POES, GOES,DMSP, JASON-2, NPP

COSMIC

CGS

DCS

Domsat

Domsat

Domsat

Domsat

Domsat

Domsat GOES

GOES POES

METOPNDEGINILRITMSGFOS

MTSATSPP & DDS

WALLOPS CIP OBF

MPLS

CLASS

CLASS

CLASS

CLASS

LRITEMWIN

Emer Msg

COSMIC

2/16/2011

GOES, NON-NOAA

POES, METOP, DMSP

BNCF Fairmont WV

NOAAPORT

MTSAT, MSG

Met-7

Met-7

Ancillary Model Data

NWS AWIPS

BNCF Fairmont, WV

POES, GOES DMSP, METOP

NAWIPS, NOAA SCIENCE CENTERCAMP SPRINGS, MD

FAIRBANKS CDA

POES

JASON-2

COSMIC

Domsat

Domsat

NPP

CLASS

NPPSATELLITE INGEST SYSTEM

(SIS)CGS NDE

PRODUCT DISTRIB.

AND ACCESS

(PDA)

14

NESDIS & NWS Satellite Product Data Flow – Planned 2015

SATELLITE INGEST SYSTEM

(SIS)

CGS NDE

PRODUCT DISTRIB.

AND ACCESS

(PDA)

GOES-R

PG PD

GOES-R Notional Architecture

15

GS CoreGOES-R Access Subsystem

Algorithm Support(AWG)

GOES-R GS, NSOF

GOES-RAccessPoint

GOES-R7-Day Store

Antenna/RF(GSP)

LS GN

Ancillary DataRelay System

(OSDPD)

Users(External to

NSOF)

CLASS(Node at NSOF)L1b, L2+, Ancillary, Inst. Cal

Sectorized Cloud & Moisture Imagery

Products

Products

Ancillary Data

Satellite Simulator(GPO/Flt)

T&C

GRB

T&C

GS Core


LS GN

T&C

Antenna/RF(GSP)

T&C

DCS/DAPS(OSDPD)

HRIT/EMWIN(NWS)

GOES N/O/P SSGS(OSO)eGVAR

GS Core


LS GN

T&C

Antenna/RF(GSP)

T&C

HRIT/EMWIN(NWS)

Sectorized Cloud & Moisture Imagery

L0, L1b, L2 KPPs, Inst. Cal

L0

HRIT

HRIT

DCS

CMD, GRB

Telem,Msn Data

CMD, GRB

Telem,Msn Data

Wide Area Network Communications (OSO)

GS Contractor Scope

GFP

GOES-R GS External Functions

GS Internal I/F

GS External I/F

NS

OF

(Su

itla

nd

, MD

)

Wide Area Network Communications (OSO)

ESPDS

T&

C, G

S S

ynch

, EM

,In

st. C

alib

rati

on

Dat

a

T&

C, G

S S

ynch

, EM

,In

st. C

alib

rati

on

Dat

a

Data/Prods àß EMEvents

CLASS(Ingest Portal

at WCDAS)

WAN (OSO)

CLASS(Ingest Portal

at RBU)

AWIPS*(I/F from

NSOF and RBU)

WC

DA

S(W

allop

s, VA

)

Off-S

ite

To Archives

To Archives

WA

N (

OS

O)

RB

U(F

airmo

nt, W

V)

TNCF(MD)

NCF(MD)

BNCF(WV)

WAN (OSO)

PoP

EM

PG PDMM

EM

PG PDMM

EM

PG PDMM

L2+ Parameters, L1b Cal Coefficients(via physical media to operators)

Backup Slides

16

O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S

FY 2013Q1 Q2 Q3 Q4

FY 2014Q1 Q2 Q3 Q4

FY 2012Q1 Q2 Q3 Q4

FY 2010Q1 Q2 Q3 Q4

FY 2011Q1 Q2 Q3 Q4

WA 6 Domain 5 /

HRIT

WA 7 CIP

DSCOVR

WA 1 PDA/ Enterprise

WA 3 Ingest

WA 2 NDE

WA 4 ADRS

WA 5 Space Weather

I2 ORR

10/24

I2 TRR

1/14

I1 ORR

10/9

I1 TRR

1/14

I1 PSR

6/4

I2 PSR

5/22

Start

9/1

PDR-A

5/20

CDR

11/2

IBR

2/2

SRR/SDR

1/21

Start

9/1

IBR

11/17

Build 3

11/26

Build 4

8/20

Build 5

10/3 1/31

NDE Sustainment CompletedNPP Launch

10/25

Trans to Ops

April

Start

4/4

Completion

9/30Start

12/28 4/25

SRR/SDR PDR

7/21

CDR

11/2

TRR

1/14

ORR

10/96/4

PSR

Start

2011

Completion

2013

Start

6/1

Completion

2013

Start

4/1

Completion

9/30

Start

2012

Completion

2018

Funded

Unfunded

PDR-B

6/20

Phase 1

6/4SAR

7/14

ESPDS Program MilestonesAs of April 1, 2011

17

Functional Analysis & Decomposition Process to Develop Legacy Requirements

• PDA Functional Model – Capture all functions for data product access & distribution– Identify missing functions and requirements

3.0 Disseminate Data

3.1 Receive Data Products

3.3 Distribute Data Products

3.2 Route Data Products

3.3.2 Initiate Data Product Push

3.3.3 Allow Data Product Pull

3.3.1 Enable Data Discovery

3.3.4 Log Data Product

Distribution

3.3.1.1 Provide Order Status Notification

3.3.1.3 Support Data Product

Requests

3.3.1.3.1 Accept Data Product

Requests

3.3.1.3.2 Approve Data Product

Requests

FR001_FTP_PullFR004_FTP_PushFR005_FTP_Push_PrimaryFR006_FTP_Push_Secondary

FR007_FTP_Push_RetransmitFR021_Rename_Before_PushFR022_Push_To_Temp_Name

FR008_User_Push_Pull_BothFR019_Dual_Role_AccountNDE_SRS118_Data_Delivery

FR012_Server_LogsFR013_Client_LogsFR023_Site_Parameters

NDE_SRS_209_User_Subscription_Requests NDE_SRS_265_Approve_Subscription_Requests

NDE_SRS120_Order_Status_Notification

3.3.2.1 Provide Data Product

Status

18

an enterprise approach for meeting satellite data and product distribution and access requirements...

Documents

access of data

distribution of poes

satellite data format

meeting satellite data

meteorological data

currentplanned distribution

separate distribution

version of mcidas mcidasx