gmes space component data access architecture and ... · um catalogue ordering programming...

GMES Space Component Data Access

Architecture and Operational Scenarios, HMA Implementation Status

GSCB WorkShop – ESRIN – June 18th, 2009

Outline of the presentation

GSC Data Access and PreGSC Data Access and Pre--Operation ProjectOperation Project–– ScopeScope–– Data Sets DefinitionData Sets Definition

GSC Coordinated Data Access (CDS) SystemGSC Coordinated Data Access (CDS) System–– Overview Overview –– Major ComponentsMajor Components–– Operational scenariosOperational scenarios–– CDS project status CDS project status

Focus on Heterogeneous Mission Accessibility (HMA)Focus on Heterogeneous Mission Accessibility (HMA)–– Interfaces implementationInterfaces implementation–– Standardisation and interfaces evolutionStandardisation and interfaces evolution


Integration of GMES Contributing Missions (GCMs) and Sentinels data flows for GMES Service Projects through coordination of operational interfaces.

GMES Ground Segment and Data Access


Data System Overview

From the data requirements collected from the GMES Service Projects, the Data Access Portfolio (DAP) is generated and accordingly theCoordinated Data access System (CDS) shall:

•Build the data collection across a diversity of Missions product offer •Operate across a diversity of Missions Ground Segments interfaces


GMES Data Sets Concept

Data sets definition covers: •Geographical coverage (e.g. European land coverage, pre-defined emergency areas,…)•Product specifications (instrument types or modes, product level..)•Availability specification (timeliness, period of acquisition,…)

http://gmesdata.esa.int

http://gmesdata.esa.int/


Coordinated Data Access System (CDS):A large heterogeneous distributed system requiring the integration and coordination of a large number of operational interfaces

Coordinated Data Access (CDS)


Coordinated Data Access System components:Service Projects Coordinated Interface:

•Service Projects interface for data sets and operations advertisement, user management, data ordering interface•Data set production coordination •GCMs interface for mission production coordination

Core Infrastructure: Products collection and cataloguing for data sets creationReporting and performance: Overall performance continuous measurement

Coordinated Data Access Overview


Operations are based on scenarios triggered by GMES Service Projects needs in terms of data sets performances and operational interfaces e.g.:

•Data streams from global systematic missions scenario•Geographic Area Coverage scenario•Emergency Rush Satellite Tasking scenario

Operational Scenarios


Data Streams from Global systematic Missions Scenario•Coordination of data registration and subscriptions

Global Systematic Missions Scenario

Acqu

isiti

on/

Proc

essi

ng

Dis

sem

inat

ion

GM

ES S

ervi

ce P

roje

cts

(GSC

DA

Inte

rfac

e)

• Subscription Request

GC

Ms

CDS

Mission Planning

User Services

Post-processing

Element

Core InfrastructureService

Projects Coordinated

Interface

Reporting and

Performances

GM

ES S

ervi

ce P

roje

cts

(Dat

a R

ecip

ient

)GCM Products

L0/L1/L2 Archive

Delivery Reports

SubscriptionRequest

Acqu

isiti

on/

Proc

essi

ng

Dis

sem

inat

ion

GM

ES S

ervi

ce P

roje

cts

(GSC

DA

Inte

rfac

e)

• Subscription Request

GC

Ms

CDS

Mission Planning

User Services

Post-processing

Element

Core InfrastructureService

Projects Coordinated

Interface

Reporting and

Performances

GM

ES S

ervi

ce P

roje

cts

(Dat

a R

ecip

ient

)GCM Products

L0/L1/L2 Archive

Delivery Reports

SubscriptionRequest


Geographical Area Coverage scenario:•Coordination of mission ordering and mission archive interfaces

Geographical Area Coverage Scenario

GM

ES S

ervi

ce P

roje

cts

(Dat

a R

ecip

ient

)

GCM

Acqu

isiti

on/

Proc

essi

ng

Dis

sem

inat

ion

CDS

• Order or Standing Order

GSCData Sets

Mission Planning

User Services

• Tasking Reports• Optical Acquisition

Reports• Circulation Reports• Coverage Reports

GCMProducts

CDS-SCICDS-CI

CDS-SPR

CDS-PPE

GM

ES S

ervi

ce P

roje

cts

(GSC

DA

Inte

rfac

e)

Archiving Reports

Delivery Reports

DAP Management functionDAP Management function

Dissemination Request

DataSet definition

Subscription request

L0 Archive

SubscriptionRequest

DataSet Activation Request and full Definition


Emergency Rush Satellite Tasking scenario:•Coordination of mission planning interfaces

Emergency Rush Satellite Tasking Scenario

GM

ES S

ervi

ce P

roje

cts

(Dat

a R

ecip

ient

)

GCM

Acq

uisi

tion/

Pro

cess

ing

Dis

sem

inat

ion

• Rush Satellite Tasking Request GCM

Products

GCM

CDS

Mission Planning

User Services

• Acknowledgement• Planning Feedback• Tasking Report• Delivery Report• Circulation Report

Email notification

NRTGCM

Products

CDS-SCICDS-CI

CDS-SPR

CDS-PPE

GM

ES S

ervi

ce P

roje

cts

(GSC

DA

Inte

rfac

e)

Archiving Reports

DataSet definition

L0 Archive

Emergency Request


Coordinated Data Access System Project Context

2008/2009: V1 Scope:Establish a coordinated technical baseline for GSCDA data flows“Preliminary” Pre-operations of GMES Services Projects

2009/2012: V2 Scope:GSP operational interfaces implementationHMA infrastructure initial operations

2009/2013: V3 Scope:GSP operations evolutionsCDS operations evolutions Integration of Sentinels Ground Segments


Coordinated Data Access System Project Status

KO

GCMs ITT

CDS System

Requirements Review

CDS Preliminary

Design Review

DAP-R 1.0 DAP-R 1.1

Coordinated

Data A

ccess System

Sept 07

GSCDA IF reqs for GCMs

Summer 2008

June 2008 May 2009

May 2008 March 2009

Pre-ops KODec. 2008

KO

Sept 07

CDS reviews organised with participation of GMES Service Projects


Coordinated Data Access System Preliminary Architecture

Coordinated Data Access System Preliminary Architecture has been defined, including:•CDS sub-components preliminary design•Integration of EO Data Access Integration Layer


Interfaces with GMES Contributing Missions

Interface Requirements have been defined for the GMES Contributing Missions concerning•Interface Operational procedures•Service performance monitoring and management•Machine to machine protocols (incl. HMA interfaces)


GCMs Interface Implementation

Preparation and implementation

Integration Readiness Review

Integration and Verification

Operations Readiness Review

KO

Transfer to Operations

KO Meeting(ESRIN)

KO+3 months

ORR Meeting

IVRR Meeting

Progress meeting

2 Months

1 Month

Unified integration process tailored to specific GCM G/S capabilities

Resulting in:• Qualified GSC operational

baseline through formal engineering process

• Documented operational baseline available to all GSC participants

• Measurable performances against baseline

• Strong basis for improvements and evolution from both GCM and GSP points of view

Within challenging constraints:

• Preliminary operations already on-going

• Very short development life-l


KO IVRR

ImageSat&EUSI

Summer integration activities with GCMs

June 09 Dec 09

ORR


Acqu

isiti

on/

Proc

essi

ng

Dis

sem

inat

ion

Archive

GM

ES S

ervi

ce P

roje

cts

(Coo

rdin

ated

Ope

ratio

nsIn

terf

ace)

GC

Ms

Coordinated Data System

Mission Planning

User Services

Post-processing Element

Post-processing Element

Core Infrastructure

Service Projects

Coordinated Interface

Reporting and

Performances

Reporting and

Performances

OperationalDataSets Definition

OperationalDataSets Definition

GM

ES S

ervi

ce P

roje

cts

(Dat

a R

ecip

ient

)

The large number of different operational scenarios (~15) combined with the number of different data sets (~40) and the number of different external interfaces (~20) lead to operational risks e.g.•Operational resources involvement•Overall system performance monitoring and management•Reliability

Interoperability Operational Challenges

HMA shall provide an integrated layer of mission interfaces allowing streamline of operations and therefore general performance increase.

implementation and usage is supported within the CDS environment


HMA Build-upG/S Task Force Recommendation:

use of standardized interfaces

ESA/PB-EO(2004)53, rev. 1

Heterogeneous Mission Accessibility

EOP-G presentation to DOSTAG 43. April 2005.

ESA

HMA Architecture Working Group

HMA WG Terms of ReferenceRef. GMES-DFPR-EOPG-PR-06-0006

HMA Implementation

Standard specifications

HMA Standards Interfaces Initial Specifications

DAIL Implementation

HMA I/F Implementation @ ESA

HMA I/F Implementation @ HMA Contributing Agencies

HMA Test Bed

Prototyping and Testing

Standards Evolution

Interoperability standards project

Operational Implementation Projects

Standard specifications

Feedbacks Feedbacks

EUM

DLR

ASI

CNES

CSA

BNSC

HMA I/F Implementation @ GCMs

HMA Contributing Agencies


HMA Implementation Activities

20102009

ORRORRKOKO

CatalogueOrdering

Programming

Catalogue

UMCatalogueOrdering

Programming

CatalogueOrdering

Catalogue

CatalogueOrdering

User ManagementWMS


Impact of HMA on GSC Ground Segment

• GSC Data Access fully relies on a coordinated approach of the Earth Observation data provision

• HMA architecture and standards will improve the performance and reliability of operations. Complete availability of this solution depends on GCMs readiness

• GSC HMA implementation is not specific and can be easily reused within other Earth Observation missions context (e.g. scientific missions and user community)

GMES Space Component Data Access��Architecture and Operational Scenarios, HMA Implementation Status ��Outline of the presentationOutline of the presentationData System OverviewGMES Data Sets ConceptOutline of the presentationCoordinated Data Access System �Project ContextCoordinated Data Access System �Project StatusCoordinated Data Access System Preliminary ArchitectureInterfaces with GMES Contributing MissionsGCMs Interface ImplementationSummer integration activities with GCMsOutline of the presentationHMA Build-upHMA Implementation ActivitiesImpact of HMA on GSC Ground Segment

gmes space component data access architecture and ... · um catalogue ordering programming...

Documents