the gmes space component data access system: harmonizing ... · the gmes space component data...

7/13/2011

1

1INSPIRE Conference 2011 – Edinburgh, June 30

The GMES Space Component Data Access System:

harmonizing Earth Observation products

flows and services

for the GMES

A. Tassa1, J. Martin1, R. Knowelden2, M. Nota3, G. Vingione4

1European Space Agency (ESA), ESRIN, Frascati, Italy2 ASTRIUM UK, Portsmouth, UK

3 Telespazio, Rome, Italy4SERCO SpA, Frascati, Italy


Introduction Project background

Data sources and users heterogeneity

GSCDA harmonization approach

GSCDA Functionalities

GSCDA Operational Scenarios

GSCDA Interfaces

GSCDA interoperable standards and protocols

Metadata for spatial DataSets

Catalogue

Order and User Management

Web Map Service

Project status and follow-on

DEMO web map service

Outline of presentation

7/13/2011

2


GMES Space Component Context


Marine

Core ServiceSecurity

Core Service

Atmosphere

Core Service

�Multi-temporal mosaics

�Systematic environmental

monitoring

�Alert systems

�Ship detection

�Oil Spills

�Geology and Hydrology

�Urban Atlas

�European coverage

�Hot spot monitoring

�Forestry

� Agriculture

�Urban sprawl

� Soil erosion

�Desertification

�Damage Assessment

�Disaster monitoring (i.e.

floods)

�Cartographic service

�Man-made emergency

situations

GSCDA users and applications (EC FP7)

�Nuclear and Treaties

Monitoring

�Natural resources and

conflicts

�Migration and Border

Monitoring

�Critical Assets

Marine Land Emergency Security Atmosphere

�Air Quality

�Global Atmospheric

Composition

�Climate

Land

Monitoring

Core Service

Emergency

Response

Core Service

AQUAMAR ASIMUTH BIO_SOS

CARBONESCoBios

CRYOLAND DOLPHIN DORIS EUFODOS

EURO4M

EVOSS FIELD_AC FRESHMON GARNET-E GEO-PICTURES GLOWASIS

ISAC

MALAREO

MS.MONINA MYWATER NEREIDS PASODOBLE REDDAF REDD-FLAME

SEAU

SIDARUS

SIRIUS

SubCoast

See GSCDA users on http://gmesdata.esa.int

7/13/2011

3


Radarsat 1-2

Envisat

Rapideye

SPOT5

IRS

Landsat

ALOS

Cosmo-SkyMed

Ikonos

Geo-Eye

TerraSar-X

DMC

Deimos-1

QuickBird

EROS

ERS

Spot Vegetation

Global Systematic

Productions

Commercial

scene ordering

Value added

products

Eumetsat Missions

GMES Contributing Missions heterogeneity

Emergency

data provision

�Systematic EO products

productions

� Systematic EO products

delivery to the users

�Maritime surveillance

�Delivery Statistics Reporting

�On-demand rush

satellite tasking

�Rush ordering from

archive

�Full reporting

� On-demand EO products ordering

�Geographic Areas Coverages

standing production and delivery

�On-demand Map gaps filling

�Full Reporting

�DataSets Quality Control

� Orthorectified EO

Products

�Full reporting

�Multi-temporal

composites

See GSCDA providers on http://gmesdata.esa.int


ERS

Self Described

Containers Formats

EO Products:

Image Standard FormatsEO Products Format

�XML

�HDF4-5

�netCDF

�SHAPE

�NITF

�NSIF

�SAFE

�JPEG

�JGW

�PNG

�BMP

�GIF

�PNM

�JPEG2000

�TIFF

�GeoTIFF

�TFW

�CEOS Superstructure

�Generic EOSAT Fast Format

�Earth Explorer File Format

�DIMAP

Radarsat 1-2

Envisat

Rapideye

SPOT5

IRS

Landsat

ALOS

Cosmo-SkyMed

Ikonos

Geo-Eye

TerraSar-X

DMC

Deimos-1

QuickBird

EROSSpot Vegetation

Eumetsat Missions

GCMs Heterogeneous Products Formats

7/13/2011

4


GSCDA data sources and users heterogeneity

…taking into account the need to:

• Rely on GCMs existing infrastructures

• Avoid unnecessary duplications

• Avoid disruption of existing operational interfaces

• Minimize impact on GCMs

How to handle all this diversity?



Data sources heterogeneity




GSCDA Interfaces



Catalogue


Web Map Service




7/13/2011

5


GSCDA Harmonization Approach

Develop a Coordinated Data Access System (CDS) in charge

of leveling diversity as needed for delivering services to

the users

AND

Define:

• CDS vs. GCMs functionalities

• CDS vs. GCMs operational scenarios

• CDS �� GCMs interfaces and protocols

GSCDA system is a distributed system that provides predefined services relying on GCMs

and CDS according to pre-defined scenarios and interfaces


GSCDA functionalities

7/13/2011

6


GSCDA operational scenarios

14 GSCDA Operational Scenarios

• DataSet production

mechanism?

• Products flows from GCMs

to CDS to users?

• Archiving strategy?…with every scenario characterized by specific interfaces and protocols


• Products packaging metadata

• Reporting Metadata

• Quality Control

• Satellite tasking metadata

• Catalogue (OGC 06-131)

• Ordering from Catalogue (OGC 06-141)

• User Management (OGC 07-118)

• Programming (OGC 07-018)

• Web Map Services

Interoperable (M2M)

interfaces

GSCDA (internal) interfaces and protocols

Semi-automated interfaces

Operators

interfaces

• Advertisement

• Orbit information

• Mission unavailability

• Tasking requests

• Help Desk

ESA contributes to

OGC via HMA

Working Group

7/13/2011

7


GSCDA operational scenarios and corresponding interfaces and protocols are described

in a complete documentation package for GCMs available to all space missions

contributing to GSCDA

(soon available on http://gmesdata.esa.int)

GSCDA interfaces and protocols for GCMs







GSCDA Interfaces



Catalogue


Web Map Service




7/13/2011

8


Metadata for Datasets

• Currently all GSCDA datasets are described by ISO19115 compliant metadata

• The metadata is used by the Advertising Function, which publishes descriptions of datasets to users and how they are made available

E.g. Description of dataset DAP_MG2_13 (Volcanoes

Europe/RoW HR Opt) at: http://gmesdata.esa.int/web/gsc/

E.g. Description of dataset DAP_MG2_13 (Volcanoes

Europe/RoW HR Opt) at: http://gmesdata.esa.int/web/gsc/

GS

CD

A A

DV

Fu

nct

ion

GS

CD

A A

DV

Fu

nct

ion

GSCDA standards and protocols #1:

publishing DataSets Metadata

INSPIRE Equivalence: “Metadata for Spatial

DataSets”


• The GSCDA-HMA Catalogue is based on the ebRIMProfile (OGC 07-110r2) of the OGC Catalogue Services for the WEB (OGC 07-006r1 )

• The native GML Earth Observation Product Metadatadefined in OGC 06-080r4 are mapped in the ebRimstructure for data discovery as defined in the (OGC 06-131r6)

• Protocol based on http – SOAP 1.1


HMA Catalogue

INSPIRE Equivalence: “Discovery service”

7/13/2011

9




• Order Services (OGC 06-141)

• Prioritised for ordering reference data from archive for emergency scenarios

• Allows specification of ordered items, order options and order feedback

• For suppliers supporting on-line download (e.g. CDS Core Infrastructure), direct products download available

• Supporting standards

• SOAP, SWE

• User Management (OGC 07-118)

• Required I/F for user clients authentication/authorisation

• Optional I/F for contributing missions

• Required for re-use of I/F in multiple use-cases.

• Integrated with WEB Single-Sign-On

• Supporting standards• OASIS SAML 1.1, WS-Security 1.1, WS-Trust 1.3, WS-Security

UsernameToken Profile 1.1

• W3C SOAP 1.2 (and 1.1), XML Encryption / XML Signature

• Non-intrusive and applicable to other service specifications where necessary

OrderOrder

Authorise

Authorise

Authenticate

Authenticate

INSPIRE Equivalence: “Invoke & Download Services”



Web Map Service

• EO Profile for WMS (OGC 07-063)• Profile that allows individual products from

large collections of data to be displayed as WMS layers

• Provision of “reduced resolution” browse without any data policy issue

• Provision of “full resolution” imagery depending on license

INSPIRE Equivalence: “View Services”

Still pilot: watch Live Demo!

7/13/2011

10


GSCDA interoperable interface with external users

Guidelines for M2M integration activities with users being defined

User clients

HMA Catalogue and Order

INSPIRE Equivalence: “Discovery, Invoke and Download”

GSCDA clients







GSCDA Interfaces



Catalogue


Web Map Service




7/13/2011

11


GSCDA Development Project Status

GSCDA infrastructure V1: in operations

� Focus on: automated products circulation, archiving and dissemination

• CDS V1.4

• GCMs IFs V1 (10 G/S integrated)

GSCDA infrastructure V2: on-going

� Focus on: HMA interfaces, streamlined ordering interfaces and automated collection discovery

– CDS V2.0 soon to be deployed

– GCMs IFs V2 interfaces progressively integrated as available

22

GSCDA extended concept: EC DataWareHouse

• Participants to a project financed under FP7 [FP7_Proj]

• Institutions and bodies of the EU [EU_Inst]

• Public authority [Public_Auth]

• International Organisations and NGOs [INT_ORG_NGO]

• Public [Public]

Extended USER CATEGORIES

• DISCOVERY Service:Spatial data services making it possible to search for spatial datasets and services on the basis of the content

of the corresponding metadata and to display the content of the metadata.

• VIEW ServiceThe VIEW service shall make possible, as a minimum, to display, navigate, zoom in/out, pan, or overlay

viewable spatial data sets and to display legend information and any relevant content of metadata

• DOWNLOAD Service:The DOWNLOAD service shall allow the beneficiary:

(1) to make an unlimited number of copies of the Primary Product as needed (archiving and backup purposes

included);

(2) to install on as many individual computers as needed, including internal computer network;

….<omissis>…

Extended USAGE TYPES

(SERVICES)

7/13/2011

12

23

Outlook to the future

GSCDA infrastructure V3: under definition

� Focus on: extended needs from DWH (e.g. VIEW service and enhanced users community) +

continuity/evolution of services after Sentinels integration

– CDS V3.0 (under definition)

– GCMs IFs V3 (to be defined)

– Sentinels PDGS IFs under development

2013, 2014+

Sentinel 1 – SAR imagingAll weather, day/night applications, interferometry

2013, 2015+

Sentinel 2 – Multispectral imagingLand applications: urban, forest, agriculture,..Continuity of Landsat, SPOT

2013, 2015+

Sentinel 3 – Ocean and global land monitoringWide-swath ocean colour, vegetation, sea/land surface temperature, altimetry

24

Live demonstration of pilot

Web Map Service

the gmes space component data access system: harmonizing ... · the gmes space component data...

Documents