vgisc project: status and plans

Abteilung Systeme und Betrieb

WMO CBS TECO WIS, Seoul 06-08.November 2006

VGISC Project: Status and Plans

Heinrich Knottenberg ([email protected])

Deutscher Wetterdienst

(http://www.dwd.de)



Overview

Motivation WIS Project Overview VGISC/SIMDAT VGISC Prototypes Preparation of Operations



Information collection

Global InformationSystem CentreGISC

GISC

GISC

GISC

GISC

NCNC

NC

NC

NC

NC

NC NC

NC

NC

Data Collection or Product Centre

National CentreNC

DCPC

DCPC

DCPC

DCPC

NC NC

Various communication networks

Global InformationSystem CentreGISCGISC

GISC

GISC

GISC

GISC

NCNC

NC

NC

NC

NC

NC NC

NC

NC

Data Collection or Product Centre

National CentreNC

DCPC Data Collection or Product Centre

National CentreNC

DCPC

DCPC

DCPC

DCPC

NC NC

Various communication networks



Information distribution

NationaldisseminationRequest/reply(Internet)

Nationalusers

Nationalusers

Routinedissemination(Internet, privatenetwork,satellite,etc.)

GISC

GISC

GISC

GISC

NC

NC

NC

NCNC

NC

NC NC

DCPC

DCPC

DCPC

DCPC

Various communicationnetworks



Nationalusers

Nationalusers



GISC

GISC

GISC

GISC

NC

NC

NC

NCNC

NC

NC NC

DCPC

DCPC

DCPC

DCPC

Various communicationnetworks



Overview




VGISC Partners

• In 2001, RA-VI decided to create a project for the development of a prototype GISC.

• The NMSs of France, Germany and the UK have volunteered to jointly design and implement a virtual GISC (VGISC) shared by their Services and to include the ECMWF and EUMETSAT as DCPCs into the concept, funded partially as EU project SIMDAT.

• A first proof-of-concept system was demonstrated during CBS XIII.

VGISC



VGISC Project Overview

Year

2005 -

2006 -

2007 -

2008 -

2009 -

Preparations

Operations

Steering

Group

Project

Office

SIMDAT Project

Distribution Systems of the Partners e.g. WebWerdis, DIFMET, ECPDS, JEDDS, EUMETCast, RETIM2000

Subscription Service



VGISC Working Groups

• Data Policy (Francois Duvernet, Meteo France)

• Data Management (Steve Foreman, UK Met)

• Data Acquisition and Dissemination (H. Knottenberg, DWD)

• Communication (Hans Janßen, DWD)



“Pull” request handling

data flow

control flow

local data sourcelocal production

tools

production controltranslator

data controltranslator

localinstruction(for ownproductiontools)

Production(NC/DCPC)

atomiccatalogue

productcatalogue

product instancecatalogue

distribution catalog.

customer orders

Metadata-pool

GISC-node

distribution tool (push)

monitoring tool

synchronisation tool

definition demon or-webservice

Web-Browser

Client

distribution demon or-webservice (pull)

GISCproduct instance

pool localinstruction(searching foratoms inown database )

global instructions(for data searching and production)

Tools and frontend-Server(adminstration- andcoordination centre)

Internet Portal(web frontend)

Local data pool(s)



“Push” distribution

atomiccatalogue

productcatalogue

product instancecatalogue

distribution catalog.

customer orders

Metadata-pool

GISC-node

monitoring tool

synchronisation tool

definition demon or-webservice

Client

distribution demon or-webservice (pull)

GISCproduct instance

pool

data flow

control flow

distribution tool (push)

Internet Portal(web frontend)

Tools and frontend-Server(adminstration- andcoordination centre)

Local data pool(s)



Overview




SIMDAT

Data Grids for Process and Product Development using Numerical Simulation and Knowledge Discovery

www.simdat.org

funded by the European Commission

SIMDAT General Information



Application Activities

Four sectors of international economic importance:

Automotive

Pharmaceutical

Aerospace

Meteorology

Technology Activities

Seven Grid-technology development areas:

Grid infrastructure

Distributed Data Access

VO Administration

Workflows

Ontologies

Analysis Services

Knowledge Services

SIMDAT Application and Technology



SIMDAT Conceptual View

• Through the Distributed Portal users searches for and retrieves data, subscribe to services subject to authentication and authorization

• The Virtual Database Service provides a single view of partners databases



VGISC-SIMDAT Working Groups

• Virtual Organisations (Lothar Wolf, EUMETSAT)

• Ontology (Jeremy Tandy, UK Met)

• Distributed Data (Jacques Roumilhac, Meteo France)

• Grid Infrastructure (Hans Janßen, DWD)



VGISC SIMDAT structure



Interface to offer a single view of the data- Discovery facilities- Request/Subscription

MonitoringLoggingControl

Error tracking

SecurityAuthenticationAuthorization

Audit

ManagementUser registration

DB adminCatalogue admin

Grid infrastructure for sharing data

Interoperability interfaces for data/metadata exchange

mechanisms to synchronise metadata

DisseminationAcquisition

mechanisms



• Presented to EU-Commission in November 2005:

• VGISC-Nodes at the contributing sites

• Data contributions

• DWD: Access to climate time-series data

• UK Met Office: XML Metadata / - Data Prototype

• Meteo France: NWP Products

• ECMWF: Model Analyses, Observational Data (One Sample Day)

SIMDAT EU Demonstrator 2005



• To be presented to EU-Commission at end of November 2006:

• VGISC-Nodes (Enhanced Version) at the contributing sites

• Data Contributions

• DWD: Access to climate time-series data, NWP Products

• UK Met Office: XML Metadata / - Data Prototype, Lighting Detection data

• Meteo France: NWP Products, Selection of GTS Data

• ECMWF: Model Analyses, NWP Products

• EUMETSAT: Satellite Images

SIMDAT EU Demonstrator 2006



Overview




• DWD: Portal

• DWD: Push/Pull System

• DWD: Access to climate time-series data (UNIDART-Project)

• UK Met Office: XML Metadata / - Data Prototype (Description only)

• ECMWF: Model Analyses

• EUMETSAT: Access to EUMETCast Dissemination

• NCAR: Model Analyses

CBS 2005 GISC Prototype



• Push/Pull System: DWD

• DWD: Access to climate time-series data (UNIDART-Project)

UK Met Office: XML Metadata / - Data Prototype

• ECMWF: Model Analyses

• EUMETSAT: Access to EUMETCast Dissemination

• NCAR: Model Analyses

RA VI Conference Demonstration(Continuation of CBS 2005-Prototype)



• Portal: At Sites of contributors

• Available data types:

• DWD: NWP Products, Climate Time Series

• ECMWF: NWP Products, TIGGE, Reanalysis

• EUMETSAT: Satellite Images

• METEO-France:NWP Products, Selection of GTS Data

• UK MET-Office: Selection of OPMET-Data (METARs, TAFs)

• NCAR: Reanalysis data, environmental data

• RNODC: GTS Data

CBS TECO WIS Presentations



• Available data types (continued):

• BoM: NWP Products, Observational Data

• CMA: NWP Products, Satellite Images

• JMA: NWP Products, Satellite Images

• KMA: NWP Products, Climate Time Series

CBS TECO WIS Presentations



Overview




VGISC Project Office

• Investigate and prepare options for the Policy Board on organisational, financial and technical matters such as– precise scope of the VGISC including data policies and

GTS support– operating the VGISC– methods of funding, acquisition and staffing– management structures– implementation and migration



Open Issues (technical)

• WMO Standards not yet specified/finalised

… Metadata Standard

… Interfaces between Centres

… Operational procedures

• …..

•



Questions ?

vgisc project: status and plans

Documents