Meta-data in GRUAN

Michael Sommer GRUAN Lead Centre, DWD

6th GRUAN Implementation and Coordination Meeting (ICM-6)

Greenbelt, MD, USA 10 March 2014

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 2 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Outline

➔ Introduction

➔ Meta-data in GRUAN ● Part 1 – GRUAN meta-data base

● Part 2 – Station & measurement systems

● Part 3 – Measurement

● Part 4 – Data & processing

● Part 5 – Dissemination

➔ Conclusion

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 3 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

What are “meta-data”?

➔ Everybody has an own imagination of that ● And all are different

➔ My interpretation of “meta-data” ● Data about data

● Information about characteristics of the data

● All information which is relevant to fully understand the data

➔ Important properties of meta-data ● Automatic handling → standardisation

● Good structured → as simple as possible but as complex as required

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 4 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Part 1: GRUAN Meta-Data Base

GRUAN

Meta-Data Base (GMDB)

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 5 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Part 2: Station & meas. systems

Station &

Measurement Systems

GRUAN

Meta-Data Base (GMDB)

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 6 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Structured meta-data

NW1

NW2 …

NW3

Station

MS1

MS4 …

MS3 MS5

MS2

Measurement systems

Base info

Network

Measurement system

Base info

Inst1

Inst4 …

Inst3

Inst5

Inst2

Instruments & sensors

Base info, e.g. position (lat, lon, alt), name, description,

start/end

Add info

Add info, e.g. manufacturer, specific properties,

measurand, ~method

Station &

Measurement Systems

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 7 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Station &

Measurement Systems

Change management

Change 2 Recalibration of

Instrument 5

2001

-05-

01 1

2:30

Change 1 Replacement of

Instrument 1

1998

-12-

07

Change 3 New software version for …

2005

-03-

24

2000 2005 2010 2015

Change 4 Meas. system shifted by 3 m

2009

-09-

02

Change 5 Replacement of

some components

2010

-02-

05

Change 6 From now in

Network TEST

2014

-01-

01

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 8 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Summary of part 2

➔ General information about a station ● When, where, what, who, …

➔ Instrumentation ● GRUAN measurement systems

● Detailed description of equipment/instrumentation of such a system (including their properties)

● History of changes of components (and their properties)

➔ Focus → traceability of change management over time

Station &

Measurement Systems

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 9 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Part 3: Measurement

Station &

Measurement Systems

Measurement

GRUAN

Meta-Data Base (GMDB)

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 10 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

RsLaunchClient

➔ Tool to collect meta-data and raw data ● For use at the stations

➔ Features of newest version 0.5 ● Improved template management

● Extracting of meta-data from different files

● Validation of all collected meta-data

● New documentation GRUAN-TD-3 → in review

➔ Coming features (end of 2014) ● Management of general meta-data of station → like operator, equipment, …

● Access to data product statistics of station → like data reports, …

Measurement

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 11 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

General information Measurement

Where, what, when 1

Site-internal, who 2

Campaigns 3

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 12 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Instrumentation Measurement

Links to processing systems 5 General infos 3

Properties 4

Ground equipment 1

Launch equipment 2

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 13 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Special actions Measurement

Ground checks and preparations 1

General infos 2

Properties 3

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 14 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Related data files Measurement

File infos 2

Files 1

Extract meta data 3

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 15 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Summary of part 3

➔ General information about a measurement ● When, where, what, who, …

➔ Instrumentation ● Used equipment including specific properties

● Interaction between components, like sonde ↔ telemetry system

➔ Special actions ● Ground checks, instrument preparations, …

➔ Related raw data ● Raw data of measurement

➔ Development of tools to collect these meta-data, e.g. RsLaunchClient

Measurement

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 16 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Part 4: Data & processing

Station &

Measurement Systems

Measurement Data

& Processing

GRUAN

Meta-Data Base (GMDB)

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 17 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Part 5: Dissemination

Station &

Measurement Systems

Measurement Data

& Processing

Dissemination

GRUAN Meta-Data Base

(GMDB)

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 18 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Data products

➔ Meta-data included in GRUAN data product files ● Using of a file format, that allows self-description of content → NetCDF

➔ Using of standards ● Who is our audience?

● Climate and Forecast (CF)

● Includes only: when, where, who, what

➔ Additional meta-data (GRUAN-specific) ● Instrumentation, equipment

● Preparation, ground checks

● Results of quality check

Dissemination

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 19 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

External services

➔ WMO Information System (WIS) ● Find (and get) GRUAN data

● GRUAN data products at GISC Offenbach (gisc.dwd.de)

● Product keys, like → org.gruan.RS92-GDP.v002.LIN.2013

➔ DataCite ● DOI's for specific GRUAN data products

● Using of special “landing pages” providing relevant meta-data

● In planning phase → discussion here at ICM-6

➔ Other services ● Always → Prepare meta-data in a service-specific way

Dissemination

Lead Centre M. Sommer – 2014-03-10 – Greenbelt, MD, USA – p 20 Lindenberg Meteorological Observatory

Richard Aßmann Observatory

Conclusion

➔ GMDB is existent and in operation

➔ Complex structured meta-data

➔ GMDB is the backbone of all GRUAN data flow

➔ At the moment → Only a small part of meta-data goes out.

➔ In the future → How can we enlarge the utility for you?

Thank you for your attention.

Station &

Measurement Systems

Measurement Data

& Processing

Dissemination

GRUAN Meta-Data Base

(GMDB)