CEOS/WGISS, Toromsoe – May 10-14, 2004 1

WTF-CEOPJAXA Implementation Plan

May 12, 2004

Osamu Ochiai, Ben Burford / JAXAKen McDonald, Yonsook Enloe / NASA

Rong XIE / University of Tokyo

CEOS/WGISS, Toromsoe – May 10-14, 2004 2

Contents

1. WTF-CEOP project status: Osamu Ochiai 10minprogram purpose, history, project plan status, meeting schedule, etc

2. Data Integration: Yonsook Enloe 10minData Integration white paper and its meaning

3. JAXA Implementation Plan (with demo): Ben Burford 15minJAXA prototype system and demo

4. NASA Implementation Plan: Ken McDonald 15minNASA prototype system planning

5. Other possibilities for CEOS WGISS member participation: Ben 10min.6. ISO/TC211 metadata and data for CEOP: Dr. Shibazaki 20min

CEOP acitivity for ISO/TC211 and discuss how to collaborate in WGISS

7. Total Discussion: 30min (including future plan and plenary demo)

CEOS/WGISS, Toromsoe – May 10-14, 2004 3

WTF-CEOP JAXA FundingFirst Implementation Plan

地球水循環インフォマティクスの確立 (chikyuu mizu junkan infomatics no kakoritsu)

Establishing a Global Water Cycle Informatics

MEXT (Ministry of Education, (Science, Culture, Sports) and Technology).

University of Tokyo/JAXA/RESTEC分散型データマイニングシステム

(bunsangata data mainingu shisustemu)“Distributed Data Mining System”

CEOS/WGISS, Toromsoe – May 10-14, 2004 4

Users

Menus - Select DataFunctions - Plot Data

Web Browser

UCAR Archive

(In-situ)MPI

Archive (Model Output,

MOLTS)

DODS

CSDICArchive

(Satellite, Model Output)

DODS

DODS

Live Access Server (LAS)WTF-CEOP

Ferret

Open source s/w from Pacific Marine Environmental Laboratories (US)Access by web browserMenus (to select data and functions)

Functions (plot, quick inspection, download)Scientist’s requests (diurnal cycle)Provide links to documentation and metadataSearch function on variables and dataset names

WTF-CEOP First IP

CEOS/WGISS, Toromsoe – May 10-14, 2004 5

CEOS/WGISS, Toromsoe – May 10-14, 2004 6

CEOS/WGISS, Toromsoe – May 10-14, 2004 7

CEOS/WGISS, Toromsoe – May 10-14, 2004 8

CEOS/WGISS, Toromsoe – May 10-14, 2004 9

CEOS/WGISS, Toromsoe – May 10-14, 2004 10

CEOS/WGISS, Toromsoe – May 10-14, 2004 11

CEOS/WGISS, Toromsoe – May 10-14, 2004 12

CEOS/WGISS, Toromsoe – May 10-14, 2004 13

CEOS/WGISS, Toromsoe – May 10-14, 2004 14

CEOS/WGISS, Toromsoe – May 10-14, 2004 15

CEOS/WGISS, Toromsoe – May 10-14, 2004 16

CEOS/WGISS, Toromsoe – May 10-14, 2004 17

CEOS/WGISS, Toromsoe – May 10-14, 2004 18

CEOS/WGISS, Toromsoe – May 10-14, 2004 19

CEOS/WGISS, Toromsoe – May 10-14, 2004 20

CEOS/WGISS, Toromsoe – May 10-14, 2004 21

CEOS/WGISS, Toromsoe – May 10-14, 2004 22

CEOS/WGISS, Toromsoe – May 10-14, 2004 23

Data Type

In-situ

MOLTS

Satellite

Model Output

In-situ

Surface

Tower

Soil

Flux

Reference Site

Mongolia

Siberia

Lindenberg

Taiwan

Etc.

Station

A1

A2

A3

A4

Etc.

Variable

Atm. Pressure

Air Temp.

Surface Temp.

Wind Speed

Etc.

WTF-CEOP Menus

1. Surface Meteorological and Radiation Data Set

2. Meteorological Tower Data Set3. Soil Temperature and Soil Moisture Data

Set4. Flux Data Set

CEOS/WGISS, Toromsoe – May 10-14, 2004 24

Sample of In-situ Data

2001/07/01 01:00 2001/07/01 01:07 LBA Pantanal A11 -19.56339 -57.01494 425 1003.30 G 25.62 G 16.54 G 57.22 U 11.75 U 2.98 I 38.82 U -1.87 U -2.32 B 0.00 U -999.99 M -2.40 U -1.26 U -999.99 M -999.99 M -27.10 U -999.99 M -0.52 U -3.22 U

CEOS/WGISS, Toromsoe – May 10-14, 2004 25

Main In-situ Data Difficulty7 QC Flags

G Good B Bad U Unchecked I Interpolated/Estimated C Reported value exceeds output format field

size OR was negative precipitation. D Questionable/Dubious M Parameter value missing OR Derived

parameter can not be computed.

CEOS/WGISS, Toromsoe – May 10-14, 2004 26

QC Flag Menuand QC Flag Statistics

G 85% B 2% U 8% I 0% C 0% D 0% M 5%

G B U I C D X X X

CEOS/WGISS, Toromsoe – May 10-14, 2004 27

Plot of QC Flags

CEOS/WGISS, Toromsoe – May 10-14, 2004 28

Way Forward for IP #1

Install LASand FerretSoftware

Developand InstallIn-situ DataMenus and Functions

UCARInstall In-situ DataandDODS

Developand InstallMOLTSMenus andFunctionsMPIInstall MOLTS DataandDODS

DevelopAnd InstallSatelliteMenus andFunctions CSDICInstall Satellite DataandDODS

Developand InstallModel OutputMenus and FunctionsCSDICInstall ModelOutput Data(++MPI)

Make ISO TC211 Metadata Plan and Gather MetadataGather Data DocumentationIncorporate Scientist’s Requests

9 Mo./

1 Yr.?

Sep.?

IP #1

IP #1 and Future

CEOS/WGISS, Toromsoe – May 10-14, 2004 29

Users

OtherData

Archives

Locate DataVisualize DataLight Processing

Web Browser

“Assisted” Download

UCARArchive(In-situ)

MPI Archive (Model Output, MOLTS)

DODS

CSDIC Archive (Satellite, Model Output)

DODS

DODS

DODS

Live Access Server (LAS)WTF-CEOP

Ferret

GrADS

IDL CDAT

Matlab

Download SoftwareLibrary of scripts

CEOS/WGISS, Toromsoe – May 10-14, 2004 30

Contents

1. WTF-CEOP project status: Osamu Ochiai 10minprogram purpose, history, project plan status, meeting schedule, etc

2. Data Integration: Yonsook Enloe 10minData Integration white paper and its meaning

3. JAXA Implementation Plan (with demo): Ben Burford 15minJAXA prototype system and demo

4. NASA Implementation Plan: Ken McDonald 15minNASA prototype system planning

5. Other possibilities for CEOS WGISS member participation: Ben 10min.6. ISO/TC211 metadata and data for CEOP: Dr. Shibazaki 20min

CEOP acitivity for ISO/TC211 and discuss how to collaborate in WGISS

7. Total Discussion: 30min (including future plan and plenary demo)