Progress of CMA TIGGE Archive Data center

(updated)

Bian Xiaofeng ,Li Xiang ,Sun Jing

(National Meteorological Information Centre,CMA)

Chen Jing Hu Jiangkai,

(National Meteorological Centre,CMA)

22 - 24 February, 2010, Geneva,Swiss

Archive Centre

Current Data Provider

NCAR NCEP

CMC

UKMO

ECMWFMeteoFrance

JMAKMA

CMA

BOMCPTEC

IDD/LDM

HTTP

FTP

Archive Centre

Current Data Provider

NCAR NCEP

CMC

UKMO

ECMWFMeteoFrance

JMAKMA

CMA

BOMCPTEC

IDD/LDM

HTTP

FTP

TIGGE Archive Centers and data providers

Courtesy of Steve Worley, NCAR

UPDATE: TC CXML Providers:• CMA – yes ECMWF – yes Met Office - yes• JMA - yes NCEP – yes CMC - yes (via

NCEP)• KMA - yes

CMA hosts Asia TIGGE Center

3

Platform (Hardware & Software)

• Linux Cluster (named “Purple Haze”)

• 7 Nodes (IBM X series)• 1 node for Management• 3 node for exchanging data with ECMWF, NCAR,

CPTEC, CMC via LDM• 1 node for data processing • 1 node for MARS server (testing), 1 node for

MARS client• 2 node for ftp server• Connected via GB Ethernet

• Storage: Disk Array• Physical Capacity: < 30 TB• Interface: 4GB-FC

• GPFS:• installed on each node • configured for sharing data within the cluster

TIGGE Platform Update since 2009

• Apr.2009 Increasing EMS Memory of Nodes,– LDM ---32GB，– Others ---- 16GB

• Jun.2009 : the real-time updates of the TIGGE information on monitoring and requests.

• Jan.2010: expanding 15TB disk array

CenterForecast Length

(Hour, Day) Members Le vel time Start dateGB/Day

Total(GB)

egrr(UKMO) 0000-0360, 15 24 pl, pt, pv, sl 2(00,12 11/2006 24 28,464

babj(CMA) 0000-0240, 10 15 pl, sl 2(00,12) 02/2007 28 30,660

ecmf(ECMWF) 0000-0360, 15 51 pl, pt, pv, sl 2(00,12)03/200701/2010

150332

157,130

kwbc(NCEP) 0000-0384, 16 21 pl, pt, pv, sl 4 (00,06,12,18) 04/2007 12 12,764

rjtd(JMA) 0000-0216, 9 51 pl, sl 1(12) 05/2007 7 6,990

ammc(BoM) 0000-0240,10 33 pl, sl 2(00,12) 05/2007 8 8,048

cwao(CMC) 0000-0384,16 21 pl, sl 2(00,12) 10/2007 7.5 6,220

lfpw(Meteo France) 0000-0060, 2.5 11 pl, pv, sl1(18)

2(06, 18)10/200712/2009

0.22

286

rksl(KMA) 0000-0240,10 17 pl, sl 2(00,12) 01/2008 5 3,659

sbsj(CPTEC) 0000-0360, 15 15 pl, sl 2(00,12) 02/2008 12 9,340

total 437 260,560

TIGGE Data at CMA : 260TB until 15 Nov.2009

Note:PL = Pressure Level, PT = 320K θ Level, PV = ± 2 Potential Vorticity Level, SL = Single/Surface Leveln

Update of TIGGE data provider :

• LFPW(Meteo France) : since 8 Dec. 2009 ， increasing 29274 fields at 06Z and 35152 fields at 18UTC

• RKSL(KMA) : since 18 Dec 2009, increasing 3009 fields at 00Z and 12UTC

• ECMWF: increasing model resolution from N200 to N320， data up to 330GB/day

CMA portal offers services:

- Access to online & offline data

- Aggregation along any axis (date, level, parameter, origin, ensemble, …)

- Product Generation on Webpage

- Request Monitoring and Query

- User Management and Access Control

- Sub-area selection

- Reduces volumes to be downloaded by many order of magnitude ( Divided into more small tar files )

Request Monitoring and Query

Access control– Administrator: access the whole system and all services

– Common users

• Super Member: access both Data Catalogue and Product Catalogue

• Data Member: access Data Catalogue

• Product Member: access Product Catalogue

Common users are denied access to the User Admin component, and can only monitor or query the status of their own requests.

User Admin Data Product Request Monitoring/Query

Product Member partial

Data Member partial

Super Member partial

Administrator all

10

TIGGE Data Service by Dec. 2009Supporting 2008 Beijing Olympic Gameweather

serviceTwo trainings for TIGGE users from chinese

research institutes, universities, national and regional meteorological center in 2009

User accessing：Online: data for the last one month.

Offline : data for one month ago

Produce special dataset for research projects

– For example, service dataset during flood seasons in 2007-2008 ( include ecmf 、 kwbc 、 babj 、 rjtd, et al )

– 40 TB data services until 12 2009 for researchers in China

– To reorganize the list and put on the website

TC CXML data Receiving status at CMA TIGGE Archive Center

centerCentercode

AccessingLagged hours

CMC cwao FTP 11.5h

CMA babj FTP 8.5h

ECMWF ecmf FTP00Z: 7h12Z: 16h

JMA rjtdDSS of

NCAR00Z: 12h12Z: 24h

KMA rksl FTP 8h

UKMO egrr FTP 8.5h

NCEP kwbc FTP 7.5h

12

2010 key services : TIGGE Data Services For WMO Shanghai EXPO 2010 RDP and FDP projects

Thank you for your attention