CMA’s Network and HPC environment

Tian Hao

NMC, CMA

Aug. 27, 2003

Busan

2

OutlineNational Meteorological Centre （ NMC） - introductio

n

CMA international network - GTS

CMA WAN - CMNET

CMA LAN – gigabit Ethernet

Application of CMA network

The future of CMA network and HPC

3

State Council

China Meteorological Administration

National Meteorological

Centre

Administrative Departments

Other Operational Centres

Local Meteorological Bureaus

4

National Meteorological Centre

Merging of the former National Climate centre to form the new National Meteorological Centre in 2001

Three sub-centresWeather ForecastingClimateInformation System

Meteorological Meteorological InformationInformation

CenterCenter

Telecommunication DivisionTelecommunication Division

High performance High performance Computer DivisionComputer Division

Network & Storage DivisionNetwork & Storage Division

Lab. of Lab. of Meteorological DataMeteorological Data

The Organization of Meteorological Information CenterThe Organization of Meteorological Information Center

6

CMA’s Information Networks

GTS international network

CMA Wide Arae Network(WAN)

CMA Local Arae Network(LAN)

7

GTS

GTS(Global Telecommunication System) is the key component of WMO WWW(World Weather Watch) program

3 layers: Main Telecommunication Network(MTN), Regional Network, and National Network

MTN is the Kernel of GTS, interconnecting 3 World Meteorological Centres, and 15 regional telecomunication centres

8

GTS - Means of communication

point-to-point circuit: surface, ocean, and satellite links

multipoint-to-point: Data Collection Platform(DCP) of Meteorological Satellite

point-to-multipoint: satellite-based data broadcasting, radio facsimile broadcasting

Global, regional, national centres exchange of observation and product data

9

CMA’s International Network

GTS RTH BeijingRTH(Regioonal Tele. Hub) on WMO GTS/MTN64Kbps links with Offenbach and TokyoRegional Links to Moscow, Bangkok, New Delhi, Se

oul, etcAlpha server+VAX based, OpenVMS, to be replace

d in 2003 with UNIX systemX.25, Frame relay, TCP/IPJoining RMDCN (Regional Meteorological Data Communications

Network Project) soon

10

东 京Tokyo

RJTD

奥芬巴赫 Offenbach

EDZW

莫 斯 科Moscow

RUMS

伯 力Habarovsk

RUHB

汉 城Seoul

RKSL

北 京 Beijing

BABJ

曼 谷Bangkok

VTBB

河 内Hanoi

VNNN

乌兰巴托Ulan Bator

MNUB

平 壤Pyongyang

DKPY

新 德 里New Delhi

DEMS

64Kbps

64Kbps

9.6Kbps

2.4Kbps

64Kbps

9.6Kbps

9.6Kbps

75BD

75BD

75BD

Beijing Meteorological Telecommunication SystemBeijing Meteorological Telecommunication System

11Region II (Asia) point-to-point circuits implementation (transmission speed in bit/s)

RTH

NMC

Centre in other region

MTN circuit

Regional circuit

Interregional circuit

Algiers

Cairo

Offenbach

Moscow

Vientiane

Ulaanbaatar

Baghdad

Manila

Kuala Lumpur

Melbourne

Washington

Doha

Kuwait

Bahrain

Dhaka

Yangon

KathmanduKabul

Karachi

Colombo

Male

Hong Kong

Hanoi

Sanaa

Jeddah

Phnom Penh

Tokyo

Khabarovsk

Moscow

PyongYangAshgabad

Macao

Melbourne

Tehran

Novosibirsk

Emirates

64k

4 800

2 400

7 200

7.2k - 28.8k-V.34

64k

64k

75

75

14 400

FR 64k (CIR:16k)

200

64k

9 600

75

100

50

1 200

50

1 200

50

50

75

7 200

7 200

100

1200

1200

200

75

75

50

50

100100

64k

100

50

75

9600

50

Tashkent

Dushanbe

Bishkek

Almaty

100

75

100

1200

200

NI

NI

NI

NI

NI

Seoul

64k

NI

64k

64k

NI

NI Not implemented

NO Not operational

2 400

NI

NI

19 200

26/VIII/2002

NI

9 6009 600

9 6009 600

9 600

Beijing

Internet

FR 64k (CIR:16k)

FR 64k (CIR:16k)

FR 64k (CIR:32k)

Offenbach

9 600

Cairo

Internet

Muscat

additional circuit

200

Singapore

Bangkok

2 400

New Delhi

64k

12

CMNET - China Meteorological NETwork(sWAN）

Project code named “9210”, means approved in October, 1992

CMA’s national meteorological operational information network

1993-94 overall design, selecting of key technology 1995- 96 pilot system 1997-1999 full scale application software development;

equipment deployment, trial-operation 2000 operation started in Jan.

13

CMNET - Components

Asiasat-2, Ku band transponder VSAT based TCP/IP network

1 hub station, 31 provincial stations, 300 small stations; data rate 512Kb/s (outbound) and 8*128Kb/s(inbound)

Satellite telephone network PCVSAT data broadcasting network

with more than 2000 receiving stations, total data rate: 2 Mb/s

14

CMNET - Application software

3 Functional subsystems: data exchange, database, and operation supervision

developed by a single team for different levels of weather centres, centralized technical support

3 different types of computers： IBM RS6000， DEC ALPHA、 PC

15

VSAT Control Center

VSAT Control Center

PBX

Server

TCP/IP Surface backupnetwork

Regional Centres

Provincial WeatherForecasting Offices

City-level WeatherForecasting Offices

Asiasat-2

National OperationCentres

CMA’s VSATTwo-way InformationNetwork

CHINAPAC

Framework of CMNET -- 4 levels

16

Multiple AccessPC Card

UplinkFacility inBeijing

Asiasat-2

2300 ReceivingStations in ChinaAnd Neighbouringcountries

CMA’s VSAT data broadcasting system

1.2/1.8m antenna

PC VSAT station

5th level of CMNET

17Signal coverage of Asiasat-2

18

3 、卫星通信小站站点分布图layout of 2300 PC-VSAT stations scatter

Not including the neighbouring countries

19

CMA‘s Campus Network（ LAN）

History of LAN

1989, implemented CDCNET and DECNET(10Mbps Eth

ernet) with installtion of CYBER main frame and VAX

1989,using 50Mbps Local Couple Network(LCN) connec

ting CYBER and M360 and VAX and IBM main frame ，forming a heterogenous main frame network

1995, implemented 100Mbps FDDI instead of LCN

20

CMA‘s Campus Network

2001, gigabit Ethernet implementation Gigabit/s Ethernet L3switching, CISCO switch connecting all office buildings in CMA’s h

eadquaters4Gbps between core switchs2Gbps form office builldings to core switch100Mbps for desktop

Internet connection: 10Mbps

21

Network of CMA CampusNetwork of CMA Campus

SiSi SiSi

SiSi

SiSi

SiSi SiSi

SiSi SiSi SiSiSiSi SiSi

SiSiSiSi

SiSiSiSi

CISCO CT6509-NEB

NSMCCISCO CT6506

NSMCCISCO CT6506

Other centerCISCO CT4003

Institute of Met. science

CISCO CT6506

Training centerCISCO CT4003

3COMCB3500

3COMCB5000

IBM SP IBM SP2

CRAY C92CRAY J90

CMA organCISCO CT4003

Builings switchCISCO CT3548

NMCSwitch3COM SSII 3900

Satellite Hub station

NMCCISCOCT6506

Logistic centerCISCO CT4003

Data lab.CISCO CT4003

NMC periferrySwitch3COM SSIII4900

NMC buildings Switch3COM SSII3900

CMA InternetCISCO Secure PIX

CISCO 3640

CHINANET

NMC storage system

3COMCB3500

3COMCB5000

NMC GTS circuit

FDDI

FDDI

FDDI

FDDI

CISCO 3640

CISCO Secure PIXGTS

Tcp/ip

Fram

e relay

NMC HPC

CMA organ

CS1 CS2

ES3 ES4

CS3

22

High Performance Computing

CDC Cyber, Galaxy-2, CRAY

IBM SP, Shenwei, Galaxy-3

Parallel application effort started in early 1990s

Current Major NWP systems

T213L31 on IBM SP

T106l19 Ensemble on Shenwei

New supercomputer to be acquired in 2003

Climate model on IBM P670 now

Main for climate system

23

A Diagram of Computer System at NMCA Diagram of Computer System at NMC

CRAY C92 Speed: 200MFLOPS, Number of CPU: 2, Storage/Disk: 1G/127GGalaxy-III Speed:18GFLOPS, Number of CPU: 16+1, 16+1 nodes (Made in China)IBM SP Speed: 78GFLOPS, Number of CPU: 88, 12 nodesShenwei Speed: 384GFLOPS, Number of CPU: 384, 96 nodes (Made in China)

1000 Mbps

24

Computer Year Installed

# CPUs Peak

Performance (Mflops)

Major Application

Cyber992 91 1 57 T42 Galaxy-2 93 4 400 T63L16

Cray EL98 94.8 4 533 Climate Sim. Cray C92 94.9/95.3 2 2000 T106L19

IBM SP2 95.6 32 8500 Development, MM5, Ensemble of T63

Cray J90 96.1 4 800 Dvlpmt, File Server

Shenwei 99.9 384 384000 Development, Ensemble of

T106L19,MM5

IBM SP 99.11 80 71040 NWP T213L31 operation

The history of HPC installation in NMC,CMA

25

Challenges

Radar data Automatic weather station data Satellite data Centralized data management Massive parallel computing Olympic Games in 2008

26

The layout of new radars distribution plan

27

distribution

Automatic weather stations distribution and plan

28

NMC current Hierarchical Storage Management(HSM) status

29

NMC upcoming Storage and Archiving system -- general design

DISK

SAN SWITCH SANSWITCH

Cisco6509

Cisco6509

资料I/O服务器p630

管理监控服务器p630

应用WAS备份服务器

p650

应用WAS服务器p650

Oracl e服务器p670

Oracl e服务器p670

HPSS服务器p650

Moverp655

Moverp655

HPC

HPS System(HSM)

30

NMC upcomi ng Hi gh performance Storage HSM system

S A N

HPSMetadata

HPScore

server

Hi gh speed LAN

HPCs GTS server DATABASE server Other server

HPS Cl i ent

Controlpath

Datapath

HPSdatamover

HPSdatamover

HPSdatamover

HPSdatamover

60 TeraBytes 1200 TeraBytes10 TeraBytes

31

高速内部互连 高速内部互连

NMC upcomi ng HPC sketch map - -TFLOPs l evel

2 SAN 个 交 换 机

NMCbackbone

LAN

node

node

I /O节点

Localdisk

Disk array

32

Future CMA network

Reliable Cost effective and affordable Technologically sustainable and appropriate

to local expertise Modular and scalable Flexible - able to adjust to changing

requirements

GTS - Design philosophy of FWIS

33

WAN Cost effective and affordable High speed(broad bandwith) national network infrastruct

ure for data exchange between provinces and metropolis instead of CMNET

CMNET ONLY for PCVSAT data broadcasting system

LAN Trunk technology for upgrading LAN speed SAN for storage network VPN technology for enlarging service coverage and sec

urity and convenient of remote access

34

tianh @cma.gov.cn

Thanks for listening!