2003. 1. 22 korea meteorological administration dongil lee perspectives of apan for the next...
TRANSCRIPT
2003. 1. 222003. 1. 22
Korea Meteorological AdministrationKorea Meteorological Administration
Dongil LeeDongil Lee
Perspectives of APANPerspectives of APAN
For the next Generation GTS For the next Generation GTS
of WMOof WMO
I.I. Understanding the needsUnderstanding the needs
II.II. Global Telecommunication Global Telecommunication
System (GTS)System (GTS)
III.III.Future WMO Information Future WMO Information
System System
IV.IV.Future PlanFuture Plan
ContentsContents
DATAPRODUCERS
GlobalObserving
System
GOS
DATACONVEYORS
GlobalTelecommunication
System
GTS
DATA USERS
Global DataProcessing
System
GDPS
World Meteorological Organization(187members)World Meteorological Organization(187members)
GOSObservation to understandthe current weather
Surface
Weather Weather ObservationObservation
Buoy· Ship
Radiosonde
Aircraft
Sat.(wind)
Sat.(temp)
to understand the current weather
satellite, aircraft, wind profiler, buoy, etc…
international data exchange
GOS(Global Observing System)
64000bps
9600bps
200baud
75baud
Data Type # of Data (/day) Data Type # of Data (/day)
SYNOP/SHIP 30,000 SATEM-A 6,800
BUOY 2,500 SATEM-C 6,800
TEMP-A/PILOT-A 1,600 SATOB (SST) 7,000 TEMP-B 900 SATOB (WIND) 9,200
TEMP-C/PILOT-C 1,200 TOVS 60,000 TEMP-D 800 PAOB 500
AIREP/AMDAR 18,000 ACARS 100,000
Offenbach
Washington
MelbourneWMC
TokyoRTHSeoul
NMC
PyonyangNMC
KhabarovskRTHBeijing
RTH
Hongkong
Real Time Data Exchange via GTS
GDPS
Decoding
Statistical Model
Q.C.
charts
Pre Processing Encoding
Analysis ChartObjective Ana.
NWPGlobal
Regional
Numerical Model
Post Processing
Data Ass.
Graphics
Forecast Guidance
Prog. Index
Indexs
AnalysisAnalysis
Nature Model
예보모델 Initial Data
Data Assimilation to improve the initial data quality
Ensemble Forecast to reduce the uncertainty of N.M.
Numerical Model
지상기압과 강수분포지상기압과 강수분포 상층제트상층제트
단열선도단열선도
MeteogramMeteogram
Output Examples
Kalman FilterKalman Filter
Perfect Prog MethodPerfect Prog MethodDynamic LinearDynamic Linear
Output Examples
Cloud ForecastCloud Forecast
To improve the accuracy of weather forecast
improve the initial data using satellite, radar, etc.. reduce the uncertainty of numerical model
To achieve this goals, we need more observation data and model resultsmore observation data and model results
Source : FSU, U.S.A.
II. Current GTS(Global Telecommunication System) integrated Network ( point-to-point, multi-point circuit ) combination of terrestrial and satellite telecommunication link for data distribution ( point-to-point, point-to-multi-point circuit) for data collection ( multi-point-to-point, two-way multi-point circuit)
Three level basisThree level basis MTN : Main Telecommunication Network
network among 3 WMCs and 15 RTHs for the global data exchange RMTNs : Regional Meteorological Telecommunication Networks
for the 6 regions (Africa, Asia, South America, North&Central America, South-West Pacific, Europe), for the regional data exchange NMTNs : National Meteorological Telecommunication Networks
for the national data exchangeWMC : World Meteorological Center
Melbourne, Moscow, WashingtonRTHs : Regional Telecommunication Hubs
Algiers, Beijing, Bracknell, Brasilia, Buenos Aires, Cairo, Dakar, Jeddah, Nairobi, New Delhi, Offenbach, Toulouse, Prague, Sofia, Tokyo
Data Exchange with SatelliteData Exchange with Satellite geostationary or near-polar orbiting satellite Marine data(ARGOS etc) International Maritime Mobile Service INMASAT Meteorological Satellite Meteorological Data Distribution(MDD) of METEOSAT Communication Satellite RETIM or FAX-E via EUTELSAT : point-to-point Countries Argentina, Canada, China, France, India, Indonesia, Mexico, Saudi Arabia, Thailand, USA
Data Exchange with InternetData Exchange with Internet New Delhi - Melbourne, New Delhi-Muscat From the new data source(aircraft, satellite, wind-profiler etc)
GTS Main Telecommunication Network
Dakar
Brasilia
Algiers
Nairobi
Jeddah
Cairo
Sofia
ToulousePrague
New Delhi
Beijing
Bracknell
Moscow
Tokyo
Melbourne
Washington
Buenos Aires
WMC / RTH
RTH
Offenbach
Speeds in kbit/sec
64 64
32/32
64
64
64
24/8
128/64
9.6
64
48/48
64
9.6
32/32
64
9.6
19.28
9.6
4.8
9.60.1
Source : report from RA II, WMO
Regional Meteorological Telecommunication Network for Region II (Asia) point-to-point circuits implementation (transmission speed in bit/s)
RTH
NMC
Centre in other region
MTN circuit
Regional circuit
Interregional circuit
Algiers
Cairo
Offenbach
Moscow
Vientiane
Ulaanbaatar
Baghdad
Manila
Kuala Lumpur
Melbourne
Washington
Doha
Kuwait
Bahrain
Dhaka
Yangon
KathmanduKabul
Karachi
Colombo
Male
Hong Kong
Hanoi
Sanaa
Jeddah
Phnom Penh
Tokyo
Khabarovsk
Moscow
PyongYangAshgabad
Macao
Melbourne
Tehran
Novosibirsk
Emirates
64k
4 800
2 400
7 200
7.2k - 28.8k-V.34
64k
64k
75
75
14 400
FR 64k (CIR:16k)
200
64k
9 600
75
100
50
1 200
50
1 200
50
50
75
7 200
7 200
100
1200
1200
200
75
75
50
50
100100
64k
100
50
75
9600
50
Tashkent
Dushanbe
Bishkek
Almaty
100
75
100
1200
200
NI
NI
NI
NI
NI
Seoul
64k
NI
64k
64k
NI
NI Not implemented
NO Not operational
2 400
NI
NI
19 200
26/VIII/2002
NI
9 6009 600
9 6009 600
9 600
Beijing
Internet
FR 64k (CIR:16k)
FR 64k (CIR:16k)
FR 64k (CIR:32k)
Offenbach
9 600
Cairo
Internet
Muscat
additional circuit
200
Singapore
Bangkok
2 400
New Delhi
64k
Source : report from RAII, WMO
Regional Meteorological Telecommunication Network for Region VI (Europe)Figure 1 - point-to-point circuits implementation (transmission speed in kilobit/s)
Dublin
Tirana
Beirut
Washington
Nairobi
Cairo
New Delhi
Jeddah
Casablanca
TripoliTunis
Beijing
RTH
NMC
Centre in other region
MTN circuit
Regional circuit
Interregional circuit
Ljubljana
Athens
Brussels
Kishenev
Kiev
Tbilisi
Bucharest
HelsinkiOslo
Zagreb
Warsaw
Minsk
Malta
Amman
Bet Dagan
Reykjavik
SondreStormfjord
De Bilt
Lisbon
Budapest
Bratislava
Vilnius
Riga
Prague
Zurich
Damascus
Ankara
Larnaca
Khabarovsk
Novosibirsk
Tashkent
Tehran
64
14.4
9.6
9.6
64
64
4.8
9.6
2.4
9.6
Nairobi
0.05
64
7.2
0.05
7.2-28.8
0.050.05
0.119.2
9.6
9.6
0.2
NI
NI
NI
9.6
9.6
9.6
9.6
9.6
N/O
9.6NI
NI
Dakar
0.1
Beijing
Melbourne
19.2
64
64
Hanoi
Almaty
Yerevan
3..IX..2002
Algiers
Madrid
2.4
32
8
32
16
16
256/128
16
24
48
16
64
16
64
128/16
8
8
8
16
16
16
8/3232/64
48
32
32/96
16/48
64/16
64/8
RMDCN Committed Information Rate
48/24
8
16/8
24/8*
* The RMDCN circuit Helsinki - Tallinn is not yet in the RTMN plan, but replaces the former GTS connection of Tallinn
Belgrade
Bracknell
Toulouse
Rome
Copenhagen
Norrköping
Vienna
Tallinn
19.2
ECMWF
NI
16/8
16/64
Offenbach
16/8
64/8
16/8
128/64
19.2
N/O
NI
N/O
24/8
Baku
8/16
32/8
Skopje
14.4
Moscow
Sofia
NI
N/ON/O
NWSTG Data Flow Diagram
GTSGTS To meet a diverse set of requirements. Operational private network for Routine collection of observed data ,Automatic dissemination of scheduled products : real-time high priority data - mature, well tested and operated according to well-defined procedures and shared responsibilitiesGTS has been adapting itself to the changing requirements and available technology
data rate : 50, 75 baud 64, 128kbps dominant protocol : asynchronous X.25, Frame Relay, TCP/IP contents : character data any type of data Implementation of message switching, HF radio broadcasting,
low and high speed satellite broadcasting ProblemsProblems lack of capacity to meet the new requirements of WWW and other programmes of WMO lack of flexibility to meet different types of requirements need more observation data for GDPS incompatibilities, inefficiencies, duplication of effort and higher costs for Members
0
500
1000
1500
2000
2500
3000
3500
4000
2001 2002 2003 2004 2005 2006 2007
GB
/Da
y
NWP Messages NEXRAD Prod NEXRAD Base
Data is increasing…. For one center
각국 전구분석 사용 관측자료이용 비교 (I)
NUMER OF DATA(#/DAY)DATA TYPE
KMA JMA AUSTRALIA CANADA GERMANY
REFERENCE(case in KMA)
12 TOVS 60000 14900 90000 95000* Not used operationally
13 PAOB 500 500 500
14 PROFILER 600 635* not imported
15 PIREP 900* not imported
16 BATHY/TESAC 5500 not decode
17 ERS 1000 280000* not imported
18 SSM/I 1000 1000000*** not imported
19 HUMSAT 1000 16000** not imported
20 GRIB 7500btns(?)
21 BUFR 700btns(?)
NUMER OF DATA(#/DAY)DATA TYPE
KMA JMA AUSTRALIA CANADA GERMANY
REFERENCE(case in KMA)
1 SYNOP/SHIP 30000 34300 30000/2500 19000 40000
2 BUOY 2500 6200 6000 6000
3 TEMP- A/PILOT- A 1600 1900 1200/900 1250 1300/680
4 TEMP- B/PILOT- B 900 2100 (TT/PP) (TT/PP) Not decode PILOT- B
5 TEMP- C/PILOT- C 1200 1200
6 TEMP- D/PILOT- D 800 1100 not decode PILOT- D
7 AIREP/AMDAR 18000 21500 130003600/56000*
(ACARS)15000
8 SATEM- A 6800 7800 20000 9900 5500 not used operationally
9 SATEM- C 6800 7800 not used operationally
10 SATOB(SST) 7000 8300 2000 4200 not used operationally
11 SATOB(WIND) 9200 33700 100000 15000 18000 Not used operationally
Example of data usage for global model
Problems of GTSProblems of GTS
•Use of proprietary high level protocols that are not supported by the marketplace•Volume restrictions preclude the transmission of satellite imagery, as well as video and other high volume data sets(in the order of gigabytes or terabytes)•Lack of support for a request/reply system providing ad-hoc access to the data and products available for international exchange.•Inability to facilitate information insertion and distribution to programmes and public and other clients beyond the meteorological community•Inability to rapidly(i.e. routinely near-real-time) identify where data losses are occurring and undertake remedial action.•Inability to easily accommodate requirements that include short periods of high volume traffic followed by lengthy periods of low or no traffic.•Inadequate product identification and metadata leading to duplication and uncertainty of contents
III. Future WMO Information SystemIII. Future WMO Information System
FWIS should provide an integrated approach to meeting the requirements of Routine collection of observed data Automatic dissemination of scheduled products, both real- and non-real-time Ad-hoc non-routine applications(e.g. requests for non-routine data and products )
The system should be Reliable Cost effective and affordable for developing as well as developed Members Technologically sustainable and appropriate to local expertise Modular and scalable Flexible –able to adjust to changing requirements and allow dissemination of products from diverse data sources
The system should also support Different user groups and access policies Integration of diverse datasets Data as well as network security Ad hoc as well as routine requests for data and products(“pull” as well as “push”) Timely delivery of data and products (appropriate to requirements)
The WMO’s future information system will include the capability for ad hoc requests as well as routine distribution of meteorological and related datasets and informationThe WMO’s future information system will include a dataset catalogue that will enable users to locate the meteorological and related data and products that they require The WMO’s future information system will conform to open, global standards to the greatest extent possible.In developing the WMO’s future information system attention should be given to include open source code components as alternatives to proprietary, or member written component applications.In acquiring communications bandwidth consideration will be given to all technically viable alternatives for providing the bandwidth in the most cost effective manner. Such alternatives will include, inter alia, consideration of the public Internet, private leased lines and satellite broadcast. These will be managed and funded through national or bilateral agreements, regional consortia and possibly a global consortium for bandwidth leasing.Technical, as well as organizational considerations will determine the topology of the WMO’s future information system. Logical topology is different than the current GTS The WMO’s future information system will include the capability to move large files from sender to recipient without having to comply with predetermined routing maintained through message switches.
General ConsiderationsGeneral Considerations
Basic concepts of FWISBasic concepts of FWIS
Highly reliable and timely delivery of data and products
Data Collection : Internet e-mail high speed Internet
data Dissemination : Satellite communication Basic Methods : satellite broadcasting RA III&IV : ISCS STAR4 RA V&West of RAII :EMWIN and SADIS RA I : MSG & PUMA project as well as SADIS
Push systems are the most appropriate approach for both the routine collection of observations and the routine dissemination of observations and other products
Distribution of ad hoc non-routine products should be accomplished via request/replyrequest/reply or “pull” systemsor “pull” systems
WCDMPWCASPWCRPGCOS
WCP
FWIS
PWSMarine
AviationAgriculture
AMP
ETRP
WSP
FSHSDWCBHWRI
HWRP
BSHWWRPTCRP
AREP
GOSGDPSSSA
WWW
IMOPTCPERA
WDMGTS
HRDPTAPETFP
GAW
ADM
Routine: Store and forward / broadcast
Ad hoc: request-reply
Private Networks Public Internet Post
WWWSatellite Climate
HydrologyResearchPrograms
IGOSS/IODE
HydrologyGRDC
WWWmodel data
GAWWWW
WAFS
IGOSS/MEDS
Climate
EMWIN
GTS protocols and procedures
Internet protocols TCP/IP, HTTP, FTP, etc.
FWIS relationship to WMO Programmes
Current WMO Information Systems
Collection of Data Routine Dissemination
Ad hoc Request/ReplyGlobal InformationSystem Centre
Data Collection orProduct Centre
National Centre
GISC GISC
DCPC
DCPC
DCPC
GISC
GISC
NC
DCPC NC NC
NC
NC NC
NC
NC NC
NC
GlobalRegional
FWIS StructureFWIS Structure GISC : Global Information System Center (10 ~ 20) DCPC : Data Collection or Product Center NC : National Center
Global InformationSystem CentreGISC
GISC
GISC
GISC
GISC
NCNC
NC
NC
NC
NC
NC NC
NC
NC
Data Collection or Product Centre
National CentreNC
DCPC
DCPC
DCPC
DCPC
NC NC
Various communication networks
Global InformationSystem CentreGISCGISC
GISC
GISC
GISC
GISC
NCNC
NC
NC
NC
NC
NC NC
NC
NC
Data Collection or Product Centre
National CentreNC
DCPC Data Collection or Product Centre
National CentreNC
DCPC
DCPC
DCPC
DCPC
NC NC
Various communication networks
National disseminationRequest/reply (Internet)
Nation
al u
sers
Nat
ion
al u
sers
Routine dissemination(Internet, private network,satellite, etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NCNC
DCPC
DCPC
DCPC
DCPC
Various communication networks
National disseminationRequest/reply (Internet)National disseminationRequest/reply (Internet)
Nation
al u
sers
Nat
ion
al u
sers
Routine dissemination(Internet, private network,satellite, etc.)
Routine dissemination(Internet, private network,satellite, etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NCNC
DCPC
DCPC
DCPC
DCPC
Various communication networks
Data Collection
Data Distribution
a.Collect observational data and products that are intended for global exchange from national centres within their area of responsibility, reformat as necessary and aggregate into products that cover their responsible areab.Collect information that is intended for global exchange from Data Collection or Product Centres within their area of responsibilityc.Receive information intended for global exchange from other Global Information Systems Centres d.Disseminate the entire set of data and products agreed by WMO for routine global exchange (this dissemination can be via any combination of the Internet, satellite, multicasting, etc. as appropriate to meet the needs of Members that require its products)e.Hold the entire set of data and products agreed by WMO for routine global exchange and make it available via WMO request/reply (“Pull”) mechanismsf. Describe its products according to an agreed WMO standard and provide access to this catalogue of productsg. Provide around-the-clock connectivity to the public and private networks at a bandwidth that is sufficient to meet its global and regional responsibilities.h. Provide facilities to collect observations from and deliver products to all NMHS within its area of responsibilityi. Ensure that they have procedures and arrangements in place to provide swift recovery or backup of their essential services in the event of an outage (due to, for example, fire or a natural disaster).j. May perform the functions of a Data Collection or Product Centre and/or a National Centre.
Global Information System CenterGlobal Information System Center
Data Collection or Product CentresData Collection or Product Centres Several dozen centres would serve as Data Collection or Product Centres (DCPC). Existing World Meteorological Centres and Regional/Specialized Meteorological Centres would function as DCPCs. However, many additional centres would also serve as DCPCs. This would include suppliers of special observations (e.g. ARGOS, ARINC), research projects, and centres producing products related to a specific discipline. DCPCs would:
a. Collect special programme-related data and products as appropriate
b. Collect information intended for dissemination only to NMHS within its area of responsibility (i.e. regional collections)
c. Produce agreed data and products
d. Provide information intended for global exchange to their responsible Global Information System Centre
e. Disseminate information not intended for global exchange in whatever manner is agreed upon between the centre and the users of the product
f. Provide facilities to collect observations from and disseminate products to the least developed NMCs within its area of responsibility (e.g. via e-mail)
g. Support access to its products via WMO request/reply (“Pull”) mechanisms in an appropriate manner (i.e. dynamically-generated products would require around-the-clock connectivity to the Internet)
h. Describe its products according to an agreed WMO standard and provide access to this catalogue of products or provide this information to another centre with this responsibility (e.g. a GISC)
i. Ensure that they have procedures and arrangements in place to provide swift recovery or backup of their essential services in the event of an outage (due to, for example, fire or a natural disaster).
j. May perform the functions of a National Centre
National CentresNational Centres National Centres would form the foundation of the Future WMO Information System. Many National Centres would be part of an NMHS but others would have national responsibility for functions falling within WMO Programmes but located outside of the NMHS. The participation of the centres would be coordinated through the national Permanent Representative to WMO. National Centres would:
a. Collect observational data from within their country
b. Provide observations and products intended for global dissemination to their responsible GISC
c. Provide observations and products intended for regional distribution to the responsible DCPC
d. Collect, generate and disseminate products for national use
FWIS techniques and pilot projectsFWIS techniques and pilot projectsXML : Extensible Mark-up Language ( BUFR, WEB, CREX )The InternetOpen-Source software : Linux, GNUUnidata IDD : UCAR, the Internet Data Distribution(IDD) system - since 1995, providing the real time data to 150 universities - IDD has ‘Store and Forward’ hierarchy of data flowMED-HYCOS : Mediterranean Hydrological Cycle Observing SystemUNIDART : Uniform Data Request InterfaceMDiS : Multicast-enable platform for distribution - based on MTP/SO (RFC1301) and provides a socket style programming interface AFD : Automatic File distributor, DWD - FTP, SMTP, log, user interface, Multicasting Web-Werdis ( Web-weather Request and Distribution System )
Further DevelopmentFurther DevelopmentDevelopment of the catalogue of products ( highest priority )Proof of concept through pilot testsUpgrade of the GTS
Recommended steps toward implementationRecommended steps toward implementation
Catalogue of products Development of a WMO directory-level metadata standard Dec. 2001 Design, development and implementation of a pilot catalogue as a proof of concept Sep. 2002 Progress report to CBS Dec. 2002 Implementation of prototype at multiple centers, including support for request/reply service at limited level 2004 First operational implementation 2006 Review requirement for continued use of WMO Pub. 9, Volume C 2007
Pilot tests Evaluate results of pilot tests Sep . 2002 Evolution of GTS into future WMO communication system Improvements to telecommunication, providing increased bandwidth and TCP/IP services ongoing Selection and approval of technologies for routine dissemination for the Future WMO Information System(store and forward, multicast, etc) 2004 Development of a translator(s) between the GTS Abbreviated header and the new WMO product Identifier 2004 Begin phased implementation of the Future WMO Information System 2006
Current Pilot ProjectCurrent Pilot Project
CliWare ProjectUK-DWD pilot project (LDM test)RA VI Virtual GISCMETGISUnidata IDD - IDD & LDMSimple meteorological display system - METGIS from South Africa, METCAP from Turkey, EMWIN custom browser from USA - PUMA workstation in every NMHS in AfricaUNIDART -request/reply capability
There is no pilot project in ASIA…..
Example : Proposal for RA-VI(Offer supported by DWD, Met Office and Météo France)
“Virtual” GISC
DWD, Met Office, Météo France (RTH and RSMC)
DCPC’s
ECMWF,
EUMETSAT
“Virtual” GISC
Some concerns - reliable and continuous connectivity - sufficient bandwidth to handle peak-period data transmission - responsive delivery of time-critical information - a secure networking environment
Long term testing of Internet capabilities and advanced methodologies(e.g. IPv6, QoS) that promise to provide a secure network and predictable performance
Current KMA statusCurrent KMA status Internet ISP 100Mbps, HPCNet 2 x 2Mbps KOREN (155Mbps –1Gbps) - APII&TEIN Satellite communication Multi purpose satellite at 2008 OBCOM
Current and Future Plan to use APANCurrent and Future Plan to use APAN
APAN is important Infrastructure to exchange data and APAN is important Infrastructure to exchange data and develop basic techniques for FWIS develop basic techniques for FWIS
• KMA is collecting the Global Model data, observation data(satellite, ocean,
aircraft) from U.S.A. routinely• KMA is exchanging the global model data with several centers• KMA is leading and involving some WMO projects ( APCN, ARGOS, WAMIS …)
KMA- JMA will exchange the ensemble data with Internet KMA will receive the EU Met Satellite from DWD Data via TEIN - contents will be expanded KMA will provide 2 Weather Radar data to USA on the near-real time base KMA will adopt the GRID concept for the request/reply to exchange data KMA wants to improve the network security, QoS and IPv6 of FWIS with APAN
기상청
GFK, APAN-KR
GGF
APAN
양국간 협력
미국 ,독일 ,호주 ,일본 ,중국
WMO/CBS - GTS, GDPS CAgM - CAS RAII
기 상 청
APCNAPCN FWISFWIS WAMISWAMIS WMO WMO clustercluster Met SatMet Sat
e-Science e-Science
Grid ↔ GFKGrid ↔ GFK
International Infra : APAN, TEIN, ...International Infra : APAN, TEIN, ...
National Infra KOREN, Kreonet, HPCNetNational Infra KOREN, Kreonet, HPCNet
Working FrameWorking Frame
National FrameNational Frame
International FrameInternational Frame
KMAKMA
GFK, APAN-KRGFK, APAN-KR
WMO/CBS - GTS, GDPSWMO/CBS - GTS, GDPS CAgM -CAgM - CAS CAS RAIIRAII
JMA, NWS, DWD, BOM, CMA, etcJMA, NWS, DWD, BOM, CMA, etc
GGFGGF
APANAPAN
KMAKMA
