earth system supercomputer center/ kma 2004. 8. 28 dongil lee
TRANSCRIPT
Earth System
Supercomputer Center/ KMA2004. 8. 28Dongil Lee
contents
• What the earth system is• How we can understand the earth
system – observation, analysis, and prediction
• Examples of Grid Project for Earth System
• opportunity
contents
• What the earth system is• How we can understand the earth
system – observation, analysis, and prediction
• Examples of Grid Project for Earth System
• opportunity
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
Source:isc2003 Walter Zwieflhofer ECMWF
contents
• What the earth system is• How we can understand the earth
system – observation, analysis, and prediction
• Examples of Grid Project for Earth System
• opportunity
observationobservation
Technology for the weather Technology for the weather forecastingforecasting
collectioncollection Diss.Diss.Anal.& WFAnal.& WF
DATAPRODUCERS
GlobalObserving
System
GOS
DATACONVEYORS
GlobalTelecommunication
System
GTS
DATA USERS
Global DataProcessing
System
GDPS
World Meteorological Organization(187members)World Meteorological Organization(187members)
GOSObservation to understandthe current weather
Surface
Weather Weather ObservationObservation
Buoy
Radiosonde
Aircraft
Sat.(wind)
Sat.(temp)
to understand the current weather
satellite, aircraft, wind profiler, buoy, etc…
international data exchange
GOS(Global Observing System)
National Space Program in Korea
1999 KITSAT 3
2003Scientific Satellite 1
20012005Scientific Satellite 2
2008 Scientific Satellite 3
2006
2011
2005 KOREASAT 5
1999 KOREASAT 3
2013Scientific Satellite 52015
ScientificSatellite 6
2004 KOMPSAT 2
2008Communication, Ocean & Meteorological Satellite-1
2008 KOMPSAT 3
2009 KOMPSAT4
2010KOMPSAT5
2011 Scientific Satellite4
2012KOMPSAT 6
2014KOMPSAT 7
2015KOMPSAT 8
2015 KOREASAT 6
1999 KOMPSAT 1
2014Communication, Ocean& Meteorological Satellite 2
COMS System Architecture
Command,Telemetry
Raw Data,HRIT/LRIT
HRIT/LRIT
Satellite Operation Control Center/ Back-up Data Processing Center
Meteo/Ocean DataApplication Center(Primary Data Processing Center)
HRIT/LRITForeignMeteorological DataReceiving Station
CommunicationSystem MonitoringFacility
Specialized Organization/ Domestic User
Foreign Meteorological Organization/ Foreign User
Exclusive Line
Meteorological Information Supply
Various Site
Internet
Internet
Ka-band RF Signals
Raw Data
Internet
Telecommunication with Telecommunication with 187 countries187 countries
Nature Model
예보모델 Initial Data
Data Assimilation to improve the initial data quality
Ensemble Forecast to reduce the uncertainty of N.M.
Numerical Model
연구배경
• Global Scale Study => climatology with Atmos., Ocean, land surface, etc • Global Observation and sharing information• Co-work with international society is important
Some Characteristics of Earth Science
global science with huge observation data and high performance computing
• Dynamic Equation Set • Numerical Representation
• Super Computing
GDPS
Decoding
Statistical Model
Q.C.
charts
Pre Processing Encoding
Analysis ChartObjective Ana.
NWPGlobal
Regional
Numerical Model
Post Processing
Data Ass.
Graphics
Forecast Guidance
Prog. Index
Indexs
Cloud ForecastCloud Forecast
Partition #1
Partition #2
Dual 64 Ports QlogicSAN Channel Fabric
Gigabit Switch
ADIC Scalar10K Library1-PBytes
Direct Attached Disk(31.5-TBytes)
10/100T Switch
Cray X1E SystemCWS
CPES
CPES
File System Server
Resevoir
Chiller C/T
#1Pre/Post
Processing Server#2
Remote Display and AG
KMABackbone
Pro
vid
er
KMA HQ
3d Rear Projector
MFC
CNS
CNS
MFC MFC
MFCMFCMFC
SAN Disk( 12-TBytes )
Direct Attached Disk(31.5-TBytes)
* For User data only
IOC
IOC
MFC
Basement rooftop
Login/cross compile server
MFC
Partition #1
Partition #2
Dual 64 Ports QlogicSAN Channel Fabric
Gigabit Switch
ADIC Scalar10K Library1-PBytes
Direct Attached Disk(31.5-TBytes)
10/100T Switch
Cray X1E SystemCWSCWS
CPES
CPES
File System Server
Resevoir
Chiller C/T
#1Pre/Post
Processing Server#2
Remote Display and AG
KMABackbone
Pro
vid
er
KMA HQ
3d Rear Projector
MFC
CNSCNS
CNSCNS
MFC MFC
MFCMFCMFC
SAN Disk( 12-TBytes )
Direct Attached Disk(31.5-TBytes)Direct Attached
Disk(31.5-TBytes)
* For User data only
IOC
IOC
MFC
Basement rooftop
Login/cross compile server
MFC
KMA Supercomputer - Cray X1E-8/960L; final stage(18Tflops)
KMA 2nd Supercomputer Baram
언론기관
WMOWMOGridGrid
WMOWMOGridGrid
APCNGrid
CAgMGrid
Agro-Agro-GridGrid
Hydro-Hydro-GridGrid
Ocean-Ocean-GridGrid
MarineMarineGridGrid
Energy-Energy-GridGrid
Environ-Environ-GridGrid
Impact-Impact-GridGrid
Space-Space-GridGrid
Trans-Trans-GridGrid
AquacultureAquaculture
MappingMapping
DefenceDefence
GHG inventoryGHG inventoryWater useWater use
Food securityFood security
SatteliteSattelite
TransSiberiaTransSiberia
AssessmentAssessment
WAMISWAMISNetwork HubNetwork Hub
0
0.1
0.2
0.3
0.4
0.5
93년 94년 95년 96년 97년 98년 99년 00년 01년
강수유무 1mm 이상 5mm 이상강수유무 1mm 이상 5mm 이상
Applications of Meteorology
To improve the accuracy of weather forecast
improve the initial data using satellite, radar, etc.. reduce the uncertainty of numerical model
To achieve this goals, we need more observation data and model resultsmore observation data and model results
Source : FSU, U.S.A.
0
500
1000
1500
2000
2500
3000
3500
4000
2001 2002 2003 2004 2005 2006 2007
GB
/Da
y
NWP Messages NEXRAD Prod NEXRAD Base
Data is increasing…. Example of one center
Turning Observations into Knowledge Products
Source: Dr.Ghassem Asrar, GEO
contents
• What the earth system is• How we can understand the earth
system – observation, analysis, and prediction
• Examples of Grid Projects for Earth System
• opportunity
The Grid and Meteorology:Opportunities
• Inter-personal collaboration– E.g., Access Grid, CHEF
• On-demand access to simulation models– E.g., Espresso
• Access to, and integration of, data sources– E.g., Earth System Grid
• Dynamic, virtual computing resources– “Metacomputing”
• Integration of all of the above– Collaborative, computationally intensive analysis of large qua
ntities of online data
Source: APAN16 Ian Foster
Expresso Modeling Interface(Michael Dvorak, John Taylor)
• “Meteorology on demand”
Source: APAN16 Ian Foster
Earth System Grid (ESG)
Goal: address technical obstacles to the sharing & analysis of high-volume data from advanced earth system models
Source: APAN16 Ian Foster
Collaborations & Relationships
• CCSM Data Management Group• OPeNDAP/DODS (multi-agency)• NSF National Science Digital Libraries Program (U
CAR & Unidata THREDDS Project)• U.K. e-Science and British Atmospheric Data Cen
ter• NOAA NOMADS and CEOS-grid• Earth Science Portal group (multi-agency, internat
ional)Source: APAN16 Ian Foster
Linked Environments for Atmospheric Discovery (LEAD)
A Cyberinfrastucture for Mesoscale Meteorology Research and Education
Linked Environments for Atmospheric Discovery (LEAD)
A Cyberinfrastucture for Mesoscale Meteorology Research and Education
Kelvin K. DroegemeierSchool of Meteorology and
Center for Analysis and Prediction of StormsUniversity of Oklahoma
Source : Kelvin Droegemeier
LEAD Data Cloud
Source : Kelvin Droegemeier
Geosciences CI Activities
Source : Kelvin Droegemeier
contents
• What the earth system is• How we can understand the earth system
– observation, analysis, and prediction• Examples of Grid Project for Earth System• Opportunity – CPU-intensive and data-intensive
Example : Proposal for RA-VI(Offer supported by DWD, Met Office and Météo
France)
“Virtual” GISC
DWD, Met Office, Météo France (RTH and RSMC)
DCPC’s
ECMWF,
EUMETSAT
“Virtual” GISC
The Earth Observation Summit II was held on Sunday, April 25th, 2004 at Hotel Okura in Tokyo, Japan. 43 countries (including Japan) from G8, Asia, Europe, Africa, Latin America, etc and the European Commission participated in the Summit. Among the participants were the Honorable Michael O. Leavitt, Administrator of the US. Environmental Protection Agency, Dr. John M. Marburger, Science Advisor to the President and Director of the Office of Science and Technology Policy from United States and Minister Guanhua Xu from the Ministry of Science and Technology of China, Ministers from Gabon, Guatemala and Israel. To name the few of the participating 25 organizations were IBRD (The World Bank Group), U.N. Educational, Scientific and Cultural Organization (UNESCO) and World Meteorological Organization (WMO), which made the grand total of the participants to approximately 350 people.
Feedback mechanism between Earth Observation and Societal Benefits
GEOSSKorean Meteorological
Administration
29 November, 2003 GEO-2 Baveno, Italy 42
Idealized System Components
• Data Exchange and Dissemination:exchange and
disseminate observational data and information
Approved at GEO-2:
Observation Component
Data Processing Component
Data Exchange and Dissemination Component
• Observation:acquire observations based on existing national, regional and
global contributions
• Data processing: process data into useful information
Korean Meteorological Administration
Items
The first proposal
Initial system(2004)
Final system(2005)
Model name X1-3/192-L X1E-8/960-L
MainSystem
The number of cabinets 3 7.5
NodesSystem 1 4
Computing 47 236
CPUsSystem 4 16
Computing 188 944
Single CPU performance 12.8Gflops 19.2Gflops
1 CPU Sustained performance 3.38 Gflops 4.63Gflops
Total Sustained Gflops 635.44 Gflops 4,370.72 Gflops
Total memory size 760 Gbytes 3776 Gbytes
Disk &I/O
I/O Cabinets 1 2
I/O Drawers 4 8
SPC channels 16 32
PC-20 Cabinets 6 8
SAN Disk 12 Tbytes
Direct Attached Disk 44 Tbytes 63 Tbytes
KMA 2nd Supercomputer Boram
Items
The second proposal
Initial system(2004)
Final system(2005)
Model name X1-3/192-L X1E-8/960-L
Servers
CPES 1 2
Login Server(cross compiler)
CPES +Dual 3 Dell 1750 cluster
CNS 2 4
Pre-post processing servers 2* Fujitsu RX800(8-way)
File system server 2
CWS 1
NetworkCisco 76xx routers 2
Cisco 45xx routers 2
RemoteDisplaySystem
Video Display System 1
Access Grid System Fixed 2, mobile type 1
3D Hologram System 3D Rear Projection System
Tape Library ADIC Scalar 10K 1 (1 Pbytes capacity)
Chiller
Chiller (60RT) 4
Cooling Tower(80RT) 4