updates of china actiiiivities on hpc -...
TRANSCRIPT
![Page 1: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/1.jpg)
IESP Workshop Kobe
d f Chi i i i CUpdates of China Activities on HPC
Zhong Jin1, Xue‐Bin Chi1 and Yutong Lu2
1Supercomputing Center, Computer Network Information Center, Chinese Academy of Sciences
2National University of Defense Technology04/12/2012
![Page 2: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/2.jpg)
OutlineOutlineChi ’ C t St t• China’s Current Status
• Funding Agencies of HPC in China• Research Plans of HPC in China• Research Plans of HPC in China
NSFC MOST MOST
• SCCAS CAS SCDI Applications SCEC D i i CAS Co‐Design in CAS
Future plan• NUDT• NUDT
![Page 3: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/3.jpg)
China’s Current Status
![Page 4: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/4.jpg)
China’s Current StatusChina s Current Status• Significant improvements in HPC and GridSignificant improvements in HPC and Grid
• Still far behind
Kernel technologies
Applications
Multi-disciplinary research Multi disciplinary research
Professionals
• Sustainable development - crucial
* Refer to Professor Depei Qian’s report
![Page 5: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/5.jpg)
Funding Agencies of HPC in Chinag g
![Page 6: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/6.jpg)
Funding Agencies of HPC in China
• MOST – 863 Program, 973 Program (HW, SW & Apps)
• CAS – Informization Project (HW, SW & Apps)
• NSFC – General projects (Apps)
• Ministry’s funding (SW)
• Funding from local governments (HW)• Funding from local governments (HW)
![Page 7: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/7.jpg)
Research Plans of HPC in ChinaResearch Plans of HPC in China
![Page 8: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/8.jpg)
NSFCNSFC• Basic Algorithm and Computational Modeling for High g p g g
Performance Scientific Computing
Highly efficient algorithm for numerical calculation
Computational modeling based on mechanism and data Computational modeling based on mechanism and data
Evaluation on high performance computing and algorithm
• Duration: 2011~2015
B d t 40 Milli i RMB (2012)• Budget: 40 Millions in RMB (2012)
• Projects: 25j
![Page 9: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/9.jpg)
NSFC (cont’)NSFC (cont )• Research areas
Computing method for nonlinear eigenvalue problem of partial differential equation
C li d l d l ith f h i l ti f t i l Coupling model and algorithm for physical properties of materials
Computable modeling and algorithm of multi‐media and multi‐component fluid dynamicscomponent fluid dynamics
New algorithm and verification of numerical simulation of trasport
Reconstruction theory and algorithm of highly dimensional biological Reconstruction theory and algorithm of highly dimensional biological system based on small sample data and its application
Modeling and computing method of interactive dynamics between g p g yclimate and vegetation
Modeling and basic algorithm of large scale complex optimizing design problem for aircraft
![Page 10: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/10.jpg)
MOST – 863 ProjectMOST 863 Project• High technology research and develop
( j )program (863 project , FY 2011~2015) Hardware two 100PF Level supercomputers by 2015
Numerical Frame Numerical FrameStructural mesh, non‐structural mesh, non‐mesh geometry and finite element methodg y Scalable up to ~ 900,000 CPU/cores Parallel efficiency ~ 30%y % budget: 20 Million in RMB
![Page 11: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/11.jpg)
Eight strategic applications Eight strategic applicationsSoftware system will be developed and can be scaled up to 300 000 CPU/cores with the parallel efficiency ofto 300, 000 CPU/cores with the parallel efficiency of more than 30%
Budget:~80 Million in RMBBudget: 80 Million in RMB Fusion Aircraft Design Aircraft Design Aerocraft Drug Design Drug Design AnimationMechanics of Giant Engineering EquipmentMechanics of Giant Engineering Equipment Electromagnetic Environment Simulation New Type Material Design New Type Material Design
![Page 12: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/12.jpg)
MOST – 863 ProjectMOST – 863 Project• A key project on cloud computing• A key project on cloud computing
Key technologies and systems of cloud computingy g y p g
Operating systems
k h Network search engines
Network based language translation
• Sustainable improvement ‐ balanced
development of high‐productivity computers,
application environment and HPC applicationsapplication environment and HPC applications
![Page 13: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/13.jpg)
MOST – 973 ProjectMOST – 973 Project• National Key Basic Research and DevelopmentNational Key Basic Research and Development Program (973 Project, FY2011~2015) New computing mode fit to petascale scientific New computing mode fit to petascale scientific computing Institute of Computational Mathematics and Scientific Institute of Computational Mathematics and Scientific /Engineering Computing, Chinese Academy of Sciences
Goals Crucial common basic algorithm problem for petascalescientific computing
Highly productive realizing method for parallel application g y p g p ppsoftware
New computing mode for effectively using thousands and ten thousands CPU/coresthousands CPU/cores
![Page 14: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/14.jpg)
SCCASSCCAS
![Page 15: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/15.jpg)
CAS SuperComputing Development Index, CAS SCDICAS SCDI
• Goal ‐ Quantitatively evaluate the development of Supercomputing in CAS• Six ComponentsSix Components
Individual Supercomputing Environmental Construction Index Individual Supercomputing Environmental Application Index Scientific Impact Indexp Individual Talents Training Index Individual Scientific Research Projects Support Index Individual Income Index
![Page 16: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/16.jpg)
ApplicationsApplications
• Computational Material• GPU‐PEtotGPU PEtot• Eigenvalue Calculation on GPU
![Page 17: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/17.jpg)
Negative Index Meta‐materials: Simulation and Shape Optimizationp
Simulation ‐MoM + FGMRES for PMCHWT equations with Periodic FMMSimulation MoM FGMRES for PMCHWT equations with Periodic FMMOptimization ‐ LM‐BFGS,with Adjoint Variable Method* Collaborating with Prof. Nishimura at Kyoto University, Japan
![Page 18: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/18.jpg)
GPU‐PEtot: DFT on GPUTesting systems: 512 atoms GaAs bulk system with oneAs replaced by N.13~22 times faster than CPU PEtot
Number of Cores 16 32 64 128 256 System 512-GaAs 512-GaAs 512-GaAs 512-GaAs 512-GaAs
PEtot (CPU) 735 396 221 128 91 8PEtot (CPU) 735 396 221 128 91.8PEtot_GPU0(GPU) 87.3 55.9 33.3 23.4 19.8 PEtot_GPU (GPU) 34.06 19.48 11.83 7.21 6.79
Speed-up (with PEtot CPU) x22.11 x20.36 x18.69 x17.79 x13.52 Total flops (Tflops) 1.51 2.94 4.47 7.15 7.59
Efficiency 17.14% 16.69% 12.69% 10.15% 5.39%
The Scalability of CPU/GPU PEtot, AB‐CG parts scalability
* Collaborating with Dr. Lin‐Wang Wang , LBNL and Prof. Xingao Gong, Fudan Univ.
![Page 19: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/19.jpg)
Eigenvalue Calculation on GPUEigenvalue Calculation on GPU• Size of Matrix: 20000
GPU 1 2 4 8 16
Time/s 824 2 480 4 290 9 210 4 119 8
Size of Matrix: 20000
Time/s 824.2 480.4 290.9 210.4 119.8
Speedup 1 1.72 2.83 3.9 6.9
Size of Matrix 20000 30000 50000
• Number of GPUs used: 16Size of Matrix 20000 30000 50000
Time/s 135.8 433.44 1388.33
Ratio/Gflops 274 290 419
*Dense matrix calculation
![Page 20: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/20.jpg)
SCESCE
• Overview• NodesNodes• Applications• Users• JobsJobs
![Page 21: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/21.jpg)
OverviewOverviewD i th 11th 5 l• During the 11th 5‐year plan
• Extension of traditional computing grid• Extension of traditional computing gridmulti‐tree structure like a pyramid matrix like a pyramid matrix
• Grid nodes are not equal in functions– root or master node dominate the whole system– easy for operation and management in a special organization like CAS
![Page 22: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/22.jpg)
SCE –NodesSCE Nodes
• Root: 150Tflops– Deepcomp 7000
• Middle: 80Tflops– 8 nodes
• Bottom: 70Tflops– 17 institutes from CAS17 institutes from CAS
• GPU: 3000 Tflops– 11 institutes from CAS
![Page 23: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/23.jpg)
Windows / Linux Clients
Web Portal
Users Administrator
SCE Middleware
HPC Cluster Workstation StorageHPC, Cluster, Workstation, Storage
![Page 24: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/24.jpg)
SCE– 83 ApplicationsSCE 83 Applications
BioInfo
ChemOthersDevelopment
76 Grid Apps
AlgorithmCFD
Material
24
![Page 25: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/25.jpg)
UsersUsers• Untill Mar 2012Untill Mar. 2012
– More then 200 grid users submitted jobs
25
![Page 26: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/26.jpg)
JobsJobs• Untill Mar 2012Untill Mar. 2012
Number of Jobs > 120K Walltime > 28M (CPU Hr ) Walltime > 28M (CPU Hr.)
26
![Page 27: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/27.jpg)
Co Design in CASCo‐Design in CAS• Goal• Goal
Develop more efficient application software which is able to take advantage of the computing capability ofable to take advantage of the computing capability of faster supercomputers
• Candidate ApplicationsCandidate Applications Electronic Structure Calculation Molecular Dynamics Molecular Dynamics Climate Fluid Dynamics Fluid Dynamics Bioinformatics More More
![Page 28: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/28.jpg)
Co Design in CAS (cont’)Co‐Design in CAS (cont )
• Key Algorihms Adaptive mesh refinementp Sparse and dense linear algebra PDEs: implicit PDEs: implicit PDEs: explicit FMM FFT ODE integrators
![Page 29: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/29.jpg)
Co Design in CAS (cont’)• Co Design Strategy
Co‐Design in CAS (cont )• Co‐Design Strategy
Hardware Evaluation
Performance Analysis
h
Programming Model
Mathematics
![Page 30: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/30.jpg)
Co Design in CAS (cont’)Co‐Design in CAS (cont )• Co Design Process
Application
• Co‐Design Process
Community Identifies Needs
Identify Gap
Feedback and Refining Designy p
Programming Integration, Deployment
![Page 31: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/31.jpg)
• International Workshopp on CO‐DESIGNpp 2011.10.25‐26, Beijing 60 participants, 24 invited talks
![Page 32: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/32.jpg)
Future PlanFuture Plan• Informization Project on HPC (12th Five‐year plan)Informization Project on HPC (12 Five year plan)A several Petaflops supercomputerChinese Scientific Computing EnvironmentChinese Scientific Computing EnvironmentBudget: ~200 million in RMB
• Application Software Development CenterGoal ‐ to improve computational efficiency in scientific computing and develop software systems
Disciplinesp• Mathematics, Chemistry, Material Science, Climate, Fluid Dynamics, Bioinformatics, Drug Design, Geophysics and Astrophysics
![Page 33: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/33.jpg)
Sunway Bluelight• National Supercomputing Center
in Jinan China
Sunway Bluelightin Jinan, China
• Ranked 14th on TOP500 (November, 2011) 1PF k 1PF peak
Power:1074.00 kW
Cores:137200
Memory:139264 GB
Very compact system• 128TF/Rack
Implemented with domestic 16-core processors
Infiniband QDR 40Gbps
Exploring possible architectures and key technologies for 10-Petascale computers
![Page 34: Updates of China Actiiiivities on HPC - exascale.orgexascale.org/mediawiki/images/e/ea/Talk-6-Jin.pdf · Future plan • NUDT. ... * Refer to Professor Depei Qian’s report. Fundinggg](https://reader031.vdocuments.mx/reader031/viewer/2022030923/5b8094c27f8b9a35788d9a1f/html5/thumbnails/34.jpg)
NUDT’s ActivitiesNUDT s Activities
• By Professor Yutong Lu