Recent Advances in Recent Advances in ChinaGrid ProjectChinaGrid Project

Hai JinHai JinHuazhong University of Science and Technology Huazhong University of Science and Technology Wuhan, ChinaWuhan, China

hjin@hust.edu.cnhjin@hust.edu.cn

2

2

Huazhong University of Science and Technology, located in the central of China, was founded in 1953, and ranks the TOP 5 universities in China.

3

3

Nation-wide Grid Projects in China • China National Grid – CNGrid (Ministry of Sci

ence and Technology )• China Education and Research Grid – China

Grid (Ministry of Education)• China Science Grid Project (National Science

Foundation)Two group efforts working on the grid middleware

platform Group 1: ICT/CAS, HUST, Peking U., Tsinghua U., Xi’an Jiaotong U.,

and Shanghai Supercomputer Center (CSGrid project) Group 2: Beihang U., Peking U., Tsinghua U., NIC/ CAS, NUDT

(China Research and Development Environment Over Wide-area Network, CROWN)

4

4

ChinaGrid in a Nutshell • China Education and Research Grid

• Funded by Ministry of Education

• As the pilot grid application supported by National 863 Hi-Tech R&D program

• Based on CERNET (China Education and Research Network)

• First Phase From 2003-2005 12 key universities as initiative More than 6Tflops w/60TB 20 key universities now

5

5

About CERNET• Second largest IP backboned network in Chin

a 36 PoPs cover all the province capitals The network backbone is 2.5-10Gbps DWDM

• Cover more than 1,500 universities/colleges in about 200 cities About 20 million users Many universities have their own campus network in

China

6

6

State-of-the-art of CERNET-1

7

7

ChinaGrid (The First Phase)

8

8

ChinaGrid (till now)

9

9

ChinaGrid Mission

•Campus grid platform

•Common platform for ChinaGrid

•Grid application platform and representative grid applicationsImage processing grid Bioinformatics grid Course on-line grid Computational fluid dynamic gridLarge scale information processing grid

10

10

Campus Grids and their Computing Power and

Storage Capacity• HUST： 0.8Tflops, 5TB• THU： 1.3Tflops, 20TB• PKU： 1.5Tflops, 10TB• BUAA： 0.7Tflops, 10TB• SCUT： 0.9Tflops, 20TB• SJTU： 0.5Tflops, 9TB• SEU： 1.0Tflops, 19TB• XJTU： 0.1Tflops, 2.5TB• NUDT： 0.2Tflops, 5TB• NEU： 0.8Tflops, 5TB

• ZSU： 1.3Tflops, 10TB• SDU： 1.3Tflops, 18TB• NWPU： 0.4Tflops, 2TB• ZJU： 0.6Tflops, 3TB• FUDAN： 1.8Tflops, 6TB• TONGJI： 0.2Tflops, 1TB• USTC： 1.2Tflops, 5TB• UESTC： 0.3Tflops, 2TB• RUC： 0.1Tflops, 0.5TB• LZU： 0.3Tflops, 1TB

ChinaGrid： >15Tflops, >150TB

11

11

Layered Infrastructure of ChinaGrid

High performance computing environment(campus grid)

ChinaGrid Supporting Platform (CGSP)

NUDT

THU

HUST

ZSUPKU SJTU XJTU

NEUSCUT

BUAA

SEU

SDU

Remoteeducation

grid

Imageprocessing

grid

Fluiddynamics

grid Massiveinformationprocessing gridBioinformatics

grid

12

12

What’s CGSP?• ChinaGrid Supporting Platform, a grid middleware

for ChinaGrid

• Follow the WS-Resource Framework (WSRF) and Open Grid Service Architecture (OGSA)

• Beta version was announced last October at GCC’04 in Wuhan

• CGSP 1.0 was released Jan. 10, 2005

• Developed by the joint working group from HUST, THU, PKU, BUAA and SJTU

13

13

Status of CGSP 1.0• CGSP download more than 300 times

• Support three major grid applications of ChinaGrid

• Installed in 12 universities as campus grid environment

14

14

15

15

ChinaGrid Supporting Platform

Portal

Information Center

Uniform Management

Computing Nodes

Secu

rity Mod

ule

Grid Developing Environment

Portal: Grid entry for submitting & monitoring job, querying resources’ info, user management and accounting etc.

Grid Developing Environment: a set of toolkits including portal development tools, resource encapsulation tools, programming tools and job generation tools etc.

Information Center: the manager of resource & service information

Uniform Management: a set of managers including job manager, data center, domain manager and service container

Security: Identity authentication and mapping, service and resource authorization, secure transferring etc.

16

16

GSI

WS-Security

CAS

SimpleCA

Data Managemen

tSecurity

WSCore

Resource Managemen

t

Information Services

Authz Framework

RFT

RLS

OGSI-DAI

New GridFTP

XIO

JAVAWS Core(WSRF)

C WS Core(WSRF)

MDS2

WS-Index

Pre-WSGRAM

WS-GRAM

CSF(contribution)

pyGlobus(contributed)

Python Bindings(contributed)

Data Center(CGSP)

Data Center(CGSP)

Portal SDK(CGSP)

Portal SDK(CGSP)

Programming Toolkits(CGSP)

Programming Toolkits(CGSP)

Resource-Index(CGSP)

Resource-Index(CGSP)

HyperService(CGSP)

HyperService(CGSP)

Proxy(CGSP)

Proxy(CGSP)

MetaData-Man(CGSP)

MetaData-Man(CGSP)

InterDomain(CGSP)

InterDomain(CGSP)

Topologic(CGSP)

Topologic(CGSP)

RemoteDeploy(CGSP)

RemoteDeploy(CGSP)

Job Manager(CGSP)

Job Manager(CGSP)

WorkFlow(CGSP)

WorkFlow(CGSP)

HotDeploy(CGSP)

HotDeploy(CGSP)

GT3.9 and CGSP

17

17

CGSP in DetailPortal

Grid Developing Environment

Portal development tools

Resource encapsulation tools

Programming tools (GridRPC/GridPPI)

Job generationtools

Managementtools

Installationtools

Information Center

Servicemanagement

Resourcemanagement

Servicematching

Topologymanagement

Fault-tolerancemechanism

Quality of servicemanagement

Metadatadescription

Domain infomanagement

Domain Manager

Usermanagement

Statusmonitor

Identitymapping

Negotiationpolicy

Job Manager

Job submission

Job scheduling

Job remote-deploy

Work flow management

Job monitoring

Service support

Service Container

GT3.9.1 core

Life cycle Service group Notification

Base fault Resource property

Remote&hot deploy

Node resource monitor

Service monitor

Batch job service

Security

Certification authority

Identity certification

Proxy management

Single sign-on

Security management ofservice and container

Resource access control

Data Manager

Uniform access entry

Metadata manager

Storage resource manager

Replica catalog

Storage agent

18

18

Working Flow of CGSP

Resource information

C A

Container

J1 J2

Resource wrapping tools

Information Center

Portal

Web App S1

S2

S3

S4Domain manager

Management GUI

Job Definition tools Portal toolsProgramming

modelsInstallation

tools

Administrators Resource providers

programmers

Global

1

2

3 4

5

6

7

Local

Job managerContainer CMD

Legacy Program

Remote resources

StorageData Management

Container

Container

Retrieve data

Retrieve input data

Job information

Available services S2

Request for S2Request for J1

Tool set

Developers and

Grid Constructors

19

19

20

20

AG4ChinaGrid ： GridAsia 2005

21

21

http://www.chinagrid.edu.cn

22

22

Bioinformatics Grid

23

23

BioGrid Applications

•Protein target selection for rice genome•Multi-sequence alignment for ganoder

ma family•Gene joint for white mice •Cardiovascular disease research

24

24

Image Processing Grid

25

25

ImageGrid Applications• Three-dimension reconstruction of digital virtual

human being (HUST)• Medical image diagnosis (ZSU)

• Remote sensing image processing（ NUDT）

26

26

CFD Grid

27

27

Pilot Applications based on CFD Grid

• Shanhai JiaoTong University: Aircraft genetic optimization design system

• Xi’an JiaoTong University: Parallel algorithm for molecular dynamics

• Southern China University of Technology: Simulation and optimization techniques for metal powder figuration process

• Northeast University: Large scale geological disaster forecasting system

• Southeast University: Computational electromagnetism applications in airplane and automobile design

28

28

Course On-line Grid

29

29

Course Resource Contribution

• Number of courses: Number of courses: 233233 ；； Number of hours: Number of hours: 25662566

474

117

32

283251

332

202

332

205

12

213

0

113

050

100150200250300350400450500

PK TS XJ SJ DB SD HN HZ DN HK DZ BH ZS

30

30

User IP distribution （ 2004/08/27-2005/01/16 ）

Server Independent IP number

Total number of HTTP GET

PK1 15359 5868376

PK2 264 10970

BY 2922 640255

BH 121 10383

TS 818 125083

DB 1358 848936

DN 696 71957

ZS 9370 1260541

Server Independent IP number

Total number of HTTP GET

SD 1110 128816

UST 9513 1093657

XJ 3981 697464

SJ 528 265055

XB 1318 160240

LD 5101 618136

HZ 598 64299

HN 387 705687

Numbers of independent IPs ： 25,807 ； Total number of HTTP GET ： 12,569,855

Usage Survey

At least so many people use course-online grid

Total number of access

31

31

Massive Information Processing Grid

32

32

University Digital Museum Grid (UDMGrid)

33

33

Total Investment of China to Implement Initial Informalization by 2020

•Computer 3.900Trillion RMB• Internet Host and Systems 117.000Trillion RMB•Communication 6.100Trillion RMB•Digital TV 1.950Trillion RMB•Total 128.950Trillion RMB

•It is necessary to lower down the cost of informalization greatly by using resource sharing and cooperative working

34

34

Thanks!