thailand grid and networking: infrastructure and activities putchong uthayopas director high...

45
Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University, Bangkok, Thailand Vice Chairman Thailand National Grid Committee Ministry of Information and Communication Technology [email protected]

Upload: jayson-dorsey

Post on 18-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Thailand Grid and Networking: Infrastructure and Activities

Putchong UthayopasDirectorHigh Performance Computing and Networking CenterKasetsart University, Bangkok, Thailand

Vice Chairman Thailand National Grid CommitteeMinistry of Information and Communication [email protected]

Page 2: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

http://www.ntl.nectec.or.th/internet/

Current Internet in Thailand

6 million users 18 Commercial ISP 2 Research and Education Networks International Bandwidth 2238.87 Mbps National Exchanges 17964.60 Mbps Total Domestic Traffic 8648.5 Gb/day

Source

Page 3: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,
Page 4: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,
Page 5: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,
Page 6: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Current Research and Education Networks

UNINETUNINET 27 state own universities27 state own universities 2 colleges2 colleges 5 private universities5 private universities 2 government institutes2 government institutes

THAISARNTHAISARN 10 state own universities10 state own universities 1 private universities1 private universities 1 research institute1 research institute 3 government institutes3 government institutes

Page 7: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

THAISARN

Page 8: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

UNINET• OC-3 BackboneOC-3 Backbone

• Tentatively be upgraded Tentatively be upgraded to 1Gbps in the near to 1Gbps in the near futurefuture

Page 9: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Current connectivity

UNINET

ISP

NIX

1 Gbps

1 Gbps

THAISARN

IIR100 mbps200 mbps

APAN

Internet2

NII

Page 10: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

ThaiREN: Next Generation connectivity

UNINET

RENEX

THAISARN

APAN Internet2

……..

DWDM Ring(1-10 Gbps)

FundingMICT (CAT)

Page 11: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Activities

Grid

IPV6

E-science Application

Network layer

Middleware Layer

Application Layer

Page 12: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

IP V6 Effort

Working Group PSU, KU, AIT, KKU, RBU,CAT

Activities Building IPV6 Test bed

Tunneling Partly Native IPV6 now (PSU, KKU, RBU, CAT)

Workshop and technology Transfer Direction

Extending the test bed Promote adoption and application of IP V6 in Thailand

Page 13: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Thai e-science Project

New project funded in 2003 Application oriented project

Current members Computational Chemistry Unit Cell, Department of Che

mistry, Chulalongkorn University Department of Computer Engineering, Chulalongkorn U

niversity HPCNC, Kasetsart University

Contact:http://www.thai-escience.net/ Dr. Prabhas Chongstitvatana (Associate Professor, Intel

ligent System Lab, Department of Computer Engineering, Chulalongkorn University)[email protected]

Page 14: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

ThaiGrid

A partnership project to explore grid computing technology and application in Thailand. Project started since December 2000

Link: http://www.thaigrid.net Currently funded by

National Research Council of Thailand (NRCT) Commission on Higher Education, Ministry of Education

Contact Putchong Uthayopas, KU ([email protected]) Vara Varavidthaya, KMITNB ([email protected])

Page 15: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Members 8 universities

Kasetsart University King Mongkut’s Institute of Technology North Bangkok Suranaree University of Technology Asian Institute of Technology Chulalongkorn University Walailak University Chiangmai University KMUTT

1 Government Agency National Electronics and Computing Technology

Page 16: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Goal

Create a grid computing infrastructure for Thai researchers

Stimulate the deployment of Grid Computing Technology

Build a collaborative Research Network among Thai researchers

Act as a focal point for international grid collaboration

Page 17: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

ThaiGrid System

KU

AIT

KMITNB

SUT

PALM

OPTIMA CAMETA

GASS

AMATA

HPCNC

OBSERVER MAEKA WARINE

ThaiGrid

CU

NECTEC

WU

CMU

KMUTT

Page 18: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Resources (2003- First Part of 2004) KU

MAEKA 32 nodes 64 CPU dual processors

AMD Opteron 1.4Ghz, 3GB Mem 80Gb HDD, Gigabit EthernetGASS

6 nodes 12 CPU AMD Athlon MP1800+, 1GB RAM 80 GB HDD

Gigabit Ethernet WARINE

16 nodes Celeron 2Ghz , 512 Mb RAM 80GB HDD, Fast Ethernet

AMATA

14 nodes AMD 1GHZ 512 MB 40GB Fast Ethernet Myrinet (6 nodes)

HPCNC 1 nodes ATHLON 1800+ , 512 MB

RAM, 80GB HDD OBSERVER

1 nodes Athlon 1800+ 512 MB RAM, 80 GB HDD

KMITNB PALM

16 nodes Pentium 4 2GHz 512 MB RAM, Fast Ethernet

Enqueue 9 nodes 18 CPU Dual

AMD 2.2GHz, 1GB RAM 32GFLOPs,2G Myrinet

AIT OPTIMA

8 nodes Athlon XP1800+ Fast Ethernet

SUT CAMETA

16 nodes Athlon XP1800+ Fast Ethernet

Total of 166 processors on ThaiGrid

Page 19: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

ThaiGrid core Network

THAISARN2 Mbps link supported by NECTEC

NECTEC- KMITNB NECTEC- SUT

NECTEC-KU ATM 155Mbps UNINET

KU-UNINET 155 MbpsAIT-UNINET 155Mbps

UNINET-Internet 2 45Mbps

Page 20: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Concept

Advanced network

Grid

DrugDesign

Life Science

AnimationFinancialAnalysis

SimulationModeling

USERS

Page 21: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Example Application

Computational Fluid Dynamics Simulation

SchedulingPGA Pack

Computational ChemistryGAMESS(General Atomic and Molecular

Electronic Structure System) Future

Life Science, Multimedia

Page 22: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

DRUG DESIGN GRID

Using grid technology to pull HPC resources together to support scientist mission CheminformaticsDrug design

Partnership projectHPCNC/KU, LCAC/KU IBM

Page 23: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Drug Design Grid AMATA 14 nodes Athlon

1Ghz Warine 16 nodes Celeron

2.0Ghz GASS 6 nodes 12

processors Athlon MP1800+

Maeka 16 nodes 32 processors Opteron system

Total of 74 processors are involved

AMATA

KU Gigabit Campus Network

Warine GASS Maeka

Globus 2.4

SQMS SQMS SQMS SQMS

SQMSG

SCE Portal

SCMSWeb

Page 24: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,
Page 25: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

THAILAND NATIONAL GRID PROJECT

Page 26: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Thailand National Grid Project (TNGP)

Proposed project funded by Ministry of Information and Communication technologyAbout 5.5 Million US$ ( 3 year Project)

3 main componentsNational Grid CommitteeNational Excellence Center for Grid

ComputingNational Grid Platform

Page 27: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Partner Institutions 16 institutions

Kasetsart University Chulalongkorn University King Mongkut’s Institute of Technology North Bangkok King Mongkut’s Institute of Technology Ladkrabang King Mongkut’s University of Technology Mahidol University Chiangmai University Prince of Songkla University KhonKhaen University Suranaree University of Technology Asian Institute of Technology Silpakorn University Walailak University Dept. of Metrological, Ministry of ICT 2 new one in the next 2 years

Page 28: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

National Grid Committee A committee will be setup to oversee the grid development

Chair: Dr. Surapong Suebwonglee (Minister of ICT) Vice Chair: Dr. Putchong Uthayopas (KU) Secretary : Dr. Vara Varavidthaya (KMITNB) Consists of representative from participant institutes Advisory Committees

Dr. Jack Dongarra (UTK) Dr. Thomas Sterling (NASA JPL) Dr. Satoshi Matsuoka (TITECH) Dr. Satoshi Sekiguchi (AIST) Prof. Yuen Poovarawan (KU, Thailand)

Mission Oversee the direction of Thailand Grid Computing Development Encourage and stimulate grid computing development in

Research Education Commercial

Page 29: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

National Excellence Center on Grid Computing Located at Kasetsart University Mission

Conduct grid research projectsOversee the Grid deploymentEducation, technology transfer Industry support

Page 30: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

National Grid Platform

Startup platform for nation wide grid deployment

Concept A 32 processors Beowulf clusters (16 systems)

will be built for each partner institutes Network upgrading to Gigabit in Bangkok and

some upgrading in upcountry to increase bandwidth

Building a Terascale Cluster as a center for large computation shared by all Thai scientist

Page 31: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Current Status

The concept has been approved by ICT minister. .

Official committee setup is done Waiting for Budget approval and will start

execution in about 3 months

Page 32: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Conclusion

Thailand is in a big transitionMore active in many area of science and

technology : Life science, Nano TechnologyBetter national network infrastructure in the

near futureFuel by grid computing and many HPC

application Look forward to being more active partner

in global collaboration

Page 33: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

The end

Page 34: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Software Local Resources Management

Condor SQMS (KU) SGE (Planned)

Middleware Globus 2.4

Grid Level Resource Management SCEGrid Scheduler (KU)

Data Grid Gfarm Data Grid (AIST)

Grid Programming Environment Ninf GridRPC (AIST) MPICH-G2

Tools SCMSweb Monitoring (KU)

Page 35: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Tools Development

OpenSCE: Cluster software Tools and Middleware (KU) MPview – MPI program visualization MPITH – Quick and simple MPI runtime for cluster

and grid SQMS – Batch scheduler for cluster SCMS/ SCMSWEB cluster management tool

ThaiGrid Portal (KMITNB) HypersimGrid Simulator for Grid design (KU)

Page 36: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Working Group

Organization

Chair

Committee

Grid Infrastructure and Middleware

Group

Simulation Group

Computational Chemistry

Group

CFDGroup

Remote SensingGroup

EvolutionaryComp. Group

FEMGroup

Page 37: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Activities

Building ThaiGrid Testbed Research and Technology Transfer International Collaboration

ApGridPRAGMAAPAN Grid Working Group

Page 38: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

NECTECComputing

System

KUComputing

System

KMITNBComputing

System

SUTComputing

System

AITComputing

System

LRM LRM LRM LRM LRM

ThaiGrid Software Architecture

Grid Middleware (Globus 2.4)

Grid Resources Manager (SCEGrid)

Grid RPC(ninf)

Grid Tools

Grid Applications

LRM=Local Resources Manager

Page 39: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Grid Monitoring

Page 40: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Clean Room Project Member: KU, SUT Goal: study clean room using CFD

Three-Dimensional Turbulence Problem Heat & Mass Transfer

Using: Finite volume, Multigrid, Parallel computing

Solution: Grid is used to Provided uniform security mechanism across the cluster

computing environment Provide mechanism for large scale data access

Tools Globus , MPICH Grid RPC (ninf, netsolve) Gfarm data grid

Page 41: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Software Structure

Network

•Front End•Sequential Solver•Visualization

•Front End•Sequential Solver•Visualization

Parallel CFDSolver

Parallel CFDSolver

Page 42: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Simulation

Many simulation and optimization problem can utilized grid and cluster well

Parametric applications is perfect for grid Simulation job on the ThaiGrid

Genetic algorithm for optimization problem using PGApack

Grid simulation (HyperGridSim)

Page 43: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Computational Chemistry

Laboratory for Computational and Applied Chemistry (LCAC), KU.

Research Zeolite Chemistry & Catalysis Surface Structure & Reactivity

of Advanced Materials  Drug Design for HIV, Avian Flu

Page 44: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Technology Transfer

First Cluster Computing Workshop, KU (30)

Second Cluster Workshop, KKU (25) Third Cluster Workshop, KU (25) First Drug Design Workshop, KU (60) First Windows Cluster Workshop, KU (12) 152 people being trained

Page 45: Thailand Grid and Networking: Infrastructure and Activities Putchong Uthayopas Director High Performance Computing and Networking Center Kasetsart University,

Research and Development

First Drug Design Grid Solution finished SCE roll Finished and will be released soon by

SDSC as part of NPACI Rocks 3.2.0 Part of KU(HPCNC)/SDSC collaboration under

PRAGMA consortium HPCNC researchers is now working with AIST

Grid Research Center in building Gridftp and LUFS support into Gfarm grid File systems