The TOP500 Projectof the Universities

Mannheim and Tennessee

Hans Werner MeuerUniversity of Mannheim

EURO-PAR 2000 29. August - 01. September 2000

Munich/Germany

Outline

• TOP500 Approach

• HPC-Market as of 06/2000

• Market Trends, Architecture Trends, Technology Trends

• WWW Service for TOP500

• Future of TOP5000

Supercomputer and TOP500

• 1980’s (early)- Vector computers- One main application area

• ‘numerical’, scientific and engineering

• What is a ‘Supercomputer’?

Mannheim Supercomputer Statistics

• 1990’s- ?

TOP500 Idea

• Assemble list of the XXX most powerfulcomputers in the World and define them as‘Supercomputer’

• Update as needed• The problem is now shifted from defining

‘Supercomputer’ to ‘powerful’• Define ‘powerful’ with a benchmark result

Linpack

• Features:– Most widely used benchmark on large systems– Favors large memory

• Performance increases with problem size

– Not very sensitive to network performance– No I/O!

• Benchmark measuring the solution of a dense system of linear equations

• Still much better than peak performance

TOP500 Procedure

• Assemble list of the 500 most powerfulcomputers in the World

• Yardstick for performance:– Rmax of the LINPACK

• Updated twice a year:– June at ‘Supercomputer’ in Mannheim– November at ‘SCxx’ in USA

• Widely accepted after 15 editions

TOP500 Authors- Started in spring 1993 by:

Hans W. Meuer and Erich Strohmaier

- First list published in 6/93 together with

Jack Dongarra

- Basis for analysing the HCP market

- Quantification of observations

- Detection of trends • market, • architecture, • technology

TOP500 Benefits

TOP500 Status

• 1. List in June 1993

• Accepted by Users and Manufacturers

• 15. List on June 8, 2000

TOP500 list - Data shown• Manufacturer Manufacturer or vendor• Computer Type indicated by manufacturer or vendor• Inst. Site Customer• Location Location and country• Year Year of installation/last major update• Field of Appl. Academic,Research,Industry,Vendor,Class.• # Proc. Number of processors• Rmax Maxmimal LINPACK performance achieved• Rpeak Theoretical peak performance• Nmax Problemsize for achieving Rmax

• N1/2 Problemsize for achieving half of Rmax

• Nworld Position within the TOP500 ranking

TOP10 06/2000

RANK MANU-FACTURER COMPUTER

RMAX[TF/S]

INSTALLATION SITE COUNTRY YEAR AREA OFINSTALLATION # PROC

1 Intel ASCI Red 2.38 Sandia National LabsAlbuquerque

USA 1999 Research 9632

2 IBMASCI Blue-

Pacific SST, IBMSP 604E

2.14 Lawrence Livermore NationalLaboratory USA 1999 Research 5808

3 SGI ASCI BlueMountain

1.61 Los Alamos National Lab USA 1998 Research 6144

4 IBM SP Power3 375MHz

1.42 IBM/Naval OceanographicOffice (NAVOCEANO)

IBM/Poughkeepsie

USA 2000 Vendor/Research 1336

5 Hitachi SR8000-F1 1.04 Leibniz Rechenzentrum,Munic

Germany 2000 Academic 112

6 Hitachi SR8000-F1 0.92High Energy Accelerator

Research Organization/ KEK,Tsukuba

Japan 2000 Research 100

7 Cray Inc. T3E 1200 0.89 Government USA 1998 Classified 1084

8 Cray Inc. T3E 1200 0.89 US Army HPC ResearchCenter at NCS, Minneapolis

USA 2000 Research 1084

9 Hitachi SR8000 0.87 University of Tokyo Japan 1999 Academic 12810 Cray Inc. T3E 900 0.82 Government USA 1997 Classified 1324

TOP10 in Europe 06/2000RANK

(EUROPE)RANK

(WORLD)MANU-

FACTURER COMPUTER RMAX[GF/S] INSTALLATION SITE COUNTRY YEAR AREA OF

INSTALLATION

1 5 Hitachi SR8000-F1/112 1035 Leibniz Rechenzentrum Germany 2000 Academic

2 14 Cray Inc. T3E1200 671 CSAR at the University ofManchester UK 2000 Academic

3 15 Cray Inc. T3E1200 671 Deutscher Wetterdienst Germany 1999 Research

4 18 Cray Inc. T3E900 552 United KingdomMeteorological Office UK 1997 Research

5 20 Cray Inc. T3E1200 526 United KingdomMeteorological Office UK 1999 Research

6 32 Cray Inc. T3E1200 447 ForschungszentrumJuelich (FZJ) Germany 1999 Research

7 36 Cray Inc. T3E 355 Max-Planck-GesellschaftMPI/IPP Germany 1997 Research

8 38 Fujitsu VPP5000/38 345 ECMWF UK 1999 Research

9 39 Cray Inc. T3E900 341 HWW/Universität Stuttgart Germany 1996 Industry

10 46 Fujitsu VPP5000/31 286 Meteo-France France 1999 Research

Outline

• TOP500 Approach

• HPC-Market as of 06/2000

• Market Trends, Architecture Trends, Technology Trends

• WWW Service for TOP500

• Future of TOP5000

Japan12%

Europe30%

Others4%

USA54%

Total: 500

Systems installed

06/2000

Others3%

USA58%

Europe24%

Japan15%

Total: 64,3 Tflops

Rmax installed

06/2000

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%Au

str./

Suiss

e

Bene

lux

Germ

any

Fran

ce UK Italy

Scan

din.

Total: 150

Number of systems installed in Europe

06/2000

Performance Statistics - Countries

131 78 8737 67 41 57 29

704

0

100

200

300

400

500

600

700

800

Kflo

ps p

er in

habi

ta

USA

Japa

n

Ger

man

y

Fran

ce UK

Scan

dina

via

Switz

erla

nd

New

Zea

land

Luxe

mbo

urg

06/2000

Germany - Bundesländer

0

5

10

15

20

25#

Syst

ems

Bade

n-W

ürtte

mbe

rg

Baye

rn

Berli

n

Brem

en

Hess

en

Nied

ersa

chse

nNo

rdrh

ein-

Wes

tfale

n

Rhei

nlan

d-Pf

alz

06/2000

Manufacturers

0%

5%

10%

15%

20%

25%

30%HP

Com

paq

Cray

Inc.

Fujit

su

Hita

chi

IBM

Inte

l

NEC

SGI

SUN

Self

Mad

e

Total: 500

06/2000

Outline

• TOP500 Approach

• HPC-Market as of 06/2000

• Market Trends, Architecture Trends, Technology Trends

• WWW Service for TOP500

• Future of TOP5000

Performance Development

1.167 TF/s

64.3 TF/s

2.38 TF/s

59.7 GF/s43.8 GF/s

0.4 GF/s

Jun-93

Nov-93Ju

n-94Nov-94Ju

n-95Nov-95Ju

n-96Nov-96Ju

n-97Nov-97Ju

n-98Nov-98Ju

n-99Nov-99Ju

n-00

Intel XP/S140Sandia

Fujitsu'NWT' NAL

SNI VP200EXUni Dresden

Cray Y-MP M94

KFA Jülich

CrayY-MP C94'EPA' USA

Hitachi/TsukubaCP-PACS/2048

SGIPOWER

CHALLANGE GOODYEAR

IntelASCI Red

Sandia

IntelASCI Red

Sandia

Sun UltraHPC 1000

News International

SunHPC 10000Merril Lynch

IntelASCI Red

Sandia

SGIT3E900/38

CIEMAT

N=1

N=500

SUM

Sun HPC1000 400MHz/64EDS Plano

1 Gflop/s

1 Tflop/s

100 Mflop/s

100 Gflop/s

100 Tflop/s

10 Gflop/s

10 Tflop/s

Continents

USA/Canada

Europe

Japanothers

0

100

200

300

400

500

Jun-93

Nov-93

Jun-94

Nov-94

Jun-95

Nov-95

Jun-96

Nov-96

Jun-97

Nov-97

Jun-98

Nov-98

Jun-99

Nov-99

Jun-00

Europe - Countries

Germany

UKFrance

ScandinaviaBenelux

Switzerlandothers

0

50

100

150

Jun-93

Nov-93

Jun-94

Nov-94

Jun-95

Nov-95

Jun-96

Nov-96

Jun-97

Nov-97

Jun-98

Nov-98

Jun-99

Nov-99

Jun-00

Producers

USA

JapanEurope

0

100

200

300

400

500

Jun-93

Nov-93

Jun-94

Nov-94

Jun-95

Nov-95

Jun-96

Nov-96

Jun-97

Nov-97

Jun-98

Nov-98

Jun-99

Nov-99

Jun-00

HPC Manufacturers from 1980 to 2000

1980

1981

1982

1983

1984

1985

1986

1987

1988

1989

1990

1991

1992

1993

1994

1995

1996

1997

1998

1999

2000

CrayCray Computer

SGI

CDC/ETA

Fujitsu

NEC

Hitachi

Convex/HP

TMC

Intel

nCUBE

Alliant

FPS

Meiko

Parsytec

MasPar

DEC/Compaq

KSR

IBM

Sun

Fujitsu Siemens

/

/

/

Manufacturers

Cray

SGI

IBMSun

Convex/HP

TMC

Intel

"Japan Inc"others

0

100

200

300

400

500

Jun-93

Nov-93

Jun-94

Nov-94

Jun-95

Nov-95

Jun-96

Nov-96

Jun-97

Nov-97

Jun-98

Nov-98

Jun-99

Nov-99

Jun-00

Manufacturers - Performance

10

100

1000

10000

100000

Jun 93

Jun 94

Jun 95

Jun 96

Jun 97

Jun 98

Jun 99

Jun 00

Perf

orm

ance

[GFl

op/s Cray

IBM"Japan Inc"SGISunIntelConvex/HPTMCothers

Customer Types

Research

Industry

Academic

ClassifiedVendor

0

100

200

300

400

500

Jun 93

Nov 93

Jun 94

Nov 94

Jun 95

Nov 95

Jun 96

Nov 96

Jun 97

Nov 97

Jun 98

Nov 98

Jun 99

Nov 99

Jun 00

Customer Types - Performance

10

100

1000

10000

100000

Jun-93

Jun-94

Jun-95

Jun-96

Jun-97

Jun-98

Jun-99

Jun-00

Perfo

rman

ce [G

Flop

/s]

ResearchIndustryAcademicClassifiedVendor

Applications in Industry

engineering

commercial

unknown

0

50

100

150

200

250

Jun-93

Nov-93

Jun-94

Nov-94

Jun-95

Nov-95

Jun-96

Nov-96

Jun-97

Nov-97

Jun-98

Nov-98

Jun-99

Nov-99

Jun-00

Processor Types

Chip Technology I

Chip Technology II

Architectures

Outline

• TOP500 Approach

• HPC-Market as of 06/2000

• Market Trends, Architecture Trends, Technology Trends

• WWW Service for TOP500

• Future of TOP5000

www.top500.org

www.top500.org

www.top500.org

www.top500.org

Outline

• TOP500 Approach

• HPC-Market as of 06/2000

• Market Trends, Architecture Trends, Technology Trends

• WWW Service for TOP500

• Future of TOP5000

ASCI Red

Cray T3DTMC CM-5

TMC CM-2Cray 2

Cray X-MP

Cray 1

CDC 7600 IBM 360/195

CDC 6600

IBM 7090

UNIVAC 1EDSAC 1

1950 1960 1970 1980 1990 2000

1 KFlop/s

1 MFlop/s

1 GFlop/s

1 TFlop/s

Performance and Moore's Law

based on R. W. Hockney

Performance Development

0,1

10

1000

100000

Jun 93

Nov 93

Jun 94

Nov 94

Jun 95

Nov 95

Jun 96

Nov 96

Jun 97

Nov 97

Jun 98

Nov 98

Jun 99

Nov 99

Jun 00

Perf

orm

ance

[GFl

op/s

]

N=1

N=500

Sum

N=10

Performance Development

ASCIEarth Simulator

Jun 93

Jun 94

Jun 95

Jun 96

Jun 97

Jun 98

Jun 99

Jun 00

Jun 01

Jun 02

Jun 03

Jun 04

Jun 05

N=1

N=500

Sum

N=10

1 GFlop/s

1 TFlop/s

1 PFlop/s

100 MFlop/s

100 GFlop/s

100 TFlop/s

10 GFlop/s

10 TFlop/s

• There is no agreed benchmark set for HPC systems

• Linpack and NAS Parallel Benchmarks (NPB) are the only recent candidates

• System capabilities vary quite tremendously over time due to Moore‘s Law

scalability problem

Status of HPC Benchmarking

Status of Linpack• Pure CPU benchmark

• Not sensitive to memory issues - but dependant on memory size

• Over-optimized compared to real applications

• Scalable over wide range

slowly approaching its limits !

New Approach

• Erich Strohmaier: “A new benchmark suite must be simple enough to be usable and maintainable, complex enough to reflect the influences of all system attributes of interest, and scalable to utizile resources in a variety of system sites.“

• IDC 2000 Benchmark (Earl Joseph II)

• IDC Forum Mountain View, July 24-25, 2000

Thank you!

TheThe PowerPoint PowerPoint slides slides of of thisthis presentationpresentation

maymay bebe accessedaccessed viavia URL: URL:

http://www.uni-mannheim.de/rum/dokus/talks/