program update

Program Update

Presented by

Larry Davis, Deputy Director

September 2009

Department of DefenseHigh Performance Computing Modernization Program

HPC Forum Briefing – l. Davis

Outline

Introduction

Program Structure

0 HPC Centers

0 Networking

0 Software Applications Support

0 Resource Management

Solving the hard problems . . .5/4/2009-2.1


HPC Modernization Program



Solving the hard problems . . .

HPC Modernization Program Goals

5/4/2009-4.1



A Quick History Program initiation — 1992–1993

0 HPC Modernization Plan0 Initial program structure established,

S&T0 Initial HPC capabilities provided0 HPCMP established as an ACAT1

Program formalization — 1994–19950 Program office established0 DoD oversight process implemented0 Program structure and customer base

expanded, include T&E

Major acquisitions — 1995–19960 Four major shared resource centers0 Defense Research and Engineering

Network (DREN)0 Programming Environment and

Training (PET) contract established

Operations focus — 1997–20000 Continuous upgrades at HPC centers0 Selection of new distributed centers

(DCs)0 DoD Challenge Projects established

Major contract awards — 2001–20030 DREN contract awarded0 HPC Centers contract awards0 New PET contract awarded

Operations focus — 2003–20060 New DHPIs, Institutes and Portfolios

selected0 Capability Applications Project (CAPs)

established0 Minority Undergraduate Education and

Research Initiative established0 Value to the DoD study–Return on

Investment (ROI) project

Major contracts & expansion — 2007–20090 Next Generation Technical Services

(NGTS) contract awarded0 New DHPIs, Institutes and Portfolios

selected0 Computational Research and Engineering

Acquisition Tools and Environments (CREATE) program initiated

0 New PET3 contract awarded0 New archival storage contract awarded

5/4/2009-5.1



DoD HPC Modernization Program

6/492009-6.3

Army HPCMP Participation

ARL & ERDC DSRCs1,309 Users/22 Organizations/102 Projects56 DREN Sites14 Challenge Projects/2 DHPIs5 Institutes

Navy HPCMP ParticipationNAVY DSRC1,031 Users/16 Organizations/198 Projects38 DREN Sites12 Challenge Projects/3 DHPIs1 Institute

Air Force HPCMP ParticipationAFRL & MHPCC DSRCs1,361 Users/24 Organizations/175 Projects24 DREN Sites12 Challenge Projects/5 DHPIs3 Institutes

Defense Agencies ParticipationDARPA, DTRA, JFCOM,MDA, PA&E & OTE644 Users/4 Organizations/21 Projects35 DREN Sites3 Challenge Projects

Other

ARSC ADC68 DREN Sites1 DHPI


DoD Supercomputing Resource Centers (DSRCs)

Six Large HPC Centers



Solving the hard problems . . .Solving the hard problems . . .

DoD Supercomputing Resource Centers (DSRCs)

FY09 Capability

As of: July 2009

Location SystemProcessors

(Cores)Memory

(GB)Capacity

(Habus)

AFRL HP Opteron ClusterSGI Altix ClusterSGI Altix 4700

2,0482,0489,216

4,0963,584

20,480

201884

ARL Linux Networx ClusterLinux Networx Cluster (Classified)Cray XT5 (Classified)SGI Altix ICE 8200SGI Altix ICE 8200 (Classified)

4,5283,464

10,54011,3847,088

8,976 6,736

40,128 34,152

21,264

5526

138254161

ARSC SUN x4600Cray XT5

2,3203,504

9,280 14,784

1855

ERDC Cray XT3Cray XT4SGI Altix ICE 8200

8,3208,760

16,160

16,640 17,696 48,480

95100360

MHPCC Dell PowerEdge 1955 5,120 10,240 61

NAVY IBM 1600 Power5 ClusterIBM 1600 Power5 Cluster (Classified)Cray XT5IBM Power 6

3,0721,920

12,8725,312

6,144 3,840

26,592 8,448

3317

202125

Total 117,676 301,560 1,822

FY09 HPC Systems shown in GREENFY08 HPC Systems shown in REDFY07 HPC Systems shown in BLUEOlder HPC Systems shown in BLACK

7/13/2009-8.4


TI-09 Installation Status Rackable’s recent purchase of SGI’s assets included all HPCMP

contracts

– TI-09 systems on track for delivery as scheduled New SGI remains committed to delivering the new system and

maintaining existing system


ARL – Classified SGI Altix ICE 8200

0 6,656 core (169 HABUs)

0 Final acceptance September 18, 2009 ARL – Unclassified SGI Altix ICE 8200

0 10,752 core (271 HABUs)

0 Final acceptance late September 2009 ERDC – Unclassified SGI Altix ICE 8200

0 15,360 core (385 HABUs)

0 Final acceptance October 2, 2009

8/3/2009-9.3



TI-01 TI-02 TI-03 TI-04 TI-05 TI-06 TI-07 TI-08 TI-090

200

400

600

800

1,000

1,200

1,400Habus Procured for Each TI-XX

Percent Procured from Pevious Year

To

tal

Nu

mb

er

of

Ha

bu

sHPC Installations (TI-01 through 09)Added HPC Capability Trend (DSRCs Only)

+ 3

0%

1.1 2.14.6

1.6

2.2

1.8

1.7

1.5

2.1

8/3/2009-10.2



TI-01 TI-02 TI-03 TI-04 TI-05 TI-06 TI-07 TI-08 TI-090

2

4

6

8

10

12

14

16

18Increase in Habus per processor for each TI-XXIncrease in Number of processors for each TI-XX

Fa

cto

r In

cre

as

ePerformance Increases Come from Both Processor Improvement and Processor Count

8/3/2009-11.2

Implication: Need Software Applications that Scale to 1,000s of Processors


Next Generation Technical Services Support (NGTS) Contract

HPC Center’s Technical Services Support contract provides 30–50 FTEs per Center

0 Technical Expertise Customer Support System and Network Administration Application/System Performance Analysis Expansion Analysis and Integration Services Operators and Operations Support Outreach

0 Acquisition Vehicle for Small Purchases (ODCs)



NGTS (Continued)

Attributes of Contract

0 One five year contract for four DSRCs Facilitates leveraging innovations and

efficiencies across multiple DSRCs Does not include ARSC and MHPCC with the

exception of support for the Consolidated Customer Assistance Center

0 Cost plus type contract with a fixed award fee pool and no base fee

0 Awarded to Lockheed Martin Information Systems (LMIS) in March 2008

0 $344M contract ceiling



Solving the hard problems . . .Solving the hard problems . . .

HPCMP Storage Initiative

Computing power grows annually—so do stored files Archived data is hard for users to use and manage Costs: User time, labor, hardware, software and media Storage Initiative

0 Objective: Refresh to manage data for next 10 years

0 Goals: 10-year architecture Leverage advances in technology Improve user productivity Improve reliability & adaptability Sustain within current storage budget

0 Funding: Reserved 1/3 of FY09 investment dollars

0 Challenge: User awareness and behavior changes

5/4/2009-14.1


HPCMP Data Storage GrowthSingle Copy Data Storage


2001 2002 2003 2004 2005 2006 2007 20080

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

Year

Sin

gle

Co

py

of

HP

CM

P S

tora

ge

in T

era

by

tes

5/4/2009-15.1



Storage Lifecycle Management (SLM)

Three Key Features0 Utility Server to provide longer term near-line storage to store

data for up to 30 days prior to archiving

0 Information Lifecycle Management (ILM) system to help user and system to associate important information with data

0 Establishment of a 10-year contract to facilitate predictable costs (possibly fixed) for data management software

Acquisition0 Software

ILM software, archive software and development services Full and open competition RFP release in March 2009, award made in August 2009

0 Hardware Execute via NGTS

5/4/2009-16.1



10 years

StorageHardware

Generation 1

Storage SoftwareLong-term

Government Partnership with Industry

Hardware Refresh Cycle

HPCMP Storage Initiative Overall Acquisition Strategy

StorageHardware

Generation 2

StorageHardware

Generation 3

StorageHardware

Generation 4

5/4/2009-17.1



Storage Target Architecture

Short-Term Storage

SLM

Medium-Term Storage

ILM-Driven Long-Term

Storage

Tape

ILM-managed

File System Utility

Server

ArchiveServer

Data Sharing withOther Centers

Center Archive Cache

DRCache

HPCSYSTEM

A

HPC File System

A

HPC File

SystemB

Remote Disaster

Recovery Facility

HPCSYSTEM

B

5/4/2009-18.1


User Interface Toolkit – API


Single Desktop Interface to Multiple HPC Systems

• Supports Novice to Expert Users• Central Access to HPC Resources• Custom Productivity Clients• Complete Job Stream Management• Fast Large File Transfers• Secure Authentication

UITMaking High Performance Computing Easy

UITAPI

7/9/2009-19.2



Defense Research & Engineering Network (DREN) (pronounced: 'dē-ren)

5/11/2009-20.2



DREN – Two WorldsHPCMP - Buy-In Customers

68 HPCMP sites

111 Subscriber sites

6/9/2009-21.2



Software Applications Support

5/4/2009-22.1



HPC Software Applications Institutes

8/27/2009-23.1



HPC Software Applications Institutes

8/27/2009-24.1


User Productivity Enhancement, Technology Transfer and Training (PET3)




PET3 Contract Award Update

PET3 was awarded to High Performance Technologies Inc. (HPTi) on July 31, 2009 to start September 1, 2009

Award amount ~$147 million over ten years

The HPTi team is made up of major HPC groups around the country, including Texas Advanced Computing Center, Pittsburgh Supercomputing Center, San Diego Supercomputer Center, and 18 other partners

One major feature is the combination of Computational Environment (CE) and Enabling Technologies (ET) into Advanced Computational Environments (ACE)

8/27/2009-26.1


Computational Research and Engineering Acquisition Tools and Environments



Resource Management




Customer Needs, Priorities, and Usage History Drive HPCMP Investments

Detailed requirements information collected annually through web-based requirements survey (includes all projects)

Requirements information refined through in-person interviews and quality checks

Requirements validated by senior S&T and T&E executives in each Service and Agency

2007 2008 2009 2010 2011 2012 2013 20140

5,000

10,000

15,000

20,000

25,000

30,000Capacity

Aggregated Requirements

Max Projected Requirements

Fiscal Year

Ha

bu

-yrs

Historical Projection of Requirements

7/9/2009-29.6



DoD Challenge Projects

7/24/2009-30.2


Dedicated HPC Project Investments




Summary

World-class corporate computing capability established for DoD HPC community

High Performance Computing capabilities being employed to provide substantial contributions to DoD mission capabilities

Successful transition to scalable, parallel computing

Leveraging national, academic and federal activities

7/24/2009-32.1

program update

Documents