Windows Compute Windows Compute Cluster Server And Cluster Server And Deskside ClustersDeskside ClustersAn OverviewAn Overview

Anand KrishnanAnand KrishnanProduct ManagerProduct ManagerWindows Server HPCWindows Server HPCMicrosoft CorporationMicrosoft Corporation

We’re Going To Talk About …We’re Going To Talk About …

What is HPC?What is HPC?

What’s happening with the HPC market?What’s happening with the HPC market?

What are customers looking for?What are customers looking for?

What is Microsoft planning to do in What is Microsoft planning to do in this space?this space?

How does this affect my business?How does this affect my business?

What Is HPC? What Is HPC?

Cutting edge problems in science, Cutting edge problems in science, engineering and business require engineering and business require capabilities beyond those of standard capabilities beyond those of standard desktops and serversdesktops and servers

Improved Vehicle Improved Vehicle AerodynamicsAerodynamics

Computational Fluid Dynamics (CFD) Packages Computational Fluid Dynamics (CFD) Packages used to model vehicle aerodynamicsused to model vehicle aerodynamics

Source: Source: www.fluent.com/ about/news/pr/pr48.html ; www.fluent.coml ; www.fluent.com

Safer Structural ElementsSafer Structural Elements

Finite Element Analysis (FEA) packages model Finite Element Analysis (FEA) packages model element stress-profiles under various conditionselement stress-profiles under various conditions

More Efficient Oil ExtractionMore Efficient Oil Extraction

Reservoir simulation packages model oil/gas Reservoir simulation packages model oil/gas reservoir rock and fluid propertiesreservoir rock and fluid properties

Source: http://www.geocap.no/products/a4.eclipse.shtmlSource: http://www.geocap.no/products/a4.eclipse.shtml

Some Clarification On Some Clarification On Terminology …Terminology …

HPC Systems

Shared Memory Distributed Memory

Dedicated Compute Clusters Non-Dedicated Clusters

Collections of Collections of computers, networked computers, networked together and acting as a together and acting as a single large machinesingle large machine

Each ‘node’ is Each ‘node’ is dedicated to the dedicated to the compute clustercompute cluster

Collections of Collections of computers, networked computers, networked together and acting as a together and acting as a single large machinesingle large machine

Nodes have ‘day-jobs’ Nodes have ‘day-jobs’ and can only provide and can only provide cycles when unusedcycles when unused

Entry Price-points For HPC Entry Price-points For HPC Have DroppedHave Dropped

Distributed Memory Distributed Memory Becoming The NormBecoming The Norm

Clusters over 70%

Commercial Adoption Is On Commercial Adoption Is On The RiseThe Rise

Industry usage rising

HPC system growth: 70% in 2004; 25% in 2005 (IDC)HPC system growth: 70% in 2004; 25% in 2005 (IDC)

Growth being driven by <$250k segment (clusters)Growth being driven by <$250k segment (clusters)

x86 server clusters growing faster than market (15%-20% for HPC x86 server clusters growing faster than market (15%-20% for HPC clusters, 11.4% for x86 overall)clusters, 11.4% for x86 overall)

Market Growth Driven By Market Growth Driven By The Low EndThe Low End

Challenges in HPC todayChallenges in HPC today

““.. want to do more .. want to do more science & less IT”science & less IT”

““..apps not keeping up ..apps not keeping up with ideas”with ideas”

“…“…takes a village to takes a village to raise a cluster”raise a cluster”

““...parallel programming ...parallel programming is difficult”is difficult”

““..not enough tools”..not enough tools”

App availability and App availability and integrationintegration

Simpler job submission Simpler job submission and monitoringand monitoring

Easier deployment and Easier deployment and setupsetup

Simplified mgmt Simplified mgmt environmentenvironment

Integrated & complete Integrated & complete development development environmentenvironment

Platform standardsPlatform standards

End Users

IT Pros

Developers

Microsoft’s Vision For HPCMicrosoft’s Vision For HPC

Empower scientists and engineers to Empower scientists and engineers to interactively employ massive interactively employ massive computational resources to solve complex computational resources to solve complex technical problemstechnical problems

Make distributed computing resources Make distributed computing resources productive to develop for and cost-productive to develop for and cost-effective to operateeffective to operate

Microsoft Initiatives In HPCMicrosoft Initiatives In HPC

Develop a complete productDevelop a complete productWindows Compute Cluster Server 2003Windows Compute Cluster Server 2003

Grow the ecosystemGrow the ecosystemWork with partners to build & sell solutionsWork with partners to build & sell solutions

Work with the HPC communityWork with the HPC communityPartner with academia and industry to Partner with academia and industry to develop standards and advance researchdevelop standards and advance research

Raise AwarenessRaise AwarenessEvangelize parallel computingEvangelize parallel computing

Compute Cluster Server Compute Cluster Server 2003 (CCS)2003 (CCS)

Complete, integrated platform for computational Complete, integrated platform for computational clusteringclustering

Core PlatformCore PlatformWindows Server 2003 Compute Cluster EditionWindows Server 2003 Compute Cluster Edition

x64 onlyx64 only

Cluster ToolsCluster ToolsMicrosoft Compute Cluster PackMicrosoft Compute Cluster Pack

Built-in Cluster Mgmt, Job Scheduler & MPIBuilt-in Cluster Mgmt, Job Scheduler & MPI

Interconnect support leveraging Winsock DirectInterconnect support leveraging Winsock Direct

AvailabilityAvailabilityPre-release bits at Pre-release bits at http://www.microsoft.com/http://www.microsoft.com/hpchpc

RTM in JuneRTM in June

The CCS Value PropositionThe CCS Value Proposition

Faster time-to-insight Faster time-to-insight ..through simplified cluster deployment, job ..through simplified cluster deployment, job submission and status monitoringsubmission and status monitoring

Integration with Windows infrastructureIntegration with Windows infrastructure… … allowing customers to use existing allowing customers to use existing technology and skill-setstechnology and skill-sets

Integrated development environmentIntegrated development environment… … allowing developers to write parallel allowing developers to write parallel applications from within the Visual Studio IDEapplications from within the Visual Studio IDE

Target VerticalsTarget Verticals

AutomotiveAutomotive AerospaceAerospaceLifeLife

SciencesSciencesGeoGeo

ServicesServicesFinancialFinancialServicesServices AcademiaAcademia GovernmentGovernment

PartnersPartners

University of Virginia

Charlottesville, VA USA

University of Tennessee

Knoxville, TN USA

Cornell Theory CenterIthaca, NY USA

University of Utah

Salt Lake City, UT USA

TACC – University of TexasAustin, TX USA

Southampton University

Southampton, UK

HLRS – University of Stuttgart

Stuttgart, Germany

Shanghai Jiao Tong UniversityShanghai, PRC

Tokyo Institute of Technology

Tokyo, Japan

Nizhni Novgorod UniversityNizhni Novgorod, Russia

HPC InstitutesHPC Institutes

Bringing HPC Into The Bringing HPC Into The MainstreamMainstream

Co

mp

uti

ng

Sca

le

Deskside Clusters

Datacenter Based Compute Clusters

Datacenter-Based Compute Datacenter-Based Compute ClusteringClustering

Sizes ranging from 8-1000+ nodesSizes ranging from 8-1000+ nodes……but 90+% of installs are <64 nodesbut 90+% of installs are <64 nodes

High affinity to workstations for interactive High affinity to workstations for interactive processingprocessing

Seamless interaction between workstation and Seamless interaction between workstation and cluster critical to end-userscluster critical to end-users

Integration into IT infrastructure critical to IT ProsIntegration into IT infrastructure critical to IT Pros

Purchasing decision driven by combination of Purchasing decision driven by combination of Corp IT and End-UserCorp IT and End-User

Deskside SupercomputingDeskside Supercomputing

End users that are caught between the desktop and End users that are caught between the desktop and the datacenterthe datacenter

Need access to 4-8 nodes for most of their processingNeed access to 4-8 nodes for most of their processing

Might have access to larger HPC systems but want ‘in-lab’ Might have access to larger HPC systems but want ‘in-lab’ clusters for development purposesclusters for development purposes

Allows user to refine algorithms and code before deployment on Allows user to refine algorithms and code before deployment on larger departmental clusterslarger departmental clusters

User profile: Engineers and scientists solving “what if” User profile: Engineers and scientists solving “what if” problems inproblems in

Life SciencesLife Sciences

Computer Aided EngineeringComputer Aided Engineering

FinanceFinance

Oil and gas/geophysicsOil and gas/geophysics

What Should A Deskside What Should A Deskside Cluster Look Like?Cluster Look Like?

True high performance parallel computersTrue high performance parallel computers

Small enough for the office and labSmall enough for the office and lab

Powered from a standard wall outletPowered from a standard wall outlet

Cool running and quietCool running and quiet

Priced under single-user purchase limitsPriced under single-user purchase limits

As easy to use as a PCAs easy to use as a PC

Comes with OS pre-installed (and Comes with OS pre-installed (and potentially app as well)potentially app as well)

Deskside ScenarioDeskside ScenarioMolecular ModelingMolecular Modeling

Personal 4 node clusterPersonal 4 node clusterPer node: Dual core, dual proc x64, Per node: Dual core, dual proc x64, 2GB RAM2GB RAM

Dual NIC (Ethernet + GigE or IB)Dual NIC (Ethernet + GigE or IB)

1 head node, 3 compute nodes1 head node, 3 compute nodes

110v pluggable, low noise, 110v pluggable, low noise, desk-side towerdesk-side tower

Front end workstation used to build, Front end workstation used to build, view and interact with the model in 3Dview and interact with the model in 3D

Coarse-grained simulations run Coarse-grained simulations run against desk-side cluster.against desk-side cluster.

Larger models handed off to Larger models handed off to datacenter-based resourcesdatacenter-based resources

SummarySummary

Parallel computing is here to stayParallel computing is here to stay

Windows Compute Cluster Server 2003 is Windows Compute Cluster Server 2003 is Microsoft’s first step towards bringing Microsoft’s first step towards bringing HPC into the computing mainstreamHPC into the computing mainstream

CCS will serve existing scenarios…CCS will serve existing scenarios…Datacenter-Based Compute ClusteringDatacenter-Based Compute Clustering

……and drive momentum around new onesand drive momentum around new onesDeskside SupercomputingDeskside Supercomputing

Call To ActionCall To Action

Download Compute Cluster Server 2003 Download Compute Cluster Server 2003 @ @ www.microsoft.com/www.microsoft.com/hpchpc

Think about taking HPC beyond the Think about taking HPC beyond the datacenterdatacenter

Build, Test and Prepare to ship products Build, Test and Prepare to ship products for CCSfor CCS

ResourcesResources

Microsoft HPC Web siteMicrosoft HPC Web sitehttp://www.microsoft.com/hpc/http://www.microsoft.com/hpc/

Microsoft Windows Compute Cluster Server 2003 Microsoft Windows Compute Cluster Server 2003 Beta ProgramBeta Program

http://www.microsoft.com/windowsserver2003/ccs/beta.mspxhttp://www.microsoft.com/windowsserver2003/ccs/beta.mspx

Microsoft Windows Compute Cluster Server 2003 Microsoft Windows Compute Cluster Server 2003 Community SiteCommunity Site

http://codegallery.gotdotnet.com/windowshpchttp://codegallery.gotdotnet.com/windowshpc

Windows Server x64 informationWindows Server x64 informationhttp://www.microsoft.com/64bit/http://www.microsoft.com/64bit/http://www.microsoft.com/x64/http://www.microsoft.com/x64/

Windows Server System informationWindows Server System informationhttp://www.microsoft.com/wss/http://www.microsoft.com/wss/

Get the Facts Web siteGet the Facts Web sitehttp://www.microsoft.com/http://www.microsoft.com/getthefactsgetthefacts

User AppUser App

MPIMPI

Node ManagerNode Manager

Job ExecutionJob Execution

Datacenter-Based Compute ClusteringDatacenter-Based Compute Clustering

DB/FSDB/FS

UserUser

Cmd lineCmd line

Desktop AppDesktop App

Job Mgr UIJob Mgr UI

AdminAdmin

AdminAdmin Console Console

Cmd lineCmd line

Head NodeHead Node

Job MgmtJob Mgmt

Resource MgmtResource Mgmt

Cluster MgmtCluster Mgmt

SchedulingScheduling

High speed, low latency interconnect

Tasks

Man

agem

ent

Jobs Policy, reports

Active Active DirectoryDirectory

Data

Inp

ut

Domain\UserADomain\UserA

© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions,

it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.