High Productivity Computing High Productivity Computing

Windows HPC Server 2008

Why Microsoft in HPC?Current IssuesCurrent Issues HPC and IT data centers merging: isolated cluster management Developers can’t easily program for parallelism Difficult for users to access processing cores and data

How can Microsoft help?How can Microsoft help?Positioned to mainstream integration of application parallelism Efforts underway to enable parallelism broadly to the developer community Can expand the value of HPC by integrating productivity and management tools

Microsoft Investments in HPCMicrosoft Investments in HPCComprehensive software portfolio: Client, Server, Management, Development, and CollaborationDedicated teams focused on Cluster ComputingUnified Parallel development through the Parallel Computing InitiativePartnerships with the Technical Computing Institutes

2008 Microsoft Investment in HPC

>$150M total investment in HPC in 2008.• Platform Portfolio:

– Client: Windows Vista 64-bit (technical workstation)– Server: Windows Compute Cluster Server– Development Platform: Visual Studio IDE with Parallel Tools– Management: Systems Center for HPC– Collaboration/Workflow: Sharepoint and Windows Workflow

Foundation• Windows HPC Server

– 40 engineers on HPC server tools– 40 incubation sales world-wide (sales+technical)– 15 dedicated HPC marketing leads– 55 half-time regional leads

• Parallel Computing Initiative– 180 engineers focused on parallel development tools

• Technical Computing Institutes

Microsoft Confidential

HPC Technical Management Team

Name and Background

Craig Mundie, Chief Research and Strategy Officer

Tony Hey, Corporate Vice President

Bill Laing, Vice President of Engineering

Kyril Faenov, HPC General Manager

Burton Smith, Technical Fellow

Shawn Hansen, Director of HPC Marketing

Dan Fay, Director Technical Institutes

Dan Reed, Director of Microsoft Research

Windows HPC Server 2008

• Complete, integrated platform for computational clustering• Built on top the proven Windows Server 2008 platform• Integrated development environment

Beta1 available from http://www.microsoft.com/hpc

Windows HPC Server 2008: Ready for Prime-time

Location Tukwila, WAHardware – Machines 256 Dual-CPU, quad-core Intel

5320 Clovertown 1.86GHz processors and 8GB RAM

Hardware – Networking Cisco Infiniband SDRBroadcom GigE

Number of Compute Nodes 256Total Number of Cores 2048

Total Memory 2 TB of RAMLinpack Results Linpack rating 11.75 TeraFLOPS

Cluster efficiency 77.1%For Comparison…

Linpack rating from June2007 Top500 run (#106) on the

same hardware

8.99 TeraFLOPS

Cluster efficiency from June2007 Top500 run (#106)

on the same hardware

59%

Typical Top500 efficiency for Clovertown motherboards w/

IB regardless of Operating System

65-77% (2 instances of 79%)

30% improvement in efficiency on the same

hardware.

Less than 2 hours to deploy

#116#116Top 500Top 500

6

Industry Focused Solutions

AutomotiveAerospaceGeo

ServicesFinancialServicesAcademia Government

LifeSciences

Market Results

• Key traction in commercial and higher education markets.– Large clusters in financial services.

• National City, Lincoln Financial, Aegon,

– Clusters in education• Arizona State, Holland Computing Center, NCSA, Univ of Minn, Univ of Arizona

– Many POCs in manufacturing, scaling out now.• Honeywell, Callaway, 3M, Boeing

• Clusters >1,000 nodes in almost every major region. Real growth in every geography.

• Expect FY08 to focus on government as major new segment.

Microsoft HPC Strategy: Expanding to the Enterprise

Compute

Phase 1:Departmental

Clusters

Compute

Storage

IO

2006-2007 2008

Phase 2:Common Platform for

Departmental to Enterprise Clusters

Windows Compute Cluster Server 2003

Rapid deploymentTurnkey app monitoring

Ease-of-management

Scalable Clustered File System Support

NetworkDirect for very high network efficiency

Dev ToolsCommon dev platform

for desktop->cluster

Windows HPC Server 2008

Visual Studio 2008Parallel Computing

Initiative

ProductivityCommon mgt and

productivity platform

MOSS, SQL,System Center

Key Partners

Resource Mgt SOA-based; scalable partners

Key Partners

What’s new in HPC Server 2008?

Systems Systems ManagementManagement

Job Job SchedulingScheduling

NetworkingNetworking& MPI& MPI StorageStorage

New System Center UI PowerShell for CLI ManagementHigh Availability for Head NodesWindows Deployment ServicesDiagnostics/ReportingSupport for Operations Manager

Support for SOA and WCF Granular resource scheduling Improved scalability for larger clusters New Job scheduling policiesInteroperability via HPC Profile

NetworkDirect (RDMA) for MPI Improved Network Configuration Wizard Shared Memory MS-MPI for multi-core MS-MPI integrated with Windows Event Tracing

Improved iSCI SAN Support in Win2008 Improved Server Message Block ( SMB v2) New 3rd party parallel system file support for Windows New Memory Cache Vendors

HPC Storage SolutionsA

ggre

gate

(M

b/s/

core

)

Number of cores in cluster

• Windows Server 2003 • Windows Server 2008 …

• HP - PolyServe • Ibrix - Fusion• Quantum - StorNext• SANbolic – Melio file system

• IBM – GPFS• Panasas – Active Scale

High Speed Networking Technologies

Myrinet, In

finiband, 10GigE

1Gig Ethernet

100MB Ethernet

Ban

dwid

th

Availability

CiscoVoltaireQlogic

Open Fabrics

Myricom

NetEffect

Improved Efficiency for the Systems Admin

• Simple to setup and manage in a familiar environment– Turnkey cluster solutions through OEMs– Simplify system and application deployment

• Base images, patches, drivers, applications

• Focus on ease of management– Comprehensive diagnostics , troubleshooting

and monitoring– Familiar, flexible and “pivotal” management

interface– Equivalent command line support for

unattended management

• Scale up– Scale deployment, administration,

infrastructure– Head node failover– Cluster usage reporting– Compute node filtering

• Better integration with enterprise management

– Patch Management– System Center Operations Management– PowerShell– Windows 2008 high Availability Services

Parallel Programming• Available Now

– Development and Parallel debugging in Visual Studio– 3rd party Compilers, Debuggers, Runtimes etc.. available

• Emerging Technologies – Parallel Framework– LINQ/PLINQ – natural OO language for SQL queries in .NET– C# Futures – way to explicitly make loops parallel

• For the future: Parallel Computing Initiative (PCI)– Triple investment with a new engineering team– Focused on common tools for developing multi-core codes from desktops to clusters

Release Schedule

• Technical Preview – Private Release• Beta 1 – Publicly Available now!• Beta 2 – Coincides with Windows Server 2008

RTM• RTM – 90 to 120 days after Windows RTM

Nov 2007

Tech Preview Beta 1 Beta 2 RTM

Aug 2007

Early 2008

Summer 2008

Resources

• Microsoft HPC Web site – download Beta 1 Today!– http://www.microsoft.com/hpc

• Windows HPC Community site– http://www.windowshpc.net

• Windows Server x64 information– http://www.microsoft.com/x64/

• Windows Server System information– http://www.microsoft.com/windowsserver

• Get the Facts Web site– http://www.microsoft.com/getthefacts