COMPUTING INSPIRES FUTURE

HPC New Developments

Vangel BojaxhiHPC Business Development Manager

Agenda

Inspur Global Server & HPC Leader HPC Market & Technology Trends Inspur HPC Products, Integrated Solutions & Services Inspur HPC Community Outreach

Agenda

Inspur Global Server & HPC Leader HPC Market & Technology Trends Inspur HPC Products, Integrated Solutions & Services Inspur HPC Community Outreach

Company Business Brief

Multinational IT company headquartered in China Global business with 104 countries and 12,000 partners Comprehensive Petascale to Exascale turn-key solutions Leadership in IaaS, PaaS, and SaaS Cloud business INSPUR server and HPC technology used in more than

5000 research institutions in over 104 countries

R&D

EngineerMarket

ManageOther

Employee: 26200+

5.1 6.3 7.5 8.210.3

Sales Volume: $B

Three Stocks

• INSPUR Soft（600756）Shanghai Shares

• INSPUR Info（000977） Shenzhen Shares

• INSPUR International（596.HK） HK shares

Goal: 500% in 5 years server business increase

Inspur Customer Coverage Update

Communication: 52 operators in 41 countries Bank: 4 of the World's Top 10 Banks Internet: 40%+ China internet market Education: 200+ universities and institutions Government: 30 governments worldwide Enterprise: 20%+ the World’s Top 50 company

Company R&D

Five Large Scale R&D centers WWMore Than 1500 Patents to Date *Server Technology

HPC Market Leader

in China.

No.1 China Server Vendor*Source: Gartner

No.5 WW Server Vendor *Source: Gartner

End-to-End IP Design & Manufacturing

ChipChip Chipset, SAS

BoardBoard Motherboard, RAID, HBA

Auxiliary ModuleAuxiliary ModuleBackplane, Power Supply, Adaptor, Fans

StructuralStructural

Chassis,Cabinet, Cables,Package

IntegrationIntegration Final assembly

• Top quality ASIC

Global R&D Partners - HPC Innovation

2011 2013

• Together with Intel co-developHPC lab. (Intel XEON Phi)

• The 1st Intel MIC monograph.

• INSPUR | Nvidia Innovation Lab in China.

• Successfully improve 90xperformance for Qihoo China.

2015

• INSPUR | CISCO joint venture company in China.

• Develop network technology and products.

Global R&D Partners - HPC Innovation

20162015

• Inspur | Intel HPC lab. (Intel XEON Phi)• Knights Landing Evaluation and Escalation

Program.

2015• INSPUR | Intel | Altera joined launch

FPGA+DNN+OpenCL solution.• Overall HPC Cluster performance improved.• FPGA|CPU = 18.18x• FPGA|GPU = 3x

Agenda

Inspur Global Server & HPC Leader HPC Market & Technology Trends Inspur HPC Products, Integrated Solutions & Services Inspur HPC Community Outreach

2020s - Exascale2010s - Petascale1970s

Artificialintelligence

Numericalanalysis …

Numericalsimulation

Scientific Computing

Business Computing

NumericalComputing

SmartComputing

Mission CriticalComputing

ScientificComputing

Inspur Compute+ 2020 Vision

HPC Strategy

HPC Design & Manufacturing

Scientific&Industrial Application

HPC Community Converged & Scale-out Architecture HPC Turnkey Solutions & Appliances Industry Standard Components

IMCE / ICCE

HPC Big-Data Analytics Artificial Intelligence, Deep Learning

ASC 12/13/14/15/16/17

GPUGPUCPUCPU MICMIC FPGAFPGA

HPC Petascale to Exascale

1EF/s 50GF/W

New Parallel Algorithms September 2016, US / China announced multibillions 1EFlops machines around / by 2020.

Energy Consumption: 20MW Node Scalability：20 - 30 thousand Thread Parallelism: 20 - 30 million Hybrid System Architecture

GPUGPUCPUCPU MICMIC FPGAFPGA

HPC Missing Middle

Group of HPC users between low-end, mostly workstation-bound HPC users, and the high-end HPC typically performed at national labs and some large corporations & universities

Exascale is widening the gap of missing middle Increased HPC complexity impose better

collaboration between manufacturers PhD application science experts and customer programmers.

SMB would benefit from HPC, but Lack of easy to develop and use application software Lack of sufficient human expertise Costs of qualified personnel

Agenda

Inspur Global Server & HPC Leader HPC Market & Technology Trends Inspur HPC Products, Integrated Solutions & Services Inspur HPC Community Outreach

Product Family

Unified Storage

Critical Application HostK1 product line features modular architecture, redundant technology to and reliably supports core business systems in thefinancial, telecommunication, energy, social security, public security,and other national key industries.

Eight-socketWith powerful, stable, and reliable performance, Inspur TS860G3 is the ideal platform for cloud computing services, financial,telecommunication, government, energy, transportation and other keyindustries.

Four-socketUsing the latest processor platform, these products provide excellent quality, stability, efficiency and scalability in high demanding IT environment.

Two-socketWith excellent performance and flexibility, these products have been engineered for avariety of configurations and are very efficient for various enterprise-level applications.

Single-socketWith a leading price performance ratio, these products are verycompetitive for a variety of IT applications in small and mediumbusinesses, and hyper-scale deployments.

Data Protection Storage Mass Storage

Tower

Rack

Blade

High-density/Storage Server

Whole-cabinetServer

UNIXServer

AS5300/5500

On chip water cooling 

Mainframe Unix K1 Series

Independent�Unix�OS:�Inspur K-UX 2.0 Successful�70,000�Unix�certification�test�/�benchmarks.�

Operating Systems with UNIX

Certification

IBM IBM AIX 5L/6

HP HP-UX 11i

Oracle Oracle Solaris 10/11 FCS

Apple Mac OS X 10.8

Inspur Inspur K-UX 2.0

K1 950

32-Socket256�Cores

Kanas

64-Socket1152�Cores

Next�Gen

HPC HW & SW Stack

IEEL solution• Intel HPC enterprise file system• High performance hundreds of GB/s

FDR/EDR InfiniBand

Cluster Engine• Cluster management, monitoring, alarms, job

scheduling• Web interactive access, cluster configuration

Rack Cabinet• 42U Module• Industrial standard

C

S

N

M

I

Management• 10Gb/1Gb

InCloud RackI9000High density converged

AS13000• Cluster architecture • N+M erasure codes

Omni-path

TEYE• Application run time

monitoring & tuning

Water-cooling cabinet• Closed cooling cycle， variable speed fan• PUE＜1.5，40KW cooling capacity per Rack

Standard Rack Inspur

Smart Rack

Fully integrated system of Rack/Node/Network/PSU/Thermal/Management Scorpio 2.0 Open Data Centre standard Specifically designed for private / public cloud

Accelerator node4 x GPU

48 x 2PCompute nodes

Storage nodesHot-Swap

156,000 Multinode Servers shipped in Q1–Q3,2016, in hyper-scale deploymentsSource: Gartner

EP  Computing Module2�Socket�EP�Processors24×DDR42×2.5”Storage

EX Computing Module4/8�Socket�Scale-up2�socket�EX48×DDR44×2.5”Storage

Storage Extension Module12×2.5” Hot-swapHDD/SSD

PCIe Extension Module2× PCIex16�Slot2× PCIex8�SlotUp�to�2× MIC/GPU

Hardware Refactoring

Standard�PCIe Slots

Support�GE/10GE/FC/FCoE in�the�same�chassis

Overall�Unified Management

Centralized Power�Supply�and�Heat�Dissipation

Modularized�Computing�Resource

The�only�blade�server�supports�two sets of 8-socket servers

I9000

HPC Converged Architecture – I9000

Product Features

Product Features

InCloudRack Different Applications

Product FeaturesDense Computing MPI Applications 

- 64 Compute�Nodes�- 128�Sockets�E5�CPU- 1536�DDR4�Memory

Bigdata Analytics

- 24�Nodes- 48�Sockets�E5�CPU- 24�Storage�Expansions�

336 HDD or SSD

Memory Sensitive OpenMP

Applications 

- 6�X�4�Soc.�+�3�X�8��Soc�.- 48 Sockets E7 CPU- 1152��DDR4�Memory

Combined Applications 

- Flexible�resource�combination�for�different�application�requirements�

- 24�Nodes- 48�Socket�E5�CPU- 24�PCIe Expansions- 48 MIC or GPU cards

Machine Learning 

HPC Management & Service - Cluster Engine

Comprehensive management Resource utilization trend analysis

User friendly - remote access

Job scheduling - management Application runtime analysis

Result checkpoint & restart

Hot spot - bottleneck alleviation

User account management

23

HPC jobs & BigData jobs

Infrastructure& Platform

Management

HPC pool BigData pool

Monitor Job scheduling

User interface

node01

node04

node07

node02

node05

node08

node03

node06

node09

node10

node12

node14

node11

node13

node15

MRMR

MRMR

MRMR

HPC HPC MR

MR

MR

Video Wall Application

HPC Converges with Big Data

HPC Management & Service - Cluster Engine

• Desktop solution G100• Small Scale

• Cluster solution G1000• Large Scale

Quiet, Office environment

Economic

20 Exome AnalysisPer day

High performance

Space economic、large memory、fast I/O

2 Human genome analysis/ calculating node (2 CPU)/day

Integrated Genomic Analysis Appliances

INSPUR HPC – Deep Learning Integrated Solution

Deep Learning Appliance• Inspur Cluster MPI enhanced Caffe framework• Product image search, shopping, OCR identification• DNN network traffic examination accuracy exceeds 99%

Key Features Performance Acceleration

– Support MPI 32+ GPU acceleration– KNL Cluster Edition in development

Unified installation package – Integrated Caffe-MPI, CUDA and run-

time libraries. Mainstream parallel file system supported

– Support IEEL high performance I/O Unified system management

– Integrated with INSPUR ClusterEngine, support cluster management, license management, job scheduling etc.

Inspur HPC Application Development Services

NodeFull Scale Server Solution & Technology, x86, Mission Critical … etc

Entry to High End

Interconnect IB, OPA, GBE

Operating System Windows, Linux, x86, x64, Unix

Storage Full Scale Storage Solution, DAS, NAS, SAN … etcEntry to High End

Cluster ManagementTechnology

INSPUR Cluster EngineT-Eye

DevAppsDevelopment and cross platform code migration, optimization, test evaluation

for Oil & Gas, Life Science, Weather, Animation, etc.

INSPUR Integration

and Services

INSPUR Technology Partners

Inspur Major Clients and Partners

Inspur Application Development Services Examples

Field Application Clients Speed-up ratio Platform

Life ScienceBLASTN Beijing Institute of Genomics 35X(kernel) 1GPU /1CPU core

ET Institute of Biophysics, CSA 48X 1GPU /1CPU core

CFD LBM_LES — 100X 1GPU /1CPU core

Oil&Gas

RNA

BGP

8X 24 GPU nodes /24 CPU nodes

PSTM 5X 6 GPU nodes / 6 CPU nodes

Scandip 9X 4GPU+2CPU /2CPU

Inspur 360 Degree Expert Services

Requirement Analysis Customer Consulting

After-sales Service

Implementation

Engineering Design

PhD domain science liaisons

x86/GPU/MIC/FPGA programming

co-development, cross platform code

migration, optimization and test

evaluation of many HPC applications,

like in Oil & Gas, CAE/CAD,CFD, Life

Science, Financial, Weather, etc.

Data & workflow advocate

Proprietary use on NDA.

Product Introduction HPC Application Development

Agenda

Inspur Global Server & HPC Leader HPC Market & Technology Trends Inspur HPC Products, Integrated Solutions & Services Inspur HPC Community Outreach

Knights Landing Evaluation and Escalation Program: KEEP

Launched by Inspur and Intel at ISC2016 The world's largest free KNL platform For HPC/Deep Learning/Big Data apps.

Application optimized for business users

Intel Xeon Phi Knights Landing (KNL) Intel Omni-Path Architecture (OPA) Network

KEEP Progress

KEEP Cluster 64 KNL nodes 200TFlops, projected 700TFlops 100Gb/s OPA networking IEEL storage

KEEP�Cluster

User Application AreaXidian University RSIP Image�Processing

Hebei�University�of�Technology DOCCNOEA Intelligent�

ComputingChongqing�University�of�

Arts�and�Sciences Abinit Material�simulation

National�Taiwan�Normal�University WRF Weather�Forecast

NorthwesternPolytechnic�University LES CFD

China�Academy of�Sciences LAMMPS Molecular�Dynamics�

Simulation

Yunnan Astronomical�Observatory NVST�level2 Astronomy

Ocean�University�of�China CFAR Ocean�Simulation

National�Astronomical�Observatories NRAO�PRESTO Astronomy

Nanjing�University�of�Science &�Technology Data�Classification Big�Data

Huiying Medical Medical�image�classification Deep�Learning

Fudan University Apache�Spark Big Data

KEEP Performance Benchmarking

Deep Learning Performance on KNL

Caffe�- MPI Parallel Data Large-Scale Image Training Developed by Inspur, Based on BVLC Caffe, Available on GPL High Performance and Scalable Deep Learning Framework KNL Cluster + OPA network + IEEL Storage

How to Apply for KEEP

Participate in KEEP and use the KNL cluster for free. Code design and optimization support from Inspur experts. Apply online through http://inspurhpc.com/KEEP For any question please send email to KEEP@inspur.com Applications will be reviewed by December 31, 2017

ASC – Student Supercomputer Challenge

Organized by Asia Super Computing Community and INSPUR HPC More than 130 world wide universities participated since it started in 2012 ASC12 Beijing. China – 27 Teams ASC16 Wuhan, China – 175 Teams

ASC12 ASC13 ASC14 ASC15 ASC16 ASC17Equipment Hardware platform including server, switch, and accelerator card provided by InspurContest Design and build a cluster that optimizes designated applications under 3000WBenchmark HPL HPL HPL HPCC HPLApplication CPMD Gromacs QE NAMD MASNUM

CP2K OpenCFD LICOM WRF‐Chem HPCGOpenFoam WRF SU2 Palabos ABINITNEMO MPIBlast HPCG ABySS

BSDE 3D‐EW Gridding DNNPresentation

ASC17 – Open for Applications!

COMPUTING INSPIRES FUTURE

Thank You