Upload
nvidia-japan
View
643
Download
6
Embed Size (px)
Citation preview
OpenPOWER Overview
September 2015
John AshleySenior IBM Developer Relationship Manager, [email protected]
© 2015 OpenPOWER Foundation© 2015 OpenPOWER Foundation
© 2015 OpenPOWER Foundation2
What is OpenPOWER?
© 2015 OpenPOWER Foundation3
• Moore’s law no longer
satisfies performance gain
• Growing workload
demands
• Numerous IT consumption
models
• Mature Open software
ecosystem
OpenPOWER, a catalyst for Open Innovation
• Rich software ecosystem
• Spectrum of power
servers
• Multiple hardware
options
• Derivative POWER chips
OpenPOWER is an open development community,
using the POWER Architecture to serve the evolving needs of customers.
Performance of
POWER architecture
amplified capability
Open Development
open software, open hardware
Collaboration of
thought leaders
simultaneous innovation,
multiple disciplines
Feeds back … resulting in client choice
3
New Open InnovationMarket Shifts
© 2015 OpenPOWER Foundation4
In the beginning
© 2015 OpenPOWER Foundation5
Fueling an Open Development Community
© 2015 OpenPOWER Foundation6
The road
ahead
AugustAnnounced intent to form OpenPOWER
DecemberIncorporated Foundation and elected officers;5 members
AprilPublic launch in San Francisco and Beijing with 6 demos and first hardware from Google and Tyan26 members
JulyIBM, with contributions from Google, released 420,000 lines of firmware code44 members
OctoberMultiple offerings available from Altera, Canonical, IBM, NVIDIA, OVH, Redis Labs, and Tyan70 members
OctoberChina government endorsed OpenPOWER ecosystem through formation of the China Power Technology Alliance
• Collaborative solutions, standards, and reference designs available• Independent members solutions and systems• Sector growth in technical computing and cloud• Global growth with increasing depth in all layers• Broad adoption across hardware, software, and end users
NovemberDepartment of Energy chose OpenPOWER design for $325M supercomputing contract; Nallatech CAPI developer kit released77 members
2013 2014
DecemberRackspace declares Open Compute, OpenPOWER strategy; Seven work groups chartered84 members
MarchFirst OpenPOWER Summit• 50+ member presentations
and solution demos• 15 hardware reveals• 100+ member projects 112 members
MarchSoftLayer announces first OpenPOWER bare metal as a service offering
2015
Amazing member engagement with incredible progress
MayChartered nine work groups, major HPC deals to be announced; Member solutions promoted at 6k attendee Edge event, announced systems now available130 members
JuneAnnounced £313m UK collaboration with STFC; China Cloud Computing Conference; First China OpenPOWER Summit, 630+ attendees136+ members
© 2015 OpenPOWER Foundation7
Where is the platform going?
© 2015 OpenPOWER Foundation8
IBM and Partner collaboration on OpenPOWER Roadmap
2015 2016 2017
POWER8
POWER8+
POWER9
OpenPowerCAPI Interface
NVLink
Enhanced CAPI & NVLink
Connect-IBFDR Infiniband
PCIe Gen3
ConnectX-4EDR Infiniband
CAPI over PCIe Gen3
ConnectX-5Next-Gen Infiniband
Enhanced CAPI over PCIe Gen4
MellanoxInterconnect Technology
IBM CPUs
NVIDIA GPUsKepler
PCIe Gen3Volta
Enhanced NVLinkPascalNVLink
IBM Systems
© 2015 OpenPOWER Foundation9
New Chips &
Components
Components
& Systems
New Systems &
Platforms
Bringing It
All Together
First Open server specification and motherboard combining OpenPOWER, Open Compute and OpenStack (mock-up)
First GPU-accelerated OpenPOWER developer platform
Prototype of a new high-performance server on the path to exascale
First commercially available OpenPOWER serverRedPower, the first China OpenPOWER
2-socket system coming in 2015 Inspur 2-socket POWER8 Server
ChuangHe China-branded OpenPOWER system with POWER8
Data Engine for NoSQL with 40TB CAPI-attached flash
Open Source Redis
Clustering 192 Vcores + CAPI
40TB in 2U
First China “local” POWER derivative chip, CP1Convey’s CAPI developer kit based on the company’s Xilinix-based co-processors
DMI connection between an Altera Stratix V FPGA accelerator and a POWER8 CPU
First commercially available OpenPOWER third-party server
New CAPI-based solution: the ConnectX-4 adapter card by Mellanox
Nallatech’s OpenPOWER CAPI Developer Kit
24:1 Server consolidation for 3x lower cost per user
© 2015 OpenPOWER Foundation10
First OpenPOWER Developer System
• Single socket ATX form factor board, BMC based evaluation board
• Service subsystem identical to x86
• Reference System for ISV application and OpenPOWER partners
• OpenPOWER Software Stack
© 2015 OpenPOWER Foundation11
OpenPOWER Work Group Roadmap
2014 2015 2016
Developer Platform
System SW
HW Architecture
Accelerator
Compliance
Proposed Work Groups Integrated Solutions
Pers Med
SP010 – Tyan OpenPOWER Customer Reference System
CAPI – Coherent Accelerator Processor Interface
AFU – Accelerator Function Unit
FSI – Field Replaceable Unit (FRU) Service Interface
25g IO Compatibility
Memory
OpenPOWER I/O
9 Work Groups
CharterCompliance SpecificationDraft Review WG Spec
CompSTD
Charter
OpenPOWER ISA Profile V1IO Device Architecture V2Coherent Accel Intf Arch
OpenPOWER ISA Profile V2IO Device Architecture V3Coherent Accel Intf Arch
CharterP8 SP010Data
P8 2U2SReference
P8+ 1U1SReference
P8+ 2U2SReference
OPMB Intf. Spec V1Charter
CharterCAPI AFU Intf Spec V1
OpenCL SDK
CAPI AFU Intf Spec V2
Charter
CAPI LinuxSDK
64b ABIPlatform Ref
Sys I/O Enablement GuideCharter
Charter 25g IO Spec
OPMB – OpenPOWER Memory Bus
ABI – Application Binary Interface
FSI Specification FSI SpecCharter
SDK – Software Developer Kit
© 2015 OpenPOWER Foundation12
Engage in the OpenPOWER community
AC
TIO
NO
UT
CO
ME
INT
ER
ES
T
Technology and
Software Innovators
Discuss areas of
collaboration and synergy
in OpenPOWER.
Sign up for membership
and join a work group.
Build technical and
business relationships.
Developcollaborative innovations
with compelling value
Innovators, Integrators,
and Partners
Deep understanding of
workload demands and
consumption preferences
of end users.
Team with innovators and
end users to drive
requirements, engage in
specific projects.
Delivercollaborative innovations
with compelling value
End Users
Strategic imperatives and
workload demands for
performance and cost
optimization.
Require open software
and systems with choice
and flexibility.
Engage directly on
system design options.
Deploy collaborative innovations
with compelling value
© 2015 OpenPOWER Foundation13
According to results shared at the STAC Summit on June 4, an IBM Power8-based system server delivered more than twice the performance of the best-in-class x86 counterpart when running a set of standard financial industry benchmarks. - HPC Wire
“Both the current results and future potential are so promising that we are
preparing to build an OpenPOWER-based, Open Compute platform.
And it will run OpenStack services. - Aaron Sullivan, Senior Director &
Distinguished Engineer, Rackspace
We estimate that a physical Power Systems server can support twice as many virtual environments – and therefore double the number of client systems – as a physical x86 server. -Ubuntu
“The $320 million deal [U.S. Department of Energy's Sierra and Summit supercomputers] is a validation of sorts of IBM’s recent strategic shift to open up its POWER computing architecture for license and use by other companies looking for alternatives to an Intel-controlled world. - Forbes
“While other vendors are struggling to establish themselves in China,
IBM seems to have found the secret with OpenPOWER. Not only
does this seem to be cementing IBM inside the tough Chinese
technology market but the benefits, such as SuperVessel, are now
starting to be felt
across the whole of IBM.
- Enterprise Times
I still see the POWER8 processor as one of the most
powerful processors in the industry – and with the
accelerators being developed in the OpenPOWER
ecosystem, it is going to be hard for other processors
(including Intel and ARM silicon) to match some of the
acceleration speeds that will be achieved by POWER8
and successive generations. - Clabby Analytics
People Can't Stop Talking About OpenPOWER
“
“
“
“People ask me if we would switch to Power, and the answer is
absolutely,” Urs Hölzle, Google, said emphatically and unequivocally.
“Even for a single generation.”
- The Platform
““The architectures of the last fifteen or more years are clearly not
going to take us past the next several years, so there needs to be a
step change and there are lots of options but for the workloads we’re
looking at ahead, we are confident about this architecture. - Cliff
Brereton, STFC
© 2015 OpenPOWER Foundation14
Solutionsmaking a difference!
© 2015 OpenPOWER Foundation15
Application Benchmarks
© 2015 OpenPOWER Foundation16
• 50 IBM Innovation Centers
• Compelling PoCs
• Support for little endian applications
Over 1,600 Linux ISVs developing on Power
Big Data & Machine Learning
Cloud Mobile Enterprise
Major Linux Distros
HPC
miniDFT
CTH
BLAST
Bowtie
BWA
FASTA
HMMER
GATK
SOAP3
STAC-A2
SHOC
Graph500
Ilog
CHARMM
GROMACS
NAMD
AMBER
RTM
GAMESS
WRF
HYCOM
HOMME
LES
MiniGhost
AMG2013
OpenFOAM
© 2015 OpenPOWER Foundation17
Compelling solution performance on Power
Data Engine for NoSQL with Redis Labs
• POWER8 + CAPI FLASH as RAM
• 24:1 server consolidation
• Up to 3x lower TCA
Turbo LAMP on Linux on Power
• Next generation integrated LAMP stack
• Accelerated Dev/Ops for Mobile Apps
• 53% less $$ per user / hour with Magento running on Turbo LAMP
MariaDB on Linux on Power
• Up to 2.2x better per core performance
• Up to 1.9x better per system performance
SAP HANA on Linux on Power
• Designed for mission critical 7X24 Enterprise customer operations
• Outstanding throughput per core
• Virtualization out of the box
Veristorm Data Integration & Open
Source Apache
• ETL warehouse data & x86 Hadoop data into Linux on Power Hadoop clusters
• Run Open Source Apache Hadoop optimized for faster insights
© 2015 OpenPOWER Foundation18
• In-memory distributed database using GPUs for processing
• Order of magnitude gains:
• Performance over CPU solutions
• Power reduction
• Cost savings
• Anticipate order of magnitude gains with POWER based NVLink solutions in 2016
GPUdb in-memory Accelerated Database
Ultrafast ingest and analysis of billions of objects
© 2015 OpenPOWER Foundation19
10x higher throughput, 10x lower
latency accelerating NoSQL workloads
PHP (Zend)
PHP (Zend)
Linux (Ubuntu)
Apache Web Server (Ubuntu)
MariaDB (MariaDB)
PHP (Zend)
Orc
hestra
tion
-Juju
(U
buntu
)
High Speed Data Transfer (Mellanox)
Turbo LAMP Stack for mobile and web apps
Future
Turb
o L
AM
P
Dramatically less data center infrastructure
Dramatically faster responsiveness to customers
© 2015 OpenPOWER Foundation20
• Accelerated appliance with novel data-flow implementation of Memcached
on FPGA.
• Up to 36x improved performance and power response times in
microsecond range.
• CAPI integration of memory allows both host memory and coherent-
attached flash to be used as value store.
Up to 36x performance improvementfor Key-Value Store acceleration
© 2015 OpenPOWER Foundation21
Data Engine for NoSQL with 40TB CAPI-attached flash
Load Balancer
500GB Cache
Node
10Gb Uplink
POWER8 Server
Flash Array w/ up
to 40TB
After: NoSQL POWER8 + CAPI Flash
WWW
10Gb Uplink
WWW
Backup Nodes
500GB Cache
Node500GB Cache
Node500GB Cache
Node500GB Cache
Node
Before: NoSQL in memory (x86)
24U4U
Less is More
24:1 physical server consolidation =
6x less rack space
24:1 server consolidation
3xlower cost per user
© 2015 OpenPOWER Foundation22
Best-in-class ingredients • IBM POWER8
• IBM Java
• NVIDIA CUDA GPU acceleration
• Ubuntu Little Endian Linux for POWER
8x performance
improvementGPU acceleration for Java on
segmentation using accelerated machine
learning for clustering with Hadoop / Mahout
© 2015 OpenPOWER Foundation23
50x faster insights with POWER8
systems designed for Big Data and BLU
POWER8 Scale-out Systems
Power S824
Power S822L
Power S824L
Power S822
24:1 server footprint
reduction through CAPI Flash
for BD&A – no SQL
5x Watson scaling through
Software Optimization and
POWER8 for Cognitive
Non-disruptiveApplication mobility from
P6/P7 to P8
65% Guaranteed system
utilization without application
degradation
8x IBM Java advantage through
NVIDIA GPU acceleration
4x reduction in storage
through GPFS and compression
for BD&A - Hadoop
10x ops/sec via Mellanox
Fabric exploitation for Data-
centric workloads
© 2015 OpenPOWER Foundation24
IBM, Mellanox, and NVIDIA awarded
$325M U.S. Department of Energy’s Super Computer bids
Two super computers for Oak Ridge and
Lawrence Livermore Labs in 2017. Sequoia (LLNL)
2012 - 2017
Mira (ANL)
2012 - 2017Titan (ORNL)
2012 - 2017
Current DOE Leadership Computers
5x – 10x Higher Application Performance versus Current Systems
>100 PF, 2 GB/core main memory, local NVRAM,
Mellanox EDR 100Gb/s InfiniBand, IBM POWER CPUs, NVIDIA Tesla GPUs
© 2015 OpenPOWER Foundation25 https://www.stfc.ac.uk/3583.aspx
£313 million collaboration to boost Big Data research in the UK
The research programme will leverage OpenPOWER high performance computing
innovations to enable complex analytics on massive amounts of data.
IBM contributions
• Latest data-centric and cognitive computing technologies,
including ‘Watson’ cognitive computing platform
• 24 IBM researchers to be based at the Hartree Centre
• Joint commercialisation of intellectual property produced in
partnership with STFC
© 2015 OpenPOWER Foundation26
Superior Cloud
Economics
New: SoftLayer Bare Metal POWER cloud
New: Rackspace joins OpenPOWER, declares
Open Compute OpenPOWER system
New: Docker for Power Systems
Update: OpenStack HEAT and Chef Server for Power
New: Bluemix Cloud Integration and SQLDB Services
with Power Systems for SOE/SOR integration
http://labs.runabove.com/power8/
Up to 100xthe power of a classic x86 setup
© 2015 OpenPOWER Foundation27
Critical workloads run on Linux on Power
• Compute intensive
• High memory bandwidth
• Floating point
• High I/O rates
• High quality of service
• Scalability
• Flexible infrastructure
• Large memory footprint
Business Applications
• Highly threaded
• Throughput oriented
• Scale out capable
• High quality of service
Web, Java Apps and Infrastructure
• Handle peak workloads
• Scalability
• High quality of service
• Resiliency and security
HPC applications for
Life Sciences
Database
Analytics & Research
© 2015 OpenPOWER Foundation28
Solution stacks continuing to grow
Cloud
Software
Operating
System / KVM
Standard Operating
Environment
(System Mgmt)
Existing
Open
Source
Software
Communities
Firmware
Hardware
New OSS
Community
OpenPOWER
Technology
OpenPOWER
Firmware
• ISV community of 1,600+
• All major Linux distros
• Open sourced POWER8
firmware stack
• Resources for porting
and optimizing: OpenPOWERFoundation.org