1 October 2015

IBM Power LinuxIntroduce PowerKVM an Open Virtualization choice for Linux Systems

Zainal Abidin <Zainal.Abidin@Avnet.com>Pacet - October 22, 2015

2 October 2015

Today Agenda

• Intro

• Why Linux?

• Power System Technology

• Virtualizations on Power System

• PowerKVM Architecture & Strategy

• Live Demo

• Q & A

3 October 2015

Intro

4 October 2015

2.880 Core Power 7 15 TB RAM

80 teraflops200 million pages

of content

Waitless Computing for Digital Era

Hardware of IBM Watson

5 October 2015

Why Linux?

6 October 2015

Key Facts About Linux

Linux is the world’s fastest growing OS (33.8% revenue share in 2009)

Over 90% of world’s fastest supercomputers, including top 10 in TOP500 list, run on Linux

8 of the world’s top 10 websites including Google, YouTube, Yahoo, Facebook, and Twitter run on Linux

80% of all Stock Exchanges in the world rely on Linux

95% of the servers used by Hollywood studios for animation films run on Linux

US Department of Defense is the "single biggest install base for Red Hat Linux" in the world

Linux has strong following in smartphones & other electronic devices.

Worldwide Linux and Open Source Software Ecosystem Revenue, 2007–2014

Source: http://www.redhat.com/f/pdf/IDC_Linux_Mainstream.pdf

7 October 2015

IBM’s commitment to Linux ecosystem growth

Learn about Power Systems Linux centers Beijing, ChinaAustin, TXNew York, NYMontpellier, France

Who Has Contributed to Linux?

8 October 2015

IBM continues its commitment to Linux growth

Power Systems intends to invest a billion dollars in solutions for Linux and open source workloads, adding to prior investments by IBM during the last decade on a wide range of open initiatives.

$1 Billion….again

IBM Press Release

Wall Street Journal Coverage

And, we recently opened a Power Systems Linux Center in Montpellier, France, joining our centers around the world dedicated to Linux developers.

Learn about Power Systems Linux centers Beijing, ChinaAustin, TXNew York, NYMontpellier, France

Request briefing or training sessionRequest porting assistance

OpenPOWER Consortium

9 October 2015

Power Systems Technology

10 October 2015

New IBM Power based on Power 8

Power S822L

1 or 2 sockets 10 or 12 cores/socket Up to 1 TB of Memory

Power S824 or Power S814

1 or 2 sockets 6, 8,10 or 12 cores/socket Up to 1 TB of Memory

Power S822Power S812L

Designed for Big Data

Superior Cloud Economics

Open Innovation Platform

11 October 2015

POWER8: The 1st Processor Designed for BigData

IBM 22nm Technology• Silicon-on-Insulator

• 15 metal layers

• Deep trench eDRAM

POWER8 ProcessorCompute

• 12 cores (thread strength optimized)

• SMT8, 16-wide execution

• 2X internal data flows

• Transactional Memory

Cache

• 64KB L1 + 512KB L2 / core

• 96MB L3 + up to 128MB L4 / socket

• 2X bandwidths

System Interfaces

• 230 GB/s memory bandwidth / socket

• Up to 48x Integrated PCI gen 3 / socket

• CAPI (over PCI gen 3)

• Robust, Large SMP Interconnect

• On chip Energy Mgmt, VRM / core

12 October 2015

POWER8: New Features and Benefits

Feature Benefits

Simultaneous Multi-Threading 8 Improve system performance by increasing the throughput of

workloads with large or frequently changing working sets, such as

database servers and Web servers by

Ability to invoke up to 8 concurrent threads per core

Ability to schedule threads across core

Ability to designate/change primary thread

Java Code Optimization w/HW

Assist

Taking already strong Java performance to the next level, included

as part of Java Runtime, hardware helpers for Java IT code

optimization

Transactional memory Reducing customer cost by Improving performance of legacy

software with large sequential components

Efficient power management Lower power usage at idle

Optimized workload power management

Improved performance per watt at moderate utilizations

PCI Gen3 Significant increase in bandwidth and reduction in latency

Required for Analytics, Big Data.

Coupled with memory bandwidth drives higher compute than x86

Coherent accelerator processor

interface*

Virtual Addressing & Data Caching

Easier, more natural programming model

Enables applications not possible on I/O

13 October 2015

Chip Family

Core

Frequency

(GHz)

L1 and L2

Cache per

Core

Approximate

Cache per

Core (MB)

Intel EN E5-v2 (8+ core) 1.7 – 2.464 KB

256 KB2.81

Intel EP E5-v3 (8+ core) 1.8 – 3.264 KB

256 KB2.81

Intel E7-v2 (8+ core) 2.0 – 3.264 KB

256 KB2.81

POWER8 (8+ core) 3.4 – 4.3596 KB

512 KB19.27

System z EC12 5.50160 KB

2 MB20.82

Cache and Core Speed

14 October 2015

Core

Cache

Memory

Memory is slow

relative to

cache1-100

clock cycles

400-800

clock cycles

1

clock cycle

Cache is Critical to Good Performance

15 October 2015

POWER8 Cache Design

L2 L2 L2 L2 L2 L2

L1 L1 L1 L1 L1 L1

C C C C C C

L2

L1

L2

L1

L2

L1

L2

L1

L2

L1

L2

L1

C C C C C C

Shared L3 Cache

Mem L4

Mem L4

Mem L4

Mem L4

MemL4

MemL4

MemL4

MemL4

16 October 2015

Core

Cache

Memory

What Benefits from Cache – Everything!

• Large working sets

• Multi-threaded or mixed workloads

• Transactions that lock data

• Batch

• Virtualized environments

• Shared data

• Write burst traffic

• Mixed reads and writes

17 October 2015

0

0.5

1

1.5

2

2.5

3

3.5

4

P7

SMT1

P8

SMT1

P8

SMT2

P8

SMT4

P8

SMT8

•SMT1: Largest unit of execution work

•SMT2: Smaller unit of work, but provides greater amount of execution work per cycle

•SMT4: Smaller unit of work, but provides greater amount of execution work per cycle

•SMT8: Smallest unit of work, but provides the maximum amount of execution work per cycle

•Can dynamical shift between modes as required: SMT1 / SMT2 / SMT4 / SMT8

•Mixed SMT modes supported within same LPAR

• Requires use of “Resource Groups”

POWER8 Multi-threading Options

18 October 2015

Superior Performance: POWER8 (.vs. Intel X86)

Sandy Bridge

EP E5-26xx

Ivy Bridge EX

E7-88xx v2

Haswell EX

E7-88xx v3POWER7+ POWER8

Clock rates 1.8–3.6GHz 1.9-3.4 GHz 2.0-3.0 GHz 3.1-4.4 GHz 3.0-4.15 GHz

SMT options 1,2 * 1, 2 * 1, 2 * 1, 2, 4 1, 2, 4, 8

Cores per socket 8 15 18 8 12

Max Threads /

socket16 30 36 32 96

Max L1 Cache 32KB 32KB * 32KB * 32KB 64KB

Max L2 Cache 256 KB 256 KB 256 KB 256 KB 512 KB

Max L3 Cache 20 MB 37.5 MB 45 MB 80 MB 96 MB

Max L4 Cache 0 0 0 0 128 MB

Memory

Bandwidth

31.4-51.2

GB/s68-85 GB/s ** 68-93 GB/s

100 – 180

GB/sec

190-230

GB/sec

* Intel calls this Hyper-Threading Technology (No HT and with HT)

* 32KB running in “Non-RAS mode” Only 16KB in RAS mode

** 85GB running in “Non-RAS mode” = dual-device error NOT supported

Intel need scarify RAS

for more Performance

19 October 2015

** Published Benchmarks – ALL data is PUBLISHED

Performance comparison – x86 .vs. POWER8-SIBM POWER8 core and system performance is leadership versus the x86 Xeon

x86

“Haswell”

IBM

POWER S824POWER8 vs. x86

Core Performance

RatioIntel Xeon E5-2699 v3

(except where noted)

POWER8

@ 3.5 GHz

# Cores 36 24

SAP 2-Tier 16,500 21,212 1.9

SPECint_rate2006 1,400 1,750 1.8

SPECfp_rate2006 942 1,370 2.1

SPECjbb2013 (max-jOPS) 195,119 361,293 2.7

SPECjEnterprise2010 19,282 22,543 1.7

Oracle eBS 12.1.3 Payroll1,017,639

(24-core E5-2697 v2)

1,090,909

(12-core)

2.1

Siebel CRM Release 8.1.1.4 10,000

(16-core E5-2690)

50,000

(6-core)

13.3

1) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD benchmark users,

running AIX® 7.1 and DB2® 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014

2) Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory; 16,500 SD

benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark.

3) SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/

4) SPECjbb2013 results are submitted as of 10/15//2014. For more information go to http://www.specbench.org/jbb2013/results

5) SPECjEnterprise2010 results are valid as of 3/2/2015. For more information go to http://www.specbench.org/jEnterprise2010/results/

6) Oracle eBS 12.1.3 Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.html

7) Siebel 8.1.1.4 PSPP Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/white-papers/siebel-167484.html

20 October 2015

SAP Benchmark on POWER8 & POWER7+ over Intel’s Ivy Bridge

21 October 2015

Virtualization on Power System

22 October 2015

Power Virtualiazation Options

PowerKVM

PowerVM

PowerVM is Power Virtualization that will continue to be enhanced to support AIX, IBM i Workloads as well as Linux Workloads

2004Initial Offering

Q2 2014Initial Offering

PowerKVM provides an open source choice for Power Virtualization for Linux workloads. Best for clients that aren’t familiar with Power and Linux centric admins.

23 October 2015

PowerKVM & PowerVM Comparison

Power 8 Linux only Hardware

Firmware

Host Software

Hardware

OPAL FirmwareHardware AbstractionBoot services

Standalone Diagnostics

P6, P7, P8 Hardware

Phyp Firmware - Hypervisor

Linux MCP/KVM Hypervisor

Guest VM Types

Managers

VIO ServerIO Virtualization

HMC, IVM, FSM, PowerVC, ISD VMControl

PowerVC, OpenStack, libvirt, Open Source Tools

24 October 2015

PowerVM PowerKVM

GA Availability Now since 2004 Q2 2014

Supported Hardware All P6, P7, P7+, P8 Systems S812L, S822L

Supported Guest OS AIX, IBM i & Redhat, SUSE Linux Redhat, SUSE & Ubuntu Linux

Workload Mobility Supports AIX, IBM i & Linux Linux

Basic Virtualization

ManagementIVM/HMC/FSM Virtman/libvirt/Kimchi

Advanced Virtualization

ManagementPowerVC/VMControl PowerVC, Vanilla OpenStack

Admin Type Power Centric Linux/x86 Centric

Established Security Track

Record on PowerYes No

Open Source Hypervisor No Yes

Complete Hardware

Awareness & Exploitation Yes Partial

25 October 2015

PowerKVM

26 October 2015

PowerKVM - Open Virtualization for Power Linux Servers

PowerKVM provides simple, robust, cost effective server virtualization built on open source for Linux workloads running on Power Systems

PowerKVM Solution

Simplifies configuration and operation of server virtualization

Provides an Open Source Virtualization Choice

Lower cost virtualization alternative for Linux Workloads

Flexibility and agility leveraging the Open Source Community

KVM is the original hypervisor focus for OpenStack

Client Pain Points

Complexity and time required implement server virtualization

Virtualization vendor lock-in

Total cost of ownership for server virtualization solutions

Closed inflexible solutions

Lack of seamless integration with new cloud technologies like OpenStack

PowerKVM

27 October 2015

KVM Architecture Overview

Power8 Platform

OPAL FW

Qemu

VM1RHEL

VM2SLES

LibvirtAPI & virsh CLI

Linux Kernel

Pow

erK

VM

Host

ConsoleShell CLI

Linux UserspaceOpenstackEnd-node

componentsKimchi

Openstackcontroller

XcatChef

PuppetCustom scripts

IBM CloudManager

Kimchi BrowserOr

Client

CLI / IPMIFSP

SUSE Manager

KVM

VM3Fedora

28 October 2015

Dashboard for Local Administration

Provides simple graphical

web interface to initially

configure the PowerKVM

Host and to manage basic

virtualization for a small

configuration.

Included in PowerKVM

distribution.

Function includes

Initial host setup

Firmware update

Backup of configuration

Simple VM setup

Start and stop of VMs

Host monitoring

Use of Templates

View VM guest console

29 October 2015

PowerKVM vs PowerVM

Planning and Sizing Infrastructure

Initial Server Configuration

Virtualization Setup Initial VM Creation Advanced Virtualization Management

Serviceability

Workload Estimator(WLE)

Score request for certified storage

ASM/HMC

Power Control Network Config

Connection to management consoles

HMC / IVM

Install VIOS & Configure

FC Storage, Internal Disk

Network definition

HMC / IVM

Firmware maintenance HMC

Phone Home

PowerVM

HMC / IVM

PowerVC

Planning and Sizing Infrastructure

Initial Server Configuration

Virtualization Setup Initial VM Creation Advanced Virtualization Management

Serviceability

Workload Estimator(WLE)

ASM: Setup FSP IP address, if no DHCP available

IPMI: Remote Power Control and remote console

Host OS: IP, timezone and root password (if defaults do not apply)

KVM pre-loaded with reasonable defaults for storage, network and logging

Point browser to Kimchi-ginger for further Host OS configuration

Linux cmd line available

Error logs exposed through KVM/Linux

Firmware Maintenance through Linux

ESA Agent

PowerKVM

Virshcommand line

Kimchi (Web)

PowerVC

Or IBM Cloud Manager

30 October 2015

•Provides Open Source Server Virtualization Offering for Power Targeted to Linux Workloads

• Provides simplicity and familiarity for VMware and KVM Intel Linux Admins

• Allows cloud providers to easily integrate Power Linux servers into their OpenStack environments

• Available on new POWER8 Scale out Linux only servers

• PowerKVM will not support IBM i or AIX workloads

30

PowerKVM Summary

31 October 2015

Platform

Management

Virtualization

Management

Cloud

Management

PowerVC

ICM

Infrastructure as a service with IBM Cloud Manager With

OpenStack(formerly Smart Cloud Entry)

Virtualization Management with PowerVC

Linux / x86 Style of Platform Management

• IPMI for Power Cycling and control

• Hardware logs in PowerKVM host

• Firmware updates through Linux host

• Simple Management solution for PowerKVM

• Virtual Image Management and Deployment

• Resource Pooling and Dynamic VM Placement

• On-going optimization and VM resilience

• End-user self-service provisioning and automation

• Service catalog with virtual systems and applications

• Subscriber and account management (multi-tenancy)

• Delivered as Entry, Provisioning and Orchestration

Just another KVM / Linux host. Normal open

source tools & OpenStack can be used for

management.

31

Host

Either ICM or PowerVC can

manage a single PowerKVM

host but not both.

PowerKVM Management Strategy

32 October 2015

DEMO Power Linux

33 October 2015

DEMO: Power Linux

34 October 2015

THANK YOU

Zainal – 081 615 295 592

35 October 201535 © Copyright IBM Corporation 2014

Linux Myth

myth buster

Power provides platforms with comparable TCA to x86

Power is too expensive for running Linux

36 October 2015

IBM Power 822L pricing comparison ($US) – Scale-Out Cloud with KVM

Comparable TCA

Linux on Intel

Ivy Bridge + KVM

Vs.

Linux on

POWER8 + KVM

Dell PowerEdgeR720

HP ProLiant DL380 G8

IBM Power 822L

$21,300 $22,763 $22,382

Server list price*-3-year warranty, on-site

$12,605 $14,068 $14,895

Virtualization- OTC + 3yr. 9x5 SWMA

$2,998

KVM for Red Hat on x86 (RHEV)

$2,998

KVM for Red Hat on x86 (RHEV)

$2,998

KVM for Linux on Power (PowerKVM)

Linux OS list price

- RHEL, 2 sockets, unlimited guests, 9x5, 3 yr. sub./ supp.

$5,697Red Hat subscription and Red

Hat support

$5,697Red Hat subscription and Red

Hat support

$4,489Red Hat subscription and IBM

support

Total list price: (Total cost of acquisition) $21,300 $22,763 $22,382

Server model Dell R720 HP Proliant DL380p G8 IBM Power 822L

Processor / cores Two 2.7 GHz , E5-2697, Ivy Bridge, 12-core processors Two 3.4 GHz POWER8, 10-core

Configuration 64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port Same memory, HDD, NIC

* Based on US pricing for Power S822L announcing on April 28, 2014 matching configuration table above. Source: hp.com, dell.com, vmware.com

36

37 October 2015

Linux on Power - ISVs and Open Source Ecosystem

Analytics Open Source Cross Industry

Regional Database

Available for All PowerLinux servers

Netweaver

Tools

Oracle 10g (Client)

37