IBM: The Linux Ecosystem

IBM Power8 and the Linux EcosystemLuca CompariniISV & Business Development – IBM Global Business PartnersPower Linux Leader Europe

@lucacomparini

@lucacomparini

Before we start: do you know who is this kid?

© 2014 International Business Machines Corporation 2

@lucacomparini

Before we start: do you know who said that?


“Linux is a cancer that attaches itself in an intellectual property sense to everything it touches (…)”

@lucacomparini

Before we start: have you seen this before?


@lucacomparini

Some history and facts on IBM & Open Source


“is getting smarter every day” (2003)

Credits to Michel Teyssedre (2006) – now CTO IBM France

IBM began participating in the community development of Linux in 1999 and Open Source, resulting in:

§ All the IBM servers support Linux operating system

§ Over 500 IBM software products run on Linux

§ A full line of implementation, support and migration services

Active participation in 150+ projects, including:

§ Eclipse, Apache Foundation, Mozilla Firefox, OpenOffice.org, Samba, PHP…

§ Apache Hadoop, Apache UIMA, KVM, Openstack, Cloudfoundry…

“$1 billion commitment” on Linux and Open Source technologies (2001, 2013)

IBM Linux Technology Centers in Bejing, Austin, New York, Montpellier, Tokyo

@lucacomparini

Open Source Trend


Diffusion and interest

2M projects by 2014;; x2 in last 2y.

140% increase in interest purchasing open source software

57% of companies using open source will collaborate with competitors.

41% of people plan to deploy open source solution in 1-2 years.

* “free is free only if your time has no value”

Business dimension

OpenSource Venture investments:+80% between 2011 and 2012

OpenSource means free*?~2B$ in open source sales in 2013

http://blog.gogrid.com/2014/04/08/2014-year-open-source/

@lucacomparini

Linux trend


476 of the Top 500 supercomputers run Linux (2013)Four of the Top 10 supercomputers run on Power Systems. (2014)

Linux for Mission-Critical Workloads (2013)

http://www.linuxfoundati on.org/infographics/2013-enterprise-end-user-report

@lucacomparini

Power paradigm: same technology excellence for scale-up and scale-out systems


Design point is “purposeful”:Enterprise / Mission-Critical workloads (OLTP, ERP, SAP, Big Data, Analytics…)

Design Goals: “consolidate”Consistency, Availability, Reliability, SecurityExtreme performance (throughput per core)>> Less Operational & Licenses Costs

Design point:General Purpose, Cloud, Computing Grids

Design Goals: “distribute”TCA, Standardization (at cost of under-utilization)Performance (throughput per node)>> Affordable acquisition costs, scale is incremental

Systems of Record Structured data from operational systems 20% of all data generated

Systems of Engagement Data that “connects” companies with their

customers, partners and employees80% of all data generated

Power technology fuels:100% of the top10 Banks & Telcos80% of the top 10 Insurers & Retailers

@lucacomparini

Power8 is designed for data: dynamic SMT


Intel HyperThreading: 2 x Threads per CorePower Simultaneous Multi-Threading: 1 / 2 / 4 / 8 x Threads per Core+ 1.6 times single thread performance of Power7+

@lucacomparini

Power8 is designed for data: memory bandwidth


Power8: 230GB/s sustained memory bandwidth96 MB L3 cache, 128 MB L4 cache

@lucacomparini

Unusual transportunfortunately, moving data is a different story


@lucacomparini

Power8 vs Intel comparison (for geeks)


*Intel calls this Hyper-Threading Technology*32KB running in Non-RAS mode, Only 16KB in RAS mode

Sandy Bridge EP E5-26xx

Ivy Bridge EPE5-26xx v2

Haswell EPE5-26xx v3

Ivy Bridge EXE7-88xx v2 POWER 7+ POWER8

Clock rates 1.8–3.6GHz 1.7-3.7GHz 1.7-3.7GHz 1.9-3.4 GHz 3.1-4.4 GHz 3.0-4.15 GHz

SMT options 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8

Cores per socket 8 12 18 15 8 12

Max Threads / socket 16 24 36 30 32 96

Max L1 Cache 32KB 32KB* 32KB* 32KB* 32KB 64KB

Max L2 Cache 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB

Max L3 Cache 20 MB 30 MB 45 MB 37.5 MB 80 MB 96 MB

Max L4 Cache 0 0 0 0 0 128 MB

Memory Bandwidth 31.4-51.2 GB/s 42.6-59.7 GB/s 51.2-68.3 GB/s 68-85 GB/s 100 – 180 GB/sec 190-230 GB/sec

@lucacomparini

Performance comparisons


Java – SPECjbb2013 (Max-jOPS)4.1x Performance

ERP – SAP 2-Tier (Users) 2.4x Performance

SPECint_rate20062.0x Performance

SPECfp_rate20062.2x Performance

• Results are based on best published per core results on Xeon E7-8890 processor.• SAP results are based on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application. Results valid as of October 3, 2014. IBM Power Enterprise System E870 on

the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors / 80 cores / 640 threads, POWER8; 4.19GHz, 2048 GB memory, 79,750 SD benchmark users running AIX® 7.1 and DB2® 10.5, Certification #: 2014034 Result valid as of October 3, 2014. Source: http://www.sap.com/benchmark. IBM System x3950 X6 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 8 processors/ 120 cores/ 240 threads, Intel Xeon Processor 8890 v2; 2.80 GHz, 1024 GB memory; 49,000 SD benchmark users, running Windows Server 2012 Standard Edition and DB2 10; Certification # 2014024. Source: http://www.sap.com/benchmark .

• SPECjbb2013 results are valid as of 10/2/2014. For more information go to http://www.specbench.org/jbb2013/results/ All IBM benchmark results will be submitted to spec.org on October 15, 2014.• SPECcpu2006 results are submitted as of 10/2/2014. For more information go to http://www.specbench.org/cpu2006/results/ All IBM benchmark results will be submitted to spec.org on October 6, 2014.

Intel Xeon E7-8890 v2IBM x3950 X6Win 2012 / DB28s/120c/240t

POWER8IBM E8708s/80c/640t

Intel Xeon E7-8890 v2HP Converged System

8s/120c/240t

POWER8IBM E870AIX / DB28s/80c/640t


Intel Xeon E7-8890 v2Fujitsu PRIMEQUEST2800E

8s/120c/240t


Intel Xeon E7-8890 v2Huawei RH8100 V38s/120c/240t

0

200

400

600

800

1000

1200

020004000

600080001000012000

140001600018000

01020

30405060

708090

0

10

20

30

40

50

60

70

@lucacomparini

The rise of


Performanceof leading POWER architecture Broadens the capability and performance of POWER

Open DevelopmentOpenPOWER enables greater innovation through open software and open hardware

Collaborationacross multiple thought leadersCollaborative development model drives collective thought leadership, across multiple disciplines

- Members can build custom servers (custom-tuned for specific applications)

- Members can provide feedback to the ecosystem, influencing future developments

Context: Growing trend among datacenter operators who design their own hardware, instead of buying

August 2013 (announced OpenPower)1. Create ecosystem2. Make POWER IP licensable to members3. Open POWER Firmware to members

- Innovation injected into the community- Innovation available for POWER customers

&

@lucacomparini

April 2014: Open Standard introduced on

Native PCI-Express 3.0 Support- replacing proprietary GX/Bridge

Transport Layer for CAPI protocol- Coherently Attach Devices connect to processor via PCIe

- Protocol encapsulated in PCIe

FPGA and GPU accelerators

Bi-Endian platform

Support for PowerKVM Hypervisor


OpenPOWER Foundation Chairman Gordon MacKeandisplayed an early system design architecture that Google,through its leadership in OpenPOWER, is investigating asan alternative for large scale data centers with massive datarequirements

At the same time

@lucacomparini

Coherently Attached Protocol Interface (CAPI)… so what?


For each I/O: 40X Fewer Instructions with CAPI500 vs. 20,000 instructions

With CAPI, an accelerator based on GPUs, DSPs, or FPGAs that resides on a PCI card can link into the Power8 processor and memory complex and look like what is in effect a “hollow core” that has the same access to the memory hierarchy as the actual Power8 cores. What this means is that these accelerators do not have to move data back and forth between the CPU and the accelerator;; both devices address the same memory space.http://www.enterprisetech.com/2014/10/02/ibm-accelerates-power8-clusters-gpus-fpgas-flash/

IBM Confidential

@lucacomparini

Coherently Attached Protocol Interface (CAPI)… so what?

© 2014 International Business Machines Corporation 17IBM Confidential

Identical hardware with 2 different paths to data

http://techstacks.io/tech/redis

24:1 consolidation

12x less energy6x less space

3x lower price

40TB Power vs 24TB Intel

infrastructure consolidation savings vs. Intel Xeon for in-memory data

@lucacomparini

FPGA and GPU… so what?


NVIDIA acceleration built into IBM Power S824L

8x faster than x86 Ivy Bridge on pattern extraction82x faster for Cognos BI and DB2 BLU

Altera FPGA acceleration and IBM CAPI

Monte Carlo 250x faster than POWER8 core alone, reduced C code 40x over non-CAPI FPGA

CAPI dev kit with FPGA card from Nallatech

US Dept of Energy $325M super computing contract awarded to IBM, Mellanox, and NVIDIA

DoE systems for science and stockpile stewardship

Sierra and Summit systems to be >100 PF, 2 GB/core main memory, local NVRAM, and science performance 4x-8x Titan or Sequoia

@lucacomparini

FPGA and GPU… so what?


Performance of java.util.Arrays#sort(int[]) on NVIDIA Tesla K40 GPU (ECC enabled) and IBM Power8 CPU.

Up to 48x performance improvement

@lucacomparini

PowerKVM… so what?


@lucacomparini

PowerKVM… so what?


OVH was founded in 1999#1 Internet Hosting in Europe (#3 WW)17 Data Centers (1st biggestWW)180.000 Physical Servers700.000 CustomersWW

@lucacomparini


Founded in 1998Founder of OpenStack9 datacenters300.000 CustomersWW#1 hosting for Internet Retailers#1 hosting OpenStack private cloud

Aaron Sullivan (Director Infrastructure Strategy) shows off Rackspace POWER8 OpenComputeForm Factor Planar

Cloud Ecosystem

Founded in 1999#1 Internet Hosting in Europe (#3 WW)17 Data Centers (1st biggestWW)180.000 Physical Servers700.000 CustomersWW

https://cloud.runabove.com/signup/?launch=power8

@lucacomparini

Cloud Ecosystem


Coming soon: POWER8 Bare Metal as a Service 3 Fixed Configurations + SDD, deployed < 30 mins

Suitable for:§ Big data & Analytics for optimal cost/performance§ Optimized e-commerce & content management§ Hybrid Cloud & Bluemix integration§ Cloud service provider & database services

TYAN TN71-BP012 Collaborator: Tyan, MellanoxWith planned availability second quarter 2015, the TYAN TN71-BP012 servers are designed for large scale cloud deployments and follow Tyan’s highly successful OpenPOWER customer reference system introduced in October 2014. IBM will be among the first to deploy the new servers as part of its SoftLayer infrastructure, utilizing them for a new bare metal service offering.

@lucacomparini

So what? The Linux on Power8 ecosystem at a glance


New. DB2 with BLU Acceleration

Update: SAP HANA Ramp-Up program

New. SoftLayer – POWER-based Bare Metal offerings

New. Rackspace joins the OpenPOWER Foundation

Superior Cloud Economics

New. Docker for Power Systems

Update: OpenStackHEAT and Chef Server for Power

New. Bluemix with Power for SOE/SOR integration

113 members

New. Red Hat in LE mode, RHEV

New. Veristormopen source Hadoop offering

Cloud Open Innovation Big Data & Analytics

Cognos BI already available (BE);; BI and TM1 coming (LE)

SPSS Modeler and Analytics coming (LE)

BPM Advanced 8.5.5Business Monitor 8.5.5

WebSphere Application Server 8.5.5.3

WebSphere Extreme Scale 8.6.0.6

CachingWebSphere MQ 8.0.0.1WebSphere MQ MFT Ed 7

Reliable Messaging

IBM MobileFirstPlatform Foundation 6.3Middleware

IBM Hadoop solutions: BigInsights and Veristorm

OpenSource focus

@lucacomparini


@lucacomparini

Open Source Ecosystem: Relational Databases


https://www-304.ibm.com/partnerworld/wps/servlet /download/DownloadServlet?id=LQPehnUMv8eiPCA$cnt&attachmentName=ibm_power_systems_solution_for_postgr esql.pdf

https://www.flamingspork.com/blog/2014/06/03/1-million-sql-queries-per-second-mysql-5-7-on-power8/

@lucacomparini

Open Source Ecosystem: Turbo LAMP


@lucacomparini

Magento benchmark on IBM TurboLAMP


Independent testing has shown that Magento Enterprise Edition demonstrates a substantial 2.5-3x performance improvement on the POWER8 architecture with its ability to process up to 8 multiple parallel threads per core versus similar priced Intel architectures on the IBM Turbo LAMP stack. Magento serves more than 240,000 retailers worldwide, and enables retailers and brands to create customized, innovative, commerce experiences to accelerate their growth.

Craig Hayman , President - eBay Enterprise Business

TCA = $19,885$3.98 /user/hour

TCA = $45,100$1.88 /user/hour

4x Dell servers (Sandy Bridge)Open Source LAMP, bare metal PHP Server, MySQL, CentOS

Magento Benchmark Test (JMeter driven)A test is considered “successful” if 90% of the user interactions (page load) complete in less than 2 seconds

For a given Users Per Hour Load, simulated User Roles:- 30% browse the catalog- 62% view products and add them to the shopping cart but abandon it- 4% checkout as guest- 4 % checkout as a named user

@lucacomparini

The IBM Linux Commercial from 2003.https://www.youtube.com/watch?v=x7ozaFbqg00

@lucacomparini