34
Violin Memory Inc. Proprietary 1 1 Violin Memory Presentation for Storage Event Lake Solutions Jürg Stiefenhofer, Olivier Hartmann Violin Memory, Switzerland April 2013

Violin Memory Presentation for Storage Event Lake · PDF fileViolin Memory Presentation for Storage Event Lake Solutions Jürg Stiefenhofer, Olivier Hartmann Violin Memory, ... Performance

  • Upload
    ngotruc

  • View
    223

  • Download
    1

Embed Size (px)

Citation preview

Violin Memory Inc. Proprietary 1 1

Violin Memory Presentation for Storage Event Lake Solutions

Jürg Stiefenhofer, Olivier Hartmann Violin Memory, Switzerland

April 2013

Violin Memory Inc. Proprietary 2 2

Violin Memory

• Founded 2005, first flash product in 2009

• 200+ top tier customers

• Toshiba investor/ Strategic Supply & Roadmap Agreement – Intellectual Property

– Juniper Network, SAP

• Global Presence

– WW HQ in Silicon Valley USA,

– Offices in North America, EMEA and APAC

– 450+ employees

• Global Ecosystem

– Global Support: IGS

– Local Country Organisations (Sales, Support)

– Customer References

Violin Memory Inc. Proprietary 3 3

We’re focused on two customer challenges

•Functional Applications - OLTP / Analytics / SAS

•Business Applications - SAP / Oracle

•Lift to cloud - mobile BI

•Virtual Desktop

•Unlimited IO for Developer •Big Data

• Physical consolidation - 10:1

• Storage management software licence reduction

• Server optimization – fewer servers

• OPEX savings – power, space, maintenance

• Core licensing reduction – less Oracle cores

Application

Acceleration

Violin Memory Inc. Proprietary 4 4

MORE APPLICATIONS

MORE DEVICES

MORE USERS

More Demand for Data, NOW!

10101001101011011001100111001110010

10100001000101011001001010101111010

0

Compute

10101001101011011001100111001110010

10100001000101011001001010101111010

0

Network

1010100110101101100110011100111001010100001000101011010101

11 Storage

Real time, concurrent

data access, heavily

virtualized infrastructure

Multi-Core Compute that

is I/O Starved, CPU

waiting for I/O

Storage Must Deliver High Random IOPS & Low Latency

Violin Memory Inc. Proprietary 5 5

Flash

Network

Server

Our vision is the all Silicon Datacenter for Tier1Data

Centre

High speed Multi-core Compute

High speed low latency Networking

FLASH storage required

to match compute and

network performance

Tag:V3000

High speed Low latency

Flash Memory Arrays

Tag:V6000

Violin Memory Inc. Proprietary 6 6

Violin is not SSD – it is 3rd Generation Flash

Highly Available - 24x7x365 operation

Transformational performance improvement

100% Compatible with existing investments & processes

Multitenant/shared

SERVER-CENTRIC SOLUTION

Dedicated to server

Non-HA

Performance and capacity scaling are limited by server

HARD DRIVE REPLACEMENT

Integrated within existing infrastructure

Incremental performance boost

Performance scaling limited by controller/server

PURPOSE-BUILT ENTERPRISE SOLUTION

3RD GENERATION 2ND GENERATION 1ST GENERATION

“The transition from spinning to solid-state storage is

already underway.” Steve O’Donnell, ESG

Tag:V6000

Violin Memory Inc. Proprietary 7 7

Performance Challenges: SSD – “write cliffs”

19

4k I

OP

7

60

MB

/s

SSD-based

Violin

Violin Memory Inc. Proprietary 8 8

Inherent Design Shortcomings

─ Performance limited Controllers

─ Maximum supported SSDs

Workarounds:

─ Short stroking

─ Wide striping

─ Adding SSD to legacy array

─ ‘Read-Only’ flash cache

─ “FAST”

─ “Easy Tier”

Performance Challenges: Legacy Storage

Violin Memory Inc. Proprietary 9 9

Performance Challenges: Legacy Storage

Inherent Design Shortcomings

─ Performance limited Controllers

─ Maximum supported SSDs

Workarounds:

─ Short stroking

─ Wide striping

─ Adding SSD to legacy array

─ ‘Read-Only’ flash cache

─ “FAST”

─ “Easy Tier”

High Acquisition Costs

Higher Operational Costs

Violin Memory Inc. Proprietary 10 10

No SSDs ─ Violin Intelligent Memory Modules

Core building block of the Memory Fabric

‒ 256GB SLC Flash / 512 GB MLC Flash

‒ DRAM for metadata & caching

Hot Swappable

Proprietary flash endurance & wear leveling extending Flash life up to 10x

‒ Continuous data scrubbing

‒ Advanced hardware based ECC

‒ Automated in-place die failure handling

Violin Memory Inc. Proprietary 11 11

The Violin Innovation Advantage

Technological innovation at every layer from Hardware to Software – Intellectual Property (IP) aggregation resulting in a fundamentally unique solution

Deep software and hardware integration – Toshiba partnership

– Violin Switched memory architecture

– vMOS - Violin Memory Operating System optimized for flash

– vRAID - Flash optimized RAID

Toshiba

Flash

VIMM

vRAID Group

Violin 6000

Violin Memory Inc. Proprietary 12 12

Connectivity options

Ethernet Fibre Channel

Fabric

2x Direct PCIe

8x iSCSI 10GbE

8x IB QDR SRP

8x FC (4,8 Gb/s)

Application Acceleration, Database Consolidation, Virtualisation, Infrastructure Consolidation

Infiniband

Violin Memory Inc. Proprietary 13 13

Violin Memory 6000 Series Models

6212 6222 6232 6606 6611 6616

Form factor 3U 3U

Flash type Capacity (MLC) Performance (SLC)

Raw Capacity (GiB) 12.2TB 22.5TB 32.7TB 6.1TB 11.2TB 16.3TB

Raw Capacity (GB) 13.2TB 24.2TB 35.2TB 6.6TB 12.1TB 17.6TB

I/O Connectivity 8Gb FC, 10GbE iSCSI, 40 Gb IB, PCIe G2

Maximum 4KB IOPS (Mixed) 200K IOPS 350K IOPS 500K IOPS 450K IOPS 800K IOPS 1M IOPS

Maximum Bandwidth (100%

Reads) 1.5GB/s 2.5GB/s 4GB/s 3GB/s 3.5GB/s 4GB/s

Nominal Latency 500 µsec (mixed) 250 µsec (mixed)

Violin Memory Inc. Proprietary 14 14

Engineered For Performance & Reliability

IO modules ‒ FC, 10GE, IB, PCIe Interfaces

Active/Active memory gateways ‒ Storage virtualization

‒ LUN configuration

Array control modules ‒ Fully redundant

‒ Controls flash memory fabric

‒ System level PCIe switching

Flash memory fabric ‒ Heart of the system

FLASH

MEMORY

FABRIC

24 to 64

Hot Swappable

VIMMs

Violin Memory Inc. Proprietary 15 15

Core Requirements for Datacentre Grade Flash…

Highly Available and Scalable

Predictable Low Latency read and WRITE Performance

Mixed Workload (Open Appliance)

Non–Contended Multitenant/Shared

Hot Swap and Support

Violin Memory Inc. Proprietary 16 16

Use Cases

Violin Memory Inc. Proprietary 17 17

World Record Breaking Performance

June 29, 2010 -TPC-E World Record ‒ 1,464.12 tpsE, $302.49 / tpsE ‒ MS SQL Server + HP Blade Server: 4

CPU, 48 cores

May 9, 2011 - TPC-C World Record ‒ 1,024,380 tpmC, $0.65 / tpmC ‒ MS SQL Server + HP DL380: 2 CPU, 6

cores

May 23, 2011 - TPC-C World Record ‒ 1,263,599 tpmC, $0.51 / tpmC ‒ MS SQL Server + HP Blade Server: 4

CPU, 48 cores

June 22, 2011 – File System World Record ‒ IBM GPFS ‒ 10 billion files scanned in 43 minutes ‒ 37x faster than previous best

December 8, 2011 - TPC-C World Record ‒ 1,053,100 tpmC, $0.58 USD/ tpmC ‒ Oracle 11g + Cisco UCS Blade Server: 2

CPU, 12 cores

September 12, 2012 – VMmark 2.1 World Record

‒ 11.32 @ 10 Tiles ‒ ESXi 5.1 + 2 Cisco UCS B200 M3

September 18, 2012 – VMmark 2.1 World Record ‒ 42.79 @ 36 Tiles ‒ vSphere 5.1 + 8 Cisco UCS B200 M3

September 27, 2012 – TPC-C World Record ‒ 1,609,186 tpmC, $0.47 USD / tpmC ‒ Oracle 11g + Cisco UCS C240 M3 Rack

Server

October 02, 2012 – VMmark 2.1 World Record ‒ 29.35 @ 30 Tiles ‒ ESX 4.1U2 + 2 HP DL980 G7

November 13, 2012 – VMmark 2.1 World Records (5 of them) ‒ 46.22 @ 40 Tiles, 34.75 @ 30 Tiles, 23.14

@ 20 Tiles, 11.88 @ 10 Tiles ‒ ESX 4.1 U3 + 8 Fujitsu BX924 S3

http://vmem.com/benchmarks

Violin Memory Inc. Proprietary 18 18

Vmware Integration of Violin Memory

vStorage

APIs

vCenter

Plugin

Industry leading performance density

Sustained low latency

No tuning – one RAID level

Key Customer Benefits

• Super-charged VMFS performance

• Faster Storage vMotion

• End to end datastore management

• End to end statistics and Status

• Reduce TCO

vSphere

Desktop

virtualization

Business

Critical App

Virtualization

vStorage APIs

VAAI

VASA

VADP

SRM

vCenter Plugin

Streamlined provisioning

Per Datastore Stats/Status

VM data lifecycle Management

Violin Memory Inc. Proprietary 19 19

VMware 1M IOPS – 97% Less Space – 90% Less Power

The world is changing fast and

getting incredibly better

VMware demoed 1 Million Read IOPS from a physical host – VMAX (8 Engines, 960 disks) 5 Racks – 32,000 Watts

VMware demoed 1 Million IOPS from a VM Two Violin 6616 6 RU (97% less) – 3,600 Watts (90% less)

2011

2012

Violin Memory Inc. Proprietary 20 20

VMware Server Virtualization

Large VM estates suffer from “memory Ballooning”

Memory Ballooning is when ESX server RAM is full and the ESX hosts “swap out “ to a spinning disk LUN

>5ms latency from disks for swap outs impact VMs dramatically – especially in a large estate

VMs wait for responses, IO can pause and IO can timeout causing VM Hangs or even Crashes

Impact to production apps or hosts systems if Managed

Fabric

• A small amount of Flash presented as block

LUN to ESX clusters

• Shared access to memory array by clusters to “swap out “ to

• <0.5ms avoids VM hangs and crashes

• Memory array LUNs can also be used for VMs and there apps – Tier 0

Violin Memory Inc. Proprietary 21 21

Virtual Desktop - VDi

• Images require many IOPs – 20 -70 depending on Image OS and user profile

• 1000+ images creates huge IOP requirement for storage

• 1000s of IOPs requires large Bandwidth

• Gold images and Linked Clones reduces storage capacity requirement

• Storage utilization is poor

• Large cap-ex, complex to setup and manage

• Large op-ex costs – power, heat and space

• Violin Flash Array provides 100,000s of IOPS

• 4GB/s bandwidth per array

• Sustained Read AND Write IOPS

• Eliminate boot storms and log off storms

• Enable virus scanning and security

• Enable thin or thick apps

• Persistent or non-persistent

• Simple to use – lower capex and opex

Violin Memory Inc. Proprietary 22 22

Infrastructure Consolidation – Requirement

Typical Project:

- 20TB total usable capacity (single or consolidated

apps/databases)

- Combined requirements = sustained 500,000 I/O per

second 4KB transfers this is 2GB /sec (500,000 * 4KB)

- Mixed Database workload (R:W 2:1 ratio)

- 100% growth over three years

Classical HDD-approach:

15k rpm SAS Disk 200 IOPS

1’500 Harddisks

Need to buy: 450TB (assuming 300GB disks)

Violin Approach:

2 x 6232 Memory Array

Need to buy: 64TB

Violin Memory Inc. Proprietary 23 23

Infrastructure Consolidation - Server Compression

Challenges:

- Multiple SQL hosts/DRAM for performance

- SQL Licencing costs

- Cache contention in SAN Arrays

- Complex Storage Management

Fabric

Fabric

Violin Flash Memory Benefits:

- Significant reduction in server footprint

- Reduced power costs

- Reduced SQL/VMware licencing costs

- Latency in microseconds rather than milliseconds

- Eliminate Cache contention issues

- Existing disk arrays redeployed for Tier 3 / Archive

- Longer term only Flash and SATA disk

- Dramatically simplified data management

BEFORE

AFTER

Violin Memory Inc. Proprietary 24 24

General Recommendations:

─ Typical Applications:

MS-SQL, SharePoint, Exchange, Hyper-V

─ Simply map LUNs via FC to Application Servers

─ Best practices for FLASH – high IOPS/low latency:

Index

Search

Properties

Authentication

Authorization

MS Application Integration with Violin

Violin Memory Inc. Proprietary 25 25

SQL Server 2012 Fast Track Data Warehouse for Violin Memory Optimized Configuration on Latest Violin flash-Memory Array

Violin Memory and Microsoft’s Joint Offering Details SQL Server 2012 Fast Track DW for Violin Memory architecture

brings together the right mix of technology and software, integrating the powerful Violin Memory Compute Node, the

robust Violin all-flash Memory Array and the data warehouse capabilities of SQL Server 2012 Enterprise.

Summary SQL Server 2012 Fast Track DW for Violin Memory builds on the success of earlier Fast Track offerings with the ability to

process any data, anywhere, at any scale. The entire solution is just 5U with easily upgradable components, preserving your

initial infrastructure investments. Published 11/28/2012

25TB Certified Data Warehouse

Solution ID: VM-DW-2

Compute Node:

CPU: 2x Intel Xeon E5-2680 2.7Ghz (8Core) RAM: 256 GB

Drive: 2x Intel 520 SSD (240GB)

Storage Configuration:

Violin Memory 6232 with FC

Usable space: 20.2TB

FT rated User Data: 25TB (compressed) Max User Data: 50TB

(compressed)

11TB Certified Data Warehouse

Solution ID: VM-DW-1

Compute Node:

CPU: 2x Intel Xeon E5-2643 3.3Ghz (4Core) RAM: 128 GB

Drive: 2x Intel 520 SSD (240GB)

Storage Configuration:

Violin Memory 6212 with FC

Usable space: 6.6TB

FT rated User Data: 11TB (compressed)

Violin Memory Inc. Proprietary 26 26

Application Acceleration - SAP Case study – before Violin

8 CPUs

Oracle 11.2.0.2.0

Non-ASM

HDS Disk Storage

20k SAP processes

SVC - IBM

VMWARE

Sync Replication

Violin Memory Inc. Proprietary 27 27

Violin Test 1

8 CPUs

Oracle 11.2.0.2.0

Non-ASM

20k SAP processes

SVC - IBM

VMWARE

Sync Replication

Violin Memory Inc. Proprietary 28 28

Violin Final Test

20 CPUs

Oracle 11.2.0.2.0

Non-ASM

40k SAP processes

SVC - IBM

VMWARE

Sync Replication

600µs latency through entire stack

Violin Memory Inc. Proprietary 29 29

Violin Memory Inc. Proprietary 30 30

Backup Slides

Violin Memory Inc. Proprietary 31 31

Simple Operations

Provision storage and Go! ‒ Select LUN capacity and let vRAID

automate placement ‒ No tuning required ‒ Hot swap for non disruptive operations

Seamlessly handle performance spikes ‒ Customer example:

Rogue full table scans in dba scripts System handled the load spikes and still met

core application SLAs

Advanced Graphical User Interface ‒ Fully customizable dashboard ‒ Detailed performance statistics ‒ Supported as a vCenter Plug-In

Violin Memory Inc. Proprietary 32 32

GUI Overview Page

Violin Memory Inc. Proprietary 34 34

What are the other vendors doing?

Hosts

Connectivity

Front End Back End

Cache

HDDs & SSDs

Retrofitted HDD Storage System

FC SAN

Ports Controllers Excess Cache

RAID-5 like Algorithms

Latency = 2’000µs to 10’000µs

Slow Writes

Violin Memory Inc. Proprietary 35 35

Violin Architecture

Hosts RAID Flash

PCIe

Web GUI

vMOS

SAN Connectivity