Upload
lucy-townsend
View
218
Download
0
Tags:
Embed Size (px)
Citation preview
1
IBM FlashSystems Updateand Marketplace Overview
December 2013
John SingExecutive IT Consultant
IBM Systems and Technology
2
“How can I leverage all this data for my business and keep what I truly need?”
“Can you get me up and running fast?” “Can I add functions and scale?”
Business Critical…
“Keep me running!Secure my data.”
Economics = Speed, Flexibility & Labor Costs
Economics =LOB specific (Risk, Expertise, etc.)
Economics = Business Impact
Data Intensive Business SolutionsStart Quickly… Add Value…
Client Feedback: Data Economics
3
Why Flash…
In the last 10 years
…and everything waits
Source: IBM and Industry Estimates
CPU Performance 8 - 10x increase
DRAM Speed 7- 9x
Network Speed 100x
Bus Speed 20x
Disk Speed 1.2x
4
The Economics of Flash
Reduced latency tenfold for Oracle Retail platform.
…5TB in 2U of rack space vs. 1,300 disk drives providing 400K IOPs, less than 1/10th the cost…
“I've taken away about four days of work time…down to about half an hour now. I'm doing it at the same cost I would have done four years
ago, or probably lower.”
5
Why does Flash Latency make such a difference?
I/O TimeI/O Time Network Time
Network Time CPU TimeCPU Time
I/O TimeI/O
TimeNetwork
TimeNetwork
Time CPU TimeCPU Time
I/O TimeI/O Time Network Time
Network Time CPU TimeCPU Time
From an application’s perspective, all client requests take time…
Newer CPUs help…
But what if you could fix the I/O bottleneck?
Time RecoveredQuery Time
6
time
CPU Utilization Waiting for I/OWaiting for I/O
Work
I/O Serviced by DiskIssue/Process I/O request ~ 100+100 μs
Wait for I/O to be serviced ~ 5,000 μs
Waiting for I/OWaiting for I/O
Work
Waiting for I/OWaiting for I/O
Work
CPU Utilization = ~4% Less Work, More WaitLess Work, More Wait
time
CPU Utilization WorkWork
Wait
I/O Serviced by FlashSystemIssue/Process I/O request ~ 100+100 μs
Wait for I/O to be serviced ~ 200 μs
FlashSystem
WorkWork
Wait
WorkWork
Wait
WorkWork
Wait
WorkWork
Wait
WorkWork
Wait
7
Technology shift among storage tiers
Cost-optimizedblended withNearline disks
Primary data
Backup data
Long term archiving,“Cold data“
WorkflowData shipping
Solid-State Drives (SSD)
Cost-optimizedw/compression & deduplication
Disk and VTL
Linear Tape File System (LTFS)
High capacitive Tapes
8
“All Flash” Systems from IBMRedefine the Economics of Computing to Meet the Demands of a Smarter Planet
IBM announces new investments to help clients benefit from the value of flash• Investing ~$1B in flash system research
& development
• 12 IBM Flash Centers of Competency around the world to help clients transform their systems
• IBM integrates the IBM FlashSystemTM in the portfolio of IBM storage offerings
9
IBM Flash Storage Impact on Systems EconomicsBetter Economics Without Re-architecting Applications
The data below are based on average operating conditions that may or may not be representative of a particular customer’s operating environment. The use case measurements are from TMS customers using the flash technology that has been integrated into IBM’s systems
85% Reductionin batch
processing times
50% Reductionin Software Licenses
75% Reductionin footprint;
1 Petabyte on 1 floor time
80% Reductionin Energy
Usage
100 µs LatencyNo more
bottlenecks
Enterprise ReliabilityHigh Availability, 2D Flash
RAID & IBM Variable Stripe RAIDTM
10
Flash Enables a New, Optimized Infrastructurefor Operational, Transactional Workloads…
Secure Transactionswith Integrity
Rack Servers
IBM FlashSystem
OpenStack, Hadoop…
Storwize with All Flash
2x Latency Improvement5x Capacity Reduction
Add Flash non-disruptively via DS8870 and Storwize SVC
System z& PowerWorkloads…
DB2
Core Transactional Systems Social, Mobile, Analytics
Source: IBM Estimates
Systems of Record Systems of Engagement
http://www.forbes.com/sites/joshbersin/2012/08/16/the-move-from-systems-of-record-to-systems-of-engagement/2/
11
Journey to “Systems of Engagement”
Value: engage users in new, data-driven processes
12
15k SAS Hard DisksHigh performance spinning media
IBM FlashSystem flash storage system
Solid State DiskI/O performance in HDD form factor
IOPS
Cost / GB Flash $
Dis
kD
isk
Fla
sh
Fla
sh
‘Hybrid’ HDDs with flash Improved I/O with spinning media capacities
Storage Spectrum with FlashStorage Spectrum with Flash
7.2k SAS Hard DisksCapacity / Cost
Flash Drawers & AdaptersHigh IOPs Performance
TapeBackup, recovery, and archiving
Seconds
5-15 milliSeconds
100 microSeconds
< 1 milliSecond Latency
13
Optimized IBM Flash Portfolio
Flash Cooperative Caching
EXP30 Ultra SSD Drawer + IBM DS8870 Storage System + Easy Tier ServerAdvanced Tiering Software w/ Flash Drawers, Adapters, SSDs
IBM FlashSystemFlash Optimized Systems, All-Flash, Hybrid Flash,
Servers
Flash
Storage
EXP30 Ultra SSD Drawer Flash Adapters, SSDs, EXP30 or EXP24S Direct Attached Drawers
IBM High IOPS Adapters + FlashCacheFlash Server Caching w/ Flash Adapters and SSDs
Software
Flash in Server
Flash in Storage
Flash Caching
14
IBM Flash Software
Close storage to CPU performance gap
Disks
Server Cache
IBM FlashCache Storage Accelerator(IBM System x)
Tier data and boost storage performance with Easy Tier Server
5th Generation Easy Tier (IBM DS8870 with IBM Power 7)
15
EasyTier + SSDs in Servers
EasyTier extended to Server SSD - a unified scale out and scale up storage platform solving mission critical
memory speed storage workload problem.
Today 2 ways of solving the memory speed storage workload problem. Create scalability, integrity, reliability
and availability problem.
....
....
....
Strong Storage FunctionNot Optimal Performance
Strong Storage FunctionNot Optimal Performance
Strong PerformanceWeak Storage Function
Strong PerformanceWeak Storage Function
Strong Storage FunctionAnd Performance
Strong Storage FunctionAnd Performance
Cluster with Direct Attach
SSDs
SAN/NAS Shared Storage
SSD SSD
SSD
Combined DAS and External StorageWith Data Coherency
SSD SSD
SSDSSD in
SAN/NAS Storage
More Tiers APIs to Software
16
IBM Enterprise-Class Flash in DS8870
Exceptional Performance
SuperiorReliability
Unique Server Integration
Efficiency & Optimization
DS8870Enterprise Storage for Critical Applications
17
Optimized Local Data Placement – Easy TierSystem learns workload, does automated relocation, removes user complexity
Easy Tier for DS8000, SVC, V7000 V1, V2 - 2 Tier Now - 3 Tier New - Server attached Flash Tier Future - LTFS Tape as a Tier
SAS HDD
Easy Tier can provide better performance in 1/2 the floor space 40% less energy consumed96 NLSAS HDDs + 16 SSDs (5.7 KW) vs. 192 FC HDDs (9.5 KW)
SSDNL SAS
Logical volume
VTSLTFS
SSD RAID Array(s)
FC/SAS RAID Array(s)
SATA RAID Array(s)
18
Easy Tier V4 Application PerformanceEquivalent performance with or without encryption drives in the DS8800
19
Proven enterprise flash for DS8870
1,056 15k hard disk drives
224 flash drives
146GB 15k(RAID 10)
All-Flash(RAID 5)
All-Flash Benefit
Raw Capacity 152TB 90TB 41% Less
Usable Capacity 72TB 72TB Same
Response Time ~ 1 ms ~ 0.3 ms 70% Less
Drive Count 1,056 224 80% Less
Frames 3 frames 2 frames 33% Less
Energy Usage 13.9kw 5.3kw 62% Less
$ / GB / IOP Equivalent Equivalent NA
All-flash DS8870 delivers the ultimate in performance, resiliency and economics
Same usable capacityMuch better performanceMuch smaller footprintMuch less energyAnd can reduce overall IT infrastructure costs
All-flash or hybrid-flash
All-HDD
Source: Wikibon
Performance based on measurements and projections using IBM benchmarks in a controlled environment.
20
Start Small and Grow – Storwize Platform
Real-time Storage Usage Analytics
Simple, Rapid Development
IBM Storwize PlatformConverting SVC from a Product to a Platform
Start Small & Scale-up
Use WhatYou HaveIBM & non-IBM
Built-in Expertise
RapidDeployment
Buy LessStorage
Over 36,000 systems shipped in 2 years since inception… Over $1B revenue in 24 months…
Award winning storage platform: features, quality, reliability, support…
Packages• IBM Storwize SVC (Software
Appliance; No Storage)• IBM Storwize 3K (Low-end)• IBM Storwize 7K (Larger)
Priced Options• IBM Storwize Real-time Compression• IBM Storwize Unified (File)• IBM Storwize Metro / Global Mirror• IBM Storwize External Virtualization
Embedded Options• IBM PureSystems• Business Partner Solutions• …powered by Storwize embedded…
Under Consideration• IBM Storwize Flash• IBM Storwize ObjectStor• IBM Storwize Cloud
21
IBM FlashSystem Solution
IBM clients gain…• The extreme performance of IBM FlashSystem with IBM MicroLatency™
• Advanced storage functionality of IBM SVCo Thin Provisioning – allocate storage “just in time”o Easy Tier – storage efficiencyo FlashCopy – point in time copieso Mirroring/Copy Services – data replication and protectiono Real-Time Compression – up to 5X more data in the same physical space
• An ability to cost effectively deploy quickly and realize immediate results
Combining IBM SVC & IBM FlashSystem™In a 24/7 market, enterprise clients often strive to achieve maximum performance coupled with deep features and functionality. And naturally, it must be delivered cost effectively. With the introduction of the IBM SAN Volume Controller and IBM FlashSystem bundle, a solution now exists
22
IBM Storwize V7000 FlashSystem
Extreme PerformanceExtreme Performance Feature Rich SDS SystemsFeature Rich SDS Systemswith
IBM Storwize V7000 FlashSystem Edition
Extreme Performance with IBM MicroLatency™ All Flash 20TB RAIDed data capacityMacro Efficiency 1U form factorVariable Stripe RAID™ + 2D Flash RAID for Enterprise Reliability
IBM FlashSystem 820
Competitive EconomicsOver 250K IOPS
Flash Copy for Backup & Optimal Workload Availability$/TB Value with Thin Provisioning & Real Time Compression
Storage Efficiency with Easy Tier
23
XIV SSD Solution•High capacity SSDs used as secondary
cacheo 400GB SSD device per moduleo 6TB of total cache per rack o Housed in PCI caddy in rear of moduleo Added to all installed modules
•No tuning necessaryo Immediate gain for all applicationso Optional selective volume activation
•Available to all Gen3 systemso Order with SSD from factoryo Field non-disruptive upgrade
24
Outstanding Applications PerformanceWith SSD Caching
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
Core ERP (IOPS)• CRM and Financial DB
Workload• 70/30/8k
Medical Record App Server (RT)• Healthcare EMR Workload• 100% random IO
DB2 Brokerage (IOPS)• Heavy Random Brokerage• 90/10, Mixed block IO• 84% Random Read Miss
WebSphere Datastore (IOPS)
• Web 2.0 OLTP Workload• 80/20/4k
25
Completing IBM storage portfolio with All-Flash Arrays
Accelerate critical applications and unleash the power of performance
IBM FlashSystem All-Flash Arraysoffer extreme performance, low latency and enterprise attributes to handle fast moving
operational data in real time Direct Attach
All Flash Arrays
Hybrid Storage Systems
Direct Attach Flash (PCIe adapters, server SSDs) provides low latency, high performance storage for in-server applications
Hybrid Storage Systems(Storage with SSDs & HDDs)provide a higher level of enterprise capabilities with superior capacity
26
Hybrid arrays vs. dedicated Flash arrays?
What you get:A consolidation play
Non-deterministic performance
Ease of integration
Licensing (still common)
Built-in Tiering
Hot-spots
Another tier to manage
Relative ease of use
Marginal application efficiencies
Proven resiliency
SSDs
What you don’t get:Best Latency / Best Performance
Deterministic/Consistent Performance
Architecture design for Flash
Reduced footprint
Rack space reductions
Power/Cooling savings
Simplicity
Lesser Tiers
Zero Tuning
Maximum application efficiency
27
IBM FlashSystem Portfolio
Extreme Performance
Macro EfficiencyMicroLatency™ Enterprise ReliabilityExtreme Performance
IBM FlashSystem SolutionIBM FlashSystem 820San Volume Controller (SVC)
IBM FlashSystem 820 IBM FlashSystem 720IBM FlashSystem 810
IBM FlashSystem 710
Enterprise Features
• Boost enterprise productivity• Improve application performance• Ideal for OLTP, data warehousing
and OLAP environments• High availability system
• Acceleration of applications • Enterprise feature sets to
ensure data protection
28
IBM FlashSystem 720 / FlashSystem 820 Architecture
Redundant Power Supplies
Redundant Fans
12 Flash Modules(10+1+1)
1U Chassis
N+1 batteries
Redundant Management Control Processors
Redundant RAID controllers
Two Dual-Ported 8 Gb/s FC or40 Gb/s QDR IB Interfaces
29
1 Petabyte, 1 Rack, 22 Million IOPSWhat it means… Or, solving for 22 Million IOPs…
Source: IBM Actual Results and Estimates I
Either 315 RacksPerformance Optimized Disk…
Or 630 RacksHigh Capacity Disk…
• 1 Petabyte: 1 Floor Tile
• 100 microsecond latency
• 22 Million IOPS
• 210 GB/s
• 12.6 KW power
1 RackIBM FlashSystem
Less power than the average 200TB array
30
Tipping Point Demonstration
Highly Scalable & I/O IntensiveOLTP Database Workload• Compelling Economics
Significantly improved workload efficiency
• Extreme CapacityBuy only what you need; add capacity as needed
• Application TransparencyAvoid risk and cost of change as you grow or subside
• Continuous AvailabilityUninterrupted access to data with consistent performance
IBM FlashSystem, IBM Power Systems and DB2
IBM Power 780(4 nodes, 128 Cores,
2TB Memory)
IBM FlashSystem 820(4-1U units, 20TB
Each)
Fibre Channel Networking
10 GbE Networking
ibm.com\storage\flash
IBM DB2 v10.5
(10-8 core cluster members)
31
Tipping Point Demonstration ResultsNormalized $ / IOPS
Energy Space
IBMFlashSystem
2,500Spindles+ 128 SSDs
5,000 Spindles
11x Less
80x Less26x Less
IBMFlashSystem
2,500Spindles+ 128 SSDs
5,000 Spindles
IBMFlashSystem
2,500Spindles+ 128 SSDs
5,000 Spindles
•ibm.com\storage\flash
1.3 Million IOPS
43K+ Transactions p/sec
13K Updates per second
32
IBM Differentiators – Enterprise Reliability
Superior Protection: Beyond Disk RAID
Self-Recovering Flash Modules
Avoid system rebuilds
Protection Within And Across
Flash Modules
Variable Stripe SizesRead Disturb Mitigation
Automatic Read SweeperHigh-Speed Clock Recovery
Advanced Engineering = Less Maintenance
Superior Durability: Using the Best Flash
10X
30X
P/E
* C
yc
les
*Program/Erase (Write)Flash Type
MLC eMLC SLC0K
100K
50K
33
2013 2014 2015+
IBM FlashSystem Roadmap
Next Generation FlashSystem
Next Generation F/O
FlashSystem
IBM FlashSystem 710, 810, 720, 820
1U, 24TB, 32nm SLC, eMLC450K IOPS, 8Gb FC, QDR IB
SVC Integrated Management Next Gen SVC Integrated
Mgmt / Adv. FunctionSVC IntegrationEnhancements
FlashSystem Solution5U 24TBScalable to 8x SVC FlashSystem 820
Legend
Available Future
PureSystem Integration Next Gen PureSystem
FlashSystem F/O Flex Node
Next Gen. Big Data/Analytics solutions
DS8K and Storwize integration
Integration into Big Data/ Analytics solutions
34
IBM FlashSystem: A Marketplace Overview
So many vendors, so little time……
35
A World Full of “Flash” Options
FlashSystem
36
Everyone uses FlashThe difference is how it is implemented
•HW-based Vs SW-based architecture
•Purposed-built for flash or not?
•Flash Chip Choices
•Data Protection Schemes
•Scalability, Reliability, Availability
•Method of Deployment
•Functionality and Features
•Hybrid or All Flash
•And yes… Latency!
HW-only data path
FPGA
IBM FlashSystem
37
SSD is NOT Flash Storage
Flash inside a Disk Enclosure
Technology designed for Disk, not Flash
Data protection outside SSD
Data Path handled by OS/Controllers outside SSD
Performance is reduced and marginal
Common in hybrid arraysFocus is to maintain functionality and consolidationFocus on Tiering and Data MovementSSD competes with all other disks’ for resourcesWhen performance matters (which is ALWAYS), SSD is not the best
Common in hybrid arraysFocus is to maintain functionality and consolidationFocus on Tiering and Data MovementSSD competes with all other disks’ for resourcesWhen performance matters (which is ALWAYS), SSD is not the best
SSDAdded Latency by:
Controllers
SW Layers
SAS Controllers HDDs
Tiering
Shared data path
SSD is not Flash Storage
38
Rule of Thumb: consider 1U IBM FlashSystem when > 5 SSD
Rule of Thumb: consider 1U IBM FlashSystem when > 5 SSD
SSDSSD
EasyTier(SSD and disk mix)
525K IOPS 300 Watt 25/100 µs write/read
FlashSystem 820 FlashSystem 720FlashSystem 820 FlashSystem 720
Why? IBM FlashSystem provides better lifetime, higher performance and smaller energy foot-print when needing more Flash than 5 SSDs
SSD when:< 6 SSDs for EasyTierSVC (external EasyTier) not indicated solution
SSD when:< 6 SSDs for EasyTierSVC (external EasyTier) not indicated solution
SSD is not Flash Storage
39
IBM FlashSystem Focus areas
Performance (Latency):
Efficiency:
Reliability:
HW-based design/FPGA
Application/Server, Data Center
VSR, 2D Flash RAID
40
SW-Based Designs: SW Controlled Data PathFlash HW and SW-based designs
Front End Directors Front End Directors
Back End DirectorsBack End Directors
OSOSCPUCPU
Outside World
SSD/SAS/SATA HDD’s
CacheCache
o Added latency by:Array Controllers and SW Layers
SAS Controllers and Shared bus
Tiering and Shared data path
Form Factor Enclosure
SSD
41
HW-Based Designs: HW controlled data path
Flash HW and SW-based designs (cont)
o Maximum performance and lowest latency by:Optimized FPGA HW data path
Custom HW design
Massive parallelism handling data
25us write latency into flash media
IO Interface FPGAIO Interface FPGA
FPGAFPGACPUCPU
Outside World
Flash Media
FPGAFPGA CPUCPUAutobahn
42
IBM FlashSystem Core Performance Concepts
• IBM FlashSystem is a hardware-only data path o Custom FPGA-based data movement
decreases latency vs. software
• Focus is on MicroLatencyTM on standard SAN interfaces vs. competitors
• Comparable latency on SAN compared to DAS (PCIe)o All the benefits of shared storage with no
latency impact
• Distributed out-of-data-path CPU processing
RAID Controllers
IO Modules
Flash Modules12x
16 PPC CPUs
43
FlashSystem
10
0K I
OP
S
<1
ms
r-la
ten
cy
10
0K I
OP
S
<5
ms
r-la
ten
cy
1M
+ IO
PS
<1
00
us
50
0K I
OP
S
<3
00
us
Positioning IBM FlashSystem in a broad marketplace
44
Change the Economics of Storage
Reduce Latency
Increase Manageability
Cut Environmental Costs
Improve Compute Efficiency
Provide Scalability
Guarantee Reliability
Reduced TCO Business Value
Focus on those that deliver all of these, and more…
45
IBM Flash Software for Management, Caching & Tiering
IBM Flash Storage PortfolioMeeting the Demands of a Smarter Planet
All-Flash Storwize V7000
IBM Flash DrawersAdapters & SSDs
IBM FlashSystem
Flash in IBM XIV
and DS8870
All of the above supported with Flash Storage TODAY!
Thank You