© 2012 IBM Corporation2
Agenda
Why “Flash” MattersIBM Texas Memory Systems (TMS)RamSan OverviewWhy TMS?
© 2012 IBM Corporation3
1. Reduce DB and “per core” licensing 2. Improve application efficiency 3. Improve server efficiency 4. Increase storage operations efficiency 5. Lowest Latency!5. Lowest Latency!
5 reasons why RamSan is a “must” in every data center
What if you could…What if you could…
© 2012 IBM Corporation4
Low Latency: Do things faster
High Scalability: Do more things concurrently
Low TCO: Save money and boost value
Flash delivers performance and value to boost the applications running your business.
Are you still waiting for the 25K RPM
Disk?
Are you still waiting for the 25K RPM
Disk?
Why FLASH matters?CPU, Network, SAN, Memory and Bus are getting faster…
CPU, Network, SAN, Memory and Bus are getting faster…
© 2012 IBM Corporation5
Business Benefits of Flash
Scale applications further– Do more things with more people/customers/etc– Increase "parallel" performance
Speed up applications– Do existing things faster– Increase "serial" performance
Create new applications– Do more things with data– More analytics -> more insight
Make applications more efficient– Do more with less spindles, CPU cores, license fees, etc
Application Benefits
Application Benefits
Business Benefits
Business Benefits
© 2012 IBM Corporation6
Application Sweet Spots: Do More, Do it Faster!
OLTP DatabasesOLTP Databases– Financial, gaming, real-time billing, trading, real-time
monitoring, query acceleration (DB2/Oracle), etc.Analytical applications (OLAP)Analytical applications (OLAP)
– Business intelligence, batch processing, ERP systems, reporting, massive data feeds, etc.
Virtual InfrastructuresVirtual Infrastructures– VDI, Consolidated virtual infrastructures, user profiles,
etc. HPC/Computational ApplicationsHPC/Computational Applications
– Simulation, modeling, rendering, FS metadata, scratch space, video on demand, thread efficiency, etc.
Cloud-scale InfrastructuresCloud-scale Infrastructures– On-demand computing, content distribution, web,
caching, metadata, GPFS, active file management, etc.
© 2012 IBM Corporation7
Lots of Enterprise Flash Players
Niche & OEM Sales Mainstream WW Direct Sales
Sto
rag
e S
yste
m S
olu
tion
s
With the TMS acquisition, IBM can now offer a complete set of server and storage
Flash products.
Se
rve
r/M
od
ule
So
lutio
ns
© 2012 IBM Corporation8
Agenda
Why “Flash” MattersIBM Texas Memory Systems (TMS)RamSan OverviewWhy TMS?
© 2012 IBM Corporation10
TMS History
2012201220112011201020102009200920082008200720072006200620052005200420042003200320022002
19971997
19901990
19781978
RamSan-710: 5 TB SLC Flash, 4 FC (8 Gb)/IB (QDR) RamSan-70: 900 GB SLC Flash, PCIe x8 2.0RamSan-640: 8 TB SLC Flash, 10 FC (8 Gb)/IB (QDR) RamSan-630: 10 TB SLC Flash, 10 FC (8 Gb)/IB
(QDR)RamSan-620: 5 TB SLC Flash, 8 FC (4 Gb)RamSan-20: 450 GB SLC Flash, PCIe x4
RamSan-440: 512 GB RAM, 8 FC (4 Gb)
RamSan-500: 2 TB SLC Flash, 64 GB RAM, 8 FC (4 Gb)
RamSan-400: 128 GB RAM, 8 FC (4 Gb), 4 IB (4x)
RamSan-320: 64 GB RAM, 8 FC (2 Gb)
RamSan-210/220: 32 GB RAM, 4 FC (2 Gb)
SAM-350/SAM-450: DSP system
SAM 500: DSP/SSD, 64 GB RAM, 15 FC (1 Gb)
SAM-2000: DSP system
CMPS: custom SSD for Gulf Oil
Custom systems for seismic industry
Company founded by Holly Frost
RamSan-810: 10 TB eMLC Flash, 4 FC (8 Gb)/IB (QDR)
RamSan-820: 12-24 TB eMLC Flash, 4 FC (8 Gb)/IB
RamSan-720: 5/10 TB SLC Flash, 4 FC (8 Gb)/IB
© 2012 IBM Corporation12
Agenda
Why “Flash” MattersIBM Texas Memory Systems (TMS)RamSan OverviewWhy TMS?
© 2012 IBM Corporation13
IBM and TMS: A Winning Combination
TMS Synergy Across STG Brands – Now and Future
Key IBM-TMS Product Synergies Today
These are general themes, not specific or committed actions, programs, or intentions.
SAN Volume Controller (SVC) & Storwize V7000
Enterprise features—tiering, replication, etc.
Power SystemsLeverage purpose-built
server and storage architectures.
General Parallel File SystemAccelerate
metadata for high performance
computing (HPC).
DB2Accelerate key databases with RamSan shared
storage.
GPFSDB2
© 2012 IBM Corporation14
Performance re-focus
IOPS Vs Latency
Time Processing Data Vs Waiting
Consistent Vs Variable Performance
© 2012 IBM Corporation15
RamSan Competitive Positioning
Lowest Latency
Very Expensive
Consistent Performance
Low Latency
Fair Latency
Expensive HDD
Unbalanced Performance
Lowest Performance
Lower Cost
Server-Side Flash / HW-Based Flash Array
Server-Side Flash / HW-Based Flash Array
Hybrid ArrayHybrid Array
Disk ArraysDisk Arrays
SW-Based Flash ArraySW-Based Flash Array
ns
ms
sec
us
© 2012 IBM Corporation16
In-Server (DAS)
Single-instance applications Small capacity (> local DRAM) Absolute lowest latency
Not the best fit for: Shared data in clustered
environments Large capacities (lots of TB) Tiny capacities that fit in DRAM
Shared (SAN)
Large, shared, protected capacity Clustered file systems Data Mobility Centralized Management Easy scalability
Best fit for: Standard data center environments
(Fibre Channel, InfiniBand) Performance and capacity growth
Flash Architectural Decisions & Guidelines
© 2012 IBM Corporation17
IBM/TMS Shared Flash Systems
SLC Flash eMLC Flash
Model 710 720 810 820
Capacity 1-5 TB 5 or 10 TB 2-10 TB 10 or 20 TB
Latency (R/W) 90/25 us 90/25 us 110/25 us 110/25 us
IOPS 450K 500K 400K 450K
Bandwidth 4GB/s 5GB/s 4GB/s 4GB/s
Interfaces 4x 8Gb FC or 4x 40Gb IB 4x 8Gb FC or 4x 40Gb IB
Data Protection VSR™2D Flash RAID™
(inc. VSR™)VSR™
2D Flash RAID™
(inc. VSR™)
All units 1U form factor, less than 500 Watts
© 2012 IBM Corporation18
RamSan-720/820 Architecture
Redundant Power Supplies
Redundant Fans
12 Flash Modules (10+1+1)(module + extension board)40 Flash Chips per Module
(4 x 9+1 VSR groups)
1U Chassis
N+1 batteries
Redundant Management
Control Processors
Redundant RAID controllers
Two Dual-Ported 8 Gb/s FC or40 Gb/s QDR IB Interfaces
© 2012 IBM Corporation19
Flash Module Architecture RamSan-820
Primary Flash Board1TB eMLC Flash
Expansion Flash Board1TB eMLC Flash
© 2012 IBM Corporation20
Primary Flash Board1TB eMLC Flash
Expansion Flash Board1TB eMLC Flash
Series-7 Flash Controller™2 per Board4 per Module
eMLC Flash Chips20 per Flash Controller40 per Board, 80 per Module
Interface ProcessorDual ports to backplane
Flash Module Architecture RamSan-820
© 2012 IBM Corporation21
Flash Module Architecture
Expansion Board (optional)
Series-7 Flash Controller™2 per Board2 or 4 per Module
Flash Chips20 per Flash Controller40 per Board40 or 80 per Module
data XOR parityDistributed across ALL Chips
Primary Board
Gateway Interface & Control PPC Dual ports to backplane
© 2012 IBM Corporation23
Hardware-only data path with extreme LOW latency Custom FPGA-based data movement decreases latency vs. software
Distributed out-of-data-path CPU processing High Performance (IOPS), High Bandwidth
“ Our Symmetrix-VMAX Enginuity consists of millions of lines of code.”
How to make ‘The World’s Fastest Storage’
RAID Controllers
IO Modules
Flash Modules
12x
16 PPC CPUs
© 2012 IBM Corporation28
Four Layers of Data Correction
RamSan-720/820 introduce System-Level RAID 5 across Flash modules, plus the other mechanisms found on all RamSan Flash storage systems.
2D Flash 2D Flash RAIDRAIDTMTM
2D Flash 2D Flash RAIDRAIDTMTM
* RamSan 720/820 Only
© 2012 IBM Corporation29
RAID 5 across Flash Modules (10 data + 1 parity + 1 hot spare)
ExternalInterfaces
(FC, IB)
RAID Controllers
RAID 5 withinFlash Modules
(9 data + 1 parity)
TMS2D Flash RAID™
2D Flash RAID™ (RamSan 720 / 820)
© 2012 IBM Corporation30
Variable Stripe RAID™ (VSR)
Patented VSR allows RAID stripe sizes to vary. If one die fails in a ten-chip stripe, only the failed die is bypassed,
then data is restriped across the remaining nine chips. VSR reduces maintenance intervals caused by Flash failures
……
…16 Planes16 Planes
10 Chips10 Chips
FAILFAIL
© 2012 IBM Corporation31
Agenda
Why “Flash” MattersIBM Texas Memory Systems (TMS)RamSan OverviewWhy TMS?
© 2012 IBM Corporation33
Improving Existing Infrastructure
• COCC, financial technology provider
• Custom Oracle ATM processing application
• Mirrored TMS hybrid Flash array• CIO Chad Burney won InfoWorld
CTO 25 award for performance and cost improvements
For Internal Customer Use Only - Texas Memory Systems Confidential
© 2012 IBM Corporation34
RamSan Benefit
Time
I/O Serviced by Disk1. Issue I/O request (~ 100 μs)2. Wait for I/O to be serviced (~ 5,000 μs)3. Process I/O (~ 100 μs)
• Time to process 1 I/O request = 200 μs + 5,000 μs = 5,200 μs• CPU Utilization = Wait time / Processing time = 200 / 5,200 = ~4%
Processing~100µs ~100µs
Waiting~5000 µs
Texas Memory Systems, Inc. - The World's Fastest Storage®
CPU State
1 I/O Request
© 2012 IBM Corporation35
RamSan Benefit
Time
I/O Serviced by Ramsan1. Issue I/O request (~ 100 μs)2. Wait for I/O to be serviced (~ 200 μs)3. Process I/O (~ 100 μs)
• Time to process 1 I/O request = 200 μs + 200 μs = 400 μs• CPU Utilization = Wait time / Processing time = 200 / 400 = ~50%
Processing~100µs ~100µs
Waiting~200 µs
Texas Memory Systems, Inc. - The World's Fastest Storage®
CPU State
1 I/O Request
12X Application benefit by only changing storage latency!
12X Application benefit by only changing storage latency!
© 2012 IBM Corporation37
Performance Scenario: Oracle RAC, 4 Nodes
Enterprise Array, No FlashEnterprise Array, No Flash RamSanRamSan
2 million queries12.25 minutes to complete
16K Total IOPS4K per RAC Node
[oracle]$ time ./spawn_50.sh
real 12m15.434suser 0m5.464ssys 0m4.031s
2 million queries12.25 minutes to complete
16K Total IOPS4K per RAC Node
[oracle]$ time ./spawn_50.sh
real 12m15.434suser 0m5.464ssys 0m4.031s
2 million queries1.3 minutes to complete
160K Total IOPS40K per RAC Node
[oracle]$ time ./spawn_50.sh
real 1m19.838suser 0m4.439ssys 0m3.215s
2 million queries1.3 minutes to complete
160K Total IOPS40K per RAC Node
[oracle]$ time ./spawn_50.sh
real 1m19.838suser 0m4.439ssys 0m3.215s
A factor of over 9x improvement!
© 2012 IBM Corporation38
Comparison- AWR
• Disk (13 ms per read):
• RamSan RamSan (<1 ms per read):
9-10X Improvement!9-10X Improvement!
9-10X More processing!9-10X More processing!
1/3 The time!1/3 The time!
© 2012 IBM Corporation40
DisclaimersThis information is provided on an "AS IS" basis without warranty of any kind, express or implied, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. Some jurisdictions do not allow disclaimers of express or implied warranties in certain transactions; therefore, this statement may not apply to you.
This information is provided for information purposes only as a high level overview of what we have found from various sources. There are no warranties, express or implied, regarding non-IBM products
Any information on possible future products is intended as a high level overview only. PRODUCT SPECIFICATIONS, ANNOUNCE DATES, AND OTHER INFORMATION CONTAINED HEREIN ARE SUBJECT TO CHANGE AND WITHDRAWAL WITHOUT NOTICE.
Important notes:
IBM reserves the right to change product specifications and offerings at any time without notice. This publication could include technical inaccuracies or typographical errors. References herein to IBM products and services do not imply that IBM intends to make them available in all countries.
IBM makes no warranties, express or implied, regarding non-IBM products and services, including but not limited to Year 2000 readiness and any implied warranties of merchantability and fitness for a particular purpose. IBM makes no representations or warranties with respect to non-IBM products. Warranty, service and support for non-IBM products is provided directly to you by the third party, not IBM.
All part numbers referenced in this publication are product part numbers and not service part numbers. Other part numbers in addition to those listed in this document may be required to support a specific device or function.
MHz / GHz only measures microprocessor internal clock speed; many factors may affect application performance. When referring to storage capacity, GB stands for one billion bytes; accessible capacity may be less. Maximum internal hard disk drive capacities assume the replacement of any standard hard disk drives and the population of all hard disk drive bays with the largest currently supported drives available from IBM.
IBM Information and Trademarks
The following terms are trademarks or registered trademarks of the IBM Corporation in the United States or other countries or both: the e-business logo, IBM, xSeries, pSeries, zSeries, iSeries.
Intel, Pentium 4 and Xeon are trademarks or registered trademarks of Intel Corporation. Microsoft Windows is a trademark or registered trademark of Microsoft Corporation. Linux is a registered trademark of Linus Torvalds. Other company, product, and service names may be trademarks or service marks of others.
IBM and IBM Business Partner Internal Use Only NOT to be distributed to customers or other third parties