9
Tony Afshary – October 2015 Seagate implementation of dense storage utilizing HDDs and SSDs

Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Embed Size (px)

Citation preview

Page 1: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Tony Afshary – October 2015

Seagate implementation of dense storage utilizing HDDs and SSDs

Page 2: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 2 Sources: Reinsel, David. “Where in the World Is Storage: A Look at Byte Density Across the Globe” IDC October 2013, IDC/EMC Digital Universe, April 2014 + Seagate Estimates and Marketing & Research

Demand GROWING at Exponential RATE

Bigger Different $-Constrained

Created

Location SHIFTING dramatically to the CLOUD

Stored

Capacity

Data Center System Spend

Stable but SLOW growth

Data is… Big Data is Bigger than MORE Data

Page 3: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential

SYSTEMS

DEVICES

ARRAYS

Seagate is Evolving to Address Trends

Converged Infrastructure High Performance Storage

Hybrid Data Systems

Software-defined Storage

Flash Arrays

NAND PCIe Traditional Enterprise

NAND SAS Hyperscale

Desktop Notebook / Tablet

Branded NAND SATA Hybrid Kinetic

Still Growing

Expanded Offerings

Started with Our Core Products

The Intelligent Information Infrastructure

Flash Controllers

Page 4: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 4

Seagate Enterprise Device Portfolio H

ighe

st P

erfo

rman

ce/$

Highest GB/$ Supported by end-to-end silicon capabilities across Flash and HDDs; >1 Billion ARM CPUs shipped

Silicon technology/IP spans Flash and HDD Portfolio across PCIe, SAS and SATA

Archival HDDs Capacity

HDDs

Performance HDDs

with TurboBoost™ Flash Caching

Nytro® PCIe Flash

Accelerators with SandForce®

Technology

SAS SSDs

Mar

kets

Hyperscale

Traditional-IT

HPC

Mission-Critical/Compute Business-Critical/Near-Line

Archival

JBODs Storage Arrays

Servers

Latency

Density

Thermal

Service

PCIe M.2, 2.5

SAS 2.5, 1.8

15K/10K 2.5

NL 2.5 NL/Value 3.5

Kinetic 3.5 Archive 3.5

Perf. 3.5

Nytro PCIe SSDs

Page 5: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 5

Next generation storage deployment:

Page 6: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 6

Ceph Deployment Object Storage Daemons (OSDs): • 10s to 10000s of OSDs in a cluster • One per disk or SSD • Serves stored objects to clients • Intelligently peers to perform replication

and recovery tasks • Support for erasure encoding of objects • Support for strong consistency leveraging

write journals

DISK

FS

DISK DISK

OSD

DISK DISK

OSD OSD OSD OSD

FS FS FS FS btrfs xfs ext4

M M M

Advanced Storage: • Shingled Magnetic Recording (SMR)

Drives (drive managed) • Excellent density, cost, read performance,

and sequential write streaming. • Poor random write performance.

• PCIe Flash • Excellent performance, in server integration • Poor cost per GB.

Page 7: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 7

Featuring: Nytro XP6302 flash accelerator

card Nytro XD—tuned caching SW 12x 8TB SMR HDDs

Benefits Accelerate Ceph journals and Metadata

with flash

By moving this data onto flash, cost-effective SMR drives are well-suited for extremely dense object storage systems reducing storage costs by 25%.

Nearly triples Ceph object storage performance

Storage component deployment in Ceph Video recording of a live demo hosted at UTSA

Page 8: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Ceph RADOS Benchmarks • SMR only vs. • SMR with Journals on SSD vs. • SMR Cache Tier vs. • SMR Caching With Nytro XD

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

MB/s 2.53 2.56 5.9 28.19

05

1015202530

MB

/s

4K Writes – 16 Threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

Latency/s 0.0246 0.024 0.01 0.0022

00.005

0.010.015

0.020.025

0.03

Seco

nds

4K Writes – 16 Threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

MB/s 135.532 194.556 590.4 777.05

0200400600800

1000

MB

/s

4M writes - 16 threads

SMR only SMR withSSD

SMR CacheTier

SMR withNytro XD

Latency/s 0.471 0.328 0.108 0.082

00.10.20.30.40.5

Seco

nds

4M writes - 16 threads

Page 9: Seagate Implementation of Dense Storage Utilizing HDDs and SSDs

Seagate Confidential 9

Scaled-Up Hardware Configuration Fully Populated Open Rack:

• 18 Winterfell Servers • 33.5 TBs of Flash

• 2.2 PBs of SMR Storage