20
Shingled Magnetic Recording (SMR) Panel: Data Management Techniques Examined Tom Coughlin Coughlin Associates

Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Shingled Magnetic Recording (SMR) Panel: Data Management Techniques Examined

Tom Coughlin Coughlin Associates

Page 2: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Introduction

SMR partially overwrites written tracks with new tracks

Creates an “erase” process in HDDs

Increase in Areal Density but increase in performance overhead too 2

2016 Storage Developer Conference. © Coughlin Associates. All Rights Reserved

Page 3: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Panel Participants

Damien Le Moal, Ph.D. Sr. Manager, System Software Group, HGST

Research, Western Digital Mark Carlson

Principal Engineer, Industry Standards, Toshiba Chair, SNIA Technical Council

James Borden Principal Cloud Architect, Seagate Technology

3

2016 Storage Developer Conference. © Coughlin Associates. All Rights Reserved

Page 4: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

How SMR is Implemented on HDDs

Damien Le Moal Western Digital

Page 5: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

What is Shingled Magnetic Recording?

5

Conventional PMR HDD

Data in Discrete Tracks

SMR HDD

Data in Zones of Overlapped Tracks

While Zones are independent, we can’t change sectors independently within a Zone.

Zone

SMR Standards

T10: ZBC

T13: ZAC

2016 Storage Developer Conference. © Western Digital. All Rights Reserved

Page 6: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Why SMR?

6

without SMR

with SMR

Time

HD

D C

apac

ity

Capacity Growth

SMR accelerates areal density growth

2016 Storage Developer Conference. © Western Digital. All Rights Reserved

Page 7: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Some Architectural Constructs

7

Caching Stage writes to sequentialize the

IOs. This can be done both on the

media or on Solid State Storage.

Indirection system Not a fixed mapping from LBA

to physical location Over provisioning

Need extra space for internal bookkeeping

Garbage Collection Need background process to

fix up the data-structures. Indirection system storage

Need special mechanism to maintain the indirection system.

Solid State NV Storage Emergency storage for

indirection system

2016 Storage Developer Conference. © Western Digital. All Rights Reserved

Page 8: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Drive Managed Model

8

Sequential Read Similar to PMR

Random Read Similar to PMR

Sequential Write Similar to PMR

Random Write YMMV

? 2016 Storage Developer Conference. © Western Digital. All Rights Reserved

Page 9: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Drive Managed Model: Random Write Small Block Large Block Huge Block

Hig

h D

uty

Cyc

le

Low

Dut

y C

ycle

Performance dominated by seek time. Caching writes on media and moving later has good performance.

Performance dominated by seek time. Caching writes on media and moving later has good performance.

Behaves close to sequential writes.

Behaves close to sequential writes.

Seek time no longer dominates. Writing twice has overhead. Low duty cycle allows drive to hide overhead.

Seek time no longer dominates. Writing twice has overhead. High duty cycle fills up cache quickly and doesn’t allow time for recovery.

9

2016 Storage Developer Conference. © Western Digital. All Rights Reserved

Page 10: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

SMR Management Models and Standards

Mark Carlson Toshiba

SNIA Technical Council

Page 11: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

SMR Management Models

Hide the complexity of SMR from host software Drive Managed model – performance impact

Allow the host software to manage the SMR complexity Host Managed Model – best performance, but

all new software Something in between Host Aware Model

11

2016 Storage Developer Conference. © Toshiba. All Rights Reserved

Page 12: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

SMR Standards

For Serial ATA (SATA) ZAC – Zoned ATA Commands

For Serial Attached SCSI (SAS) ZBC – Zoned Block Commands

Two primary commands Report Zones – discover zone configuration and

write pointers Reset Write Pointer – reset the write pointer the

beginning of zone (destructive to zone contents)

12

2016 Storage Developer Conference. © Toshiba. All Rights Reserved

Page 13: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Writing to a Zoned Device

Additional commands: Open Zone – nail down resources for a zone Close Zone – free up those resources Finish Zone – fill out the remaining space

Proposed simplification Allow Report Zones even in a Drive

Managed model

13

2016 Storage Developer Conference. © Toshiba. All Rights Reserved

Page 14: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

SMR Standards Future

T13 working on ZAC-2 T10 working on ZBC-2 Infrastructure software changes are now being

put in place Hyperscalers building into their infrastructure OS and Hypervisor software being updated

Developers still needed to implement changes

14

2016 Storage Developer Conference. © Toshiba. All Rights Reserved

Page 15: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Host Implementation Considerations with SMR

Seagate Technology

Page 16: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Primary Host Issue: Non-Sequential Writes

File modifications via appends are a primary example (write in place) - does not conform to ZAC/ZBC

Host workloads would need to become copy-on-write for modifications and discard/trim old data

Several Implementation approaches:

16

2016 Storage Developer Conference. © Seagate Technology. All Rights Reserved

Page 17: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Full Stack Solution

For customers who can develop/adopt ZAC/ZBC compliant stacks… Strict latency sensitivity: Host-managed SMR

and fully compliant stack. Less strict latency sensitivity and/or not fully

compliant stack: SMR Host-aware

17

2016 Storage Developer Conference. © Seagate Technology. All Rights Reserved

Page 18: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Emulation / Shim: Sequentializer (STL)

Translation layer akin to FTL that sits below the file system

Manages LBA remapping and supports metadata storage and searches, as well as garbage collection

Possible workload dependent performance implications, but majority of the I/O stack will not need to change

Open Source prototype example for Linux https://github.com/Seagate/ZDM-Device-Mapper

18

2016 Storage Developer Conference. © Seagate Technology. All Rights Reserved

Page 19: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

Emulation / Shim: Caching

Use part of the drive (conventional space) for a “random” cache to clean later

Garbage collection and metadata tracking/searching required, similar to sequentializer

Different performance tradeoffs than sequentializer

19

2016 Storage Developer Conference. © Seagate Technology. All Rights Reserved

Page 20: Shingled Magnetic Recording (SMR) Panel: Data Management … · 2019. 12. 21. · seek time. Caching writes on media and moving later has good performance. Behaves close to sequential

2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.

SMR Market Considerations

SMR is and will be an enabler for higher HDD areal density (with TDMR, HAMR, etc.)

Drive-managed SMR is a good solution in low latency implementations (e.g., backup, video surveillance)

Host-aware and Host-managed implementations are currently most applicable and active in Enterprise and Cloud Segments (greatest ability to drive stack changes)

Appropriate use-case implementation of SMR should be able to deliver performance similar to CMR HDDs

Market adoption is positioned for a consistent, steady ramp, with initial growth in hyperscale followed by enterprise customers

20

2016 Storage Developer Conference. © Seagate Technology. All Rights Reserved