18
Jim Harris Principal Software Engineer Data Center Group

Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Jim HarrisPrincipal Software EngineerData Center Group

Page 2: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Non-volatile memoryHyper-Convergence

Hyper-Scale Cloud

Page 3: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

3

2015 2016 2017 2018 2019 2020 2021 2022

Enterprise Server SAN Storage

Hyperscale Server SAN Storage

Traditional Enterprise Storage(SAN, NAS, DAS)

38 Billion

45 Billion

Traditional Enterprise Storage, Hyperscale Server SAN and Enterprise Server SAN Revenue

Projections 2015-2022†

†Source: ⒸWikibon Server SAN Research Project 2015, see Wikibon Premium “Server SAN 2012-2026”

“EMC* Declares 2016 The “Year of All-Flash” For Primary Storage”

“By 2020, EMC* estimates that all storage used for

production applications will be flash-based”

Source: http://www.emc.com/about/news/press/2016/20160229-04.htm

* Other names and brands may be claimed as the property of others

NVM is the Catalyst

Page 4: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Where does it fit?

4

Storage Performance Development Kit

Page 5: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

5

Development Effort

Core

Value-Add

Shared

Proprietary

Proprietary

FUNCTIONALITY

SPDKShared

Page 6: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

storage performance development kit• Open Source

• ComposableBuilding Blocks

http://spdk.io

• BSD Licensed

• Userspace and Polled Mode

Page 7: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

7

Efficiency

Simplicity

Flexibility

Page 8: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

8

SPDK HistoryAPR 2017: First SPDK Summit in U.S.

Sept 2015: nvme driver on github

jan 2016: first external contributor

2013: spdk starts as INTEL® internal project

jUN 2016: NVMe-oF* Target

Page 9: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

WHAT is SPDK?

Technology

Page 10: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Non volatile memory

Hyper-Convergence

Hyper-SCale cloudDISAGGREGATION: SPDK NVMe-oF*

VIRTUALIZATION: SPDK vhost

Page 11: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Architecture

Drivers

StorageServices

StorageProtocols

iSCSI Target

NVMe-oF*Target

SCSI

vhost-scsiTarget

NVMe

NVMe Devices

Blobstore

NVMe-oF*

Initiator

Intel® QuickDataTechnology Driver

Block Device Abstraction (BDEV)

Ceph RBD

Linux Async IO

Blob bdev

3rd Party

NVMe

NVMe*

PCIe Driver

Released

Q2’17

Pathfinding

vhost-blkTarget

Object

BlobFS

Integration

RocksDB

Ceph

Core

ApplicationFramework

Page 12: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

SPDK Look Forward: Technology• Blobstore Usage Models

• Accelerator Integration

• Usability

• Validation and Testing Frameworks

• Networking

Page 13: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

WHAT is SPDK?

Technology + Community

Page 14: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

SPDK Look Forward: community• Roadmaps

• Development Process

• Meetups

Page 15: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

WHAT is SPDK?

Technology + Community =

Innovation

Page 16: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk
Page 17: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk

Notices and DisclaimersIntel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Learn more at intel.com, or from the OEM or retailer.

No computer system can be absolutely secure.

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit http://www.intel.com/performance.

Intel, the Intel logo, Xeon, and others are trademarks of Intel Corporation in the U.S. and/or other countries.

*Other names and brands may be claimed as the property of others.

© 2017 Intel Corporation.

Page 18: Jim Harris Principal Software Engineer Data Center Group · 2018-07-16 · Ceph RBD Linux Async IO Blob bdev 3rd Party NVMe NVMe* PCIe Driver Released Q2’17 Pathfinding vhost-blk