View
922
Download
3
Category
Preview:
Citation preview
RED HAT CEPH STORAGE UPDATE
Neil Levine Red Hat October 2016
SECTIONS
RED HAT STORAGE
1.3 REVIEW
2.0 FEATURES
FUTURE
1
2
3
4
RED HAT STORAGE
4
THE RED HAT STORAGE PORTFOLIO
Gluster management
Ceph data service Gluster data service
Ceph management
OP
EN
SO
UR
CE
SO
FTW
AR
E
STA
ND
AR
D
HA
RD
WA
RE
Share-nothing, scale-out architecture provides durability and adapts to changing demands
Self-managing and self-healing features reduce operational overhead
Standards-based interfaces and full APIs ease integration with applications and systems
Supported by the experts at Red Hat
5
HOW STORAGE FITS
PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD
RED HAT CEPH STORAGE
RBD A reliable, fully distributed block device
with cloud platform integration
RGW A web services gateway for object
storage, compatible with S3 and Swift
APP HOST/VM
LIBRADOS A library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby
RADOS A software-based reliable, autonomous, distributed object store comprised of self-
healing, self-managing, intelligent storage nodes and lightweight monitors
CEPHFS* A distributed file system with POSIX
semantics & scale-out metadata
CLIENT
* CephFS is Tech Preview in RHCS2 7
CEPH ARCHITECTURE
8
RED HAT CEPH STORAGE 1.3
June 2015 1.3.0
Robustness at Scale
Operational Efficiency
Performance
Improvements
Nov 2015 1.3.1
Sept 2016 1.3.3
Satellite 6 support
Update to latest version of Hammer
March 2016 1.3.2
Satellite 5 Support
SELinux
3x small write boost on SSD
9
OPENSTACK USER SURVEY Which OpenStack Block Storage (Cinder) drivers are in use?
SOURCE: OpenStack User Survey, April 2016
62%
22%
12%
10%
9%
6%
5%
4%
3%
3%
2%
2%
7%
10
HYPER-CONVERGED OPENSTACK
HCI NODE 1
Lower TCA & TCO
Fewer SKUs
Resource Management
Easy migration to 2-tier HCI NODE 2
Ceph OSD Ceph OSD
Admin Node
Nova Compute Nova Compute
HCI NODE 3
Ceph OSD
Nova Compute
Controller 1 Controller 2
Ceph MON Ceph MON
OSP Services OSP Services
Controller 3
Ceph MON
OSP Services
2.0
12
RED HAT CEPH STORAGE 2 THEMES
USABILITY OBJECT IMPROVEMENTS PERFORMANCE
13
USABILITY: RED HAT STORAGE CONSOLE
An easy to use interface for managing cluster lifecycles • Ansible-based deployment tools
for driving granular configuration options from CLI or GUI
• Monitoring and graphs for troubleshooting with statistical information about components
14
OBJECT STORAGE IMPROVEMENTS
Global object storage clusters with a single namespace • Enables deployment of clusters
across multiple geographic locations
• Clusters synchronize, allowing users to read from or write to the closest one
• Ideal for follow-the-sun, CDN or Disaster Recovery
STORAGE CLUSTER US-EAST STORAGE CLUSTER
US-WEST
15
OBJECT STORAGE IMPROVEMENTS
Support for authentication using Active Directory, LDAP & OpenStack Keystone v3
Greater compatibility with the Amazon S3 and OpenStack Swift object storage APIs
• AWS v4 signatures, object versioning, bulk deletes
New NFS gateway for import and export of object data (tech preview)
16
PERFORMANCE: BLUESTORE (TECH PREVIEW)
BlueStore is a new Ceph storage backend optimized for modern media • Replaces FileStore, which was designed
for HDDs
• Supports flexible media topologies (flash, K/V drives, persistent memory)
• Eliminates the need for an underlying filesystem or dedicated journal device
• Provides a 2-3X performance boost
17
OPENSTACK: RBD MIRRORING
Multi-site replication for block devices (RBD Mirroring) • Replicates virtual block devices
across regions
• Designed for disaster recovery and archival
• Integration with Cinder Volume Replication (OSP-10)
STORAGE CLUSTER US-EAST STORAGE CLUSTER
US-WEST
18
OPENSTACK: CEPHFS (TECH PREVIEW)
CephFS is a POSIX-compliant file system for use with OpenStack Manila • Support for FUSE or kernel clients (RHEL 7.2)
• Approach: robustness, hardening, then scalability
Nov 2015 Manila tech preview
in OSP7
Aug 2016 CephFS tech preview in
RHCS2/clients
Aug 2016 CephFS Manila tech
preview in OSP9
Nov 2016 Manila production support in OSP10
2017 CephFS production
support
INTERNAL USE ONLY
FUTURE
20
FUTURE
2.1 (Nov 2016) 1
21
FUTURE
2.1 (Nov 2016)
Ceph for Data Lakes and Analytics
1
2
22
FUTURE
2.1 (Nov 2016)
Ceph for Data Lakes and Analytics
Testing at scale
1
2
3
23
FUTURE
2.1 (Nov 2016)
Ceph for Data Lakes and Analytics
Testing at scale
3.0
1
2
3
4
24
FUTURE
2.1 (Nov 2016)
Ceph for Data Lakes and Analytics
Testing at scale
3.0
Containerized Ceph & Containerized OpenStack
1
2
3
4
5
THANKS!
@neilwlevine https://redhat.com/storage
CORE • Bluestore (tech preview) • Performance optimizations
26
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
CORE • Bluestore (tech preview) • Performance optimizations
27
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
CORE • Bluestore (tech preview) • Performance optimizations
28
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
BLOCK • iSCSI for Windows & RHEL
CORE • Bluestore (tech preview) • Performance optimizations
29
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
BLOCK • iSCSI for Windows & RHEL
UPSTREAM ACTIVITY (in the future)
OBJECT • Metadata search • Tiering to the public cloud • Object-level encryption • Compression
CORE • Bluestore (tech preview) • Performance optimizations
30
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
BLOCK • iSCSI for Windows & RHEL
UPSTREAM ACTIVITY (in the future)
OBJECT • Metadata search • Tiering to the public cloud • Object-level encryption • Compression
BLOCK • Erasure coding support • Persistent client-side cache • Improved iSCSI support
CORE • Bluestore (tech preview) • Performance optimizations
CORE • Bluestore General Availability • Data checksums • Integrated key management • Improved multi-threading
31
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
BLOCK • iSCSI for Windows & RHEL
UPSTREAM ACTIVITY (in the future)
OBJECT • Metadata search • Tiering to the public cloud • Object-level encryption • Compression
BLOCK • Erasure coding support • Persistent client-side cache • Improved iSCSI support
CORE • Bluestore (tech preview) • Performance optimizations
CORE • Bluestore General Availability • Data checksums • Integrated key management • Improved multi-threading
32
ROADMAP SUMMARY RED HAT CEPH STORAGE 2 (today)
Ceph Jewel
MANAGEMENT • Red Hat Storage Console 2 • Lifecycle management • Ansible support
OBJECT • Support for global clusters • AD, LDAP, Keystone v3 • Expanded API compatibility • NFS gateway (tech preview)
BLOCK • Volume Mirroring for DR
RED HAT CEPH STORAGE 2.1 (Q4 2016)
OBJECT • Static Websites • Indexless Buckets • Payer Request • Swift Refcore Compliance
BLOCK • iSCSI for Windows & RHEL
UPSTREAM ACTIVITY (in the future)
FILE • Active/active metadata servers • Snapshots • Hypervisor integration
OBJECT • Metadata search • Tiering to the public cloud • Object-level encryption • Compression
BLOCK • Erasure coding support • Persistent client-side cache • Improved iSCSI support
Recommended