84
Storage with Ceph Scale-Out made easy Martin Gerhard Loschwitz © 2013 hastexo Professional Services GmbH. All rights reserved.

Storage with Ceph (OSDC 2013)

  • Upload
    hastexo

  • View
    1.077

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Storage with Ceph (OSDC 2013)

Storage with CephScale-Out made easy

Martin Gerhard Loschwitz

© 2013 hastexo Professional Services GmbH. All rights reserved.

Page 2: Storage with Ceph (OSDC 2013)

Who?

Page 3: Storage with Ceph (OSDC 2013)
Page 4: Storage with Ceph (OSDC 2013)
Page 5: Storage with Ceph (OSDC 2013)
Page 6: Storage with Ceph (OSDC 2013)
Page 7: Storage with Ceph (OSDC 2013)
Page 8: Storage with Ceph (OSDC 2013)
Page 9: Storage with Ceph (OSDC 2013)
Page 10: Storage with Ceph (OSDC 2013)
Page 11: Storage with Ceph (OSDC 2013)
Page 12: Storage with Ceph (OSDC 2013)

Scalable Storage

Page 13: Storage with Ceph (OSDC 2013)

2 types of Scalability

Page 14: Storage with Ceph (OSDC 2013)

Scale-Up

Page 15: Storage with Ceph (OSDC 2013)

Scale-Up before:

Page 16: Storage with Ceph (OSDC 2013)

Scale-Up afterwards:

Page 17: Storage with Ceph (OSDC 2013)

Scale-Up quickly comes to its limits

Page 18: Storage with Ceph (OSDC 2013)

Scale-Out

Page 19: Storage with Ceph (OSDC 2013)

Scale-Out before:

Page 20: Storage with Ceph (OSDC 2013)

Scale-Out afterwards:

Page 21: Storage with Ceph (OSDC 2013)

Scale-Out is hip

Page 22: Storage with Ceph (OSDC 2013)

Webserver

Page 23: Storage with Ceph (OSDC 2013)

Databases

Page 24: Storage with Ceph (OSDC 2013)

Even me!

Page 25: Storage with Ceph (OSDC 2013)

Storage? Meh.

Page 26: Storage with Ceph (OSDC 2013)

The Block problem

Page 27: Storage with Ceph (OSDC 2013)

HDDFS

User Space

Page 28: Storage with Ceph (OSDC 2013)

Blocks for distributed systems?

Page 29: Storage with Ceph (OSDC 2013)

I don’t think so, Tim!

Page 30: Storage with Ceph (OSDC 2013)

Object Stores

Page 31: Storage with Ceph (OSDC 2013)
Page 32: Storage with Ceph (OSDC 2013)

User Space

Objects

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

Page 33: Storage with Ceph (OSDC 2013)

User Space

Objects

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

HDD

FS

Page 34: Storage with Ceph (OSDC 2013)
Page 35: Storage with Ceph (OSDC 2013)

Originally a PhD thesis

Page 36: Storage with Ceph (OSDC 2013)
Page 37: Storage with Ceph (OSDC 2013)

Object Store

Page 38: Storage with Ceph (OSDC 2013)

RADOS

Page 39: Storage with Ceph (OSDC 2013)

RedundantAutonomicDistributedObjectStore

Page 40: Storage with Ceph (OSDC 2013)

2 Components

Page 41: Storage with Ceph (OSDC 2013)

OSDs

Page 42: Storage with Ceph (OSDC 2013)

MONs

Page 43: Storage with Ceph (OSDC 2013)

Data Placement

Page 44: Storage with Ceph (OSDC 2013)
Page 45: Storage with Ceph (OSDC 2013)

MONs

Page 46: Storage with Ceph (OSDC 2013)

MONs

Page 47: Storage with Ceph (OSDC 2013)

MONs

Page 48: Storage with Ceph (OSDC 2013)

MONs

Page 49: Storage with Ceph (OSDC 2013)

MONs

Page 50: Storage with Ceph (OSDC 2013)

MONs

Page 51: Storage with Ceph (OSDC 2013)

MONs

Page 52: Storage with Ceph (OSDC 2013)

Parallelization

Page 53: Storage with Ceph (OSDC 2013)

221 1

MONs

Page 54: Storage with Ceph (OSDC 2013)

221 1

MONs

Page 55: Storage with Ceph (OSDC 2013)

221 11 2 21

MONs

Page 56: Storage with Ceph (OSDC 2013)

MONs

Page 57: Storage with Ceph (OSDC 2013)

CRUSH

Page 58: Storage with Ceph (OSDC 2013)

ControlledReplicationUnderScalableHashing

Page 59: Storage with Ceph (OSDC 2013)

Rack aware

Page 60: Storage with Ceph (OSDC 2013)

Clients?

Page 61: Storage with Ceph (OSDC 2013)

Block Device Driver

Page 62: Storage with Ceph (OSDC 2013)

RBD (RADOS Block Device)

Page 63: Storage with Ceph (OSDC 2013)

rbd

Page 64: Storage with Ceph (OSDC 2013)

Qemu-RBD

Page 65: Storage with Ceph (OSDC 2013)
Page 66: Storage with Ceph (OSDC 2013)

ReSTful API

Page 67: Storage with Ceph (OSDC 2013)

radosgw

Page 68: Storage with Ceph (OSDC 2013)

Compatible with S3 and Swift

Page 69: Storage with Ceph (OSDC 2013)

POSIX file system

Page 70: Storage with Ceph (OSDC 2013)

CephFS

Page 71: Storage with Ceph (OSDC 2013)

Still Beta!

Page 72: Storage with Ceph (OSDC 2013)

Need a special client?

Page 73: Storage with Ceph (OSDC 2013)

librados

Page 74: Storage with Ceph (OSDC 2013)

Use cases

Page 75: Storage with Ceph (OSDC 2013)

Gigantic Storage

Page 76: Storage with Ceph (OSDC 2013)

40TB, 3 replicas = € 21.000

Page 77: Storage with Ceph (OSDC 2013)

Virtualization

Page 78: Storage with Ceph (OSDC 2013)

iSCSI Storage

Page 79: Storage with Ceph (OSDC 2013)

Cloud

Page 80: Storage with Ceph (OSDC 2013)

OpenStack

Page 81: Storage with Ceph (OSDC 2013)

live demo

Page 82: Storage with Ceph (OSDC 2013)

24. May 2013

OpenStack DACH Day 2013

http://openstackdach2013.eventbrite.com

Page 83: Storage with Ceph (OSDC 2013)

Special thanks goes to:

Sage Weil (Twitter: @liewegas)& crew for Ceph

Inktank (Twitter: @inktank)for the Ceph logo

Page 84: Storage with Ceph (OSDC 2013)

goo.gl/S1sYZ (me on Google+)

twitter.com/hastexo

hastexo.com

221 11 2 21

MONS