37

OpenZFS dotScale

Embed Size (px)

DESCRIPTION

Matt Ahrens talks about OpenZFS and cloud storage

Citation preview

Page 2: OpenZFS dotScale
Page 3: OpenZFS dotScale

●○

●●●●

Page 4: OpenZFS dotScale

●●●●●

Page 5: OpenZFS dotScale
Page 6: OpenZFS dotScale
Page 7: OpenZFS dotScale
Page 8: OpenZFS dotScale
Page 9: OpenZFS dotScale
Page 10: OpenZFS dotScale

●○○

Page 11: OpenZFS dotScale

●○○

●○

Page 12: OpenZFS dotScale

●○○

●○

●○

Page 13: OpenZFS dotScale

●○○

●○

●○

●○

Page 14: OpenZFS dotScale

NFS SMB Local files

VFS

Filesystem(e.g. FFS, ext)

Volume Manager(e.g. LVM, SVM)

NFS SMB Local files

VFS

DMU(Data Management Unit)

SPA(Storage Pool Allocator)

iSCSI FC

SCSI target(e.g. COMSTAR)

ZPL(ZFS POSIX Layer)

ZVOL(ZFS Volume)

File interface

Block i/f

ZFSBlock allocate+write, read, free

Atomic transactions on objects

Page 15: OpenZFS dotScale

●●●

Page 16: OpenZFS dotScale

Hypervisor

VM A VM B

A A’ B B’

Page 17: OpenZFS dotScale

Hypervisor

VM A VM B

A A’ B B’ B’’

Page 18: OpenZFS dotScale

Hypervisor

VM A VM B

A A’ B B’

Page 19: OpenZFS dotScale

Hypervisor

VM A VM B

A A’ B

B’’

B’

Hypervisor

VM B

Page 21: OpenZFS dotScale
Page 22: OpenZFS dotScale

A1B1C1D1

E1F1G1H1

I1J1K1L1

Hypervisor

VM C VM D

VM A VM B

A2B2C2D2

E2F2G2H2

I2J2K2L2

Hypervisor

VM G VM H

VM E VM F

A3B3C3D3

E3F3G3H3

I3J3K3L3

Hypervisor

VM K VM L

VM I VM J

Page 23: OpenZFS dotScale

A1B1C1D1

E1F1G1H1

I1J1K1L1

Hypervisor

VM C VM D

VM A VM B

A2B2C2D2

E2F2G2H2

I2J2K2L2

Hypervisor

VM G VM H

VM E VM F

Hypervisor

VM K VM L

VM I VM J

A3B3C3D3

E3F3G3H3

I3J3K3L3

Page 24: OpenZFS dotScale

A1B1C1D1

E1F1G1H1

I1J1K1L1

Hypervisor

VM C VM D

VM A VM B

A2B2C2D2

E2F2G2H2

I2J2K2L2

Hypervisor

VM G VM H

VM E VM F

Hypervisor

VM K VM L

VM I VM J

A3B3C3D3

E3F3G3H3

I3J3K3L3

Page 25: OpenZFS dotScale
Page 26: OpenZFS dotScale

Networking speedsup by <10,000x in 30 years

1986: 10Base2 (thin ethernet) standardized

2012: 40Gbit/sec commercially available

Page 27: OpenZFS dotScale

Vast increase in amount of storage: $/GB down by >1,000,000x in 30 years

1984: <10KB/$2014: >10,000,000KB/$

source: http://www.mkomo.com/cost-per-gigabyte-update

Page 28: OpenZFS dotScale

AB

C D

Hypervisor

VM C VM D

VM A VM B

E FG

H

Hypervisor

VM G VM H

VM E VM F

Page 29: OpenZFS dotScale

AB

C D

Hypervisor

VM C VM D

VM B

E FG

HA’

Hypervisor

VM G VM H

VM E VM F

VM A

VM A

Page 30: OpenZFS dotScale

AB

C D

Hypervisor

VM C Ctr D

VM A Ctr B

E FG

H

Hypervisor

VM G Ctr H

VM E Ctr F Lightweight containers (e.g. zones, jails, LXC)Virtual machines

Page 32: OpenZFS dotScale

Page 34: OpenZFS dotScale

OpenZFS

Linux FreeBSD illumosMac OS X

illumos

Linux FreeBSD

Mac OS X

Current

End Goal

Page 35: OpenZFS dotScale
Page 36: OpenZFS dotScale

●○

●○

●○○○