20
Ceph Status && Community Update Ceph Day Berlin 2015

Ceph Day Berlin: Community Update

Embed Size (px)

Citation preview

Page 1: Ceph Day Berlin:  Community Update

Ceph Status && Community Update

Ceph Day Berlin 2015

Page 2: Ceph Day Berlin:  Community Update

COMMUNITY

DEV

Hammer

Modules

Orchestration / Deployment

Release Cycle

QUESTIONS

AGENDA

2

Page 3: Ceph Day Berlin:  Community Update

COMMUNITY

Page 4: Ceph Day Berlin:  Community Update

Focused on being non-disruptive

RHEL / Fedora / CentOS coverage

Maintaining Ubuntu / SUSE coverage

Co-Existing with Gluster

Bi-directional learning is fun!

LIVING IN A POST-ACQUISITION

WORLD

4

Page 5: Ceph Day Berlin:  Community Update

CEPH DAYS

You’re here!

Turning up the heat

100% Community-focused

Upcoming

Beijing

Bay Area

Los Angeles

Chicago

Autstin

Melbourne

5

Page 6: Ceph Day Berlin:  Community Update

Hosted by Intel in Hillsboro, OR

10-13 Aug

<25 people

Real work!

Performance (Mark Nelson)

RBD focus

RGW features and integration

Spread the word!

Email [email protected]

Copyright © 2013 by Inktank | Private and Confidential

Ceph Hackathon

6

Page 7: Ceph Day Berlin:  Community Update

METRICS

7

Bitergia Platform

New Quarterly View

Community-driven

Good growth

Code/Tracker/IRC/Lists

Continuing to evolve

Page 8: Ceph Day Berlin:  Community Update

USER COMMITTEE

8

Started after Dumpling

Current chair: Eric Mourgaya

Periodic meetings to discuss community matters

Most recently:

Release cadence

Contributor credits

Meetups

RADOS Gateway use cases

Discuss upcoming work

First steps towards broader governance

Page 9: Ceph Day Berlin:  Community Update

Google Summer of Code

9

Ceph project’s second year

6 slots, used 4

Last year

Wireshark

Reliability Model

Work published on Ceph wiki

Outreachy too

Get involved!

Page 10: Ceph Day Berlin:  Community Update

CentOS Storage SIG

10

Creating a collection of packages

http://wiki.centos.org/SpecialIntere

stGroup/Storage/Proposal

Easier to deploy CentOS as a

storage node

Early days

Packages for Ceph & Gluster

Get involved!

Page 11: Ceph Day Berlin:  Community Update

GOVERNANCE

11

We haven’t forgotten about you!

Page 12: Ceph Day Berlin:  Community Update

CEPH DEVELOPER SUMMIT

12

Quarterly developer summit

100% online (Blue Jeans / IRC)

Infernalis summit just completed

Videos on Ceph YouTube

channel

Next up: “J”

Page 13: Ceph Day Berlin:  Community Update

DEVELOPMENT

Page 14: Ceph Day Berlin:  Community Update

HAMMER STATUS

14

Released 13 Apr 2015

Major Features:

cephfs: journal scavenger repair tool (John Spray)

crush: new and improved straw2 bucket type (Sage Weil, Christina Anderson, Xiaoxi Chen)

doc: improved guidance for CephFS early adopters (John Spray)

librbd: add per-image object map for improved performance (Jason Dillaman)

librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen, Cheng Cheng)

librados: fadvise-style IO hints (Jianpeng Ma)

mds: many many snapshot-related fixes (Yan, Zheng)

mon: new ‘ceph osd df’ command (Mykola Golub)

mon: new ‘ceph pg ls …’ command (Xinxin Shu)

osd: improved performance for high-performance backends

osd: improved recovery behavior (Samuel Just)

osd: improved cache tier behavior with reads (ZhiqiangWang)

rgw: S3-compatible bucket versioning support (Yehuda Sadeh)

rgw: large bucket index sharding (Guang Yang, Yehuda Sadeh)

RDMA “xio” messenger support (Matt Benjamin, Vu Pham)

Page 15: Ceph Day Berlin:  Community Update

CephFS

15

Lots of hard work!

Dogfooding

Code

Src/mds: 366 commits, 19,417 lines added/removed

Src/client: 131 commits, 4289 lines

Src/tools/cephfs: 41 commits, 4179 lines

Ceph-qa-suite: 4842 added lines of FS-related python

Tracker

108 FS tickets resolved since Firefly (of which 97 were created

since Firefly)

83 ticket currently open for FS, of which 35 were created since

Firefly

31 feature tickets resolved

Page 16: Ceph Day Berlin:  Community Update

librados

16

Many more deployments/apps using direct librados

Native library for accessing RADOS

Librados.so shared library

C, C++, Python, Erlang, Haskell, PHP, Java (JNA)

Direct data path to storage nodes

Speaks native Ceph protocol with cluster

Exposes

Mutable objects

Rich per-object API and data model

Hides

Data distribution, migration, replication, failures

Page 17: Ceph Day Berlin:  Community Update

Making your intelligent nodes, intelligent-er!

Allows you to dynamically extend objects in RADOS

Examples

MD5 hash

Image thumbnail service

Log post-processing

Whatever you build!

Uses LUA

Ask Noah!

Copyright © 2013 by Inktank | Private and Confidential

Object Classes

17

Page 18: Ceph Day Berlin:  Community Update

DEPLOYMENT / ORCHESTRATION

18

Ceph-deploy in a good place

Chef / Puppet / Ansible / Salt / Juju

Docker is the up-and-comer

Ask Chris!

Page 19: Ceph Day Berlin:  Community Update

RELEASE CYCLE COMMS

19

Increased communication requested (user committee)

Alternating releases (ex: emperor vs firefly)

Product vs upstream church and state

Page 20: Ceph Day Berlin:  Community Update

THANK YOU!

Patrick McGarryDir Ceph Community

pmcgarry@

redhat.com

@scuttlemonkey