OpenStack in Action 4! Serge Frezefond - Database Clusters as a Service in OpenStack: Integrated, Scalable, Highly Available and Secure

OpenStack in Action 4 ! - Paris - 5th December 2013 Serge Frezefond .

Serge Frezefond @sfrezefond

Database Cluster as a Service in OpenStack

Integrated, Scalable, Highly Available and Secure

OpenStack in Action 4 ! - Paris - 5th December 2013 Serge Frezefond

SkySQL • Leading provider of open source databases, services and solu=ons • Home for the founders and the original developers of the core of MySQL • The creators of MariaDB, the drop-‐in, innova=ve replacement of MySQL


MySQL/MariaDB in the Cloud


MySQL/MariaDB High Availability • MySQL Replica=on with MHA and Pacemaker • MariaDB Galera Cluster Synchronous Replica=on with Codership Galera • Support from SkySQL for: • DRBD • Shared storage

4


MySQL /MariaDB Scalability • In MariaDB 5.5: • XtraDB 5.5 • Group commit • MySQL Replica=on for read scalability • TokuDB and ScaleDB engine

• Plus, in MariaDB 10: • XtraDB 5.6 with Improved InnoDB scalability • Parallel and mul=-‐source replica=on • CONNECT, Spider and Cassandra engine

• MariaDB Galera Cluster for synchronous replica=on • MySQL Cluster for high volume/small transac=ons

5


MySQL / MariaDB Ease of Use • MHA

• Xtrabackup • MariaDB Manager

• Enterprise Monitor

• Query Editor • MySQL U=li=es

• Percona Toolkit • MySQL Workbench

• Percona Nagios and Cac= plugins 6


MySQL in Rackspace

• Rackspace Cloud Database • MySQL Community 5.1 • Up to 16GB RAM, 150GB storage

• Standard Servers • Up to 8 vCPUs, 30GB RAM, 1.2TB storage • BYODBMS

7


MySQL in HPCloud

• Manage a single DB instance through the REST API

• Standard Servers • Up to 8 vCPUs, 30GB RAM, 960GB storage • BYODBMS

• Marketplace • GenieDB • MariaDB ScaleDB

8


MySQL in AWS • Amazon RDS • MySQL Community 5.1, 5.5 & 5.6 • Reserved instances, provisioned IO and Flash storage • 32 vCPUs, 244GB Memory, 10GB network

• Automa=c backups, Storage replica=on, MySQL Replica=on • Limited tuning

• Standard Servers and Marketplace • Similar instances • MariaDB on CentOS, Debian and Ubuntu • GenieDB

9


MySQL in Google Cloud

• MySQL in Google Cloud SQL

• Google compute (GA)

• Google App Engine

10


MySQL and OpenStack


MySQL in OpenStack

• Used as repository -‐ alterna=ve to SQLite • Increased portability and availability

• High Availability is the key factor: • MySQL Replica=on • DRBD • Galera

12


MySQL Replica=on

13

Node Manager

HA Manager

Control Network Compute


DRBD

14



Galera Cluster

15



MySQL as a Service


Automa=c Provisioning

• REST-‐based for interopera=on • GUI-‐assisted for end-‐users • From server to cluster

17


The false promise of the elas=city

• Distributed MySQL is not something you can have out of the box • Or not for all your applica=ons

18

Read-Write Read-Only Read-Only

binlog

relaylog relaylog relaylog relaylog


DBaaS vs PaaS

19

vs.


Storage

• Backups on Swic • Full or incremental

• Moving tablespaces in Cinder • For high availability • For backups and archiving • For maintenance

20

in01 in02 in03 in04 in05


Networking

• Mul=ple NICs and floa=ng IPs

• Public IPs • Local proxies vs enhanced connectors

21


Security

• LDAP & Keystone • Integra=on with MySQL • LDAP / OpenLDAP • MySQL Security Plugin using OpenLDAP

22

Keystone

LDAP


MariaDB Cluster in OpenStack


What’s new with MariaDB

24

MariaDB Manager MariaDB Cluster

MariaDB Server(s)

MHA Galera GUI

API

Monitor

MaxScale Configuration & Provisioning


SkySQL MaxScale

25

MaxScale Core

Data Stores

Client Applications

Backend Backend Backend

Frontend Frontend Frontend Frontend Frontend Clie

nt C

lient

Clie

nt C

lient

Clie

nt

Router Router Router

Monitor Monitor

Auth Auth Auth

Service Service Service

Listener Listener Listener Listener

Server Server Server Server Server


Introducing MariaDB Manager

26


MariaDB Galera Cluster -‐ State

27


Provision a new node

28

HTTP POST method -‐ Create a node

URI: • .../resfulapi/system/systemid/node

• Parameters: • name • hostname • publicip, privateip, port •  instanceid • dbusername, dbpassword •  ...

1



29




1

HTTP POST method -‐ Run the command Connect to the new node

URI: • .../resfulapi/command/connect • Parameters: •  systemid • nodeid •  rootpassword

2



30




1



2

HTTP POST method -‐ Run the command Probe the state of the node

URI: • .../resfulapi/command/probe • Parameters: •  systemid • nodeid

3



31




1



2

HTTP POST method -‐ Run the command Probe the state of the node

URI: • .../resfulapi/command/probe • Parameters: •  systemid • nodeid

3

HTTP POST method -‐ Run the command Provision the node

URI: • .../resfulapi/command/provision • Parameters: •  systemid • nodeid

4


Start a node

32

HTTP POST method -‐ Run the command Start the node

URI: • .../resfulapi/command/start • Parameters: •  systemid • nodeid


Retrieve the status of a cluster

33

• .../resfulapi/system/systemid


Monitor the # of connec=ons of a node

34

•  ../resfulapi/system/systemid/node/nodeid/monitor/{monitorid}/data


What’s coming • MariaDB Replica=on and MHA

• MariaDB 10

• MaxScale integra=on

• Juju charms for MariaDB Cluster and MariaDB Manager

• Puppet & Chef manifests and recipes

• MariaDB and Trove

• Trove for MariaDB Manager 35


For More Informa=on...

36

•  MariaDB Enterprise: www.mariadb.org www.mariadb.com

•  MariaDB Manager and MaxScale: hPp://downloads.skysql.com/archives

•  Bugs: hPp://bugs.skysql.com


Thank You!

[email protected]

hop://serge.frezefond.com www.slideshare.net/

sfrezefond twioer: @sfrezefond

www.skysql.com

Pictures courtesy of: • www.pluralsight.com

Technology

OpenStack in Action 4! Serge Frezefond - Database Clusters as a Service in OpenStack: Integrated, Scalable, Highly Available and Secure