OpenStack: we drink our own Champagne

OpenStack: we drink our own Champagne

Teun Docter Software developer

Teun Docter Software developer

About Bright Computing

Enterprise infrastructure software company

Founded in 2009

HQ in Amsterdam & San Jose

Bare-metal & cloud provisioning, monitoring,

management of clustered systems in the data center:

HPC, Hadoop, OpenStack, storage, database and other

“clustered” systems

Customers: Boeing, ING Bank, Sanofi, NASA, DoD, DoE,

Stanford, Oracle, HP, Intel, Sinopec and >400 more

Worldwide resellers: Dell, Cisco, Cray, Huawei, Acer,

DataDirect Networks and >50 more

UK resellers

server

farms Hadoop

clusters

HPC

clusters

private

clouds

storage

clusters

database

clusters

Trends

- Centralization

- Consolidation

- Standardization

- Cloud

- General purpose

clusters

- Private clouds

- Across on-premise

and public cloud

5

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

6

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

7

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

8

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

9

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

10

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

11

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

12

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

node001

head node node002

node003

head node

node001 node002 node003

node004

node005

node006

node007

13

About Bright Cluster Manager

Deployment

Provisioning

Dashboards

Monitoring

Visualization

Health checking

Workload

management

Cloud extension

Environment specific

• HPC

• Hadoop

• Private cloud

Bright Cluster Manager

&

OpenStack

Bright Cluster Manager

&

OpenStack

Confidential. Do not distribute beyond your organization. Copyright 2013.

15

Managing OpenStack Clusters

• Managing OpenStack Clusters even more difficult then other types of clusters

• Without proper infrastructure, OpenStack will not be able to run

• Setting up OpenStack manually is often extremely complex for production setups

• Bright Cluster Manager provides single-pane-of-glass to manage and monitor all aspects of OpenStack cluster

• Includes:

• Hardware (set up, configuration, monitoring)

• Operating system (provisioning, updates)

• OpenStack installation

• OpenStack configuration

• Bright Cluster Manager provides perfect environment for OpenStack to run on

16

Ease of Installation

• Deploying OpenStack private clouds made simple

• Bright pre-packages OpenStack (Icehouse) on the DVD

• Bright installs Linux, OpenStack & itself

• OpenStack can be enabled during installation or afterwards

• OpenStack will run as services on top of Bright cluster

• Bright configures, manages and monitors physical cluster (hardware + OS + other middleware)

• Virtual Machines are managed through OpenStack

• Support various network setups (VLAN, VxLAN, flat, etc.)

• Bright integrates with Ceph, can be used for OpenStack

• Configuration wizard to guide the setup process

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

OpenStack Configuration

OpenStack configuration through roles

• OpenStack consists of several services to accomplish specific tasks

• Tasks can be assigned by assigning roles to nodes

• Example roles:

Compute (Nova) Image (Glance)

Block Storage (Cinder) Dashboard (Horizon)

Auth (Keystone) Networking (Neutron)

• Assigning/unassigning role will:

• Write out config file based on role parameters

• Start/stop/monitor relevant services

• Add/remove entries to Keystone service registry

• OpenStack configuration is dynamically updated with cluster changes (e.g. hostname, network settings)

37

USE CASE: problem

Developers need clusters to test their code

Support engineers need clusters to reproduce issues

Need to quickly spin up clusters with:

• Different version of Bright, including custom builds

• Different base distributions (eg RedHat, CentOS, SUSE, etc.)

• Different types of configurations

Limited amount of hardware available

Manual setup becomes tedious and time consuming

38

USE CASE: solution

We drink our own Champagne

Build our own private cloud

Runs Bright to manage the hardware and OS

Use Bright to deploy and configure OpenStack

Create set of end-user tools to spin up virtual clusters

• Command-line driven

• Make use of OpenStack API’s

• Use web based dashboards for console access

Each user has an isolated environment

Users have full control over their virtual clusters

Virtual clusters directly accessible from office network

Load is balanced automatically

Capacity can now be expanded easily

39

40

41

42

43

USE CASE: plans & considerations

Automated virtual head node installation

Automated nightly installations

Head node installation using volume snapshots

Works in POC and allows big clusters to spin up in minutes

Make sure you have a fast network

DNS integration

44

OpenStack in HPC

• Improved flexibility

• User can manage their code, libs, etc.

• OpenStack Ironic also allows non-virtualized instances to be created

• SR-IOV allows HPC resources (e.g. InfiniBand and GPU) to be made available directly to VMs at near-native performance (work in progress)

• Container/docker integration in OpenStack

45

Conclusion

• Bright provides tried & tested method of cluster management

• Hundreds of clusters world-wide being managed using Bright Cluster Manager

• Inclusion of OpenStack management capabilities provides complete solution for setup, management & monitoring of OpenStack based private clouds.

• Single pane of glass for management of cluster & OpenStack

• Especially well suited for clusters that run various workloads (e.g. OpenStack, HPC compute, Hadoop)

• Very scalable (i.e. thousands of nodes)

Thank you!

Teun Docter

teun.docter@brightcomputing.com

Thank you!

Teun Docter

teun.docter@brightcomputing.com