Download pdf - Introduction to Apache CloudStack by David Nalley

Introduction to Apache CloudStackDavid Nalley

@ke4qqq

[email protected]

#whoami

Recovering sysadmin

Apache CloudStack and Apache jclouds

Work for Citrix Open Source Business Office

VP Infra, Apache Software Foundation

Intro to Apache CloudStack

Questions


A brief history of CloudStack

2008-2010 – Stealth mode startup (VMOps)

2009 – First production in public cloud

2010 – Released as open source (GPLv3)

2011 – Cloud.com acquired by Citrix

2012 – Transferred to the ASF (ASLv2)

2013 – Graduated as TLP


Cloud

Infrastructure as a Service

• Compute, Network, Storage

Cloud requires:

• On-demand

• Self-service

• Scalable

• Measurable


What is CloudStack

Orchestration platform for Infrastructure as a

Service

Focused heavily on compute

Somewhat monolithic – by design

Written in Java


Where do we dive in?


IaaS is Orchestration

IaaS doesn’t really provide new services, it

orchestrates existing services

•Hypervisors

•Storage

•Network

•Isolation

•Accounting


CloudStack Hypervisor Support

KVM

XenServer

VMware vSphere

Hyper-V

Oracle VM (reappearing in 4.5)

LXC

Baremetal


CloudStack Storage - Primary

Local

NFS

iSCSI

Distributed (GlusterFS, Ceph, etc)

$anything_hypervisor_supports


CloudStack Storage - Secondary

NFS

Object Storage (S3 or Swift API)


Networking

The bane of any cloud operators existence


Networking - Challenges

Network guys are luddites (generally)

We have scale issues


Scale

VLANs – don’t scale

Firewalls – don’t scale

Loadbalancers – don’t scale


How we scale the network

Amazon’s Security Groups

In CloudStack we reuse the Security Groups

terminology.

SDN

The interesting pieces aren’t in Layer 2-3,

but 4-7, and still being developed.


Resources, hierarchy, failure

domains

Regions

Zones (DCs)

Pods

Clusters

Machines


Actual use

UI is beautiful

…..but…..

API is where real people do work.


API

Native CloudStack API

http://cloudstack.apache.org/docs/api/

EC2, GCE APIs

https://github.com/imduffy15/ec2stack

https://github.com/NOPping/gstack


http://cloudstack.apache.org/docs/api/

https://github.com/imduffy15/ec2stack

https://github.com/NOPping/gstack

API

Use an abstraction library (jclouds, fog,

libcloud)

Use tools that use abstraction libraries

(knife-cloudstack,


Stop thinking of VMs

{

"name": "hadoop_cluster_a",

"description": "A small hadoop cluster with hbase",

"version": "1.0",

"environment": "production",

"servers": [

{

"name": "zookeeper-a, zookeeper-b, zookeeper-c",

"description": "Zookeeper nodes",

"template": "rhel-5.6-base",

"service": "small",

"port_rules": "2181",

"run_list": "role[cluster_a], role[zookeeper_server]",

"actions": [

{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }

]

},

{

"name": "hadoop-master",

"description": "Hadoop master node",


"service": "large",

"networks": "app-net, storage-net",

"port_rules": "50070, 50030, 60010",

"run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]"

},

{

"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c",

"description": "Hadoop worker nodes",


"service": "medium",

"port_rules": "50075, 50060, 60030",

"run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]",

"actions": [

{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },

{ "http_request": "http://${hadoop-master}:50070/index.jsp" }

]

}

]

}

{

"name": "hadoop_cluster_a",

"description": "A small hadoop cluster with hbase",

"version": "1.0",

"environment": "production",

"servers": [

{

"name": "zookeeper-a, zookeeper-b, zookeeper-c",

"description": "Zookeeper nodes",


"service": "small",

"port_rules": "2181",

"run_list": "role[cluster_a], role[zookeeper_server]",

"actions": [

{ "knife_ssh": ["role:zookeeper_server", "sudo chef-client"] }

]

},

{

"name": "hadoop-master",

"description": "Hadoop master node",


"service": "large",

"networks": "app-net, storage-net",

"port_rules": "50070, 50030, 60010",

"run_list": "role[cluster_a], role[hadoop_master], role[hbase_master]"

},

{

"name": "hadoop-worker-a hadoop-worker-b hadoop-worker-c",

"description": "Hadoop worker nodes",


"service": "medium",

"port_rules": "50075, 50060, 60030",

"run_list": "role[cluster_a], role[hadoop_worker], role[hbase_regionserver]",

"actions": [

{ "knife_ssh": ["role:hadoop_master", "sudo chef-client"] },

{ "http_request": "http://${hadoop-master}:50070/index.jsp" }

]

knife cs stack create hadoop_cluster_a

Prereqs

Configuration management

Automated provisioning

Monitoring


Jevon’s Paradox


Rants

Portability is a red herring – Config

Management is a prereq

Portability is pointless – moving data is the

problem

Scale is hard – expect to iterate, a lot.

Failure is even harder – fail proactively


Next gen predictions

Lots of people need IaaS

Many people need workload orchestration

(Kubernetes, Apache Mesos, etc)


Questions


Get Involved

Web: http://cloudstack.apache.org/

Mailing Lists: cloudstack.apache.org/mailing-lists.html

IRC: irc.freenode.net: 6667 #cloudstack

Twitter: @cloudstack

LinkedIn: www.linkedin.com/groups/CloudStack-Users-Group-3144859

If it didn’t happen on the mailing list, it didn’t happen.
