BigData/Cloud Evangelist, InMobi

Iliyas Shirol

CloudStack For Beginners

# OpenSource Evangelist and FOSS promoter

since 2004

# Founder of LOAD (Linux On A Desktop) project.

# SysAdmin, DBA and an Ethical Hacker

# And yeah, I love to be on Cloud

$ whoami

$ whoareu

# Experience with Cloud ?

# Experience with CloudStack ?

# Which other IaaS platforms do you use ?

# Any expectations ? :)

$ Agenda

• Overview of CloudStack

• CloudStack Architecture

• Demo of CloudStack

• Q&A

$ What is Cloud Computing?

Virtualization Cloud

Server Virtualization++ Cloud

Built for traditional

enterprise apps & client-

server compute

• Enterprise arch for 100s of

hosts

• Scale-up (server clusters)

• Apps assume reliability

• IT Mgmt-centric [1:Dozens]

• Proprietary vendor stack

Designed around big data,

massive scale & next-gen

apps

• Cloud architecture for 1000s

of hosts

• Scale-out (multi-site server

farms)

• Apps assume failure

• Autonomic [1:1,000’s]

• Open, value-added stack

Think: vCloud Director Think: AWS, RAX, zCloud,

eBay, etc.

…but adoption of new

cloud architecture is the

future

Enterprises should, and

will, make SV 1.0 more

cloud-like…

• 10x more scaleable

• 2-5x lower cost

• 100% more open

• Secure, multi-tenant cloud

orchestration platform – Turnkey platform for delivering

IaaS clouds

– Hypervisor agnostic

– Massively scalable, secure and

open

– Open source, open standards

– Deploys on premise or as a

hosted solution

• Deliver cloud services

faster and at a fraction of

the cost

$ What is CloudStack?

Build your cloud the way the

world’s most successful

clouds are built

$ CloudStack Background

• OpenSource IaaS platform, now under ASL 2.0 license

• A proven cloud platform – Developed since 2008 by Cloud.com

– Acquired by Citrix in 2011

– Citrix donated to Apache Software Foundation (ASF) in

April 2012

– Version 4.2.0 available for download at

http://cloudstack.apache.org/downloads.html

– Powering some of the world’s largest clouds today.

$ Architecture / Language

• Java application

• Tomcat6, Axis2, Maven build + ant – Ant going away in 4.1

• Moving towards a plugin architecture

$ CloudStack Supports Multiple Cloud Strategies

Multi-tenant

Public Cloud

• Dedicated

resources

• Security & total

control

• Internal network

• Managed by

Enterprise or 3rd

party

• Mix of shared

and dedicated

resources

• Elastic scaling

• Pay as you go

• Public

internet, VPN

access

Hosted

Enterprise

Cloud

• Dedicated

resources

• Security

• SLA bound

• 3rd party

owned and

operated

Private Clouds Public Clouds

On-premise

Enterprise

Cloud

Compute

CloudStack Provides On-demand Access to Infrastructure Through a Self-Service Portal

Citrix Confidential - Do Not Distribute

Network

Storage

Admin

Users

Org A

Admin

Users

Org B

Users

End User

Admin

“CloudStack 3.0 is open source, but it is NOT based on OpenStack”

$ What About OpenStack?

What can CloudStack

do?

• CloudStack can manage tens of thousands of servers

installed in multiple geographically distributed datacenters

• The centralized management server scales linearly,

eliminating the need for intermediate cluster-level

management servers

• No single component failure can cause cloud-wide outage

• Periodic maintenance of the management server can be

performed without affecting the functioning of virtual

machines running in the cloud

$ Massively Scalable Infrastructure Management

• A single cloud deployment can contain multiple hypervisors

• Including Citrix XenServer, Oracle VM, KVM and vSphere

• Freedom to choose the right hypervisor for the workload

$ Multiple Hypervisor Support

• CloudStack automatically configures each guest virtual machine’s networking and storage settings

• CloudStack internally manages a pool of virtual appliances to support the cloud itself

• These appliances offer services such as firewalling, routing, DHCP, VPN access, console proxy, storage access, and storage replication

$ Automatic Configuration Management

• CloudStack offers an administrator's

Web interface, used for provisioning

and managing the cloud

• Also used as an end-user's Web

interface for running VMs and

managing VM templates

• The UI can be customized to reflect

the desired service provider or

enterprise look and feel

$ Graphical User Interface

• CloudStack provides an API that gives programmatic access to all the management features available in the UI

• The API enables the creation of command line tools and new user interfaces to suit particular needs

$ API and Extensibility

• The CloudStack platform has a number of features to increase

the availability of the system

• The Management Server may be deployed in a multi-node

installation where the servers are load balanced

• The CloudStack Database may be configured to use replication

to provide for a manual failover in the event of database loss

• For the Hosts, the CloudStack platform supports NIC bonding

and the use of separate networks for storage as well as iSCSI

Multipath

$ High Availability

End-User Experience

Citrix Confidential - Do Not Distribute

Select Operating

System

• Windows, Linux

Select Compute

Offering

• CPU & RAM

Select Data Disk

Offering

• Volume Size

Select Network Offering

• Network & Services

Create VM

$ Create Custom Virtual Machines via Service Offerings

$ Dashboard Provides Overview of Consumed Resources

Citrix Confidential - Do Not Distribute

• Running, Stopped & Total VMs

• Public IPs

• Private networks

• Latest Events

$ Virtual Machine Management

Users

Start

Stop

Restart

Destroy

VM Operations Console Access

• CPU Utilized

• Network Read

• Network Writes

VM Status Change

Service Offering

2 CPUs

1 GB

RAM

20 GB

20

Mbps

4 CPUs

4 GB

RAM

200 GB

100

Mbps

$ Volume & Snapshot Management

Volume

VM 1 Add / Delete

Volumes

Schedule

Snapshots

Hourly

Daily

Weekly

Monthly

Now

Create Templates

from Volumes

Volume

Template

View Snapshot

History 12/2/2012 7.30 am

….

2/2/2012 7.30 am

$ Network & Network Services

• Create Networks and attach

VMs

• Acquire public IP address for

NAT & load balancing

• Control traffic to VM using

ingress and egress firewall

rules

• Set up rules to load balance

traffic between VMs

Cloud Architecture

$ Open Platform to Suit Customer Needs

Compute

XenServer VMware KVM Oracle VM Bare metal

Hypervisor

Storage

Local Disk iSCSI NFS

Fiber

Channel Swift

Block & Object

Network

Network

Type Isolation

Load

balancer Firewall VPN

Network & Network Services

$ Multi-tenancy & Account Management

Cloud • Domain is a unit of isolation that represents a customer org, business unit or a reseller

• Domain can have arbitrary levels of sub-domains

• A Domain can have one or more accounts

• An Account represents one or more users and is the basic unit of isolation

• Admin can limit resources at the Account or Domain levels

Admin

Org A

Admin

Reseller A

Domain

Domain

Admin

Org C

Sub-Domain

User 1

User 2

Group B

Account

Group A

Account

VMs, IPs,

Snapshots…

VMs, IPs,

Snapshots…

Resources

Resources

• A CloudStack installation consists of two parts

• The Management Server

• The cloud infrastructure that it manages

$ Architecture

Machine 1

Managem

ent

Server

Machine 2

Hyperviso

r

Simplified view of a basic

deployment

• Manages the assignment of guest VMs to particular hosts

• Manages the assignment of public and private IP addresses to particular accounts

• Manages the allocation of storage to guests as virtual disks

• Manages snapshots, templates, and ISO images, possibly replicating them across data centers

• Provides a single point of configuration for the cloud

$ The Management Server

• Provides the web user interface for the administrator and a reference user interface for end users

• Provides the APIs for the CloudStack platform

$ The Management Server

• All CloudStack objects are stored in the CloudStack Database

• CloudStack tracks changes in the database

• CloudStack uses MySQL for the database

• Multiple DB servers & replication is possible

$ CloudStack Management Server Database

• A host is a single computer

• Hosts provide the computing resources that run the guest virtual machines

• Each host has hypervisor software installed to manage guest VMs

• The host is the smallest organizational unit within a CloudStack deployment

$ Cloud Infrastructure - Host

Cluster

• A clusters consists of one or more hosts • Provides a way to group hosts

• With one primary storage server • One primary storage server per cluster is typical • Can use local storage on each host

• The hosts in a cluster: • Have identical hardware • Run the same hypervisor • Are on the same subnet • Access the same shared primary storage

• Virtual machine instances can be live-migrated

from one host to another within the same cluster

$ Cloud Infrastructure - Cluster

Primary

Storage

V

M

Pod

• A pod consist of one or more clusters

• A pod often represents a single rack

• Hosts in the same pod are in the same subnet

$ Cloud Infrastructure - Pod

Zone

• A zone consists of one or more pods

• Plus secondary storage • Shared by all the pods in the zone

• Often corresponds to a single

datacenter, but multiple zones are

permitted

• Organizing infrastructure into zones

provides physical isolation and

redundancy

$ Cloud Infrastructure - Zone

Secondar

y

Storage

• Primary storage is associated with a

cluster

• Stores the disk volumes for all the VMs

running on hosts in a cluster

• Shared storage is normally

recommended

• NFS

• iSCSI

• Fibre Channel

• But, some situations use local storage

• Where high availability isn't needed

• Where greater disk I/O is needed

$ Cloud Infrastructure – Primary Storage

• Stores: • Templates - OS images used to create VMs • ISO Images - Images that can be bootable or

non-bootable

• Disk volume snapshots (saved copies of VM data)

• Secondary storage available to all hosts in the zone

• Secondary storage must be NFS • Or NFS + Swift

$ Cloud Infrastructure – Secondary Storage

•Secondary storage is Associated with a zone

Zone

• One or more hosts grouped

into a cluster

• One or more clusters

grouped into a pod

• One or more pods grouped

into a zone

• One or more zones

controlled by one

management server

$ Cloud Infrastructure - Summary

Pod

Second

ary

Storag

e

CloudStack

Management

Server

$ Cloud Infrastructure – Basic Networking

• Basic Shared Public Network • All zone tenants share a single flat

public network

• Tenant isolation provided by Security Groups

• Hypervisor level firewall IP Address filtering

• Layer 3 Isolation

• Scales much better than VLANs

• CloudStack virtual system router provides

• DHCP

• DNS Customer 1 Customer 2

192.168.1.55 192.168.1.56 192.168.1.57 192.168.1.58 192.168.1.59 192.168.1.60

Intern

et

Physica

l Router

CS

Virtual

Router

VM

1

VM

2

VM

3 VM

1

VM

2

VM

3

Public Network

• Advanced networking provides: • Multiple VLANs for isolation

• L2TP-based VPN

• Virtual router is gateway

• Load balancer available

• 1:1 NAT

• Metering data

• One virtual router per account

• Does not scale as well

$ Cloud Infrastructure – Advanced Networking

Intern

et

Physica

l Router

CS

Virtual

Router

VM

1

VM

2

VM

3

CS

Virtual

Router

VM

1

VM

2

VM

3

Public Network

Customer Private

Networks

Customer 1 Customer 2

VLAN 100 VLAN 200

Layer-2

Switch

Internet

Router &

Firewall

$ Cloud Infrastructure – Small-Scale Network

Second

ary

Storage

Primary

Storage

Computing Nodes

Management

Server

Public IP

50.43.51.125 192.168.10.0/24

192.168.1

0.22

192.168.10.15 192.168.10.12

IP addresses are

examples

192.168.1

0.23

192.168.10

.24

192.168.1

0.21

$ Cloud Infrastructure – Large-Scale Redundant Network

Secondary

Storage Servers

Primary

Storage

NFS

Secondary

Storage

Pod 1

Pod 2

Managemen

t Server

Cluster

Layer-3 switches with

firewall modules

Layer-2 switches

Internet

Primary

Storage

Primary

Storage

Primary

Storage

NFS

Secondary

Storage

Internet

Computing Nodes

Primary

Storage Servers

$ Cloud Infrastructure – Multi-Site Deployment

• Single Management Server can

manage multiple zones

• Zones can be geographically

distributed • Low latency links required

• 5-10K hosts per Management

Server

• Multiple MS nodes can be

deployed as cluster for scale or

redundancy

Data Center 1

$ Cloud Infrastructure – Multi-Site Deployment

Availabi

lity

Zone 1

Primary

Managemen

t Server

Data Center

2

Secondar

y

Mgmt

Server MySQL

Replication

Data Center 3

Data Center

4

Availability

Zone 2

Availability

Zone 3

Availability

Zone 4

Let’s Build Our Cloud

• CloudStack requires at a minimum: • A server to host the Management Server

• A PC for the management console

• A Hypervisor or Bare Metal machine

• NFS shared storage

• A 1GB or above network

$ CloudStack Requirements

NFS Server

Primary

Storage

Secondar

y Storage

CloudStack

Management

Server

admin

Console

• Operating system: RHEL/CentOS 6.2 64-bit only

• 64-bit x86 CPU (more cores results in better

performance)

• 4 GB of memory

• 250 GB of local disk Minimum (500 GB is

recommended)

• At least 1 NIC (Gigabit Network is recommended)

• Statically allocated IP address

• Fully qualified domain name as returned by the

hostname command

$ Management Server (Minimum Requirements)

• CloudStack needs two types of storage

• Primary storage is used for storing the guest VM root disks as well as additional data disk volumes

• Secondary storage is used for templates ISOs & snapshots

• Primary Storage can be any storage (including local) that is supported by the hypervisor

• Secondary Storage must be NFS or NFS+Swift

$ Storage Requirements

• Hardware should be supported by hypervisor vendor

• Memory and CPU should planned like any capacity planning

• Citrix XenServer® 6.0.0 + CSP

• VMware vSphere 4.1™/ VMware vSphere 5 ™ with at least Standard license (with vMotion)

• KVM running on Red Hat Enterprise Linux 6.2

• OVM Server v2.3

$ Hosts (Hypervisors) Requirements

• 1 GB or 10 GB Network

• IP range for Private Network & Public Network excluded

from local DHCP

• Managed Switches with VLAN Trunking (if using

Advanced Network)

• Static IPs for all major components (CloudStack, Hosts,

NFS server)

• Connectivity between CloudStack, hosts and NFS

• NTP setup on all servers is highly recommended

$ Network Requirements

$ Prepare the Operating System

• Configure the hostname – hostname --fqdn

• Configure the network – ping cloudstack.org

• Change mode of SELinux to ‘permissive’

$ Configure the YUM repo

vi /etc/yum.repos.d/cloudstack.repo

[cloudstack]

name=cloudstack

baseurl=http://cloudstack.apt-get.eu/rhel/4.1/

enabled=1

gpgcheck=0

$ Install Management Server

yum install cloudstack-management

$ Storage Configuration

• Export /primary and /secondary from the Management server.

• Enable rpcbind & nfs to start at boot. – chkconfig nfs rpcbind on

• showmount -e

$ Install vhd-util (Only for XenServer)

wget -c

http://download.cloud.com.s3.amazona

ws.com/tools/vhd-util

cp vhd-util /usr/share/cloudstack-

common/scripts/vm/hypervisor/xenserv

er/

$ Install the Database Server

• yum install mysql-server

• Add the params to my.cnf innodb_rollback_on_timeout=1

innodb_lock_wait_timeout=600

max_connections=350

log-bin=mysql-bin

binlog-format = 'ROW'

$ Setup the database

cloudstack-setup-databases

cloud:cloud@localhost --deploy-

as=root

* Runs the SQL and creates the necessary databases.

• cloudstack-setup-management – Setup iptables, sudoers & starts the management server.

$ Prepare the System VM Template

/usr/share/cloudstack-

common/scripts/storage/secondary/cloud-

install-sys-tmplt -m /secondary -u

http://download.cloud.com/templates/acton/

acton-systemvm-02062012.vhd.bz2 -h

xenserver

Installation Complete

Login Into The UI

http://x.x.x.x:8080/client

$ The Future Needs You

• Project website : http://cloudstack.apache.org/

• Mailing lists : – users-subscribe@cloudstack.apache.org

– dev-subscribe@cloudstack.apache.org

• IRC: #CloudStack on irc.freenode.net

• Join your local CloudStack group – http://www.meetup.com/CloudStack-Bangalore-Group

© 2010 Wipro Ltd - Confidential 64

BigData/Cloud Evangelist, InMobi

Email : iliyas dot shirol at gmail dot com

Iliyas Shirol

Questions ?