CloudOpen 2012 OpenNebula talk

CloudOpen 2012 San Diego, USA, August 29th, 2012

© OpenNebula Project. Creative Commons Attribution-NonCommercial-ShareAlike License

The OpenNebula Cloud Platform for Data Center Virtualization

Carlos Martín

Project Engineer

Acknowledgments The research leading to these results has received funding from Comunidad de Madrid through research grant MEDIANET S2009/TIC-1468,

2/25 The OpenNebula Project

What is OpenNebula? IaaS Cloud Computing Tool for Managing a Data Center's Virtual Infrastructure !

Data Center Virtualization Manager ● Open-source Apache license ● Interoperable, based on standards ● Adaptable

Private Clouds ● Virtualize your on-premise infrastructure

Hybrid Clouds ● Extend your private cloud with resources

from a remote cloud provider

Pubic Clouds ● Expose standard cloud interfaces

Ready for end-users ● Advanced user management ● CLI and Web Interface

Public User

Private User

Administrator

Physical Infrastructure Remote Provider


What is OpenNebula? A Quick Demo!

● Let’s take a look at Sunstone!


What is OpenNebula? Appliances Ready to Run!

marketplace.c12g.com

OpenNebula Marketplace ● Catalog of Virtual Appliances ● Users and organizations can share

their Appliances ● Fully integrated with OpenNebula

Virtual Appliance ● Virtual machine image and

configuration files ● Ready to run


The Cloud Provider Perspective What are the Main Components to Build a Cloud Infrastructure? !

Datastores •  VM image storage •  Multiple datastores •  Heterogeneous configurations •  Shared or non-shared

Hosts •  Multiple hypervisors •  Up to 500 hosts •  Automatic failover and HA •  Resource pools •  Automatic resource allocation

VM Instance Networks •  Public and private networks Internet

Front-end •  Authentication •  Authorization •  ACLs, roles,

groups… •  Accounting •  Logging •  Resource quotas

Service Networks •  Monitoring, control… •  Live migration… •  Storage access…


The Cloud Provider Perspective Broad Commodity and Enterprise Platform Support!

Datastores •  DFS: NFS, Gluster, GlusterFS… •  SAN: Fibre Channel, iSCSI, LVM… •  SSH

Hosts •  VMware, •  Xen •  KVM

VM Instance Networks •  VLAN per user (layer2) •  Open vSwitch, 802.1q •  Ebtables

Internet

Front-end •  X509, LDAP,

ssh keys •  ACLs,

permissions, groups

Service Networks •  SSH, Ganglia/Nagios •  Additional monitor agents


The Cloud Provider Perspective Clustering the Physical Resources!

Clusters •  Pools of hosts that share datastores and networks •  Used for load balancing, high availability, and high performance computing

Multiple Datastores per Cluster •  Balance I/O operations between storage servers •  Define different SLA policies (e.g. backup) and performance features for

different VM types or users


The Cloud Provider Perspective Centralized Management of Multiple OpenNebula Instances (Zones) !

oZones Server •  Portal •  Cloud API (EC2, OCCI) •  Global AuthN

Federation of Clouds •  Multi-tier architecture •  Scalability •  Isolation •  Multiple-site support

Cloud Administrator/

Consumer


The Cloud Provider Perspective On-demand Provision of Virtual Data Centers !

Virtual Private Cloud Computing ● Typical scenario in large organizations

and cloud providers ● On-demand provision of fully-

configurable and isolated VDC with full control and capacity to administer its users and resources


The Cloud Provider Perspective Hybrid Cloud Computing!

● Extension of the local private infrastructure with resources from remote clouds ● Cloudbursting to meet peak or fluctuating demands

Cloud Consumer

Cloud Provider


The Cloud Provider Perspective How Can I Operate my Cloud Infrastructure? !… programming APIs (create new tools and integrate), web interfaces (simplify

operation), and command lined interface (create scripts)…

CLI

API ● XML-RPC

● OCA (Ruby, Java, Python)


The Cloud Integrator Perspective The Cloud Integrator Perspective!

Design Principles ● Modularity ● Lightness ● Openness

OpenNebula core

Virtualization Images

Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)

CLI GUI Cloud Servers

DB

Languages


The Cloud Integrator Perspective How to Develop Drivers!

Drivers ● Small scripts for each action

● Any language (Shell, Ruby…)

● Different drivers can co-exist in heterogeneous environments

OpenNebula core


Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)


DB

Easy to adapt Easy to create new ones



Virtualization Drivers ● Translate the OpenNebula VM life-

cycle management into specific hypervisor operations

Monitoring Drivers ● Gather information about the

physical host and hypervisor status

Hybrid Cloud Drivers ●  Interact with an external provider

instead of a hypervisor

OpenNebula core


Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)


DB

OpenNebula distribution Community contributions



Virtualization Driver Example: Hypervisor: Xen Action: migrate Description: live-migrates a running VM to the specified Host



Image & Storage Drivers

● Create or Import new Images into the Image Repository

● File management between the Image Repository and the physical hosts

OpenNebula core


Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)


DB

OpenNebula distribution

● Shared FS

● LVM

●  iSCSI

● SSH

● HTTP

Community contributions

CDMI API

scp-tsunami MooseFS

Market Place Swift/Glance



Networking drivers ● Manage network configuration in

the hosts

● Firewalling rules

● Network Isolation

● Bridge creation OpenNebula core


Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)


DB


●  VLAN, 802.1Q

●  OpenvSwitch

●  ebtables

●  FLAT



Authentication drivers ● Strong security

● Flexibility

Authorization drivers ● Add any limitations to the user

actions OpenNebula core


Storage Network

Auth

Monitoring

Scheduler

XML-RPC API

OCA (Ruby, Java)


DB

OpenNebula distribution Community contributions OpenNebula distribution

●  SSH Keypairs ●  x509 Certificates ●  LDAP ●  Active Directory ●  ACLs ●  Quotas


The Cloud Integrator Perspective How to Interact with OpenNebula !

XML-RPC ● Simple, fast

● Works in any language

OCA (OpenNebula Cloud API) ● High level bindings

● Complete functionality

● Ruby, Java, Python

OpenNebula core


Storage Network

Auth

Monitoring

Scheduler OCA (Ruby, Java)

XML-RPC API


DB

Community Contributions

Cloud APIs

Administrator GUI User GUI


●  OCCI

●  OVF

●  CDMI


The Cloud Integrator Perspective How to Interact with OpenNebula!

OCA Ruby Example: Shutdown all my Virtual Machines


About the OpenNebula Project A Project Aimed at Building the Industry Standard Open Cloud Management Tool!

2005 2008 2009 2010 2011 2012

dsa group doing research…

TP v1.0 v1.2 v1.4 v2.0 v2.2 v3.0

4,000 downloads/month

European Funding

• Develop & innovate • Support the community • Collaborate

Third party scalability tests: 16000 VMs

Commercial Support

v3.2 3.4 3.6


Open Cloud Enabler in the ICT Industry!About the OpenNebula Project

Enabling Hosting Companies and Telcos to Offer Cloud Services

Enabling Technology Companies to Offer Cloud Products

Enabling Service Companies to Offer Cloud Consulting and Integration


Open Cloud Enabler for Building and Operating Virtualized Data Centers!About the OpenNebula Project

Supercomputing Centers

Research Centers

Industry


Join our growing community!

How to contribute ● Join our mailing list ● Follow the development at dev.opennebula.org

Ecosystem projects ● OpenNebula hosts an ecosystem catalog ● Promote and discuss ecosystem projects in our ecosystem

mailing list

IRC Channel ● #opennebula on irc.freenode.net


We Will Be Happy to Answer any Question !Questions?

@opennebula

TL; DR: OpenNebula is awesome, go check it out!

The research leading to these results has received funding from Comunidad de Madrid through research grant MEDIANET S2009/TIC-1468,