Private, Open Clouds with Eucalyptus 3

2 © 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL

Private, Open Clouds with Eucalyptus 3Dr. Jenny LozaPrincipal User Experience Architect

© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL3

Howdy, Y’all• UX Architect at Eucalyptus Systems

• PhD from UT-Austin iSchool

• Server and storage background, 15 years– IBM– LSI– NetApp

• Keeping Austin Weird!


Agenda• About Eucalyptus Systems

• Eucalyptus 3.0/3.1

• News

• Community

• Education Services

• Careers

© 2011 Eucalyptus Systems, Inc. COMPANY CONFIDENTIAL

Eucalyptus is the world’s most widely deployed on-premise cloud software platform.

AWSCloud on their hardware

EucalyptusCloud on your hardware

5


Vision We bring the power of cloud to your business

Value Proposition

The world’s most widely deployed on-premise Infrastructure as a Service cloud software platform

SolutionValue

• Open source developed and enterprise implemented (HA)• Compatible with industry leading AWS API• Hybrid and private clouds on heterogeneous infrastructure• Professional services – expert cloud training & consulting

Ecosystem• 25,000 cloud starts annually• Over 200 partners• Compatible with AWS compatible tools and images

Background• Started in 2007 as an NSF-funded research project at UC

Santa Barbara, incorporated in Jan 2009• Operations in USA, China, India & EU


Customers / Trials

Financial Sector / Large Enterprise Federal / Government Web 2.0 / Web Services


Broad, Global Partner Ecosystem

Cloud App Development

Data Center Automation

CloudManagement

Cloud Data Center

Platform and Infrastructure

SystemIntegrators


Euca IaaS support stack

Physical Resource Management

Virtual Resource Management

Cloud Resources

IaaS Web Services

Third Party Management

SaaS / PaaS Providers


Use cases

1. Bursty workloads: web and mobile applications

2. Transient apps: dev & test environments

3. Big data: analytics and computations

and: hybrid clouds, rich media encoding/decoding, complex and large-scale data processing, training & e-learning, storage-as-a-service, remote desktop hosting, public cloud, carrier-grade cloud

10


Scalable Web Services Use Case


Scalable Web App Pains

• Scalability

• High Availability

• Performance

• Manageability

• Low Cost

Website/SocialGami

ng

App Server

App Server

App Server

MySQL MySQLReplication

Web Server

Web Server

Web Server

LB

LB

External FirewallHardware or software to open standard ports (80,

443)

Web Load BalancerHardware or software to distribute network traffic

across several web servers

Web Server Farm to handle http requests

Backend firewall to limit access to App Servers(software or hardware)

App Servers and Cache servers that implement

business logic

Data Tier with protection


Example: Scalable Web Services Cloud

HLB

NFS Store (NetApp)

Puma.com

MySQL

M

Nagios

Zone 1

SLB

Web Server Web Server

App ServerApp Server

Zone 2

SLB

Web Server Web Server

App ServerApp Server

Walrus with Images

Puppet

MMerlin

Bare Metal Provisioner


Reactive IT to Proactive IT using standardized portable containers with IaaS

Application Slows down

Track down the troubled server

Application Slows down

Users Wait

Determine impact to other

critical Apps

Determine the root cause

Talk to Admins

Fix the application

(Auto) provision another exact instance to fix the

application

Reactive IT Workflow Proactive IT Workflow with Cloud

Identify the root cause

Fix infrastructure issues

Decide to include or exclude the Infrastructure

resource from the cloud


Implement Your WebApp on a Highly Available IaaS Platform

Cloud Controller HA

Walrus Storage HA

Cluster Controller HA

Node Controllers

ESXi

NAS

SAN Storage Arrays

NAS

SAN Storage Arrays

Storage Controller HA

Storage Controller HA

Cluster Controller HA

VM VM

VM VM

VM VM

VM VM

VM VM

VM VM

Programmatic Cloud Access

Self-Service GUI


Use role based firewalls for network security

• Firewall is not confined to the edge

– Configured on hosts at runtime

• IaaS imposes more secure model at the host level

• Role based firewalls– Security groups can

reference other security groups

Web Server

Web Server

App Server

App Server

DB Server

DB Server

http (80) https (443) only

SS

H to

developer

s

Only Web app role can access App Server role

Only App Server role can access DB Server

role


Scale quickly using Rapid Instancing

• Scale up zones using Rapid Instancing using Copy-on-Write enabled EMIs

• Use Node Controller storage efficiently using CoW snapshots

EMI

NC

Walrus

NC

VM VM VM VM

Full Copy Instancing

VM VM VM VM

Rapid Instancing with CoW EMIs


Eucalyptus 3.0• High-availability (HA) of the Eucalyptus Service

– Hot fail-over and repair for all components except NC

• AWS Identity and Access Management (IAM) API plus extensions for private clouds

– Quotas and metering

• Eucalyptus Block Storage improvements– Capability to boot instances from Block Storage– NetApp and JBODs SAN drivers

• Full support for Windows images– Seven different versions, AWS compatible authentication,

sysprep, ephemeral disk

• Accounting/Usage reporting– Charge-back interface linked to quotas


Eucalyptus 3 - Platform Improvements

• Revamped image caching in the Node Controller– Faster instance starts using copy-on-write

• Re-factored VMWare broker– Faster and more robust image preparation– Support for vSphere 4.X– Improved scale, more extensive deployment topologies

• Extended Linux distro support– RHEL 5 and RHEL 6, packages for Canonical LTS (Ubuntu 10.04)

• Re-designed administrative webUI

• Improved command-line admin tools

• Re-designed packaging, upgrade and dependency management

• Re-designed installation mechanism (package repositories)


Example Modular IaaS HA Practice• Active and passive HA components in different racks but NOT

over the WAN

Storage Controller

Cluster Controller

Walrus

Cloud Controller

Node Controllers

Cloud Controller

Cluster Controller

Walrus

Storage Controller

Node Controllers

Private IP - heartbeat


AWS Partnership

• Most AWS compatible, on-premise IaaS platform

• Partnership agreement signed 3/22/2012– Eucalyptus/Amazon working together to enhance compatibility

• Current APIs/services• New APIs/services

• More information at http://www.eucalyptus.com/news/amazon-web-services-and-eucalyptus-partner


AWS Compatible - Hybrid Cloud


Eucalyptus Community

• Eucalyptus 3.1:– Proprietary code removed– Branches merged

• Become a Eucalyptus user– Community cloud:

http://www.eucalyptus.com/eucalyptus-cloud/community-cloud• Currently 2.0.3, will move to 3

– Packaged 3.1 release coming 2012 Q2– Can build 3.0 now. Instructions at

• http://agrimmsreality.blogspot.com/2012/01/configuring-eucalyptus-3-devel.html

• http://agrimmsreality.blogspot.com/2012/01/building-eucalyptus-3-devel.html

http://www.eucalyptus.com/eucalyptus-cloud/community-cloud

http://www.eucalyptus.com/eucalyptus-cloud/community-cloud

http://agrimmsreality.blogspot.com/2012/01/configuring-eucalyptus-3-devel.html

http://agrimmsreality.blogspot.com/2012/01/configuring-eucalyptus-3-devel.html

http://agrimmsreality.blogspot.com/2012/01/building-eucalyptus-3-devel.html

http://agrimmsreality.blogspot.com/2012/01/building-eucalyptus-3-devel.html


Eucalyptus Community: Get Involved!• Ask questions! Answer questions!

• Community home: http://www.eucalyptus.com/participate

• Mailing list: http://lists.eucalyptus.com/cgi-bin/mailman/listinfo/community

• IRC: freenode.net #eucalyptus

• Blogs: http://planet.eucalyptus.com/

• Forums: https://engage.eucalyptus.com/

http://www.eucalyptus.com/participate



http://lists.eucalyptus.com/cgi-bin/mailman/listinfo/community

http://lists.eucalyptus.com/cgi-bin/mailman/listinfo/community

http://planet.eucalyptus.com/

http://planet.eucalyptus.com/

https://engage.eucalyptus.com/

https://engage.eucalyptus.com/


Eucalyptus Community: Contribute• https://projects.eucalyptus.com/

• Projects meet regularly on IRC– Eustore– FastStart/Silvereye– EuTester

• Code patches welcome!– Start at Engage site– Launchpad– Considering move from BZR to Git

https://projects.eucalyptus.com/

https://projects.eucalyptus.com/


Eucalyptus Education Services• http://www.eucalyptus.com/services/education

• Eucalyptus University– Eucalyptus University Press

• Eucalyptus certification

• Partner programs

http://www.eucalyptus.com/services/education

http://www.eucalyptus.com/services/education


Eucalyptus Education ServicesEucalyptus Professional Services provides industry-leading technical training and certification programs that build and recognize knowledge and expertise for the Eucalyptus cloud computing platform.

Eucalyptus offers a comprehensive, professional training curriculum that includes training for:• Cloud Administrators• Cloud Operators• Cloud Users

Training Courses are available in a variety of delivery options including:• Dedicated• Open Enrollment• Self-paced


Eucalyptus 3: Design, Build, and ManageCourse Overview: Eucalyptus 3: Design, Build, and Manage supplies the knowledge and hands-on experience needed to deploy and manage Eucalyptus clouds and cloud applications.

Audience: Administrators, Developers, Analysts, and Architects who are exploring cloud computing, implementing proof-of-concept (POC) deployments, or have already deployed Eucalyptus.

Prerequisites: No prior Eucalyptus skills are required, but students should be comfortable using a command-line and have a working knowledge of server virtualization.

Duration and Format: 24 class hours (3 days), including lectures, demos, and labs.

Topics Covered:

• Cloud Computing Concepts

• Eucalyptus Architecture and Design

• Installation and Configuration

• Management and Maintenance– Management Tools– Elastic IP’s and Security Groups

– Volumes and Snapshots– Metadata Services– IAM and HA– Troubleshooting


Cloud Connections SeriesProgram Overview: A collection of short courses that supply learners with specific, targeted information on special topics in cloud computing and Eucalyptus.

Audience: Generally technical audiences with specific content needs, but some offerings are appropriate for non-technical audiences, while others are appropriate for advanced technical audiences.

Prerequisites: Varies by course.

Duration and Format: Between 4 and 8 hours per course. Most courses include hands-on labs. Generally delivered in an open enrollment, live-online format.

Titles Available:

• Cloud Foundations

• Install and Configure

• Work with Instances and Images

• Identity and Access Management (IAM)

• Eucalyptus HA

• Application Design and Considerations

• Troubleshooting and Administration

• …more titles under development


Eucalyptus Careers• http://www.eucalyptus.com/careers

• WE ARE HIRING!

• Santa Barbara and remote employees

• Positions in– Engineering– Sales– Professional Services– Support

http://www.eucalyptus.com/careers

http://www.eucalyptus.com/careers


Cloud Meetups


Eucalyptus Meetups• Interested in attending an Austin Eucalyptus Users Meetup?

– Email [email protected]– Tweet using #eucameetup hashtag

mailto:[email protected]


Thank you. Questions?

[email protected]

Technology

Private, Open Clouds with Eucalyptus 3