Upload
eucalyptus-systems-inc
View
1.803
Download
1
Tags:
Embed Size (px)
Citation preview
#eucameetup @SVCCG
meetup.com/eucalyptus-bay-area
API – the point of freedom
Mårten Mickos CEO, Eucalyptus Systems
Eucalyptus is the world’s most widely deployed on-premise cloud software platform. 25,000 clouds
freedom
you innova-tion
Eucalyptus 3
“Scalability and reliability have been significantly improved in Eucalyptus 3”
Gregor von Laszewski Indiana University
A common set of APIs
National Institute of Standards and Technology in April 2012
There are many cloud products in the market place, but NIST has determined Eucalyptus Enterprise Edition is the only IaaS cloud management software currently on the market that is built open source and supports private and public cloud infrastructure.
3 approaches to IaaS
CLOUD APPROACH
DATACENTER APPROACH
SERVICE PROVIDER APPROACH
IaaS
CLIENT/SERVER Scale-up Closed source Monolithic binaries
WEB Scale-out Open source Stacks & distros
New paradigms CLOUD Multi-scale APIs Images in clouds
© 2012 Eucalyptus Systems, Inc. -- confidential
Eucalyptus 3: What’s new in On-premise Clouds?
Rich Wolski, CTO April 26, 2012
© 2012 Eucalyptus Systems, Inc.
Exciting Weather Forecasts 344 M
275 M
4.4 M
© 2012 Eucalyptus Systems, Inc.
Infrastructure Access, eCommerce Style
• Self-service and “zero touch.” – Scalable automatic rental of resource intensive goods
• Transactional and asynchronous – Interaction with the site is transactional – Delivery is asynchronous
• Site integrity and site availability are critical – Individual transactions can fail but the site cannot
• Customer requests must be isolated – Service venue must manage competing needs
• Scale out for request volume, scale up for request weight
© 2012 Eucalyptus Systems, Inc.
Open Source Cloud Platform
• Idea: Develop an open-source, freely available cloud platform for commodity hardware and software environments
– Stimulate interest and build community knowledge – Quickly identify useful innovations – Act to dampen the “hype”
• First-principles cloud implementation – Not a refactorization of previously developed technology
• Build from mature open source technologies – J2EE, MySQL, Web Services are high quality and scalable as
open source
© 2012 Eucalyptus Systems, Inc.
Eucalyptus Multi-tiered Service Architecture
User Transactions
Inventory and Scheduling
Actualization Actualization Actualization Actualization Actualization
Inventory and Scheduling
Inventory and Scheduling
Service Delivery User Requests
© 2012 Eucalyptus Systems, Inc.
Eucalyptus Generations
• Eucalyptus 1.X (June 08 through Sep. 10) – University code
• Eucalyptus 2.X (June 10 through Feb. 12) – Commercial focus, early production
• Eucalyptus 3.X (present - ) – Production operational improvements – Full commercial feature set (almost)
• Few, if any features deprecated – BitTorrent?
© 2012 Eucalyptus Systems, Inc.
New Eucalyptus 3.0 Features • High-availability (HA) of the Eucalyptus Service
– Hot fail-over and repair for all components except NC
• AWS Identity and Access Management (IAM) API plus extensions for private clouds
– Quotas and metering
• Eucalyptus Block Storage improvements – AWS Volume-backed instance API (persistent instances)
“bootable” – NetApp and JBOD support added to existing Dell Equallogic
• Full support for Windows images – Seven different versions, AWS compatible authentication,
sysprep, ephemeral disk
• Accounting/Usage reporting – Charge-back interface linked to quotas
© 2012 Eucalyptus Systems, Inc.
Eucalyptus 3.0 Platform Improvements • Revamped image caching in the NC
– Faster instance starts using copy-on-write
• Refactored VMWare broker – Faster and more robust image preparation, support for vSphere 4.X,
improved scale, more extensive deployment topologies
• Extended Linux distro support – RHEL 5 and RHEL 6, packages for Canonical LTS (Ubuntu 10.04)
• Substantial improvement in automated QA – Full QA sequence is 5 days (features + distros + hypervisors +
deployment topologies + networking modes)
• Re-designed administrative webUI • Improved command-line admin tools • Re-designed packaging, upgrade and dependency management • Re-designed installation mechanism (package repositories)
© 2012 Eucalyptus Systems, Inc.
Eucalyptus in The Wild
• Eucalyptus 2.0 Deployments – Games, mobile infrastructure, media, telecom
• Tons of feedback – Not all of it angry
• Top 3 – Platform HA -> VM connectivity and request service – Quotas, accounting, reporting – Windows (fast image creation and start)
© 2012 Eucalyptus Systems, Inc.
High Availability
• Eliminate single point of failure – Host failure – Network connectivity failure (including network partitions)
• Tolerate as many multiple failure cases as possible • Avoid data loss at all costs
– Fail stop is better than data loss
• Availability of the services that Eucalyptus offers – Eucalyptus requests – VM connectivity and storage – Not VM HA -> application level
© 2012 Eucalyptus Systems, Inc.
PoC Configuration
Linux
Web Service DB management
CLC Walrus
SC VMWb
CC
Linux
NC
Linux
NC
Linux
NC
Linux
NC
Linux
NC
Linux
Web Service DB management
CLC Walrus
SC VMWb
CC
Walrus
Walrus
© 2012 Eucalyptus Systems, Inc.
Multi-component Failure
Linux
Web Service DB management
CLC
SC VMWb
CC
Linux
NC
Linux
NC
Linux
NC
Linux
NC
Linux
NC
Linux
Web Service DB management
CLC Walrus
SC VMWb
CC
Walrus CLC
SC VMWb
CC
© 2012 Eucalyptus Systems, Inc.
Production CLC CLC Wal
SC
Wal
SC
CC
VMb
CC
VMb
Linux
NC
Linux
NC
Linux
NC
Linux
NC
Linux
NC
© 2012 Eucalyptus Systems, Inc.
Interesting Brain Wrinkles
• Cloud and Walrus have externally visible URLs – DNS remapping service is built into the CLC
• What happens if the master loses connectivity with the user?
– Back-up may have an alternative path to user • Arbitrator service
• Multi-failure can cause split brain – Master fails over, new master fails before original back,
original then brought up => fail stop
© 2012 Eucalyptus Systems, Inc.
IAM, Quotas, and Reporting
• IAM is AWS “Identity and Access Management” – Accounts and users, and groups of users – JSON based policies defines calls that users and groups can
execute – Also possible to attach policies to resources S3 (buckets for
now) – Linked to LDAP and AD
• Eucalyptus extends the IAM predicates with inequalities – Implements quotas as tests against IAM policies
• Resource usage information exportable in a variety of formats and through GUI
© 2012 Eucalyptus Systems, Inc.
For Example
eucalyptus support sales dev
EC2 image permission
S3 bucket ACL
quota
quota
{ "Version":"2012-‐02-‐12", "Statement":[{ "Sid":"2", "Effect":“Limit", "Action":"ec2:RunInstances", "Resource":"*", "Condition":{ "NumericLessThanEquals":{ "ec2:quota-‐vminstancenumber": "256" } } }] }
© 2012 Eucalyptus Systems, Inc.
Windows
• Windows images are big – One customer wants 200 GB images – Ephemeral within the C: drive
• Need a way to use CoW to improve Windows launch time
© 2012 Eucalyptus Systems, Inc.
The Blob Store
• Blobs are (sparse) files on the file system – remember to use ‘ls –s’ to see disk space allocated – files are mounted on loopback when in use – future implementation could use LVM volumes instead of files
• Mapping and copy-on-write snapshots are implemented using Linux kernel’s device-mapper (same as LVM snapshots)
– once snapshotted or mapped, file access method cannot be used
– i.e., backing file on disk no longer has the bits you want
© 2012 Eucalyptus Systems, Inc.
What’s Next? • Eucalyptus 3.1 (Q2)
– Refactoring for packaged plug-ins – VMWare 5 support – AWS fidelity enhancements
• Eucalyptus 3.2 (Q4) – Feature release – More AWS fidelity enhancements – ELB, Cloudwatch, Autoscaling
• Eucalyptus 4 in 2013 – Network refactorization – Multi-datacenter support
• Eucalyptus 5 in 2014 – Multi-datacenter support
© 2012 Eucalyptus Systems, Inc.
Just the beginning