# 1
Cloud Management
RightScale Cloud Management
MultiCloud PlatformManage public, private, and hybrid
clouds
Configuration FrameworkProvision servers and execute scripts
with consistency
Automation EngineMonitor, alert, auto-scale, and
automate operations
MultiCloud Marketplace™Access cloud-ready, customizable
ServerTemplates™
Governance ControlsControl access and security, track
usage, and access logs
# 2
Cloud Management
IaaS
Bridging Apps and Infrastructure
Dashboard
Governance Controls – Access, Security, Reporting
MultiCloud Platform – Provisioning
Automation Engine – Monitoring, Alerting, Scaling
Configuration Framework – ServerTemplates, RightScripts
Hardware
Hypervisor
Cloud Infrastructure
Software
API
Private Clouds Public Clouds
# 3
Cloud Management
Users Content
Clouds Services
RightScale Cloud Ecosystem
# 4
Cloud Management
Automation – Marketplace – Governance
# 5
Cloud Management
• A Cloud “Remote Control”• Private clouds• Public clouds• Hybrid clouds
• Choose your:• Vendors• Geography• Price• Performance• Compliance
MultiCloud Platform
# 6
Cloud Management
One “Cloud” – Many Resource Pools
Rackspace
Amazon Web Services
SoftLayer
Logicworks
Datapipe
Singapore
Hong Kong
Tokyo
Dallas
DC Area
NYC Area
SF Area
Seattle
Chicago
Dublin
London Amsterdam
IDCF / Yahoo! Japan
Fukuoka
Korea Telecom
Seoul
Beijing
UnGeo
Tata
Hyderabad
Private Clouds Public & Managed Clouds
Oregon
São Paulo
KINX
# 7
Cloud Management
Application Portfolio
Requirements Filter
Resource Pools
App 1
App 2
App 3
Performance
Cost
Compliance
Reliability
Security
Workload Deployment Freedom
Management & automation – across cloud resource pools
App N
…
App 1
App 2
App 3
App N
…
Internal DC
Private Cloud 1
Public Cloud
# 8
Cloud Management
RightScale ServerTemplates™
• Reproducible: Predictable deployment
• Dynamic: Configuration from scripts at boot time
• Multi-cloud: Cloud agnostic and portable
• Modular: Role and behavior abstracted from cloud infrastructure
Configuration Framework
# 9
Cloud Management
App & Web Servers
Community
ISV Partners
RightScale
Pre-built by our ecosystem
MultiCloud Marketplace
Cloud-ready stacks
Databases & Caches
And more…
# 10
Cloud Management
ServerTemplates
• ServerTemplates define individual servers and/or complete systems
• More than just instance characteristics … entire system configuration (e.g., networking, environment variables, automation settings, server interdependencies)
# 11
Cloud Management
First step to nirvana: ServerTemplates
• Chiseled in stone.• Painful to change.• So pre-cloud.
• Live above the image.• Live above the cloud.• Code your infrastructure.
Virt
ual M
achi
ne Im
age
Ser
verT
empl
ate
# 12
Cloud Management
ServerTemplates are Server DNA
“Web Server”
Public Cloud
Private Cloud
Future Cloud
Cloud AgnosticOne Asset, Multiple Options
# 13
Cloud Management
• Dynamic configuration
• Abstract role and behavior from cloud infrastructure
• Predictable deployment
• Cloud agnostic / portable
• Object-oriented programming for sysadmins
ServerTemplates
# 14
Cloud Management
What are ServerTemplates?Anatomy of a
ServerTemplateExample ServerTemplate
MySQL 5.0
RightScript/Recipe N
RightScript/Recipe 5
RightScript/Recipe 4
RightScript/Recipe 3
RightScript/Recipe 2
RightScript/Recipe 1
…
boo
t se
que
nce
RightScript/Recipe 6
RightScript/Recipe 6
ope
ratio
ns
…
Base Image
Start all services
Setup DNS and IPs
Restore last backup
Configure/tune MySQL
Install MySQL Server
Install monitoring
…
boo
t se
que
nce
Perform backup
Initialize slave
ope
ratio
ns
…
Right Image
# 15
Cloud Management
What do ServerTemplates help me do?• Affect Cloud Resources and specify cloud properties
(image, instance type, ssh key, security groups, etc.)• “Record” everything you do to set up a server
(install software, edit configuration files, start services, etc.)
• Extract variable configuration information [as Inputs]• Define custom monitors and alerts• Keep versions of your configurations, images, scripts…• Share best practices within your organization, or to the
world• Incorporate best practices from others, and receive
updates
# 16
Cloud Management
• Dynamically configure servers at run-time
• Abstract role and behavior from cloud infrastructure
• Modular and variable-based for easy maintenance
• Launch predictable infrastructure
• Portable
Dynamically Configure with ServerTemplates Create agile, automated, and predictable IT infrastructure
# 17
Cloud Management
How does RightScale help with Abstraction?
• Unified Multi-Cloud UI and new API (in progress)• Multi-Cloud Servers/Arrays• Multi-Cloud ServerTemplates• Multi-Cloud Images
Server
runnable abstraction
ServerTemplate
software config runtime config
1:1 1:N II
I
II
cloud resources
Image
# 18
Cloud Management
MultiCloud Image• Collection of RightImages that represent a standard
configuration across multiple clouds
MCI: Windows Server 2008
AWS AP-Singapore
AWS AP-Tokyo
AWS EUAWS US-
EastAWS US-
WestRackspace
# 19
Cloud Management
ServerTemplates
Virtual machine
OS
Storage volumes
Networking
SQL Server/ASP.NET…
App Libraries
RightImages &Multi-Cloud Images• Standard image
configurations
Cloud Portability• Standard configurations
that work across clouds
Application
Applications• Cloud independent
deployment
Modular – Portable – Reproducible
# 20
Cloud Management
Images vs. RightScale ServerTemplates
• Big & opaque• Complex to reproduce• Static• Not cloud-portable
Slow workflow Not cloud-agile
• Modular & flexible• Reproducible &
maintainable• Dynamic & agile• w/ MCI - Multi-cloud enabled
Dev-like workflow Dynamic configuration
Virtual Machine Images RightScale ServerTemplates
# 21
Cloud Management
Automation Engine
• Monitoring and alerting
• Server and application
• Escalations and triggers
• Auto-scaling
• Operational automation
• Database backup, failover, recovery
• Script execution
• Code deploys and patches
# 22
Cloud Management
Cluster monitoring• Individual graphs
• Good for a dozen servers• Displays all standard graphs with full detail
• Stacked graphs• Displays the contribution of many servers to a total• Great to see the sum and variability of activity in a cluster• Difficult to make out individual servers• Examples: requests/sec, cpu busy cycles, I/O bytes/sec
• Heat maps• Displays a bar for each server• Great to see uneven distribution across servers• Great to quickly spot performance problems across many servers• Difficult to read absolute values or see the total cluster activity
# 23
Cloud Management
Cluster monitoring• Current cluster monitoring: one graph per server
# 24
Cloud Management
Stacked graphs• Each color band shows contribution of one server• Servers are stacked on top of one another
# 25
Cloud Management
Heat maps• Each horizontal strip shows one server• The color shows how “hot” the server is running
# 26
Cloud Management
Heat map with 100 servers
# 27
Cloud Management
Stacked graph of the same 100 servers
# 28
Cloud Management
Cluster monitoring architecture
• Architecture• Monitoring front-end servers
pull data from storage servers• Up to 100 servers on one graph
(to be increased)
your servers
monitoringstorageservers
monitoringfront-endservers
# 29
Cloud Management
Server arrays provide horizontal scaling
# 30
Cloud Management
Governance Controls
• Access and security
• Authentication, roles, permissions
• Umbrella accounts and sharing
• Auditing and logging
• Server logs
• Infrastructure audits and tracking
• Usage and cost metering
• Cost tracking and quotas
• Real-time run rate projections
# 31
Cloud Management
Control Users & CostsMaintain IT control & visibility
• Access current and projected costs by project or department
• Roll-up and export cost data• Manage user permissions• Establish and enforce
corporate standards• Automate compliance
management• Maintain audit and log files
# 32
Cloud Management
Codify Corporate Best PracticesAchieve operational excellence and execute governance strategies
• Build library of company-specific best practices
• Preserve corporate learning• Standardize configurations
and architectures• Create run books with
associated operational scripts
• Collaborate and share cloud computing assets
# 33
Cloud Management
Niche Phase
• Share & preserve learning and best practices for next game
• Maintain the experience with SLA-
based automation ensures users
• Easily migrate “in-house” with hybrid cloud solutions
# 34
Cloud Management
RightScale Accounts
• Each account corresponds to a set of AWS credentials
• Complete isolation – reporting, configuration assets, cost tracking, etc.
• Configurations are easily shared amongst 2 or more accounts via Sharing Groups (see slide 9)
• “Enterprise Manager” allows you to manage multiple account under 1 parent account
# 35
Cloud Management
User Roles
• User roles and access rights are organized “Account down” as opposed to “User up”
• A user can access 1 or more environments with different roles and access rights
• SSO supported• Users are granted rights by Admin
via invitation process
# 36
Cloud Management
User Roles• Admin – full rights on RightScale; only role that can access
AWS private key material• Observer – may only observe an account• Actor – launch / terminate services, run configuration scripts
bundle instance, create volumes, etc. • Security Manager – only role that may create or edit security
groups (port access; firewall)• Designer – create ServerTemplates, RightScripts, set Alerts• Library – import configuration assets from library
# 37
Cloud Management
User Roles, continued
• Server-login – only role that may login to servers (SSH)• Publisher – can publish configuration assets to library; share
configurations via private “Sharing Groups”• Billing – manage billing info• Enterprise Manager – access all accounts under Enterprise
Group, grant access, control user roles• Lite User – limited access to RightScale; may launch pre-
configured systems published to Lite User account
Complete list available at: http://support.rightscale.com/15-References/Tables/User_Role_Privileges?highlight=user+roles
# 38
Cloud Management
Temporary Users
• Temporarily grant access & role(s)• Set automated expiration in # of days
# 39
Cloud Management
• Admin can set up private libraries
• Accounts with “Publisher” rights can publish ServerTemplate configurations into library
• Members of private libraries can access and deploy configurations
• No migration; seamless roll into production
Sharing Groups
Account 2Account 1 Account 3
# 40
Cloud Management
Visibility
GLOBAL (Master Parent Account)
Child #1
Global RS AdminManages user accounts and ServerTemplates for all branches.
PricingPricing set at Global level … pre-negotiated rates apply to all child accounts
Each group / PO can have specific number of accounts / users pre-associated … and can buy more at pre-negotiated corporate rate
Makes separate PO and gets charged for specific additional services (ie education, more private cloud nodes etc)
Monthly usage cost, associated to account and PO-number
Master Parent
Child #2
Child #7
Child #3
Child #4
Child #5
Child #6
Child #8
Child Accounts
LOB
2LO
B 1
Dev
.E
ME
A
PC
PC
Infrastructure Audits User Audits Cost Tracking Single Billing
# 41
Cloud Management
Visibility example: Infrastructure Audit• Review of all Security Groups or
SSH Keys• Includes audit of all Regions• Security Group audit analyzes all
or public ports
• SSH Key audit analyzes all or running servers
• Store up to 10 audits and use to baseline
• Audits can be downloaded as text or JSON files
# 42
Cloud Management
Billing
• RightScale will single bill for RS and AWS fees• Full support for AWS’ consolidated billing• RightScale accepts credit card, wire, ACH, check• Supports monthly, annual or multi-year invoicing• Standard Net30 payment terms• RightScale will mass-provision AWS accounts for customers
# 43
Cloud Management
RightScale for Enterprise
• Visibility: Single pane of glass for public, private, and hybrid clouds
• Cloud-enabled infrastructure:On-demand, elastic, metered
• Simplified provisioning:Standardized, enforced configurations
• Application-aware infrastructure: Manage systems, not servers
• Vendor freedom: Leave doors open in a rapidly changing environment
# 44
Cloud Management
The Enterprise Path to the Cloud
• Traditional Data Center
• Siloed, over capacity, server sprawl
• Virtualized Data Centers
• Increased consolidation and standardization
• Automated Hybrid Cloud
• Rapid, elastic provisioning
• Shared resource pools and workloads
• Pay per use
# 45
Cloud Management
myCloud private and hybrid clouds
# 46
Cloud Management
Use Case: Hybrid Cloud
• RightScale customer since 2009• Zynga manages their public and private/hybrid cloud (zCloud)
with RightScale – through a ‘single pane of glass’
“The zCloud also integrates with the operational and management tools that have proven critical to our business, such as RightScale and CloudStack.”
-Allan Leinwand
Zynga CTO – Infrastructure Engineering
# 47
Cloud Management
IT and Evolution of Infrastructure
Traditional ITSiloed/over capacity/server sprawl
ConsolidationPhysical infrastructure
VirtualizationIncrease utilization
StandardizationExtensible toolset
Abstraction / AutomationAPI / Config Management
Private / Multi-CloudPublic + Private
Public CloudDynamic/Elastic/Pay per Use
VisibilityUsers Accounts Billing Security
# 48
Cloud Management
RightScale’s BioPharma Solutions
Grid• Independent jobs /
parallel computing• Single or multiple worker
classes
Batch
Scheduled runs
Single or multiple worker classes
HPC
Complex jobs
Tightly coupled machines
Utility Computing
On-demand access to compliant builds
Self-service interface
# 49
Cloud Management
What is Private Cloud?
• Comprised of one or more datacenters
• Physical Infrastructure that sits behind an API
• May or may not leverage virtualization
• May or may not be hosted by ‘you’
• Is available only for your consumption.
# 50
Cloud Management
• Discourage rogue use of Public Clouds• Security and ComplianceControl
• Leverage existing hardware resources• Integrate with existing systems and
processesFlexibility
• Enable use of specialized hardware• Configure systems to match workloadsPerformance
Why Private and Hybrid Cloud?
# 51
Cloud Management
Application Portfolio
Requirements Filter
Resource Pools
App 1
App 2
App 3
Performance
Cost
Compliance
Reliability
Security
Workload Deployment Freedom
Management & automation – across cloud resource pools
App N
…
App 1
App 2
App 3
App N
…
Internal DC
Private Cloud 1
Public Cloud
# 52
Cloud Management
Benefits of myCloudAgility & Choice: Choose your cloud infrastructure based on Application requirements.
Flexibility: Manage application deployments across public and private clouds; scale on demand.
Control: Securely manage your public, hybrid, and private cloud deployments from a single Pane of Glass.
Proven: myCloud is based on proven Reference Architectures with key RightScale partners (Cloud.com, Euca, Openstack).
# 53
Cloud Management
Public IaaS Clouds
RightScale Cloud Management Platform
Applications & Data
Application Code
Middleware Automation
OS Image
Public Cloud Stack
AW
S E
C2
Re
gio
n
Ra
cksp
ace
Re
gio
n
e.g. Web Apps, Dev/Test, Self-Service, etc
# 54
Cloud Management
Cloud Infrastructure Hardware
RightScale Cloud Management Platform
Applications & Data
Host Servers – CPU, Memory
Storage
Networking
Private Cloud Stack
Cloud Infrastructure SoftwareVirtual Servers & Networking
Cloud & Storage Controller
Hypervisor
e.g. Web Apps, Dev/Test, Self-Service, etc
# 55
Cloud Management
Cloud Infrastructure Hardware
Applications & Data
Host Servers – CPU, Memory
Storage
Networking
myCloud Fills the Gap
Hypervisor
e.g. Web Apps, Dev/Test, Self-Service, etc
Application Code
Middleware Automation
OS Image
Virtual Servers & Networking
Cloud & Storage Controller
# 56
Cloud Management
Cloud Management Automates ApplicationsA
uto
mat
ion
Traditional Infrastructur
e
Cloud Infrastructur
e
ManagedCloud
Abstraction
Manual AppsManual Infrastructure= Slow & Expensive
Manual AppsAutomated Infrastructure= Manual Cloud
Automated AppsAutomated Infrastructure= Automated Cloud= RightScale
# 57
Cloud Management
Cloud FilesS3
US-West Cloud N
Storage N
US-East RAX
Use Case: Public to Public
Your Applications
IaaS
Storage
# 58
Cloud Management
Use Case: Public to Private
App A App B App C App D
IaaS
Storage
Public CloudPrivate Cloud
myCloud 1 myCloud 2 US-West RAX
DC1 DC2 S3 Cloud Files
# 59
Cloud Management
Use Case: Private to Public
myCloud 1 myCloud 2 US-West RAX
DC1 DC2 S3 Cloud Files
App A App B App C App D
IaaS
Storage
Public CloudPrivate Cloud
# 60
Cloud Management
Use Case: Private to Private
App A App B App C App D
IaaS
Storage
Public CloudPrivate Cloud
myCloud 1 myCloud 2 US-West RAX
DC1 DC2 S3 Cloud Files
# 61
Cloud Management
Create myCloud Account
Choose your infrastructure
Install your hardware
and register
Launch Server
Templates
Automate, monitor & manage
Integrate for hybrid clouds
Cloud Enable Your Infrastructure
# 62
Cloud Management
Dev & Test
• Lifecycle Challenges
• Limited, shared resources
• Lead time for procuring and provisioning equipment
• Maintaining consistent environments throughout the lifecycle
• Maintaining multiple environments in parallel
• Distributed teams and team members
# 63
Cloud Management
Dev & TestAvailable, Easily Provisioned Resources
# 64
Cloud Management
Batch Processing / Grid Computing
Challenges• For IT
• High capital investment, typically low capacity utilization• Scheduling conflicts, constant provisioning• Specialized architectural and operational skills• Specialized software applications and unique datasets
• For End Users• Wait for resources• Limited to resources available in the datacenter
1-Ja
n4-
Jan7-
Jan
10-J
an
13-J
an
16-J
an
19-J
an
22-J
an
25-J
an
28-J
an
31-J
an
3-Feb
6-Feb
9-Feb
12-F
eb
15-F
eb
18-F
eb
21-F
eb
24-F
eb
27-F
eb
2-M
ar
5-M
ar
8-M
ar
11-M
ar
14-M
ar
17-M
ar
20-M
ar
23-M
ar
26-M
ar
29-M
ar0%
50%
100%
Resource Utilization
# 65
Cloud Management
Grid Computing in the Cloud
Cloud Computing Model
Resources on Demand
Virtually Infinite Resources
Pay as You Go
Grid Computing in the Cloud
Resolves Scheduling Issues
Supports Faster Processing
Matches Costs to Demand
# 66
Cloud Management
Cloud-based Grid Computing Use Cases
Pharmaceutical Analysis – Researchers expected a protein analysis comparing 2.5 million compounds to take a week of processing on internal servers
• Using hundreds of servers, the job was completed in one day
Web 2.0 – One customer transcodes images to render video on demand
• Processing time was reduced from hours on internal resources to minutes
Insurance Claims Loss Control – Systems for detecting fraudulent, improper or duplicate claims in batches of millions of claims would have required months of processing time to run and millions of dollars in capital outlay to build in the data center
• Batch runs finished in a few days at significantly lower cost
Financial Data Processing – Back testing environments that analyze data to test new trading strategies
• Trading strategies analyzed faster and more cost-effectively by scaling out servers
# 67
Cloud Management
RightScale Grid / Batch ArchitectureAutomated server scaling, operational remediation, server cost optimization
SQS Input Queue SQS Error Queue
SQS Output Queue
Amazon S3Amazon S3
Batch jobs from Your job producer
application
Scalable cloud servers using RightScale Server Templates
Your application or next batch process
job consumer
Worker Daemon
Your code
RightScale Amazon Cloud InfrastructureCustomer code
RightScale Management Interface
# 69
Cloud Management69
• 600K concurrent users• 100X scaling in 4 days• 8,000 instances• 250K new users per hour• 0 to 35M unique users in one day• 1:1000+ data center management ratio
Why in the AWS Cloud with RightScale?
Extensive experience in large, highly-elastic single gaming applications
# 70
Cloud Management
Scalable Web Applications
# 71
Cloud Management
Scalable Web Applications• Add capacity as demand dictates• Classic example of “pay as you go” utility computing• Enables the ability to react to viral and flash-crowd events
without degradation of service• PaaS solutions exist that can leverage scalability benefits
• Zend Solution Pack• VMware’s Cloud Foundry
• Hybrid cloud environments can scale to take advantage of both public and private clouds• Zynga’s Z Cloud is currently the largest hybrid cloud in the world, all of
which is managed through the RightScale platform