21
Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog : http://cloud4developers.com/

Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Embed Size (px)

Citation preview

Page 1: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Bullet proof your Amazon Cloud Deployment

Ezhil Arasan BabarajDirector – CSS Corp LabsCSS CorpTwitter : @ezhilsathyaBlog : http://cloud4developers.com/

Page 2: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

About CSS Corp

© 2010 CSS Corporation 2

Recognized leader in Technology Operations

Management with CoEs in Telecom, SaaS, Cloud, RIM,

Testing, Support and R&D

Strong Partner Ecosystem; AWS, Microsoft, IBM, HP

150+ Long Term, Strategic and Profitable Customers

Operations in USA, UK, Poland, India, Manila &

Singapore

Strong Tools Portfolio

Passion for Advanced Technology Operations & Support Dedicated CSS Labs for Technology Innovation Business Operations and Technology Optimizer Out-comes based pricing models Top Mid Market ITO Provider 2007,2008,2009 – DataMonitor

100% Referenceable Customers Driving Technology Innovation and adoption Technology OpEx Optimization Transparency ,Openness & Flexibility Independent Centers of Excellence for R&D, Testing and Support

Privately held by investors including Goldman Sachs, SBAIF, Sierra

Ventures 5,000+ Resources Market Validation – 100% Client Retention Completed 3 acquisitions in 2010

Page 3: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Cloud Services & Solution

© 2010 CSS Corporation 3

Page 4: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Cloud Enablement Service & Phases

S.No Phase Key Activity Breakdown

1 Cloud Assessment

2 Cloud Architecture Development

3 Proof of Concept

4 Application (& Data) Migration

5 Production Operations & Optimization

© 2010 CSS Corporation 4

Application / Subsystem portfolio analysis and classification

Technical Assessment Financial Assessment CLIENT Cloud Deployment Architecture Private Cloud Deployment Architecture OSS Strategy (COTS Vs In-house Tools)

Tools Deployment Runbook Development Optimize usage based on demand

Build a pilot to validate technology AMI Creation Forklift / Hybrid Migration of applications

Page 5: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Context

© 2010 CSS Corporation 5

Complex Systems

Cascading Failures

Designing for Failure

Testing for Failure

Cloud Vs Traditional

Page 6: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

What To Do?

© 2010 CSS Corporation 8

Understand the Cloud Provider

Appropriate use of Cloud Tools

Draft a Good backup strategy

Implement Monitoring & Alerting

Ensure Effective Recovery Mechanisms

Automate Provisioning

Page 7: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Compute Cloud Provider

© 2010 CSS Corporation 9

EC2: Elastic Compute Cloud

Multiple Regions

Availability Zones

Machine Images(AMI)

EBS Volumes

Security Groups

Elastic IPs

Page 8: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Understanding AMI’s

© 2010 CSS Corporation 10

EC2: Elastic Compute Cloud

Multiple Regions

Availability Zones

Machine Images(AMI)

EBS Volumes

Security Groups

Elastic IPs

Page 9: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

AMI Type: EBS based

© 2010 CSS Corporation 11

Quick boot up

Ability to take Snapshots

Ability to stop instances

Variable Root Disk Sizes

Ease of Bundling

Page 10: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

AMI Choice & Customization

© 2010 CSS Corporation 12

Choose Trusted AMI

Launch AMI

Customize Instance

Install Provisioning Agent

Bundle the Instance=New AMI

Perform tasks on DR Regions

Page 11: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Application Deployment

© 2010 CSS Corporation 13

Tested deployment

Best when publicizing

An AMI for Every Version

Cumbersome to Maintain

Instance specific App Configs

Runtime choice

Easy to maintain deployment

Dynamic Configurations

Development knowledge

Not effective when creating public AMI's

Script Provisioning

Page 12: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Data Backup

© 2010 CSS Corporation 14

S3 Based backup

Network File Sharing & Virtual SAN

Offsite / Remote Backups

Distributed / Replicated FS

Remote Server Sync

EBS Snapshots

Page 13: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

DR Setup

© 2010 CSS Corporation 15

Needs a maintenance window

Would do with some data loss

Better cost benefit

Requires monitoring of the Primary

site

Needs a setup running all the time

Higher cost of running

All updates and patch need to be applied

Needs data to sync at all times

Cold Setup

Page 14: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Effective * DR Strategy

© 2010 CSS Corporation 16

Run the DR setup in proximity

Run all the components

Back up all data frequently

Not having fallback for DR setup

Track all the changes in live system

Keep 2 level redundant backups

Define maintenance windows

Monitor all at all times

Do’s

Page 15: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

DR Demonstration

© 2010 CSS Corporation 17

Infrastructure Monitoring Dashboard

Page 16: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

DR Demonstration: Cold DR

© 2010 CSS Corporation 18

Keep script updated & versioned

Database Backup

Bring down the Live Environment

AMI with CloudSmart on DR Region

Script CloudSmart for DR

Bring up the Environment in DR

Page 17: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

DR Demonstration Architecture

© 2010 CSS Corporation 19

Page 18: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

We managed to survive

© 2010 CSS Corporation 20

• The AWS US East Outage

Page 19: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Demo

© 2010 CSS Corporation 21

Page 20: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

Confidential

Best Practices

© 2010 CSS Corporation 22

Build Using AWS Components

Storage of Images / Static files & Content Delivery – S3 / CloudFront

Queue for storing messages – Simple Queue Service

Email sending service – Simple Email Service

Publish message / Subscription to messages - Simple Notification Service

Non-relational Data Store – Simple DB

Relational Database MySQL / Oracle – Relational Database Service

Distribution of traffic – Elastic Load Balancing

Page 21: Bullet proof your Amazon Cloud Deployment Ezhil Arasan Babaraj Director – CSS Corp Labs CSS Corp Twitter : @ezhilsathya Blog :

©2010 CSS Corp – Copyright Notice:

This presentation contains proprietary information of CSS Corp. No part of this presentation may be reproduced, stored, copied, or transmitted in any form or by means of electronic, mechanical, photocopying or otherwise, without the express consent of CSS. This presentation is for a specific intended audience circulation only and not meant for external distribution. Information is classified into 4 levels:

Confidential: This is specifically restricted to the Senior Management and specific professional advisers.

Restricted: This is restricted to Senior Management (PA’s and assistants an also access subject to respective reporting head’s approval).

Private: This covers all information assets that have value but which do not need to fall within either of the other categories.

Public: This is information which can be released outside the Organization.

Thank You!