Cloud Computing How We Got Here, Where We Are, and Where we Are Heading

The Cloud: Risks, Rewards and Realities

Cloud ComputingHow We Got Here, Where We Are,

and Where we Are Heading

Jeff Barr, Senior EvangelistAmazon Web Services


The Cloud is Suddenly Everywhere


How Did This Happen?What is it?

Where did it come from?

Where are we now?

Where are we going?


What is it?


What is Cloud Computing?Cloud Computing is a utility service - giving you access to technology resources managed by experts and available on-demand.

You simply access these services over the internet, with no up-front costs and you pay only for the resources you use.

Just like your electric utility….


Where did it come from?


Where Did The Cloud Come From?

1960!

IBM 1401


Communication 1960’s:

RS-232 Modem

1970’s: Internet TCP/IP ISDN

1980’s: DNS DSL Ethernet


Commodity Computing 1960 - IBM 1401

1977 - TRS-80

1977 - Apple ][

1982 - IBM PC

1985 – Rack mounted PC


Or, Put Another WayCommunicationsCommodity ComputingArchitectureSoftwareBusiness Value


ArchitectureSeparation of design and

implementation

Formal approach to design

Modularity


Software Cooperative development

IBM Share DECtape sharing BSD Open source

High-level languages Portable code Easy Sharing

Virtualization IBM VM/360 Xen


Business FocusValue of IT recognizedIT becomes a crucial success factorEmergence of the CIO


Where are we now?


Where We AreCloud adoption is now at early majority point


New Economic ModelNo capital expenditureCost-effective and economicalPay as you go and pay only for what you useTrue elastic capacity; Scale up and downImproved time to market


Why Are People So Excited?


Elastic and Pay-Per-Use Infrastructure

Unable to serve

customers

InfrastructureCost $

time

LargeCapital

Expenditure

OpportunityCost

PredictedDemand

TraditionalHardware

ActualDemand

AutomatedVirtualization


• Web site / application / SaaS hosting• Internal IT application hosting• Content delivery and media distribution• High performance computing, batch data

processing, and large scale analytics• Storage, backup, and disaster recovery• Development and test environments

Common Cloud Use Cases


Example: Wall Street App on Amazon EC2

3000 CPU’s for one firm’s risk management processes

Num

ber o

f EC

2 In

stan

ces

300 CPU’s on weekends

Thursday4/23/2009

Friday4/24/2009

Sunday4/26/2009

Monday4/27/2009

Tuesday4/28/2009

Saturday4/25/2009

Wednesday4/22/2009

3000 -

300 -


Example: Video App on Amazon EC2N

umbe

r of E

C2

Inst

ance

s

4/12/2008

Launch of Facebook modification

Scaled to peak of 5,000 instances in 3 days

4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/20084/17/20084/13/2008


Example: 30,000 Core Cluster in MinutesCycle Computing’s “Nekomata”

Top 5 Pharma – Molecular Dynamics95,078 compute hours (10.9 years)EC2 Spot Instances – 57% savings3 AWS Regions (US East, US West, EU West)CapEx: NoneOpEx: $1279 / hour for AWS + CycleCloud

The Cloud: Risks, Rewards and Realities 23


What is Amazon Web Services?Amazon Web Services is a cloud computing platform that provides flexible, scalable, and cost-effective technology infrastructure for businesses of all sizes around the world…

…utilizing the knowledge, expertise, and tools used to run Amazon.com’s global web properties since 1995.


2009Jan

» Amazon RDS» High-Memory Instances» Lower EC2 Pricing

» AWS Multi-Factor Authentication» Virtual Private Cloud» Lower Reserved Instance Pricing

» AWS Security Center

» Reserved Instances in EU Region» Elastic MapReduce» SQS in EU Region

» New SimpleDB Features» FPS General Availability

» Lower pricing tiers for Amazon CloudFront» AWS Management Console

» Amazon EC2 with Windows» Amazon EC2 in EU Region» AWS Toolkit for Eclipse» Amazon EC2 Reserved Instances » AWS Import/Export

» New CloudFront Feature» Monitoring, Auto Scaling & Elastic Load Balancing

» Amazon Elastic MapReduce in Europe

» EBS Shared Snapshots» SimpleDB in EU Region» Monitoring, Auto Scaling & Elastic Load Balancing in EU

Feb Mar Apr Ma

y Jun AugJul Sep Oct Nov Dec Feb

» Amazon CloudFront Private Content» SAS70 Type II Audit» AWS SDK for .NET

» Amazon EC2 with Windows Server 2008, Spot Instances, Boot from Amazon EBS» Amazon CloudFront Streaming» Amazon VPC enters Unlimited Beta» AWS Region in Northern California» International Support for AWS Import/Export

» Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances» Amazon S3 Versioning Feature» Consolidated Billing for AWS» Lower pricing for Outbound Data Transfer

2010Jan Mar

» Amazon SNS

The pace of innovation in 2009


2010Jan

» Amazon RDS Read Replicas» Suse EC2 Linux» Amazon SNS Console» Amazon ELB HTTPS» AWS Free Tier» EMR Resizing Cluster

» RDS Reserved» CloudFront Default Root» Startup Challenge 2010» CloudFront Invalidation

» CloudFront HTTPS» NYC Edge Location» Lowers Pricing HTTP» AWS Import Export GA» Amazon SNS» Amazon S3 Console» Amazon EBS CloudWatch

» Amazon SNS» Combined AWS Data Transfer Savings» Amazon EMR Bootstrap Actions» Amazon ELB Session Stickiness» Amazon RDS in EU» New Singapore Region

» EMR JobFlow Debugging» Simple DB Consistent Reads» Simple DB Conditional Puts

» VPC in EU» Amazon RDS in US-west» Amazon CloudFront Access Logs» Amazon RDS Multi-AZ» Amazon S3 RRS» Amazon RDS Console

» Amazon SQS Longer retention, Free TierAmazon S3 Bucket Policies» Amazon VPC IP Address» Cluster Compute Instances» Amazon S3 RRS Notifications

» Lowered Pricing EC2» AWS IAM» Amazon VPC Console» Micro Instances» Amazon Linux AMI» Amazon EC2 Tagging, Filtering, Idempotency, » Oracle Certified AWS» AWS PHP SDK

Feb Mar Apr Ma

y Jun AugJul Sep Oct Nov Dec Feb

» Amazon S3 Lowered Pricing» CloudFront GA, SLA» S3 Multipart» GPGPU Instance Types» ISO27001/2 Certification

» AWS Elastic Beanstalk» Amazon Simple Email Service» Improved AWS Support “Bronze”» Amazon CloudWatch Console

» AWS CloudFormation» Amazon S3 Static Websites» AWS IAM Website Login» Paris Edge Location

2011Jan Mar

» VM Connector» Tokyo Region» AWS Support JP

And pace accelerates in 2010….

» Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances» Amazon S3 Versioning Feature» Consolidated Billing for AWS» Lower pricing for Outbound Data Transfer

» AWS Java SDK» Windows BYOL» Singapore Pop» CloudFront Private Streaming

» Free Monitoring EC2» Amazon Route 53» PCI DSS Level 1 Certification» Mobile SDKs (Android, iPhone)» Large Object S3 Support» Florida POP» Import/Export APAC

» New VPC» Dedicated Instances» Windows2008 R2


2011Jan Feb Ma

r Apr May Jun AugJul Sep Oct Nov Dec Feb

2012Jan Mar

“Every day is a launch day”

» AWS Elastic Beanstalk» Amazon Simple Email Service» Improved AWS Support “Bronze”» Amazon CloudWatch Console

» AWS CloudFormation» Amazon S3 Static Websites» AWS IAM Website Login» Paris Edge Location» Amazon Route53» New VPC» Dedicated Instances in VPC» Windows 2008 R2» New AZ in JP

» VM Connector» Tokyo Region» AWS Support JP» AWS IAM for CloudFront» VPC Virtual Networking» VPC Internet Access

» Spot Integration with HPC instances» Amazon EMR in APAC» AWS Mobile SDKs» Live Streaming with CloudFront» AWS IAM GA» AWS IAM Web Console

» AWS IAM GA» AWS IAM Web Console» AWS Beanstalk Tomcat 7 Support» Amazon CloudWatch Custom Metrics» Amazon CloudWatch lower pricing» AWS SAP Certification» Amazon RDS for Oracle» Amazon ELB ipv6 support, Zone Apex» Amazon ELB Security Group integration» Amazon Route53 GA, ELB integration» Amazon Route 53 Weighted RR» New pricing control for Spot» AWS CloudFormation new enhancements

» On-demand Red Hat » Stockholm Edge Location» AWS Elastic Beanstalk new enhancements» New Data Transfer pricing» Free Inbound Data Transfer» AWS Import/Export

for EBS» AWS CloudFormation new features» AWS SDK for Ruby» Attachment support for Amazon SES» AWS Startup Challenge goes global

» AWS DirectConnect» Amazon VPC Everywhere» Mulit-AZ VPC» AWS IAM Identity Federation» AWS toolkit of eclipse 2.0» AWS GovCloud US» Spot in Amazon EMR» Amazon ElastiCache» Amazon VM import Win2k3

» AWS Mobile SDK GA» AWS Toolkit of Visual Studio» AWS DirectConnect USWest Location


AWS Regions

Ashburn, VA / Dallas, TX / Jacksonville, FL / Los Angeles, CA / Miami, FL / Newark, NJ / New York, NY / Palo Alto, CA / Seattle, WA / St. Louis, MO / Amsterdam / Dublin / Frankfurt / London / Hong Kong / Paris / Stockholm / Tokyo / Singapore

US East (Northern Virginia)US West (Northern California)GovCloud (US) (West Coast)Europe (Dublin)Asia Pacific (Singapore)Asia Pacific (Tokyo)

6 AWS Regions

19 AWS CloudFront Locations


Amazon Web Services

ComputeAmazon Elastic Compute Cloud (EC2)

Auto Scaling

StorageAmazon Simple Storage Service

(S3)Elastic Block StorageAWS Import/Export

Cloud-Powered Applications

Content DeliveryAmazon

CloudFront

MessagingAmazon Simple Queue Service (SQS)

Amazon Simple Notification Service (SNS)Amazon Simple Email Service (SES)

Parallel Processing

Amazon Elastic

MapReduce

MonitoringAmazon

CloudWatch

DatabaseAmazon RDS

Amazon SimpleDBThird-Party Offerings

ManagementAWS Management

ConsoleAWS Elastic Beanstalk

ToolsAWS Toolkits for Eclipse

Java, PHP, Ruby, Python, .Net Developer

Centers

NetworkVirtual Private Cloud

Route 53AWS Direct Connect

Elastic Load Balancing

Metering and BillingIdentity and Access Management

CachingAmazon

ElastiCache

Regions and Availability Zones


AWS Security ResourcesAWS Security White PaperC & A:

SAS 70 Type II ISO 27001 PCI DSS FISMA Moderate

HIPAA applicationsAWS GovCloud (US)http://aws.amazon.com/security/

http://aws.amazon.com/security/


Amazon Elastic Compute CloudAmazon EC2: on-demand compute power

Obtain and boot new server instances in minutesQuickly scale capacity up or downEleven instance typesHourly billing

Key features:Support for Windows, Linux, and FreeBSDSupports all major web and application platformsDeploy across Availability Zones for reliability


Amazon EC2 Pricing Options

On-DemandInstances

Pay as you go for compute powerPay only for what you use, no up-front commitments or long-term contractsUnix/Linux instances start at $0.02/hour USD in the US East Region

ReservedInstances

Pay a low up-front fee and receive a significant discount on the hourly pricing for that instance1- or 3-year termsHelps ensure that compute capacity is available when it is needed

SpotInstances

Enables you to bid on unused Amazon EC2 capacitySpot Price is based on supply/demand and is determined automaticallyIf the Spot Price is below your bid, your instances will startIf the Spot Price rises above your bid, your instances will stop


Amazon EC2 Instance SpecsStandard High-CPU High-Memory Cluster

Micro Small

Large Extra Large

Medium

Extra Large

Extra Large

Double Extra Large

Quadruple Extra Large

Cluster Compute Quadruple Extra

Large

Cluster GPU Quadruple Extra

Large

Bits 32 32 64 64 32 64 64 64 64 64 64

RAM 613 MB

1.7 GB

7.5 GB

15 GB 1.7 GB 7 GB 17.1 GB

34.2 GB

68.4 GB 23 22

Local Disk

0 160 GB

850 GB

1690 GB

350 GB 1690 GB 420 GB

850 GB

1690 GB 1690 GB 1690 GB

EC2 Compute Units

Burst to 2

1 4 8 5 20 6.5 13 26 33.5 33.5

Cores 1 1 2 4 2 8 2 4 8 8(Dual Processor)

8(Dual Processor)

GPU 2 x Nvidia Tesla "Fermi" M2050

Firewall Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes

Linux Per Hour

$0.02 $0.085

$0.34 $0.68 $0.17 $0.68 $0.50 $1.20 $2.40 $1.60 $2.10

Windows Per Hour

$0.03 $0.12

$0.48 $0.96 $0.29 $1.16 $0.62 $1.44 $2.88 N/A N/A

All prices subject to change – Current as of April 15, 2011


https://aws.amazon.com/console

AWS Management Console


Where are we going?


Where Are We Going (Our Newest Services) Relational Database Service

Provision a relational database in seconds

Virtual Private Cloud Virtualized network – routers, ACLs, IP ranges

Elastic Beanstalk Simplified application hosting

AWS CloudFormation Higher-level application (stack) management


Amazon Relational Database Service Provision a new relational database in seconds

MySQL (5.1 and 5.5) Oracle (11G)

Offload common administrative tasks to AWS OS upgrades DB upgrades and patches Scaling CPU and storage Backups & Restores

Use your existing code and tools

Pay only for what you use, no up-front commitments


RDS in Action


RDS in Action


AWS CloudFormation Stack Creation

AMAZON CONFIDENTIAL

Define a JSON template of AWS Resources to provision (EC2 instances, AZ lists, AMIs, EIP, RDS, etc)

Parameterization supported

Use CLI, API, or Management Console to register and create an AWS stack

Service automatically determines interdependencies AWS resources get created

across tiers and AZs forming a CloudFormation Stack


Amazon Virtual Private Cloud - VPC Create an isolated set of EC2 instances in the AWS cloud

Divide your IP address range into one or more public or private subnets

Control inbound and outbound access to and from individual subnets using stateless Network Access Control Lists

Protect your Instances with stateful filters for inbound and outbound traffic using Security Groups

Bridge your VPC and your onsite IT infrastructure with an encrypted VPN connection




AWS Elastic BeanstalkSimple way to deploy and manage an application

Fault tolerance Scale Administration

First Container Type: Java / Tomcat

Other platforms and languages to follow

Upload applications to AWS in minutes

Retain control and ability to “open the hood”




For More InformationAWS Web Site: http://aws.amazon.com

AWS Blog: http://aws.typepad.com

Email: [email protected]

Twitter: @jeffbarr

http://aws.amazon.com/

http://aws.typepad.com/

mailto:[email protected]


Thank YOU!


Slide Credits Crystal Ball: http://amzn.to/g06rZ8

RS-232 Cable: http://amzn.to/gxGpnJ

IBM 1401: http://en.wikipedia.org/wiki/File:IBM_1401_Control_Panel.jpg

IBM Flowcharting Template: http://www.retroist.com/2009/01/11/ibm-flowcharting-template/

COBOL for Dummies: http://amzn.to/g3OjEb

Internet in a Box: http://en.wikipedia.org/wiki/Internet_in_a_Box

TRS-80: http://en.wikipedia.org/wiki/TRS-80

Ethernet Connector: http://en.wikipedia.org/wiki/Ethernet

9-Track Tape: http://en.wikipedia.org/wiki/9_track_tape

DECtape: http://en.wikipedia.org/wiki/DECtape

C Programming Language: http://en.wikipedia.org/wiki/File:Kr_c_prog_lang.jpg

Innovation curve: http://en.wikipedia.org/wiki/File:DiffusionOfInnovation.png

http://en.wikipedia.org/wiki/9_track_tape

http://en.wikipedia.org/wiki/9_track_tape

Documents

Cloud Computing How We Got Here, Where We Are, and Where we Are Heading