Upload
sai1983
View
222
Download
0
Embed Size (px)
Citation preview
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 1/18
Cloud Computing and AmazonWeb Services
CJUG March, 2009
Tom Malaher
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 2/18
Agenda
What is Cloud Computing?Amazon Web Services (AWS)Other OfferingsComposing AWS Services
Use CasesEcosystemReality CheckPros&ConsCostAWS DemoResources
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 3/18
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 4/18
Variations on a Theme
Infrastructure as a Service (IaaS)Storage, Computing
Platform as a Service (PaaS)
Microsoft AzureGoogle App Engine
Software as a Service (SaaS)SalesForce.comGoogle DocsMicrosoft Office Live (note: still needs local install!)
Grid Computing
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 5/18
Amazon Web Services (AWS)Commerce-Related
Associates Web Service
Flexible Payment Service (FPS)Fulfillment Web Service (FWS)
Infrastructure-RelatedElastic Compute Cloud (EC2)
Runs Amazon Machine Images (AMIs) (Linux, Windows)
Elastic IP, Elastic Block Store (EBS)SimpleDB (SDB)Simple Storage Service (S3)Simple Queue Service (SQS)CloudFront
DevPay Miscellaneous
Alexa Web Search (Family of services)Mechanical Turk
Public Data Sets
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 6/18
Other Offerings
SunMySQL, OpenSolaris AMIs on EC2
Google App Engine
Host specially written Python Apps in Google's Cloud
IBM Computing on Demand (CoD) Centers
Amazon Machine Images
Microsoft AzureHost specially written .NET Apps in Microsoft's Cloud.NET, Live and SQL Services available
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 7/18
Communication between AWS Services "within the cloud" ischeaper (no bandwidth charges) than crossing the cloudboundary (some services still charge per transaction).
Composing AWS Services
S3 EC2SDB
SQS
External Servers, Clients and Browsers
HTTPBittorrent
HTTPSSHAnything
SOAPREST
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 8/18
Composing AWS Services (cont.)
Roles of each serviceEC2: Web Server, App Server, Relational DB Server
Can be clusteredExpand/contract on demand
SDB: Non-Relational DB
Quick lookupNo Schema, Strings only!No TransactionsLimited size: point to S3 for data
SQS: Asynchronous de-coupled communicating processesVisibility Timeout instead of transactions/acknowledgementLimited message size: point to SDB or S3 for data
S3: Large data sets(Media, Block Data)
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 9/18
Use Cases
eCommerceEC2:
Web (cluster)App (cluster)
DB if needed (data warehouse, reporting, order history)SDB: Carts, Wish Lists, Product CatalogSQS: Completed Orders sent to FulfillmentS3: Media, Storage of:
Product Images/VideosPDF SpecificationsSoftware bundles for electronic delivery
CloudFrontDelivery of above via HTTP or BitTorrent
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 10/18
Use Cases (cont.)
Bulk Data Processing/Map-Reduce (e.g. Image Conversion,Hadoop, Genome Analysis)
EC2: Controller, WorkersSQS: Controller messages, Worker responses
SDB: Work unit metadataS3: Worker input data, Worker results, Intermediate ReduceResults, Final Results
Software as a Service:
EC2: Web Application, Load BalancingS3: Application DataSDB: Metadata (User Database, ACLs, Indices)
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 11/18
It's an Ecosystem
Other vendors (e.g. Sun, IBM) are offering AMIs and speciallicensing deals for use on EC2.
There are software vendors who are writing free or commercial
applications entirely on AWS.
Amazon hosts a Solutions CatalogBackupAsset ManagmentEC2 Management/MonitoringCRMetc.
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 12/18
Reality Check
Is anybody doing it ? Source: Infrastructure Executive Council, Fall 2008
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 13/18
Pros
Expand and Contract as needed (TSN March Madness,PumpkinMasters, Facebook App)Pay for only what you use (CPU Time, Bandwidth,Transactions)
Leave the infrastructure management to someone elseAmazon offers an SLA with Service Credits (for EC2, so far)
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 14/18
Cons
Applications not suitable for the Cloud (yet)Very tight SLAReal time application response timesApplications requiring high bandwidth (to the end user)
Sensitivity of the application to latencySecurity ConcernsHigh Performance (CPU, RAM) Requirements
Cost!
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 15/18
CostDifficult to compare, due to threshold-based vs. pay-as-you go
pricing, but:
1and1.com: Virtual Server: $59/month1GB RAM, 50 GB HD, 2000 GB Transfer
AWS EC2 Image: $72/month1.7GB RAM, 160 GB HDIf you actually transferred 2000GB in one month: $340/monPersistent 50 GB Storage (EBS): $67.50/month
Worst case Total: $479.50http://calculator.s3.amazonaws.com/calc5.html
But if you only used it for a day? $16
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 16/18
Task Management System:Manager sends tasks to workers who are notified of new tasksvia a desktop 'alerter' application and a web-based task list.
AWS Demo
S3 EC2SDB
SQS
Browser
HTTPHTTP
REST
Thick Client
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 17/18
Resources
Sun
http://www.sun.com/solutions/cloudcomputing/http://blogs.sun.com/WebScale/entry/mysql_in_the_cloud
IBM http://www.ibm.com/cloud/HP
http://www.hpl.hp.com/research/cloud.htmlDell
http://www.dell.com/cloudcomputingEverybody
http://gigaom.com/2008/05/28/hp-weds-cloud-and-high-performance-computing/ Yahoo
http://research.yahoo.com/Cloud_Computing
8/8/2019 Cloud Computing and Amazon Web Services
http://slidepdf.com/reader/full/cloud-computing-and-amazon-web-services 18/18
Resources (cont.)
Googlehttp://docs.google.comhttp://code.google.com/appengine/
Microsoft
http://www.officelive.comhttp://www.microsoft.com/azure/
Amazonhttp://aws.amazon.com/
Solutions Catalog:
http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=60
New York Times Image conversion projectshttp://open.blogs.nytimes.com/tag/aws/