Amazon Web S ervices Overview18-April-2011-C loud Computing Team
April 18, 2011
Instructions
- 2TCS Internal
• You are in Lecture Mode• If you want to ask Question, ask it through webex. S end it in chat message to all participants. Do not send as private message.
• We will try to answer a few at the end of section. If some questions are un-answered we will publish answers soon on our KM site.
• We will share this PPT in couple of days.• We have limited US bridge numbers and we do not have any UK local number. In case you are not able to connect to US A number, request to connect to India number.
April 18, 2011
Objectives
Iaas Overview
AWS Overview
Key AWS Products for IaaS
Amazon Economic Center
Amazon S ecurity
AWS Practical Use
Demo
April 18, 2011
Objective
- 4TCS Internal
•Understand AWS as IaaS
•Learn Key Different Products of AWS
•Learn S ecurity Features
•Know where AWS can be useful
•AWS Economics
IaaS Overview
- 5
April 18, 2011
What is C loud Computing?
- 6TCS Internal
April 18, 2011
What is IaaS Under the Hood?
- 7 -
Physical Resources(Servers, Storage, Networking)
Virtualization & Virtualization Technologies(Servers, Storage, Networking) / Hypervisors
Virtual Machines(OS, Software, Tools)
Management Tools(Provisioning, Orchestration, Monitoring, Metering, Charge-Back, etc.)
On-Demand Self-Service
TCS Internal
April 18, 2011
IaaS
- 8 -
Infrastructure as a Service (IaaS)Infrastructure as a Service (IaaS)
StorageStorage NetworkingNetworking
ManagementManagement
Physical StoragePhysical Storage
Virtual StorageVirtual Storage
Shared StorageShared Storage StorageStorageReplicationReplication
BackupBackupRecoveryRecovery
ILM/HSMILM/HSM
Switches &Switches &RoutersRouters
LoadLoadBalancersBalancersFirewallsFirewalls
WAN/LAN/VLANWAN/LAN/VLAN
Dynamic DNSDynamic DNS
VPNVPN
Self-Service &Self-Service &OrchestrationOrchestration
InfrastructureInfrastructureProvisioningProvisioning
Monitoring &Monitoring &ReportingReporting
ResourceResourceManagementManagement
UtilizationUtilizationMeteringMetering
Charge-BackCharge-Back
SecuritySecurity
PhysicalPhysicalSecuritySecurity
Auditing &Auditing &ComplianceCompliance
ID ManagementID Management
Authentication &Authentication &AuthorizationAuthorization
ServersServers
Physical ServersPhysical Servers ServerServerVirtualizationVirtualization Virtual MachinesVirtual Machines OperatingOperating
SystemsSystems
Network SecurityNetwork Security
IntrusionIntrusionDetectionDetection
TCS Internal
April 18, 2011
Advantages
- 9TCS Internal
• Cost E ffective & Optimal Resource Utilization
• Ubiquitously available on Demand
• Can be configured to make High Available & High reliable S ystem
• Useful as DR S ystem
• E lasticity & S calability
• Lowe Total Cost of Ownership
• Minimal Administration
AWS Overview
- 10
April 18, 2011
Three Parts of Amazon
TCS Internal - 11
1
2
3
Ref. Amazon Training Material
April 18, 2011
Amazon Web S ervices
TCS Internal - 12
http://aws.amazon.com
April 18, 2011
Amazon Key Products
IaaS• Amazon E lastic Compute
C loud• Amazon E lastic Block
S torage• Amazon S imple S torage
S ervice• Amazon C loudFront• Amazon VPC• E lastic LoadBalancer• AWS Import / Export
Automation & Monitor• E lastic BeanS talk• AutoS caling• Amazon C loud Watch• AWS C loudformation
TCS Internal - 13
Payment• Amazon Flexible Payments
S ervice• Amazon DevPay
Notifications• Amazon S imple Queue
S ervice• Amazon S imple Email
S ervice
Database & Computing• Amazon S impleDB• Amazon RDS• Amazon E lastic MapReducehttp://aws.amazon.com/products/
April 18, 2011
Getting S tarted With AWS
TCS Internal - 14
CreateDeveloper Account
Enter PaymentInformation
S ign Up for Desired S ervices
Retrieve Private & Public Keys
Build & Deploy Application
Monitor and S cale Application
April 18, 2011
AWS Definitions
TCS Internal - 15
Instance
AMI
Volume
S napshot
S torage
April 18, 2011
Regions & Zones
TCS Internal - 16
• Amazon EC2 provides the ability to place instances in multiple locations. Amazon EC2 locations are composed of Availability Zones and Regions.
• By launching instances in separate Regions, you can design your application to be closer to specific customers or to meet legal or other requirements. By launching instances in separate Availability Zones, you can protect your applications from the failure of a single location.
Availability Zone A
Availability Z one B
Availability Zone C
Availability Zone D
Availability Z one A
Ava ilability Z one B
U S Eas t R eg ion (N .V A ) E U Wes t R eg ion (IR E )
Availability Z one A
Ava ilability Z one B
U S Wes t R eg ion (N .C A )
Availability Z one A
Ava ilability Z one B
APAC R eg ion Tokyo
Availability Z one A
Ava ilability Z one B
A PAC R eg ion S ing apore
Availability Z one B
Amazon Key IaaS Products
- 17
April 18, 2011
Amazon EC2
• Key product for Amazon as it provides controlled elastic Infrastructure on demand.
• Provides scalability on demand
• S ecure access with key-pair & groups.
• Pay as you use.
• S upports many OS & software certified by vendors.
• Create your own AMI with pre configured software.
• Comes with pre built AMI to save your install & deployment time.
• Easy to use and maintain.
TCS Internal - 18
http://aws.amazon.com/ec2/
April 18, 2011
EC2 Instance Types & S ize
TCS Internal - 19
S tandard High CPUS mall Large Extra
LargeMICRO Medium Extra Large
Bits 32 64 64 32 / 64 Bit 32 64
RAM 1.7 GB 7.5 GB 15 GB 613 MB 1.7 GB 7 GB
Disk 160 GB 850 GB 1690 GB 350 GB 1690 GB
EC2 Compute Units
1 4 8 2(S hort Burst)
5(2 virtual cores with 2.5
EC2 Compute Units each)
20 (8 virtual cores with 2.5
EC2 Compute Units each)
I/O Performance
Medium High High Low High High
Name m1.small m1.large m1.xlarge
t1.micro c1.medium c1.xlarge
Instance PricingLinux Per Hour
$0.085 $0.34 $0.68 0.02 $0.17 $0.68
Windows Per Hour
$0.12 $0.48 $0.96 0.03 $0.29 $1.16
http://aws.amazon.com/ec2#instance
April 18, 2011
EC2 Instance Life Cycle
TCS Internal - 20
AMI
Instance(Pending)
RunInstances call to cloud•Specify which AMI to launch•Provide parameters (# instances, security group, etc)
Instance launch initiated•Copy AMI bootable part) from S3•Assign parameters
Instance(Running)
Instance(Shutting Down)
Instance(Terminated)
• Attach EBS Storage once running
• Assign Elastic IP Address
• Resources automatically detached (IP, storage)
• Can also be initiated as normal operating system shutdown
Instance(Stopped)
• EBS Backed Instance
April 18, 2011
Amazon EBS
• Amazon Elastic Block Store (EBS) provides block level storage volumes for use with Amazon EC2 instances.
• EBS provides highly available, highly reliable storage volumes
• EBS volumes are off-instance storage that persists independently from the life of an instance.
• EBS is suited for applications that require a database, file system, or access to raw block level storage.
• EBS volumes are created in a particular Availability Zone and can be from 1 GB to 1 TB in size.
• EBS provides the ability to back up point-in-time snapshots of your data to Amazon S3 for durable recovery.
TCS Internal - 21
http://aws.amazon.com/ebs/
April 18, 2011
EBS with EC2 & S 3
TCS Internal - 22
How EBS Interacts With EC2 and S3
Internet
AWS Cloud
EC2 Availability Zone
EC2
S3 Storage
EBS
EC2
EC2
EBS
EBS
EBS
EBS
EBS
EBS Snapshot
EBS Snapshot
EBS Snapshot
EBS Snapshot
EBS Snapshot
Create Snapshot
Clone From Snapshot
April 18, 2011
EBS Pricing
• Volume storage is charged by the amount you allocate until you release it, and is priced at a rate of $0.10 per allocated GB per month
• Amazon EBS also charges $0.10 per 1 million I/O requests you make to your volume
• As an example, a medium sized website database might be 100 GB in size and expect to average 100 I/Os per second over the course of a month. This would translate to $10 per month in storage costs (100 GB x $0.10/month), and approximately $26 per month in request costs (~2.6 million seconds/month x 100 I/O per second * $0.10 per million I/O).
TCS Internal - 23
April 18, 2011
Amazon S 3
• Amazon S 3 is storage for the Internet. It is designed to make web-scale computing easier for developers.
• Amazon S 3 has a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure of Amazon.
• S imple to get going, simple to use
• Programmatic access via web services API
• For large data migration Amazon Import / Export.
TCS Internal - 24
http://aws.amazon.com/s3/
April 18, 2011
S 3 Vs EBS
TCS Internal - 25
http://aws.amazon.com/documentation/s3/
Amazon S 3 EBS
Paradigm Object store File system
Performance Very fast Very very fast
Redundancy Across data centers Within data center
S ecurity Public Key / Private Key Visible only to your EC2
Access from the Net? Yes(1) No(2)
Typical use case Write once, read many It’s a disk drive
April 18, 2011
S 3 Pricing
TCS Internal - 26
1 TB / MonthNext 49 TBper Month
Next 450 TBper Month
Next 500 TBper Month
US S torage (Designed for 99.999999999% Durability)
$0.14/GB $0.125/GB $0.110/GB $0.095/GB
Reduced Redundancy S torage (Designed for 99.99% Durability)
0.093 / GB 0.083 / GB 0.073 / GB 0.063 / GB
Data Trans fer
< 1 GB per Month Up to 10 TB / Month Next 40 TB /
MonthNext 100 TB
/Month
Inbound $0.10 / GB
Outbound 0 $0.15/GB $0.11/GB $0.09/GB
Within C loud Free
Requests
PUT, COPY, POS T, or LIS T $0.01 / 1000 Requests
GET and all other requests (No charge for delete) $0.01 / 1000 Requests
+
+
April 18, 2011
AMI Types
TCS Internal - 27
• An Amazon EC2 instance can be launched either from an AMI backed by Amazon S 3 or an AMI backed by Amazon EBS .
EBS -backed Instances• EBS volume attached automatically as root device. • Any changes to the local storage are then persisted and will survive instance failures
and restarts• Not all software and architectures are supported out-of-the-box as EBS -backed AMIs. • The EBS volume is mounted as the root device
S 3 (Instance)-backed Instances• S 3-backed EC2 instance gives direct control over files persistence• You have to manually attach and mount an EBS volume for persisting your data.
• Once your S 3-backed instance is terminated, any local instance storage (instance) will
be lost, but your original data and configuration will persist in your EBS volume.
April 18, 2011
AMI Types
TCS Internal - 28
EBS-backed Instances
S3 (Instance)-backed Instances
Pending Running
Terminated S huttingDown
Launch
Term
inate
Costs EC2 ($ /
Hour)
Pending Running
Terminated S huttingDown
Launch
Stop
Costs EC2 ($ /
Hour)
S topped
StartTerm
inate
Terminate Costs EBS ($ /
Hour)
For More Detailshttps://knowmax.ultimatix.net/Innovation%20Corner/Cloudcomp/Cloud%20Docs/Forms/AllItems.aspx?RootFolder=%2fInnovation%20Corner%2fCloudComp%2fCloud%20Docs%2fPersistent%20Data%20Storage&FolderCTID=&View=%7b61DC70A4%2d2B56%2d4A22%2d9C72%2dDF3658ED228F%7d
April 18, 2011
Amazon Foundation WebS ervice
TCS Internal - 29
April 18, 2011
E lastic BeanS talk
E lastic BeanS talk
TCS Internal - 30
In Local system - Using Eclipse- Packaging the application
Development
By setting - Instance type - Region - Firewall - Keys
- from the running instance - to use the AMI in Autoscaling
- logging into the instance-setting up the runtime environment-copying the appfrom local system
- through command line (API tools)-setting up an ELB- setting up scaling Triggers
Ins tanc e Launc h Deployment
AM I C reationAuto S c a ling
Ac c es s Applic a tion us ing E LB U R L
Amazon Economic Center
- 31
April 18, 2011
The Cloud Cost Differentiators
• Pay as you go Model
• Increase / decrease the infrastructure as and when required
• Do not pay additional for• E lectricity• License• Maintenance / AMC• S pace / real estate
• Minimal administration efforts
• E ffective resource utilization (as per study 40% vs. 80% in virtualized world)
• The faster procurement & deployment time
TCS Internal - 32
April 18, 2011
Instance Pricing Options
TCS Internal - 33
FreeOn
Demand R es erved S pot
Price
Defined Free Quota of EC2
Linux micro instance, ELB , EBS and other
services
On-Demand Instances let you pay for compute
capacity by the hour with no
long-term commitments
Reserved Instances give you the option to make
a low, one-time payment for each instance you want to reserve and in
turn receive a s ignificant
discount on the hourly usage
charge for that instance
S pot Instances enable you to bid for unused Amazon EC2 capacity. Instances
are charged the S pot Price, which is set by
Amazon EC2 and fluctuates periodically
depending on the supply of and
demand for S pot Instance capacity
Features Not S upported
Allow only Micro Instance.
Limited hours for ELB, EBS ,S QS
and other products
None None
Auto S caling, Amazon Virtual Private C loud,
Amazon E lastic MapReduce, and Amazon DevPay
Best S uited for
Demo of small website, S elf
Learning
For all IaaS need
For all IaaS need for longer running
instance
S elf learning, temporary hosting /
testing
April 18, 2011
Amazon EC2 Cost Comparison Calculator
• To move application to Amazon cloud, you can estimate for cost of infrastructure.
• Amazon provides tools to calculate the cost for running application on AWS .
• Please refer • http://awsmedia.s3.amazonaws.com/Amazon_EC2_Cost_Comparison_Calculator_042810.xls
• S 3 S ample Calculation
• EBS Calculation
TCS Internal - 34
April 18, 2011
Estimation
• http://calculator.s3.amazonaws.com/calc5.html
TCS Internal - 35
http://aws.amazon.com/economics/
Amazon S ecurity
- 36
April 18, 2011
Amazon S ecurity
TCS Internal - 37
http://aws.amazon.com/security
April 18, 2011
Amazon S ecurity
TCS Internal - 38
http://aws.amazon.com/security
April 18, 2011
Amazon S ecurity
Access to applications and services within the AWS cloud is secure and protected in multiple ways
TCS Internal - 39
AWS C redentia ls
Web S ervic es , A P Is , R E S T, Query, S OAP,
C ommand Line
Third Party Tools orLibraries
AWS Web S ite(S ec ure Prog res s )
http://aw s .amazon.com
AWS M anag ement C ons olehttp://aw s .amazon.com/cons ole
Amazon E C 2 Ins tanc es
S OAP : X .509R E S T & Query : Ac c es s K eys
S ig n In C redentia ls
Ac c es s K eys
K ey-Pa irs
S ig n In C redentia ls
Amazon Practical Use
- 40
April 18, 2011
AWS Use Cases
TCS Internal - 41
• Backup -Archive• Application Hosting • Media S haring (Image/ Video)• Media Distribution• Academic Computing• S earch Engines• S ocial Networking• S calable Applications• POC• Dev & Test
April 18, 2011
Application Suitability for AWS
•A few parameters for
selection– Criticality
– S LAs provided by the vendor
– Horizontally scalable applications
– S ensitivity to network latency
– Licensing compatibility
•Re-engineering choices– How to build a highly-available
application
• Choose multiple geos
– OS Migration
– Making it horizontally scalable
– Making software multi-tenant and
configurable (S aaS )
42TCS Internal
April 18, 2011
How AWS is being used across TCSG roup What R emarksInternal IT Private Lab C loud for IS U
Labs with MeghAAS as the portal
Work in progress
All IS Us Top 10 coder contest The top 10 coder contest is enabled by running the emulation software on AWS . For S QL coder contest, DBProdem was hosted on EC2
L&D Global TACTiCS 2011 Host VoIP and video streaming app on EC2 so that TCS associates can join the virtual conference. Work in progress.
CTO Web 2.0 Labs
Knome on C loud Knome is available on C loud, and all their demos to customers happen on EC2 instance, by default
CTO Hyd Labs
CytoCommix - visualizing relationships between biological entities
Tool demo available on AWS
CTO Green IT Labs
ECView carbon calculator Available on AWS
CTO Delhi Labs
InstantApps on C loud Available to external customers and internal groups as a BETA
IS TCS Private C loud Build a TCS Private C loud hosted from a partner data center – for specific customer scenarios
43
April 18, 2011
How you can use AWS
TCS Internal - 44
1. Get registered with Amazon Web S ervices with your CC2. You will get access to EC2, EBS , S 3 and other AWS products3. If you are going to use Linux instance, you need to telnet. Open
the port for specific IP range of Amazon.4. If you are going to use Windows instance, you need to raise CR
to access a few IPs for Remote Desktop.5. If you are accessing from India domain, you need to change your
VLAN to access AWS IPs. It should be firewall separated VLAN.6. Raise the CR for
a) To open specific IPs of Amazon Rangeb) To open standard ports for above IP range (22, 8080 etc)c) Procure a few S tatic IPs and make them part of point a) & b)As mentioned in the document at
https://knowmax.ultimatix.net/Innovation% 20Corner/CloudComp/Training% 20Materials/S etup% 20For% 20AWS % 20Access% 202.0.doc
April 18, 2011
Summary• Customers have started asking for “C loud-enabled” solutions
• Amazon IaaS is easy to use and cheap option for your infrastructure need.
• The different combined products will give you edge for automated deployment,
cost optimization and optimal resource utilization.
• It will be very best suited for your POC, Dev & Test, Computing purposes.
• If you application has elastic demand, some pick usage time and some non
productive hours AWS cloud can help manage resources optimally.
• If you want to use AWS , think how Cloud will fit into your architecture and
provide the right “qualities” for you
• You could do migration to AWS C loud and application can work as-is but you
might require to re-architect a few components to leverage the power of C loud!
45TCS Internal
April 18, 2011
Next Step• TCS has capability in architecting, deploying as well managing in cloud.
• If you customer is interested for AWS Cloud, we can help them evaluate
whether application is cloud ready or not.
• If you think you need to use AWS in near future and you want to train your
developers, send us their nominations.
• We can arrange detailed Amazon product training of 2-3 days for architectures /
S r. Developers.
• Reach us @
– venkatachari.raghavan@ tcs.com
– taral.shah@ tcs.com
• For more cloud material refer C loud Computing Home Page in KM.
46TCS Internal
April 18, 2011
Demo
TCS Internal - 47
• Overview AWS EC2
– AMI & Instances
– Regions & Zones
– Key-pairs and Groups
– Infrastructure on demand with tomcat
– E lastic IP
• Amazon EBS
– Volumes & S napshots
• Overview S 3
Thank You