IUT presentation - English

2010 IUT Cloud Computing Presentation

Presented by

Raymond Gao

9 Novembre, 2010

Describe myself

Job history Chief Architect @ Nokia Business Infrastructure Senior E-Commerce Architect / Technical Manager @ Sun

Microsystems (now Oracle) Board of Director for Project JXTA (P2P Computing like Bit

Torrent) Java Community Process Member Amazon User Group Leader

Publications Editor-in-Chief, Peer-to-Peer Computing Journal (Peer-reviewed) eAI Journal, Enterprise Linux, XML Journal, …

Conferences JavaOne, WebServices One, Dagstuhl (Max Planck Institute),

Dresden, etc

9 Novembre, 2010 2010 IUT Cloud Computing Seminar

2

Presentation Overview

What is cloud computing?

How does cloud computing affect you (research & study)?

Trend and major players in cloud computing

Analysis of leading players

Demonstrations of cloud computing

Q & A


3

Understand the audience

How many people have used server virtualization software?Using Parallel Desktop? Virtual PC? Or VMWare

products?Ask their experience about these software

How many people have created dynamic websites? (PHP, CGI, Java, ROR)

How many people have used managed server hosting?


4

What exactly is cloud computing?

9 Novembre, 2010

5

2010 IUT Cloud Computing Seminar

The details

Give definitionHow many people don’t have electricity at home?Cloud computing is just like electricity and better

Describe the benefits of cloud computingCostFlexibilityReliabilityRapid scalingRepeatable process


6

What is Cloud Computing?


7

First, think of your electricity service…

Power is available to you on-demand, you pay only for what you use -> CPU, bandwidth, storage, memory

…and you plug into a vast electrical grid managed by professionals to get you the lowest cost, most reliable power with much greater efficiency and safety than you could probably do on your own.

Introducing Amazon Web Services


8

AWS provides flexible, scalable, secure, and cost-effective IT infrastructure for businesses of all sizes around the world.

Compute power and storage is available to you on-demand, you pay only for the resources you use…

…running on scalable, reliable, and secure infrastructure operated by Amazon Web Services, based on the knowledge gleaned from over a decade of building efficient and dependable infrastructure for Amazon.com.

Why is Cloud computing important?


9

2007: AWS bandwidth usage surpassed Amazon.com global websites

Today: AWS bandwidth usage 30% greater than Amazon.com global websites

Bandwidth Usage:

AWS Usage Graph


10

Amazon S3 Momentum


11

Total Number of Objects Stored in Amazon S3

2.9 Billion

14 Billion

40 Billion

102 Billion

Facebook Members

More than 500 million active users

over 900 million objects (pages, groups, events and community pages)

About 70% of Facebook users are outside the United States


12

With Zucker


13

Predicting Infrastructure Needs


14C

om

pute

Pow

er

Time

Predicted Usage

Actual Usage

Waste

CustomerDissatisfaction

Wall Street & Amazon EC2


15

Num

ber

of

EC

2 Inst

ance

s

300 CPU’s on weekends

Thursday

4/23/2009

Friday4/24/2009

Sunday4/26/2009

Monday4/27/2009

Tuesday4/28/2009

Saturday4/25/2009

Wednesday4/22/2009

3000--

300 --

Amazon Web Services


16

ComputeAmazon Elastic

Compute Cloud (EC2)-Elastic Load Balancing

-Auto Scaling

StorageAmazon Simple

Storage Service (S3)-AWS Import/Export

Your Custom Applications and Services

Content DeliveryAmazon

CloudFront

MessagingAmazon Simple Queue Service

(SQS)

PaymentsAmazon Flexible

Payments Service (FPS)

On-Demand Workforce

Amazon Mechanical Turk

Parallel Processing

Amazon Elastic MapReduce

MonitoringAmazon CloudWatch

DatabaseAmazon RDS

Amazon SimpleDB

ManagementAWS Management

Console

ToolsAWS Toolkit for

Eclipse

Isolated NetworksAmazon Virtual Private Cloud

AWS Console

Saturday, Oct 2nd, 2010

2010 DFW Cloud Computing Seminar

17

Elastic Fox – A management tool

Saturday, Oct 2nd, 2010

2010 DFW Cloud Computing Seminar

18

Rationales for cloud computing

Variable Load

Reliability

Flexibility

Low-Latency

Highly Scalable

Easy-to-user


19

AWS Global Reach


20

Amazon EC2, Amazon Elastic MapReduce,Amazon SimpleDB, Amazon SQS

Amazon S3

Amazon CloudFront

Ashburn, VA / Dallas, TX / Los Angeles, CA / Miami, FL / Newark, NJ / Palo Alto, CA / Seattle, WA / St. Louis, MO / Amsterdam / Dublin / Frankfurt / London / Hong Kong / Tokyo

US StandardUS West (Northern California)Europe (Dublin)Singapore (coming soon)

US East (Northern Virginia)US West (Northern California)Europe (Dublin)Singapore (coming soon)

How can universities benefit from cloud computing?

Developing new softwareSetup and tear down environmentShow a visual example

TeachingThe environment is prebuilt from the AMI image,

making software development really simple

Cost

Amazon University Grant program


21

http://Aws.Amazon.com/eduction

Class Grant - $100 AWS credit for each studentUniversity of MarylandHarvard University

Research Grants – 4x a year

Student competition

Startup challenge


22

Demonstration of AHeadless AMI Server - Ubuntu


23

AWS Cost Structure

Time based – Usage based on HoursEC2

Transaction based - Number of hits per time-periodRDBS

Size basedS3 – GB / month


24

Instants Type

1 ECU = 1.0 – 1.2 GHz Opteron/Xeon from 20079 Novembre, 2010 2010 IUT Cloud Computing Seminar

25

RAMCores x

ECUArch

Hourly Cost (US-East)

Monthly Cost(US-East)

Standard

Small 1.7 GB 1 x 1 32bit $0.085 $62

Large 7.5 GB 2 x 2 64bit $0.34 $248

Extra Large 15 GB 4 x 2 64bit $0.68 $496

High-Memory

Extra Large 17.1 GB

2 x 3.25 64bit $0.50 $366

Double Extra Large

34.2 GB

4 x 3.25 64bit $1.20 $878

Quadruple Extra Large

68.4 GB

8 x 3.25 64bit $2.40 $1756

High-CPU

Medium 1.7 GB 2x 2.5 32bit $0.17 $124

Extra Large 7 GB 8 x 2.5 64bit $0.68 $496

Standard Instances Well suited for most applications

High Memory Instances Offer large memory sizes for high throughput applications, including

database and memory caching applications

High CPU Instances Have proportionally more CPU resources than memory (RAM) and are

well suited for compute-intensive applications

Amazon EC2 Instance Types

AWS monthly cost calculator


27

http://calculator.s3.amazonaws.com/calc5.html

Tools for managing AWS Cloud

Command Line

Elastic Fox & S3 Fox

AWS Management Console

Explorers – Bucket / SimpleDB

MobileYlasticDirectEC2

Etc.


28

Billed for actual usage on monthly basis

Standard Instances Linux/UNIX starting at $0.095 USD per hour Windows starting at $0.13 USD per hour

High CPU Instances Linux/UNIX starting at $0.19 USD per hour Windows starting at $0.31 USD per hour

High Memory Instances Linux/UNIX starting at $1.34 USD per hour Windows starting at $1.44 USD per hour

+ Data Transfer Costs

Reserved Instances Make a low, one-time payment for each instance Receive lower pricing for that instance

Amazon EC2 Pricing (EU Region)

Choosing an AWS Database Solution


30

Amazon EC2 Relational Database AMIs

Amazon Relational Database Service

Amazon SimpleDB

Features Choose your own database server (IBM DB2, Microsoft SQL Server, MySQL, Oracle, and more)

Native access to a relational database engine, with key features of a relational database, such as joins or complex transactions

Schema-less data store

Administration

Exert complete administrative control over your database

Gain a managed experience and offload common administrative tasks, such as provisioning, backup

Zero administrative overhead (automatic handling of geo-redundant replication, index creation, database tuning)

Flexibility Easy migration path (existing code, tools, applications are compatible)

Easy migration path (existing code, tools, applications are compatible)

Easy to use web service APIs

Scalability Employ many of the scalability features of Amazon EC2

Quickly scale up resources with only an API call

Automatic and elastic scaling of resources to meet request load

Backup Store snapshots to Amazon S3

Use automatic backup service at an interval you specify

High availability (multiple copies of data for reliability and failover)

Trend and analysis of current market

Who are players?

What are they doing?OfferingStrategycost


31

Who are jumping on the bandwagon?

Big Names Amazon * Google IBM Microsoft Oracle Salesforce *

Additional players Facebook & Twitter (Enabler) RightScale Collab Heroku Engine Yard, …


32

Other Important Developments

Loosely coupled webREST vs. SOAPAJAX, Flash, iPad

Social NetworkingFacebookTwitterFourSquare

New LanguagesRuby-On-RailsPython


33

The Meshup Web


34

Facebook Graph API

https://graph.facebook.com/oauth/authorize? client_id=...& redirect_uri=http://www.example.com/oauth_redirect


35

Designing Applications for Reliability


36

Region

Availability Zone Availability Zone

Amazon CloudWatchProvides monitoring for AWS cloud resources.

Elastic Load BalancingAutomatically distributes incoming application traffic across multiple Amazon EC2 instances.

Auto ScalingAutomatically scales Amazon EC2 capacity up or down according to pre-defined conditions.

Setting up Amazon Web Services Account

Pre-requisitesSSH client – Putty.exe on Windows, built-in in Mac

and Linux

To-doAccess KeySecret KeyX.509 Certificate

Private Key Public Key


37

Account Page


38

Getting AWS Access Identifiers


39

•Access Key•Secret Key•X.509 Certificate files (Self-signed)

•Public •Private

Amazon WS Management Console


40

AllowsStart / Stop / Pause a VM instanceManage Firewall portsAdd S3 storageTake snapshot of volumes & VMsCreate Security Group and Key Pair (Amazon use secure key to manage access to VM via SSH), This is different from X509 keys.Control Job Flow between VMsCloudFront Services (pushing data to the edge of network)

Contact Me

Email: [email protected]

Facebook: http://facebook.com/raygao2009

Blog: http://raysblog.are4.us


41

Education

IUT presentation - English