41
Telling your Cumulonimbus from your stratus and why it matters (Clouds) Alex McFadyen, CTO drupal.org : a_c_m || drupal.org/user/195063 email : [email protected] twitter : @a_c_m

Dcamp ldn presentation

  • Upload
    acm

  • View
    1.908

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Dcamp ldn presentation

Telling your Cumulonimbus from

your stratus and why it matters (Clouds)

Alex McFadyen, CTO

drupal.org : a_c_m || drupal.org/user/195063email : [email protected]

twitter : @a_c_m

Page 2: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Introduction

Alex McFadyen

CTO of DemotixDrupaler for 5 years 20 weeks

Demotix.com

A two minute (or less) introductionhttp://prezi.com/_ugoyxm4qprv/demotixcom-2-minutes/

Page 3: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Buzzword alert – CLOUD!!To the world

“Cloud computing refers to the delivery of computing and storage capacity as a service to a heterogeneous community of

end-recipients”

- http://en.wikipedia.org/wiki/Cloud_computing

To me (a Drupal dev)

“The cloud is just marketing gloss on quick to set up VPSs when you need them, perhaps have 'unlimited' storage space and even

a CDN if your lucky”

- Me, just now.

Page 4: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Public health announcement

Why not just pay for it to be someone else’s problem and not care about the “cloud”?

● If you can. Do.

● But perhaps you tried that and it didn't work :(

● Complexity (doesn't fit generic solutions)

● Policy / Control freak

“With great power comes great responsibility”- Uncle Ben

Page 5: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Things to think about

@ Slice ratio (How big is your share?)

●Most (not all) cloud providers slice servers up into equal cpu/ram/disk space chunks and sell them off.●Some let you add on resources you need, others don't.●Problem for file servers.

@ Poor disk IO

●Are your disks local or over the network?

Page 6: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Things to think about

@ More servers, more problems?

●Once your past dedicated use servers (web, db etc) you have to do work on the app to support more servers.

@ Support

●Do you have any?●How about at 3am?●On Christmas day

Page 7: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Things to think about

@ Bad neighbours & overselling

●Starts out great, then reddit moves in next door.

@ Cloud A != Cloud B

●Disks, Slice ratio, network speed, location, management systems etc

Page 8: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

How to pick your cloud

@ Benchmarks?

●http://cloudharmony.com cpu/ram/disk/web/db

Page 9: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Try, try, try again!

@ Try before you buy ●Some companies will give you a free day/week.●Put as close as you can 1:1 copy of your current site on it and...

@ Test, test and test some more

●AB / Siege test your caching system not your app.●Instead replay your log files with HTTPERF or Jmeter.●Monitor the results with Munin/Cacti/Newrelic.

Page 10: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

“The Clouds” but not services

● Amazon● Rackspace● Azure (Microsoft)● DediServe

Page 11: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

My Kickstarter Benchmark● Demotix is not a good example.● So, using a popular distro instead.● Build duplicate machines with puppet● Benchmark with Blaze Meter

● Run jmeter in the cloud● Drupal module!● Very cool people (gave me a free account to help this talk)● Monitor with NewRelic (also free from BlazeMeter!)

Page 12: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

How the servers were built● ~4GB ram + what ever you get with

that● Puppet install :

https://github.com/a-c-m/puppet-drupal-lamp

● 20 line bash script (to install bits)● Thats it! (I promise)● Like the sound of that?

● Go to “Vagrant: A crash course” @ 4:30pm

Page 13: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

How the servers were tested● 20 Urls from the store● 7 unauthenticated users● 7 authenticated users● 10 min test, 160 second ram up● Run using our friends Blaze Meter● Graphed with NewRelic

Page 14: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2● No free trial :( but pay by the hour.● M1.Medium linux VPS = £62.65/mo

● 1 x Intel Xeon

● 3.7 GB ram

● 410 GB disk

● M1.Large (EBS-Optimized) linux VPS = £137.35/mo● 2 x Intel Xeon

● 7.5 GB ram

● 850 GB disk

● Bandwidth, support etc is extra

Page 15: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 M - BlazeMeter

Page 16: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 M – app

Page 17: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 M – server

Page 18: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 L - BlazeMeter

Page 19: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 L – app

Page 20: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Amazon EC2 L – server

Page 21: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Rackspace Cloud● No free trial :( but pay by the hour.● 4GB linux VPS = £116.80/mo

● AMD Quad-Core

● 4 GB ram

● 160 GB disk

● Bandwidth, support etc is extra

Page 22: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Rackspace - BlazeMeter

Page 23: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Rackspace – app

Page 24: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Rackspace – server

Page 25: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure● 90 Days for free?!?● 1 Medium linux VPS = £73.32/mo

● 2x AMD Opteron

● 3.5 GB ram

● 30 GB disk

● 1 Large linux VPS = £146.63/mo● 4x AMD Opteron

● 7 GB ram

● 30 GB disk

● Smart interface● Bandwidth, support etc is extra

Page 26: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure M - BlazeMeter

Page 27: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure M - app

Page 28: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure m - server

Page 29: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure L - BlazeMeter

Page 30: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure L - app

Page 31: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Microsoft Azure L - server

Page 32: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe● Friendly / talk to them.

Gave me a free server to do this test.

● 2GB linux VPS = £66.41/mo● 4x Intel Xeon

● 2 GB ram

● 50 GB disk

● 1.5 TB transfer

● 4GB linux VPS = £107.99/mo● 8x Intel Xeon

● 4 GB ram

● 100 GB disk

● 3 TB transfer

● Managed Support is extra

Page 33: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 2GB - BlazeMeter

Page 34: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 2GB – app

Page 35: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 2GB – server

Page 36: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 4GB - BlazeMeter

Page 37: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 4GB – app

Page 38: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

DediServe 4GB – server

Page 39: Dcamp ldn presentation

£40.00 £60.00 £80.00 £100.00 £120.00 £140.00 £160.000

1000

2000

3000

4000

5000

6000

7000

8000

9000

Amazon MediumAmazon LargeRackspace 4GBAzure MediumAzure LargeDediServe 2GBDediServe 4GB

£ per month

MS

pe

r p

age

(a

vera

ge

)

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Price VS average pageload

Page 40: Dcamp ldn presentation

ALEX McFADYEN | [email protected] | @a_c_m

Drupal Camp London Saturday March 2nd, 2013

Shameless affiliate link

Page 41: Dcamp ldn presentation

Thank you

Questions?

Alex McFadyen, CTO

drupal.org : a_c_m || drupal.org/user/195063 email : [email protected]

twitter : @a_c_m