T-DOSE 2010 - Agile Enterprise, CLouds and Devops

Preview:

DESCRIPTION

 

Citation preview

Copyright © 2010 Opscode, Inc - All Rights Reserved 1

John WillisVP of Servicesjohn@opscode.comtwitter.com/botchagalupe

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 2

IT Management PodcastDevopsCafeCloudCafe

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 2

IT Management PodcastDevopsCafeCloudCafe

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 3

The Agile EnterpriseCloud and Devops

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 4

CambrianExplosion

IndustrialRevolution

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 5

Hierarchy Theory

“The rate of evolution of any system is dependent upon the organisation of

its subsystems”

Herbert Simon, Theory of Hierarchy and componentisation.

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 6

A Parable of Two Watch Makers

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 6

A Parable of Two Watch Makers

•Technological evolution (and revolution).

•Introductions of new products

•Strong and unpredictable fluctuations of the demand.

Saturday, November 6, 2010

Saturday, November 6, 2010

A Period of Combinatorial Innovation

Saturday, November 6, 2010

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

Saturday, November 6, 2010

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

• Integrated network accessible services

Saturday, November 6, 2010

A Period of Combinatorial Innovation

• Abstract and fault tolerant components

• Integrated network accessible services

• Unlimited infrastructure

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 8

Agile Infrastructure

• Operating at Cloud Scale • Ephemeral Infrastructure • Frictionless Infrastructure• Self Service Operations

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 9

Agile Operations

• Products not Projects• Walk on Walk off Projects• Velocity of Innovation• Continuos Delivery• Enterprise Lean Startup

Saturday, November 6, 2010

Devops

Saturday, November 6, 2010

Devops: Why Should You Care?

Short Answer:

It’s a way to make your business

more agile

Saturday, November 6, 2010

Devops: Why Should You Care?

Short Answer:

It’s a way to make your business

more agile

Rut Rorit’s rabout ra

business rupid

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

Devops is a cultural and professional movement!

12Saturday, November 6, 2010

Ah-ha! Ka-ching!Wall o

f C

onfu

sio

n

OpsDev

Ah-ha!

IT Anti-Pattern

Saturday, November 6, 2010

DevOps

Wall of iononfusC

Dev Ops

Saturday, November 6, 2010

Devops is About Velocity

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 16Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 16

CultureAutomation

MeasurementSharing

Saturday, November 6, 2010

So  What’sYourCultureDog

Saturday, November 6, 2010

Saturday, November 6, 2010

Culture Before Tools

• Leadership • Behavior• Communication• Passion• Having Fun

Saturday, November 6, 2010

Leadership

Saturday, November 6, 2010

Devs Ops

Leadership

Saturday, November 6, 2010

Leadership

Saturday, November 6, 2010

Behavior

Saturday, November 6, 2010

Behavior

Saturday, November 6, 2010

Behavior

Saturday, November 6, 2010

Communication

Saturday, November 6, 2010

Communication

Saturday, November 6, 2010

Passion

Saturday, November 6, 2010

Passion

Saturday, November 6, 2010

Have Fun!

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 31

Cloudy Operations and Devops

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 32

Till the Meatball Hits the Fan

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 32

Till the Meatball Hits the Fan

I did not have “cloudy” meatballs with that provider

Saturday, November 6, 2010

Automa4on

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 34

FullyAutomated Infrastructure

ReleaseControl

Orchestration

Dispatcher

Provisioning

Deploy

Config management

OS boot/install

Artifact repository

Build

CI Server Issue tracker

SCM Repository

Model

Asset inventory

Host naming

Identity

CMDBMonitoring

Events

Trending Reporting

Trending

Workflows

Resources

Topology

Configuration

Code

Sources

Scheduler

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 34

FullyAutomated Infrastructure

ReleaseControl

Orchestration

Dispatcher

Provisioning

Deploy

Config management

OS boot/install

Artifact repository

Build

CI Server Issue tracker

SCM Repository

Model

Asset inventory

Host naming

Identity

CMDBMonitoring

Events

Trending Reporting

Trending

Workflows

Resources

Topology

Configuration

Code

Sources

Scheduler

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 35

What Do Developers

Want?

Saturday, November 6, 2010

For Developers...

• Self Service Operations

• The infrastructure is the application (and vice versa)

• Minimize Bottlenecks

• The “Right” Tools

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 37

What Does Operations Want?

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 38Saturday, November 6, 2010

Operations• Say “Yes”.

• You never liked rack and stack that much anyway.

• You have never been more critical.

• Just get out of the way.

http://covers.oreilly.com/images/9780596007836/lrg.jpg

Saturday, November 6, 2010

Automate Everything

•Integration•Builds•Tests•Deploys•Orchestration

Saturday, November 6, 2010

Infrastructure as Code

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Saturday, November 6, 2010

Infrastructure as Code

‣ Version control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Saturday, November 6, 2010

Infrastructure as Code

‣ Version control

‣ Process control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Saturday, November 6, 2010

Infrastructure as Code

‣ Version control

‣ Process control

‣ Application control

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Saturday, November 6, 2010

A Tornado Hits Your Data

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

• Restore the customer and application data

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

• Restore the customer and application data

• Remove the “Hit by Tornado” page

http://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

• Restore the customer and application data

• Remove the “Hit by Tornado” page

• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

• Restore the customer and application data

• Remove the “Hit by Tornado” page

• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/

Saturday, November 6, 2010

A Tornado Hits Your Data

• Pause your movie

• Sign into your cloud provider

• Download your offsite backups

• Provision, config and integrate the new servers

• Change DNS to point to “Hit by Tornado” page

• Restore the customer and application data

• Remove the “Hit by Tornado” page

• Unpause moviehttp://www.flickr.com/photos/gi/518613153/sizes/o/

Chapter 5 Infrastructure

as CodeAdam Jacob

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

In a Cloudy WorldYour Prime Constraint Should Be

43

http://www.flickr.com/photos/visualage/2126833132/sizes/o/

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

In a Cloudy WorldYour Prime Constraint Should Be

43

The time it takes to

restore your application

data

http://www.flickr.com/photos/visualage/2126833132/sizes/o/

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Configuration Management

44Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Configuration Management

44

Provisioning

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Configuration Management

44

Provisioning

Configuration

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved

Cloudy Configuration Management

44

Provisioning

Configuration

Systems Integration

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 45

Nodes

opslb01

opsws01opsws02

opsdm01opsds01opsds02

Provisioning

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 46

Roles

loadbalancerwebserverdbmasterdbslave

Configuration Management

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 47

Load Balancer

Web Server Web Server

DB Master

DiskDisk

DB Slave DB Slave

Disk

Recipes

haproxyapache2myssql

Systems Integration

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

opsws01

Saturday, November 6, 2010

name "webserver"description "Systems that serve HTTP traffic"

run_list( "role[base]", "recipe[apache2]", "recipe[apache2::mod_ssl]")

default_attributes( "apache" => { "listen_ports" => [ "80", "443" ] })override_attributes( "apache" => { "max_children" => "50" }} })

Role Based Configuration

opsws01 opsws02

Saturday, November 6, 2010

Systems Integration

Saturday, November 6, 2010

Systems Integration

Saturday, November 6, 2010

Systems Integration

Saturday, November 6, 2010

Systems Integration

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 50

Load Balancer

Web Server Web Server

DB Master

DiskDisk

DB Slave DB Slave

Disk

Fully Automated InfrastructureProvisioning Configuration Integration

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Infrastructure as Data

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Discoverable Data

Saturday, November 6, 2010

Using a Search API

Saturday, November 6, 2010

Using a Search APIText

Saturday, November 6, 2010

• Text

Using a Search APIText

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 54http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Non Discoverable Data

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Non Discoverable Data

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Non Discoverable Data

Saturday, November 6, 2010

http://www.flickr.com/photos/asten/2159525309/sizes/l/

Non Discoverable DataLoad Balancer

Web Server Web Server

DB Master

DiskDisk

DB Slave DB Slave

Disk

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Copyright © 2010 Opscode, Inc - All Rights Reserved 56http://www.brooklynstreetart.com/theBlog/wp-content/uploads/2008/12/swedish_chef_bork-sleeper-cell.jpg

Saturday, November 6, 2010

Metrics

Measurement

Saturday, November 6, 2010

Measure Everything

• Performance Metrics• Process Data• People Data•Heuristics

Saturday, November 6, 2010

Continuos Improvement

Saturday, November 6, 2010

Old School is Still Cool

•Change•Incident•TTR/TTD

Saturday, November 6, 2010

Sharing

Saturday, November 6, 2010

Thinking that secrecy

makes you better

Anti-Pattern:

Saturday, November 6, 2010

Share Everything

• Share Metrics• Share Ideas• Share Stories•Give Developers Access• Allow Operations to Leverage

Saturday, November 6, 2010

P

Be bold-and mighty forces will come to

your aidBasil King

Saturday, November 6, 2010

Case Studies

Saturday, November 6, 2010

Homework...1. Web Operations (John Allspaw)1. Lean Startup (Eric Ries)2. Continuous Deployment (Jez Humble)2. Agile Planning (Scrum, Kanban)3. Test Driven Development / Operations

Extra Credit:5. DevOps Cafe Podcast (DevOpsCafe.org)6. Follow me on Twitter (@botchagalupe)

Saturday, November 6, 2010

Recommended