78
DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes © DTO Solutions, Inc. Nov 10, 2015 Pentagon City, VA Damon Edwards Managing Partner DTO Solutions, Inc.

DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

  • Upload
    dev2ops

  • View
    1.561

  • Download
    1

Embed Size (px)

Citation preview

Page 1: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

© DTO Solutions, Inc.

Nov 10, 2015 ● Pentagon City, VA

Damon Edwards Managing Partner DTO Solutions, Inc.

Page 2: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

@damonedwards

Damon Edwards

[email protected]

Page 3: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

I get to see a lot…

DevOps Consulting

Operational Improvement

Tools

Page 4: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

30x 200xmore frequent deployments

faster lead times

60x 168xthe change success rate

faster mean time to recover (MTTR)

2x 50%more likely to exceed profitability, market share & productivity goals

higher market capitalization growth over 3 years*

Recent IT Performance Data is CompellingHigh performers compared to their peers…

Data from 2014/2015 State of DevOps Report - https://puppetlabs.com/2015-devops-report

Page 5: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

30x 200xmore frequent deployments

faster lead times

60x 168xthe change success rate

faster mean time to recover (MTTR)

2x 50%more likely to exceed profitability, market share & productivity goals

higher market capitalization growth over 3 years*

Recent IT Performance Data is CompellingHigh performers compared to their peers…

Faster

HigherQuality

MoreEffective

Data from 2014/2015 State of DevOps Report - https://puppetlabs.com/2015-devops-report

Page 6: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

30x 200xmore frequent deployments

faster lead times

60x 168xthe change success rate

faster mean time to recover (MTTR)

2x 50%more likely to exceed profitability, market share & productivity goals

higher market capitalization growth over 3 years*

Recent IT Performance Data is CompellingHigh performers compared to their peers…

Faster

HigherQuality

MoreEffective

Data from 2014/2015 State of DevOps Report - https://puppetlabs.com/2015-devops-report

Page 7: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Data from 2014/2015 State of DevOps Report - https://puppetlabs.com/2015-devops-report

Page 8: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Data from 2014/2015 State of DevOps Report - https://puppetlabs.com/2015-devops-report

?!

Page 9: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Fast

CheapGood

“Pick Two!”

Conventional Wisdom

Page 10: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Fast

CheapGood

“Pick Two!”

Conventional Wisdom

Page 11: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster, Better, and Cheaper?

Page 12: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster, Better, and Cheaper?

Page 13: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster when labor is our largest cost

1

Start 12 mo.

1 111111111 1 1 1 1 1 1 1 1 1 1 1 1 1 1

1 1 1 1 1 1 1 1

Assumptions: Both groups are 30 people at $100/hr; backlogs are identical

GroupA

GroupB

8 “Units of Work”$6M total cost

$750,000 per unit

24 “Units of Work”$6M total cost

$250,000 per unit

45 days per “unit”

15 days per “unit”

Page 14: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster when labor is our largest cost

1

Start 12 mo.

1 111111111 1 1 1 1 1 1 1 1 1 1 1 1 1 1

1 1 1 1 1 1 1 1

Assumptions: Both groups are 30 people at $100/hr; backlogs are identical

GroupA

GroupB

8 “Units of Work”$6M total cost

$750,000 per unit

24 “Units of Work”$6M total cost

$250,000 per unit

45 days per “unit”

15 days per “unit”

Page 15: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster, Better, and Cheaper?

Page 16: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Faster, Better, and Cheaper?

Page 17: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

"In the Lean community, there is a deeply held belief that lead time is one of the best predictors of quality, customer satisfaction and employee happiness. And what we found in our benchmarking work of over 20,000 IT professionals is that it is absolutely true for the technology value stream, as well.”

Gene Kim

Page 18: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

"The data shows that throughput and stability metrics move in tandem — effectively not supporting ITIL claims that tradeoffs should be made in throughput in order to get stability. The pattern of needing to trade throughput for stability simply doesn't appear in the data.”

Nicole Forsgren

Page 19: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

How about some anecdotal proof?

Page 20: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

But let’s not talk unicorns…

Page 21: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

devopsenterprise.ioLet’s talk horses

Page 22: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Nordstrom

CourtneyKissler

Page 23: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Nordstrom

CourtneyKissler

“The DevOps journey began when Nordstrom stopped optimizing for

cost, and instead started optimizing for delivery speed.”

Page 24: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

CSG

ScottPrugh

Page 25: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

CSG

ScottPrugh

Page 26: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Why does this work?

Page 27: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Why does this work?

Fast Feedback

Page 28: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 29: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 30: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 31: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Encourages working in smaller batches (less simultaneous moving parts.. quick diagnosis and fix)

• Encourages get really good at getting through the lifecycle (lower the “transaction” cost)

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 32: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Encourages working in smaller batches (less simultaneous moving parts.. quick diagnosis and fix)

• Encourages get really good at getting through the lifecycle (lower the “transaction” cost)

• Organization learns faster at all levels (“good at getting better”)

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 33: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Encourages working in smaller batches (less simultaneous moving parts.. quick diagnosis and fix)

• Encourages get really good at getting through the lifecycle (lower the “transaction” cost)

• Organization learns faster at all levels (“good at getting better”)

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 34: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Benefits of focusing on Fast Feedback

• Encourages working in smaller batches (less simultaneous moving parts.. quick diagnosis and fix)

• Encourages get really good at getting through the lifecycle (lower the “transaction” cost)

• Organization learns faster at all levels (“good at getting better”)

Faster feedback means… higher quality, less rework, shorter cycle times, and lower costs.

• Errors are caught sooner when they are cheaper to fix (less rework)

Page 35: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

But how do we actually do that?

Page 36: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Simple System vs Complex System

Page 37: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Simple System vs Complex System•Can be understood by

reducing it to a set of simpler parts

•Can have complete information about it

Page 38: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Simple System vs Complex System•Can be understood by

reducing it to a set of simpler parts

•Can have complete information about it

•Can perfectly predict behavior and consequences of changes

Page 39: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Simple System vs Complex System•Can’t be understood by

reducing it to a set of simpler understandable parts

•Can’t have complete / prefect information about it

•Can be understood by reducing it to a set of simpler parts

•Can have complete information about it

•Can perfectly predict behavior and consequences of changes

Page 40: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Simple System vs Complex System•Can’t be understood by

reducing it to a set of simpler understandable parts

•Can’t have complete / prefect information about it

•Can’t perfectly predict behavior and consequences of changes

•Can be understood by reducing it to a set of simpler parts

•Can have complete information about it

•Can perfectly predict behavior and consequences of changes

Page 41: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Page 42: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Page 43: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Page 44: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Page 45: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Page 46: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Page 47: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Page 48: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Handoff!

Handoff!

Handoff!

Page 49: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Application Knowledge

Handoff!

Handoff!

Handoff!

Page 50: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Application Knowledge

Operational Knowledge

Handoff!

Handoff!

Handoff!

Page 51: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Application Knowledge

Operational Knowledge

Business Intent

Handoff!

Handoff!

Handoff!

Page 52: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Application Knowledge

Operational Knowledge

Business Intent

Handoff!

Handoff!

Handoff!

Ownership but limited Accountability

Page 53: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Silos are the #1 enemy of throughput and quality

Dev Release OpsPlanning

Application Knowledge

Operational Knowledge

Business Intent

Handoff!

Handoff!

Handoff!

Ownership but limited Accountability

Accountability but no Ownership

Page 54: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Page 55: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Start

Finish

The “Big Bang” Transformation Dream

Page 56: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Start

Finish

Fear

Panic

Abort

Maybe

The “Big Bang” Transformation Reality

Page 57: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Start

Finish

Fear

Panic

Abort

Maybe

People revert to legacy behaviors

The “Big Bang” Transformation Reality

Page 58: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Start

Finish

Fear

Panic

Abort

Maybe

People revert to legacy behaviors

“Finish”● Same as before ● Money/time wasted ● More fear of change

The “Big Bang” Transformation Reality

Page 59: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Big Bang“Sliver Bullet”

Page 60: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

Big Bang“Sliver Bullet”

Page 61: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Start

Finish

Start

Finish

“Big Bang” Continuous Improvement

Fear

PanicAbort

Maybe

Replace the “Big J” with “Little J’s”

Page 62: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Your organization is a complex system2

Complex System

Complex System

interacting with a

The only way to fix a sufficiently complex system is to create the conditions for the

system to fix itself.

Page 63: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

You need an Improvement System

Page 64: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

You need an Improvement System● Not for your technology● Not to build individual skills

Page 65: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

You need an Improvement System● Not for your technology● Not to build individual skills● … but for how your organization works

Page 66: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

You need an Improvement System● Not for your technology● Not to build individual skills● … but for how your organization works

Page 67: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

You need an Improvement System● Not for your technology● Not to build individual skills● … but for how your organization works

in the context of

Page 68: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

Improvement System is going to have to…

Page 69: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

•Scale quickly

•Span multiple organizational boundaries

Improvement System is going to have to…

Page 70: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

•Scale quickly

•Span multiple organizational boundaries

•Keep improvement efforts aligned

Improvement System is going to have to…

Page 71: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

•Scale quickly

•Span multiple organizational boundaries

•Keep improvement efforts aligned

•Work with substantial numbers of legacy technologies

Improvement System is going to have to…

Page 72: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

•Scale quickly

•Span multiple organizational boundaries

•Keep improvement efforts aligned

•Work with substantial numbers of legacy technologies

•Develop existing staff in mass

Improvement System is going to have to…

Page 73: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Make it Repeatable and Sustainable

•Scale quickly

•Span multiple organizational boundaries

•Keep improvement efforts aligned

•Work with substantial numbers of legacy technologies

•Develop existing staff in mass

•Be self-funding after initial seed investment

Improvement System is going to have to…

Page 74: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Example: “DevOps Kaizen”

Value Stream Mapping Retrospectives / Planning

Service Delivery Metrics

Systems Thinking

Improvement Kata

Page 75: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Provides a mechanism to introduce new ideas

Improvement System

DevOps Kaizen

Design Patterns

Page 76: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Examples of DevOps Patterns

Continuous Delivery

Everything in SDLCTesting in Production

Infrastructure as Code Blameless Post Mortems

Service Aligned Org

Ops as a Service ChatOps Prod-like Dev Environments

Page 77: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Recommended Reading

Page 78: DevOps Paradox: Going Faster Brings Higher Quality, Lower Costs, & Better Outcomes

Want to talk Improvement Systems or DevOps?

@[email protected]

Federal Agencies can also contact:Peter O'Donoghue [email protected]