Continous Delivery in Action

CONTINUOUS DELIVERY

in Action

by Hu Zhenbo (Andy) ThoughtWorks

Friday, April 27, 2012

History

Millions

2008 2009 2010 2011

Page Views/Day

2008 2009 2010 2011

Team Size70+

2008 2009 2010 2011

Features Delivered Days between major releases

major releases per year

days to deploy

people involved in deployment

Angry CustomerFriday, April 27, 2012

Sad TeamFriday, April 27, 2012

RequirementFriday, April 27, 2012

Fragile SystemFriday, April 27, 2012

Deploy to DeathFriday, April 27, 2012

2008 2009 2010 2011 2012

Features Delivered Days between major releases

delivery frequency

every 1 or 2 week

days to deploy

person dedicated for deployment

How’d we do it?

One TeamFriday, April 27, 2012

CollaborationFriday, April 27, 2012

Incremental Developing

Decode 4 types of data

21 pts

Design

Framework

Decode Data

21 pts

Decode Data A

Decode Data C

Decode Data B

Decode Data D

Feature ToggleFriday, April 27, 2012

Feature Toggle

# Feature TogglenonRealTimeRecharge = truerealTimeRecharge = false

Config File #if( $nonRealTimeRecharge )

<div>非即时到帐</div><div> ...

#if( $realTimeRecharge ) <div>即时到帐</div> <div> ...#end

Page File

Deployment Pipeline

Commit Stagecompileanalysisunit test

Acceptance Test Stage

User Acceptance Testing

exploratory test...

Non-Functional Testing

performance test...

Production

Increasing confidence in build’s production readiness

Environment become more production-like

Slower Feedback

Deployment PipelineFriday, April 27, 2012

Auto-Deploy

Code Change

JarCommit

Update Portal

DependenZIP Upload

Stop Server

Unzip ConfigCreate

Log FileStart

ServerBackup

Auto-Deploy

Code Change

JarCommit

Update Portal

DependenZIP Upload

Stop Server

Unzip ConfigCreate

Log FileStart

ServerBackup

Auto-Deploy

Code Change

JarCommit

Update Portal

DependenZIP Upload

Stop Server

Unzip ConfigCreate

Log FileStart

ServerBackup

One-click Deploy

Components & Dependencies

Common Core

Payment

Account

Portal

Mobile

Common Core

Payment

Account

Portal

Mobile

Common Core

Payment

Account

Portal

Mobile

Common Core

Payment

Account

Portal

Mobile

Common Core

Payment

Account

Portal

Mobile

Common Core

Payment

Account

Portal

Mobile

Test QuadrantsFriday, April 27, 2012

Test Pyramid

AutomatedGUI Tests

API Tests

Integration Tests

Component Tests

Automated Unit Tests

ManualSessionBasedTesting

Deployment Test system configuration component communication service is up and running ...

Acceptance Test

Performance TestFriday, April 27, 2012

Blue-Green Deploy

WebServer

AppServer

DBServer

Router

Blue-Green Deploy

WebServer

AppServer

DBServer

v5.1 v5.1 v5.1

Router

Blue-Green Deploy

WebServer

AppServer

DBServer

v5.1 v5.1 v5.1

Router

Blue-Green Deploy

WebServer

AppServer

DBServer

v5.1 v5.1 v5.1

v5.2 v5.2 v5.2

Router

Blue-Green Deploy

WebServer

AppServer

DBServer

v5.1 v5.1 v5.1

v5.2 v5.2 v5.2

Router

Data Migration

migrate - 001_create_products_table.sql - 002_add_column_to_products.sql - 003_update_data_for_products.sql

rollback - 001_create_products_table.sql - 002_add_column_to_products.sql - 003_update_data_for_products.sql

Green Database

v5.1readonly

Green Database

v5.1 v5.1

Backup

readonly

Green Database

v5.1 v5.1

Backup

Migrate

readonly

Decouple App & Database

v5.1 v5.2 v5.3

v5.2 v5.3

compatible with db 5.1 & 5.2 compatible with db 5.2 & 5.3

Production Monitoring

HardwareOS

MiddlewareApplication

Voltage

Fan Speed

Temperature

Memory

Production MonitoringFriday, April 27, 2012

Cross Functional TeamContinuous IntegrationIncremental Developing

Feature ToggleAutomate DeploymentDeployment Pipeline

Blue-Green DeploymentDatabase Migration

Production Monitoring...

Weekly Release

Good Enough?

A Long Way to Go

http://code.flickr.com/

Big ReleaseFriday, April 27, 2012

Continuous DeliveryFriday, April 27, 2012

blue-green deployment

canary releases

data management

dark launch

build pipeline

automatic deployment

branch by abstraction

DevOps

acceptancetest

virtualization

configurationmanagement

Version ControlSystem

could computinginfrastructure as code

weibo: @HuZhenbo

Continous Delivery in Action

Technology

Kaizen(Continous Improvement) in action

Serverless Architecture meets Continous Delivery · Serverless Architecture meets Continous Delivery Alex Krause alex.krause@cosee.biz @alex0ptr Andreas Mohrhard andreas.mohrhard@cosee.biz

DevOps: Continous Delivery - Como os feedbacks são importantes

Continous Fermentation1

Continous delivery - Toruń JUG...Feature flags togglz ( ff4j ( lub nawet najprościej: if (Features.NEW_USER_STATS) {//...}

Continous Delivery with CQ

Rmit facilitating continous delivery 2 (2)

Past continous

Fond Continous

· 2016. 10. 16. · kvar) + kvar) kvar as (mccb) . a • (mccb) (f . as r , o us (i . continous prime continous 3 prime a. o continous , prime continous ,prime continous s prime

Hit The Ground Running For Continous Delivery · Hit The Ground Running For Continous Delivery Ashwin Shankarananda. ... Clear understanding of Continuous Delivery. How to get started

PeopleSoft 9.2 Update Manager and Continous Delivery Model

IMS 15 Continous Delivery - IMS UG Oct 2017 Omaha

From Continous Integration to Continuous Delivery

DevOps como habilitador de continous delivery

Continous delivery regional scrum gathering ecuador

Continous-Action Q-Learning

Continous delivery with sbt

Continous integration and delivery for single page applications

Continous Improvement