Dockercon State of the Art in Microservices

State of the Art in Microservices

!Adrian Cockcroft - Battery Ventures - @adrianco

!Speeding up Development Microservice Architectures

What’s Next

Cloud Adoption

%*&!”

By Simon Wardley http://enterpriseitadoption.com/

Cloud Adoption

%*&!”

Cloud Adoption

%*&!”

Cloud Adoption

@adrianco’s job at the intersection of cloud and Enterprise IT

%*&!”

20142009

Cloud Adoption

@adrianco’s job at the intersection of cloud and Enterprise IT

%*&!”

20142009

Docker wasn’t on anyone’s roadmap for 2014. It’s on everyone’s roadmap for 2015.

Product Development

Processes

Observe

Orient

Decide

Act Continuous Delivery

Observe

Orient

Decide

Land grab opportunity Competitive

Customer Pain Point

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

INNOVATION

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Model Hypotheses

INNOVATION

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Model Hypotheses

BIG DATA

INNOVATION

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Model Hypotheses

BIG DATA

INNOVATION

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Model Hypotheses

BIG DATA

INNOVATION

CULTURE

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Incremental Features

Automatic Deploy

Launch AB Test

Model Hypotheses

BIG DATA

INNOVATION

CULTURE

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Automatic Deploy

Launch AB Test

Model Hypotheses

BIG DATA

INNOVATION

CULTURE

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Automatic Deploy

Launch AB Test

Model Hypotheses

BIG DATA

INNOVATION

CULTURE

Measure Customers

Continuous Delivery

Observe

Orient

Decide

Customer Pain Point

Analysis

Plan Response

Share Plans

Automatic Deploy

Launch AB Test

Model Hypotheses

BIG DATA

INNOVATION

CULTURE

Measure Customers

Continuous Delivery

Breaking Down the SILOs

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

Product Team Using Monolithic DeliveryProduct Team Using Monolithic Delivery

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

MgrProduct Team Using Microservices

Product Team Using Monolithic Delivery

Product Team Using Microservices

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

Platform TeamProduct Team Using Microservices

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

Platform TeamA P IProduct Team Using Microservices

QA DBA Sys Adm

Net Adm

SAN AdmDevUXProd

Platform Team

DevOps is a Re-Org!

A P IProduct Team Using Microservices

Release Plan

Developer

QA Release Integration

Ops Replace Old With New

Release

Monolithic service updates

Works well with a small number of developers and a single language like php, java or ruby

Release Plan

Developer

Release

Release Plan

Developer

Release

Developer

Old Release Still Running

Release Plan

Immutable microservice deployment scales, is faster with large teams and diverse platform components

Developer

Release Plan

Deploy Feature to Production

Developer

Release Plan

Developer

Release Plan

Configure

Developer

Release Plan

Deploy Standardized

Services

Standardized portable container deployment saves time and effort

https://hub.docker.com

Configure

Developer

Release Plan

Deploy Standardized

Services

Standardized portable container deployment saves time and effort

https://hub.docker.com

Developing at the Speed of Docker

Developers • Compile/Build • Seconds

Extend container • Package dependencies • Seconds

PaaS deploy Container • Docker startup • Seconds

Developing at the Speed of Docker

Speed is addictive, hard to go back to taking much longer to get things done

Developers • Compile/Build • Seconds

Extend container • Package dependencies • Seconds

PaaS deploy Container • Docker startup • Seconds

What Happened?Rate of change

increased

Cost and size and risk of change

reduced

Disruptor: Continuous Delivery with

Containerized Microservices

Microservices

A Microservice Definition !

Loosely coupled service oriented architecture with bounded contexts

If every service has to be updated at the same time it’s not loosely coupled

If you have to know too much about surrounding services you don’t have a bounded context. See the Domain Driven Design book by Eric Evans.

Coupling Concerns

http://en.wikipedia.org/wiki/Conway's_law

●Conway’s Law - organizational coupling

●Centralized Database Schemas

●Enterprise Service Bus - centralized message queues

●Inflexible Protocol Versioning

Speeding Up The Platform

Datacenter Snowflakes • Deploy in months • Live for years

Virtualized and Cloud • Deploy in minutes • Live for weeks

Docker Containers • Deploy in seconds • Live for minutes/hours

AWS Lambda • Deploy in milliseconds • Live for seconds

Speed enables and encourages new microservice architectures

AWS Lambda • Deploy in milliseconds • Live for seconds

http://www.infoq.com/presentations/scale-gilt

http://www.slideshare.net/mcculloughsean/itier-breaking-up-the-monolith-philly-ete

http://www.infoq.com/presentations/Twitter-Timeline-Scalability http://www.infoq.com/presentations/twitter-soa

http://www.infoq.com/presentations/Zipkin

https://speakerdeck.com/mattheath/scaling-micro-services-in-go-highload-plus-plus-2014

State of the Art in Web Scale Microservice Architectures

AWS Re:Invent : Asgard to Zuul https://www.youtube.com/watch?v=p7ysHhs5hl0 Resiliency at Massive Scale https://www.youtube.com/watch?v=ZfYJHtVL1_w

Microservice Architecture https://www.youtube.com/watch?v=CriDUYtfrjs

Microservice Concerns

ConfigurationTooling Discovery Routing Observability

Development: Languages and Container

Operational: Orchestration and Deployment Infrastructure

Datastores

Microservices

Edda Archaius !

Configuration

Asgard Aminator !Tooling

Eureka Prana !

Discovery

Denominator Zuul, Netty Ribbon 2.0 !

Routing

Hystrix Pytheus SALP !

Observability

Java, Groovy, Scala, Clojure, Python, Node.js with AMI and Docker Containers

Manual Orchestration with Asgard and deployment on AWS or Eucalyptus

Ephemeral datastores using Dynomite, Memcached, Astyanax, Staash, Priam, Cassandra

Microservices

Edda Archaius !

Configuration

Asgard Aminator !Tooling

Eureka Prana !

Discovery

Denominator Zuul, Netty Ribbon 2.0 !

Routing

Hystrix Pytheus SALP !

Observability

Java, Groovy, Scala, Clojure, Python, Node.js with AMI and Docker Containers

Manual Orchestration with Asgard and deployment on AWS or Eucalyptus

Ephemeral datastores using Dynomite, Memcached, Astyanax, Staash, Priam, Cassandra

Focus on global distribution, high scale and availability

Twitter Microservices

Decider !!ConfigurationTooling

Finagle Zookeeper !Discovery

Finagle Netty !

Routing

Zipkin !!Observability

Scala with JVM Container

Orchestration using Aurora deployment in datacenters using Mesos

Custom Cassandra-like datastore: Manhattan

Twitter Microservices

Decider !!ConfigurationTooling

Finagle Netty !

Routing

Scala with JVM Container

Orchestration using Aurora deployment in datacenters using Mesos

Custom Cassandra-like datastore: Manhattan

Focus on efficient datacenter deployment at scale

Gilt Microservices

Decider !!Configuration

Ion Cannon SBT Rake !

Tooling

Akka Finagle Netty !

Routing

Scala and Ruby with Docker Containers

Deployment on AWS

Datastores per Microservice using MongoDB, Postgres, Voldemort

Gilt Microservices

Decider !!Configuration

Ion Cannon SBT Rake !

Tooling

Akka Finagle Netty !

Routing

Scala and Ruby with Docker Containers

Deployment on AWS

Datastores per Microservice using MongoDB, Postgres, Voldemort

Focus on fast development with Scala and Docker

Hailo Microservices

Configuration

Hubot Janky

Jenkins !Tooling

go-platform !Discovery

go-platform RabbitMQ !Routing

Request trace !Observability

Go using Docker

Deployment on AWS

Datastore based on Cassandra

Hailo Microservices

Configuration

Hubot Janky

Jenkins !Tooling

go-platform !Discovery

go-platform RabbitMQ !Routing

Request trace !Observability

Go using Docker

Deployment on AWS

Datastore based on Cassandra

Focus on fast development at scale using Go

Node.js Microservices

Several different approaches !Mostly small simple microservices !Focus on easy interface with presentation code in javascript !AWS Lambda - preview only

http://senecajs.org/

http://aws.amazon.com/lambda/

Adrian’s Prototypes

Model and visualize microservices Simulate interesting architectures !See github.com/adrianco/spigo Simulate Protocol Interactions in Go !See github.com/adrianco/d3grow Dynamic visualization

Web Scale Characteristics

●Brand new Microservices are deployed infrequently

●New versions deployed automatically/frequently

●No real need for general purpose orchestration

●Architectures use hundreds of microservices

●Each deployment is heavily customized

What’s Next?

Orchestration for Applications

●Standard portable microservice based applications

●New versions deployed automatically/frequently

●Orchestration automated and standardized

●Architectures likely based on tens of microservices

●Opportunity: Docker Hub as the enterprise app store

Next Generation Applications

? !Configuration

? !Tooling

? !Discovery

? !Routing

? !Observability

Development: Components assembled from Docker Hub as a composable “app store”

Operational: Many orchestration choices across public and private clouds

Datastores: Ephemeral, Orchestrated or DBaaS

Next Generation Applications

? !Configuration

? !Tooling

? !Discovery

? !Routing

? !Observability

Development: Components assembled from Docker Hub as a composable “app store”

Operational: Many orchestration choices across public and private clouds

Datastores: Ephemeral, Orchestrated or DBaaS

Fill in the gaps, rapidly evolving ecosystem choices

Forward Thinking

http://eugenedvorkin.com/seven-micro-services-architecture-advantages/

Any Questions?

Disclosure: some of the companies mentioned may be Battery Ventures Portfolio Companies See www.battery.com for a list of portfolio investments

● Battery Ventures http://www.battery.com ● Adrian’s Tweets @adrianco and Blog http://perfcap.blogspot.com ● Slideshare http://slideshare.com/adriancockcroft !

● Monitorama Opening Keynote Portland OR - May 7th, 2014 - Video available ● GOTO Chicago Opening Keynote May 20th, 2014 - Video available ● Qcon New York – Speed and Scale - June 11th, 2014 - Video available ● Structure - Cloud Trends - San Francisco - June 19th, 2014 - Video available ● GOTO Copenhagen/Aarhus – Fast Delivery - Denmark – Sept 25th, 2014 ● DevOps Enterprise Summit - San Francisco - Oct 21-23rd, 2014 #DOES14 - Videos available ● GOTO Berlin - Migrating to Microservices - Germany - Nov 6th, 2014 ● AWS Re:Invent - Cloud Native Cost Optimization - Las Vegas - November 14th, 2014

Thank You.

Dockercon State of the Art in Microservices

Technology

DockerCon EU 2015 - Windows Server Containers

Dockercon 2015 - Persistent Data in a Microservices World

Docker 1.12 (dockercon recap)

Dockercon plugins session

State of-the-art web applications using microservices and linked data

DockerCon SF 2015: DHE/DTR

DockerCon 14 Keynote Day 2

DockerCon 2016 Seattle Recap

DockerCon EU 2015: Docker Monitoring

Dockercon eu tour 2015 - Devoxx Casablanca

DockerCon SF 2015: Docker Security

Enabling Microservices @Orbitz - DockerCon 2015

Microservices Manchester: Microservice, Microservice, Wherefor Art Thou Microservic? By Nic Jackson

Dockercon Swarm Updated

DockerCon SF 2015: Faster, Cheaper, Safer

DockerCon EU 2015 Barcelona

Eberhard Wolff - dpunkt.verlag6 Grundlagen: Microservices Begründung ISA zeigt, dass Microservices eine Art der Modularisierung sind (Prinzip 1). Dadurch können Ideen wie Information

DockerCon SF 2015: Keynote Day 1

DockerCon EU 2015: Monitoring Docker

DockerCon SF 2015: Networking Breakout