Cloud Foundry: Inside the Machine

Derek Collison

Inside The Machine

Thursday, October 27, 11

What isCloud Foundry?

The OpenPlatform as a Service

What is PaaS?

Or more specifically, aPaaS?

• Application Platform as a Service

• Applications and Services

• Application Platform as a Service

• Applications and Services

• Not • VMs

• Memory

• Storage

• Networks

• CPU

What isOpenPaaS?

OpenPaaS

• Multi-Language

• Multi-Framework

• Multi-Services

• Multi-Cloud, Multi-IaaS

• Hybrid - Public or Private or Both

• OpenSource

OpenPaaS

• Multi-Language• Ruby, Java, Scala, Node.js, Erlang, Python, PHP..

• Multi-Framework• Rails, Sinatra, Spring, Grails, Express, Lift

• Multi-Services• MySQL, Postgres, MongoDB, Redis, RabbitMQ

• Multi-Cloud, Multi-IaaS• vSphere, MicroCloud, OpenStack, AWS

The Open PaaS

Application Service Interface

Private Clouds

PublicClouds

MicroClouds

Data Services

Other Services

Msg Services

The Open PaaS

Application Service Interface

Private Clouds

PublicClouds

MicroClouds

Data Services

Other Services

Msg Services

vFabric Postgres

vFabric RabbitMQTM

What isour Goal?

What was our Goal?

Raise the unit of currency to be the application and its associated services,

not the infrastructure

What was our Goal?

Best of breed delivery platform for all modern

applications and frameworks

What was our Goal?

Favor Choice

Openness

How was it Built?

• Kernel (CloudFoundry OSS)• Core PaaS System

• Kernel and Orchestrator Shells• Layered on top of IaaS

• Orchestrator• IaaS creation, management and

orchestration

High Level

Orchestrator

CF Kernel

Hardware - CPU/Memory/Disk/Network

Clients (VMC, STS, Browser)

Basic Premises

• Fail Fast

• Self Healing

• Horizontally Scalable Components

• Distributed State

• No Single Point of Failure

• Should be as simple as possible

Basic Patterns

• Event-Driven

• Asynchronous

• Non-blocking

• Independent, Idempotent

• Message Passing

• Eventually Consistent

Basic Design

• All components loosely coupled• Few “Classes”, many “Instances”

• Messaging as foundation• Addressing and Component Discovery

• Command and Control

• JSON payloads

• HTTP or File/Blob for data transport

Kernel Components

• All dynamically discoverable

• Launch and scale in any order

• Can come and go as needed

• Monitor via HTTP and JSON

• Location independent

Kernel Components

• Router

• CloudController

• DEA

• HealthManager

• Service Provisioning Agent

• Messaging System

Logical View

VMC client STS plugin Browser(user app access)

Routers

CloudControllers App

Services

HealthManager

DEA Pool

Messaging

“The Nervous System”

Messaging

Routers

Services

HealthManager

DEA Pool

Messaging

• Addressing and Discovery• No static IPs or DNS lookups req’d

• Just Layer 4

• Command and Control

• Central communication system

• Dial tone, fire and forget

• Protects *itself* at all costs

• Idempotent semantics

Router

“Traffic Cop”

Router

Routers

Services

HealthManager

DEA Pool

Messaging

Router

• Handles all HTTP traffic

• Maintains distributed routing state

• Routes URLs to applications

• Distributes load among instances

• Realtime distributed updates to routing tables from DEAs

CloudController

“The King”

CloudController

Routers

Services

HealthManager

DEA Pool

Messaging

CloudController

• Handles all state transitions

• Deals with users, apps, and services

• Packages and Stages applications

• Binds Services to Applications

• Presents external REST API

HealthManager

“Court Jester”

HealthManager

Routers

Services

HealthManager

DEA Pool

Messaging

HealthManager

• Monitors the state of the world

• Initial value with realtime delta updates to “intended” vs “real”

• Determines drift

• Complains to the CloudControllers when something is not correct

• No power to change state itself

“Droplet Execution Agent”

Routers

Services

HealthManager

DEA Pool

Messaging

DEA (Droplet Execution Agent)

• Responsible for running all applications

• Monitors all applications

• CPU, Mem, IO, Threads, Disk, FDs, etc

• All apps look same to DEA• start and stop

• Express ability and desire to run an application• runtimes, options, cluster avoidance, memory/cpu

• Alerts on any change in state of applications

• Provides secure/constrained OS runtime

• Hypervisor, Unix File and User, Linux Containers*

• Single or Multi-Tenant

How does it allWork?

Pushing an App

• Client (VMC/STS) pushes meta-data to CC

• Client optionally pushes resource signatures (diff analysis, sys wide)

• Client pushes app resources to CC

• CC puts app together

• CC stages app asynchronously

• CC binds and stages services

• Droplet ready

Running an App

• CC asks DEAs for “help”

• First DEA back wins! Simple

• CC sends start request to selected DEA

• DEA pushes the “green” button

• DEA waits and monitors pid and ephemeral port for app to bind

• When app is healthy, sends “register” message

• Register message is seen by HM and Routers

• Routers bind URL to host:port

DEAs answer?

• DEAs first determine YES or NO• correct runtime, options, memory, etc

• Then calculate a Delay Taint• SHA hash of application

• memory

• cpu

• Taint allows balancing and selection

Scale up & down?

• Exact steps as running the app the first time

• SHA1 taint helps avoid clustering

• memory/cpu taint helps distribute as evenly as possible

• Nothing pre-computed

• Nothing assumed

Crashes?

• If your app stops and we did not tell it to, that is a crash

• Crashed apps are immediately detected by DEA and messaged

• Routers disconnect route instantly

• HM will signal CC• something is wrong

• CC will issue run sequence again52

Access to my App?

• All routers understand where all instances of your application are running

• Will randomly pick backend, not semantically aware.

• Will remove routes that are stale or unhealthy

• Session stickiness and replication available, but best to avoid if possible

What aboutServices?

Services

Routers

Services

HealthManager

DEA Pool

Messaging

Services

• Service Advertisement

• Service Provisioning

• Gateway fronts multi-backends

• Service Nodes scale independent

• App and service talk directly

• API to register into system

• Closure for additional value

Provisioning

VMC/STS

Routers

CloudControllers Services Gateway

Service NodeMySQL

Service NodeRedis

Messaging

Application

Access (Direct)

Routers

CloudControllers Services Gateway

Service NodeMySQL

Service NodeRedis

Messaging

Application

Browser(user app access)

Services

Cloud Foundry

vSphere

core services

Enterprise Services

SQLFire

service controller service broker

provision/bind

consume consume

VMware Dev Tools Partner Dev Tools

Data Director

Relational DB

Learn more:

www.cloudfoundry.org

blog.cloudfoundry.com

support.cloudfoundry.com

Thank You

Questions?dcollison@vmware.com

derek.collison@gmail.com

twitter: derekcollison

Cloud Foundry: Inside the Machine

Technology

Hargreaves Foundry Drainage · The Hargreaves Foundry group of companies includes Hargreaves Foundry Drainage, Hargreaves Foundry and Hargreaves Lock Gates. Hargreaves Foundry is

Inside the Hadoop Machine @ VMworld

Inside the Java Virtual Machine · 1 INSIDE THE JAVA VIRTUAL MACHINE Filip Hanik Covalent Technologies. August 29, 2007. Memory Management and Troubleshooting

Foundry Digitalisation Bhushan Bhatt · casting? Man-Machine-operation- Workflow •Real inventory of all the casting laying anywhere in foundry at any stage •Status of per order

Important Safety Information · 2020-04-09 · inside machine compartment onto water valve electrical terminals. 3 Tuck bottom portion of valve inside machine compartment behind the

Inside College Sports’ Biggest Money Machine Presented By: The OARS

Who are we? - Hargreaves Foundry · Hargreaves Foundry Hargreaves Foundry is a long established supplier of castings to the engineering sector, in particular the machine tool industry

Foundry Products (Ideal Foundry

Foundry Diagnostic Guide · Foundry Diagnostic Guide

Nomination of PHOENIX FOUNDRY BALLARAT · PDF fileThis image shows the machine shop of the Phoenix foundry. ... Model Locomotive Engine Created by Apprentices from the ... for the

Celebrating 10 years of success INSIDE THE TIME MACHINE

Bytes in the Machine: Inside the CPython interpreter

Machine Tool Output, 1861-1910 · category of foundry and machine shop products, ... calculation of dollar sales for the shorter period. ... of The. MACHINE TOOL OUTPUT, 1861—1910

DATA SHEET - Icecatobjects.icecat.biz/objects/mmo_76848051_1575029424_3985_30657… · Foundry Katana • • Foundry Mari • Foundry Modo • Foundry Nuke • VR Authoring. Adobe

Avtar Foundry & Workshop, Punjab, Construction Machine

R. K. Foundry & Engineering Works, Batala, Machine tools

MACHINE LEARNING INSIDE THE FOUR WALLS OF YOUR …

Chapter 5A - 3 Emotions - Actor's Foundry · 2015. 11. 16. · FOUNDRY acting with Matthew Harrison Chapter IF: Summary If you ore olive, you already have on actor inside of you

HongXiang casting Mold Co,Ltd - foundry- · PDF fileCNC machining center CNC machine ... polishing machine,lathes,CNC maching centers,Hydraulic machines,sawing machines,all kinds

· ferrous casting foundry machine type pit furnace for non ferrous pressure die casting machine pressure die casting machine gravity die casting machine rotary barrel type shot