Ecosysteme mesos university - devoxx france - 8 avril2015

@XebiaFr @YesWeScale#MesosUniversity

Mesos University

@jbclaramonte @plopezFr @jpthiery @aurelienmaury


Agenda• Mesos

• Frameworks

• Mesosphere

• Marathon

@YourTwitterHandle@YourTwitterHandle@XebiaFr @YesWeScale#MesosUniversity

Mesos


Ressources partagées

Master

Slave Slave Slave Slave

cpu: 2mem: 2048

cpu: 4mem: 16384

cpu: 2mem: 4096

cpu: 32mem: 131072


Resources

• 2 méthodes permettent de décrire les slaves du cluster

• Resources

• Tags (ou « Attributes »)


Resources• Certaines resources types sont pré définies par Mesos

• cpu

• mem

• disk

• port


Resources• Certaines resources types sont pré définies par Mesos

• cpu

• mem

• disk

• port

OBLIGATOIRE !


Resources• Trois différentes types de resources

• scalars

• ranges

• sets


Resources

cpu:24;mem:24576;disk:409600;ports:[21000-24000];disks:{1,2,3,4,5,6,7,8,9}


Resources


Scalar


Resources


Range


Resources


Set

par exemple /mnt/disk/{diskNum}


Mesos: Web UI


Mesos: Web UI


Mesos: Web UI


Mesos: Web UI


Mesos: Web UI


Framework


Framework

Framework = Application


Frameworks


Framework : API


API


APIScheduler

• Est notifié par le master de la mise à disposition de ressource

• Demande l’exécution de tâches au master

Executor

• Réalise les taches soumises par le master


API

Scheduler Mesos (master)

register

time

Executor


API


registerregistered

time

Executor


API


registerregistered

offer

time

Executor


API


registerregistered

offer

launch

time

launch

Executor


API


registerregistered

offer

launch

updatetime

launch

Executor

update


Framework : API

API du Scheduler


Scheduler : Lifecycle management

Executor

Master

Slave

Scheduler

registered(…)

void registered(SchedulerDriver driver, FrameworkID fwkId, MasterInfo masterInfo);

Master

Standby



Executor

Master

Slave

Scheduler

Master

Standby

disconnected(…)

void disconnected(SchedulerDriver driver);



Executor

Slave

Schedulerreregistered(…)

Master Master

void reregistered(SchedulerDriver driver, MasterInfo masterInfo);


Scheduler : Resource Allocation

Executor

Master

Slave

HadoopScheduler

resourceOffers(…)

Master

Standby

CassandraScheduler

void resourceOffers(SchedulerDriver driver, List<Offer> offers);

Offre de ressources


Scheduler : Resource Allocation

CassandraExecutor

Master

Slave

HadoopScheduler

offerRescinded(…)

Master

Standby

CassandraScheduler

Task

Le scheduler Cassandra

exécute le premier la tâche

void offerRescinded(SchedulerDriver driver, OfferID offerId);


Scheduler : Communication

CassandraExecutor

Master

Slave

HadoopScheduler

statusUpdate(…)

Master

Standby

CassandraScheduler

Task

void statusUpdate(SchedulerDriver driver, TaskStatus taskStatus);



CassandraExecutor

Master

Slave

HadoopScheduler

frameworkMessage(…)

Master

Standby

CassandraScheduler

Task

void frameworkMessage(SchedulerDriver driver, ExecutorID execId, SlaveID slaveId, byte[] message);


Scheduler : Error events

CassandraExecutor

Master

Slave

HadoopScheduler

slaveLost(…)

Master

Standby

CassandraScheduler

Task

void slaveLost(SchedulerDriver driver, SlaveID slaveId);



CassandraExecutor

Master

Slave

HadoopScheduler

executorLost(…)

Master

Standby

CassandraScheduler

Task

void executorLost(SchedulerDriver driver,ExecutorID execId, SlaveID slaveId, int status);



Executor

Master

Slave

Scheduler

error(…)

Master

Standby

void error(SchedulerDriver driver, String message);


Framework : API

API de l’Executor


Executor : Lifecycle management

Executor

Master

Slave

Scheduler

registered(…)

Master

Standby

void registered (ExecutorDriver driver, ExecutorInfo execInfo, FrameworkInfo fwkInfo, SlaveInfo slaveInfo);



Executor

Master

Slave

Scheduler

Master

Standby

disconnected(…)

void disconnected(ExecutorDriver driver);



Executor

Master

Slave

Scheduler

Master

Standby

reregistered(…)

void reregistered(ExecutorDriver driver, SlaveInfo slaveInfo);


Scheduler : Task management

CassandraExecutor

Master

Slave

launchTask(…)

Master

Standby

CassandraScheduler

Task

void launchTask(ExecutorDriver driver, TaskInfo taskInfo);


Scheduler : Task management

CassandraExecutor

Master

Slave

killTask(…)

Master

Standby

CassandraScheduler

Task

void killTask(ExecutorDriver driver, TaskID taskId);

schedulerDriver.killTask(…)



CassandraExecutor

Master

Slave

frameworkMessage(…)

Master

Standby

CassandraScheduler

Task

void frameworkMessage(ExecutorDriver driver, byte[] msg);


Mesosphere : Chronos & Marathon


Mesosphere

Florian Leibert

Benjamin HindmanTobi Knaup


Mesosphere

Our mission is to make building and running distributed systems as easy as building or running an

app on your smartphone.


Chronos


Marathon


Quoi ?

“Init Daemon” pour Data Center

Private PaaS


Pourquoi ?

Simplifier

Automatiser

API pour les développeurs

Améliorer l’efficacité


Fonctionnalities

Déploiement élastique

Haute disponibilité

SécuritéSystème

d’évènementsAPI REST

Service Discovery


UI : liste des applications


UI : créer une application


Cycle de vie

Master

Slave Slave Slave Slave

Marathon

Tâches Évènements / Offres


Marathon

API REST


POST /v2/apps { "id": "myrestapi", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT0" }

Démarrer une “Self Contained App”


POST /v2/apps { "id": "myrestapi", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT0" }

Démarrer une “Self Contained App”

Slave myrestapi$PORT0

ports:[0]


POST /v2/apps { "id": "ubuntu", "container": { "type": "DOCKER", "docker": { "image": "libmesos/ubuntu" } }, "instances": 1, "cpus": 0.5, "mem": 512, "uris": [], "cmd": "while sleep 10; do date -u +%T; done" }

Démarrer une application Dockerisée


Health check

• Par défaut, information provenant de Mesos

TASK_RUNNING => Healthy

• Configurable via l’API REST de Marathon


{ "id": "my-restapi-example-app", ... "healthChecks": [ { "protocol": "COMMAND", "command": { "value": "curl -f -X GET

http://$HOST:$PORT0/simpleapi/info" }, "gracePeriodSeconds": 300, "intervalSeconds": 5, "timeoutSeconds": 3, "maxConsecutiveFailures": 3 } ] }

Health check


{ "id": "my-restapi-example-app", ... "healthChecks": [ { "protocol": "HTTP", "path": "/simpleapi/info", "gracePeriodSeconds": 300, "intervalSeconds": 5, "timeoutSeconds": 3, "maxConsecutiveFailures": 3 } ] }

Health check


Les contraintes

Contrôler le “où” lors du déploiement


Les contraintes : tags

Identifier les ressources par des tags : • type de hardware • emplacement physique (datacenter , rack) • …

Positionnées au démarrage du slave

$ mesos-slave … --attributes="rack_id:2"


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNIQUE"] }

Contrainte : UNIQUE


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNIQUE"] }

Contrainte : UNIQUE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt CreditApp


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["harddrive","CLUSTER", "ssd"] }

Contrainte : CLUSTER

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt

ssd

hdd


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints":[["hostname","CLUSTER", “slave-3”] }

Contrainte : CLUSTER

Slave 1

UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt CreditApp


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["rack_id","GROUP_BY"] }

Contrainte : GROUP_BY

Slave 1

UserMgt

Slave 2

CreditApp

Slave 3 Slave 4

Rack 1

Rack 2

UserMgt CreditApp

UserMgt

UserMgt


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","UNLIKE", "slave-[2-3]"] }

Contrainte : UNLIKE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt


POST /v2/apps { "id": "my-restapi-example-app", "instances": 2, "cpus": 0.3, "mem": 128, "ports": [0], "uris": ["http://storage.googleapis.com/restapi-jb/RestApi.jar"], "cmd": "java -jar RestApi.jar --server.port=$PORT", "constraints": [["hostname","LIKE", "slave-[1-3]"] }

Contrainte : LIKE

Slave 1

UserMgt UserMgt

Slave 2

UserMgt CreditApp

Slave 3 Slave 4

UserMgt UserMgt


Application groups

• Définir des liens de dépendance entre les groupes

• Scaler tout un groupe à la fois


Marathon : Application groups

/myapp/bdd

postgresql instance=3

redis instance=4

/myapp/service

apache instance=5

tomcat instance=8

myapp

Dépendance


{ "id": "/myapp", "groups": [ { "id": "/myapp/bdd", "apps": [ { "id": "/myapp/postgresql", ... }, { "id": "/myapp/redis", ... } ] },{ "id": "/myapp/service", "dependencies": ["/myapp/bdd"], "apps": [ { "id": "/myapp/apache", ... }, { "id": "/myapp/tomcat", ... } ] } ] }

Application groups


Service Discovery

Où est mon application ?


HaProxy : reload configuration

• HaProxy - Marathon bridge (script)

• Bamboo


Service Discovery

Slave 1 Slave 2

Marathon

HA Proxy

HA Proxy Marathon Bridge

HA Proxy



Service Discovery

Slave 1 Slave 2

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100

CreditApp Port 31200

UserMgt Port : 10000 CreditApp Port : 20000Marathon

HA Proxy


HA Proxy



Service Discovery

Slave 1 Slave 2

UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100


UserMgt Port : 10000 CreditApp Port : 20000Marathon

HA Proxy


HA Proxy



Service Discovery

Slave 1

Marathon

HA Proxy


Slave 2

HA Proxy


UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100


localhost:10000 { slave1:31100 slave1:31200 slave2:31100

} localhost:20000 {

slave2:31200 }

UserMgt Port : 10000 CreditApp Port : 20000


Service Discovery

Slave 1

Marathon

HA Proxy


Slave 2

HA Proxy


UserMgt Port 31100

UserMgt Port 31200

UserMgt Port 31100


localhost:10000 { slave1:31100 slave1:31200 slave2:31100

} localhost:20000 {

slave2:31200 }

UserMgt Port : 10000 CreditApp Port : 20000


DCOS


Demo


Q & A

Software

Ecosysteme mesos university - devoxx france - 8 avril2015