Scale your docker containers with Mesos

  • Published on
    21-Apr-2017

  • View
    7.226

  • Download
    9

Embed Size (px)

Transcript

  • DockercontainersatscalewithApacheMesosDistributedSystemsEngineer

    ApacheMesosPMC

    TimothyChen

    @tnachen

    tim@mesosphere.io

    mailto:tim@mesosphere.io

  • Mesoswhat? Marathon Chronos

    Demo!

  • Statusquoisstaticpartitioninganduseofvirtualmachines

  • Addsomevirtualmachines

  • ProvisionHadoop

  • Provisionawebservice

  • Moardata,moarHadoop

  • Mesosletustreataclusterofnodes...

  • Asonebigcomputer

  • Notasindividualmachines

    NotasVMs

  • Butascomputationalresourceslikecores,memory,disks,etc.

  • 240millionmonthlyactiveusers

    500milliontweetsperdayUpto150ktweetspersecondMorethan100TBperdayof

    compresseddata

  • Mesosisthecornerstoneofourelasticcomputeinfrastructureit'showwebuildallournewservicesandiscriticalforTwitter'scontinuedsuccessatscale.It'soneofthe

    primarykeystoourdatacenterefficiency.ChrisFry,SVPofEngineeringatTwitter

  • ContainerizationinMesos,abriefhistory

  • Mesosis...Atop-levelApacheproject Aclusterresourcenegotiator Scalableto10,000sofnodes Fault-tolerant,battle-tested AnSDKfordistributedapps

  • Mesosforallthethings

  • Marathon Mesoswhat? Chronos

    Demo!

  • aself-serveinterfacetoyourcluster

  • distributed"init"forlong-runningservices

  • aprivatefault-tolerantPaaS

  • Marathondoesit!Start,stop,scale,updateappsNicewebinterface,APIHighlyavailable,noSPoFNativeDockersupportFullyfeaturedRESTAPIPluggableeventbusRollingdeploy/restartApplicationhealthchecksArtifactstaging

  • ChronosMesoswhat? Marathon

    Demo!

  • IntroducingChronos

    aschedulerforbatchandone-offjobs

  • Distributeagraphofjobs

    Dependencygraphforexecution

  • FeaturesDistributedjobschedulerWebinterface,APIHighlyavailable,noSPoFNativeDockersupportEasyschedulingwithrepeatingintervals

  • ChronosREST

    PUT chronos-node:8080/scheduler/job/job1

    GET chronos-node:8080/scheduler/jobs

    DELETE chronos-node:8080/scheduler/task/kill/job2

  • Demo!

    Mesoswhat?

    Marathon

    Chronos

  • Thanks!Comeandtalktome

    P.S.,we'rehiring!

Recommended

View more >