EMC World 2016 - code.04 Extending Mesos for Storage and External Resources

© Copyright 2016 EMC Corporation. All rights reserved.© Copyright 2016 EMC Corporation. All rights reserved. 1

EXTENDING MESOS FOR STORAGE AS A GLOBAL RESOURCESTEVE WONGDEVELOPER ADVOCATE – EMC{code}

GREG MANNSOFTWARE ENGINEER – Mesosphere

© Copyright 2016 EMC Corporation. All rights reserved. 2

GOT CONTAINERS AT SCALE?YOU NEED A SCHEDULER…


ASSUME 1000’S OF SERVICES

• How do you place an assortment of containers onto your servers efficiently?


WHAT’S A SCHEDULER?• Manages compute nodes

– Takes reports from each node regarding their health and available capacity

• Manages incoming work requests– Accepts job requests– Based on requirements, decides which node

should fulfill each request– May attempt to optimize job placement to

maximize locality, utilization, etc.

on demand

scheduled

batch


When you build a cluster, there’s no getting around it:you are building a distributed system

• Difficult to design, build and operate• Introduces complexity

Mesos takes on some of the "heavy lifting" of deploying and operating a distributed system

MESOS AS A CLUSTER MANAGER


A distributed systems kernel

• Abstracts many independent nodes into a single pool• Negotiates among multiple schedulers

– Competing schedulers can suffer from resource starvation– Mesos offers resources to frameworks to ensure fairness

WHAT IS MESOS?


WHAT IS MESOS?

Marathon


• Where it started• Recent

enhancements• Roadmap

MESOS AND STORAGE


CLUSTER NODES OFFER LOCAL RESOURCES


MESOS MASTER PRESENTS OFFERS TO FRAMEWORKS

Marathon




MESOS AND STORAGE


RESERVE CLUSTER NODE HOSTED VOLUME


External volume mounts were added in 2015• Provides

Availability + Scale

MOUNT A VOLUME FROM EXTERNAL STORAGE




MESOS AND STORAGE


NOT ALL RESOURCES ARE LOCAL


AGENT FAILURE

• Agents are the source of truth for resource information


AGENT FAILURE

• When an agent fails this information is lost, but so are the resources!


AGENT FAILURE

• When a failed agent was using a global resource, the resource is still available!


AGENT FAILURE

• The state of this resource must be stored off the agent


NEED A NEW ABSTRACTION• We need a third

entity to track the use of global resources


• Option #1: Integrate global resources into the Mesos offer cycle

HOW TO INTEGRATE GLOBAL RESOURCES?


• Option #2: Handle global resources “out-of-band”



Mesos was originally designed to manage compute node resources• Storage in this context meant DAS

A JIRA proposal exists to include global resources in the Mesos offer model, but this may not be necessary.• Feedback is welcome!



HOW DO YOU TRACK WHAT STORAGE YOU HAVE?… AND WHERE IT’S IN USE?

© Copyright 2016 EMC Corporation. All rights reserved.

Create

Utilize

Retire

MESOS INTERFACES WITH STORAGE

Lifecycle management with governance

Mount managementAssignment to applications


A LARGE SCALE INSTALLATION NEEDS TO ALLOW FOR MULTIPLE STORAGE PROVIDERS

What does this remind you of?


MESOS = 2 LEVEL CONTAINER SCHEDULER


TWO LAYER EXTERNAL STORAGE SCHEDULING


STORAGE SCHEDULER = DELIVER SCALE OUTScale out is not just about adding capacity. A Storage Scheduler will let you:• Add, remove, replace storage provider platforms

– in or out of public cloud• Add, remove, replace schedulers• This is about giving you flexibility and

shifting the burden of keeping up to vendors


POLLY AS A MESOS FRAMEWORK


DCOS: THE DATACENTER OPERATING SYSTEM

learn more at mesosphere.com

http://mesosphere.com/


Data Persistence in the New Container WorldWednesday 3PM

Joshua BernsteinVP of Technology for ETD

Tobi Knaup CEO & Co-Founder of Mesosphere

Guru Session


@EMCcode@cantbewong

mesosphere.comemccode.comcommunity.emccode.com

Come visit us at Booth #1044 or in the vLab

Questions?

© Copyright 2016 EMC Corporation. All rights reserved.© Copyright 2016 EMC Corporation. All rights reserved. 34