75
Things will Change Eric Windisch UCSM’14 June 19th

Things will Change - Usenix Keynote UCMS'14

Embed Size (px)

DESCRIPTION

From servers and containers, to services and things. Building an Internet of Things of the clouds and infrastructure we're building today. Maps the future of configuration management and systems artifact management.

Citation preview

Page 1: Things will Change - Usenix Keynote UCMS'14

Things will Change

Eric Windisch UCSM’14

June 19th

Page 2: Things will Change - Usenix Keynote UCMS'14

Visionary

• Built wearable computer in 2000

• Began building and selling PaaS-like solutions in 2002

• Began selling VM-based VPS in 2006;

• Began architecting “cloud” IaaS in 2007 at historic price-points ($5/mo VMs!)

• OpenStack contributor since Q1 2011

• Joined Docker in January 2014

@ewindisch

Page 3: Things will Change - Usenix Keynote UCMS'14

Configuration management

Page 4: Things will Change - Usenix Keynote UCMS'14

Containers

Page 5: Things will Change - Usenix Keynote UCMS'14
Page 6: Things will Change - Usenix Keynote UCMS'14

Microservices

Page 7: Things will Change - Usenix Keynote UCMS'14

“The Operating System is Dead”

Page 8: Things will Change - Usenix Keynote UCMS'14

“Two years ago, I said to a colleague: The kernel is dying.Now I fear the distribution is dying.”

Page 9: Things will Change - Usenix Keynote UCMS'14
Page 10: Things will Change - Usenix Keynote UCMS'14

“Containers technology finally leverages the things the kernel does well.”

Page 11: Things will Change - Usenix Keynote UCMS'14

“There is, of course, the matter of orchestrated per-tenant VM clusters which run clouds of containers — such as Google does.”

Page 12: Things will Change - Usenix Keynote UCMS'14
Page 13: Things will Change - Usenix Keynote UCMS'14

“Its close alignment to the Internet of Things is the disruptive elementof the microservices movement”

Page 14: Things will Change - Usenix Keynote UCMS'14

Things

Page 15: Things will Change - Usenix Keynote UCMS'14

“It’s no surprise that embedded network programming is usually bad, if most developers are work ing , not on ly with 80’s hardware, but with developer libraries of a similar vintage — as far as networking is concerned.”

Page 16: Things will Change - Usenix Keynote UCMS'14

The Cloud

Page 17: Things will Change - Usenix Keynote UCMS'14

ShoudThingsChange?

Page 18: Things will Change - Usenix Keynote UCMS'14

“There is no such th ing as stateless.”

Page 19: Things will Change - Usenix Keynote UCMS'14

“However, we can not prevent state from changing. We cannot kill the Chaos Monkey.”

Page 20: Things will Change - Usenix Keynote UCMS'14

“It is naive to think we can simply throw away VMs or containers — we want to preserve their state for archival and analysis.”

Page 21: Things will Change - Usenix Keynote UCMS'14
Page 22: Things will Change - Usenix Keynote UCMS'14

“The biggest problem with blind a d h e r e n c e t o i m m u t a b l e infrastructure & 12-factor… is ignorance of the importance of the implicit state of a system which should not be deemed disposable.”

Page 23: Things will Change - Usenix Keynote UCMS'14

Thingswill Change

Page 24: Things will Change - Usenix Keynote UCMS'14
Page 25: Things will Change - Usenix Keynote UCMS'14

“We cannot control change, we can only effect it and manage it.”

Page 26: Things will Change - Usenix Keynote UCMS'14

Microservices will Change

Page 27: Things will Change - Usenix Keynote UCMS'14

“APIs and sensors, both, are inputs.”

Page 28: Things will Change - Usenix Keynote UCMS'14

Containerswill Change

Page 29: Things will Change - Usenix Keynote UCMS'14
Page 30: Things will Change - Usenix Keynote UCMS'14

“We need to manage containers like we manage Things. Products that do not do this are not good long-term solutions for managing containers.”

Page 31: Things will Change - Usenix Keynote UCMS'14

Distributed SYSTEMS

Page 32: Things will Change - Usenix Keynote UCMS'14

C

A P

Page 33: Things will Change - Usenix Keynote UCMS'14
Page 34: Things will Change - Usenix Keynote UCMS'14

“Because we cannot kill the Chaos Monkey, we need to know how to collect its droppings.1 2 - f a c t o r a n d i m m u t a b l e infrastructure fail to acknowledge this.”

Page 35: Things will Change - Usenix Keynote UCMS'14

“We need to manage change, not prevent it”

Page 36: Things will Change - Usenix Keynote UCMS'14

Puppet?Chef? Ansible? Salt?

Page 37: Things will Change - Usenix Keynote UCMS'14

“They are not designed for microservices. They are not designed for Things. They are designed for creating change, not for capturing it.”

Page 38: Things will Change - Usenix Keynote UCMS'14

“My fear is less that they’ll fail to evolve, but that they’ll lose their identities in the process..”

Page 39: Things will Change - Usenix Keynote UCMS'14

“One could… use Chef as a cloud orchestration solution — in fact, this was the initial scheduling for the Deis project.”

Page 40: Things will Change - Usenix Keynote UCMS'14

“The new pattern wil l be to configure Things through their own APIs, rather than through custom agents.”

Page 41: Things will Change - Usenix Keynote UCMS'14

“This [new fashion of configuration management] will work on all Things, all devices, and across Operat ing Systems — even Windows.”

Page 42: Things will Change - Usenix Keynote UCMS'14

“ We c a n n o l o n g e r a b i d e configuration management tools that use specialized agents.”

Page 43: Things will Change - Usenix Keynote UCMS'14

The future of management services

Page 44: Things will Change - Usenix Keynote UCMS'14

“Application-specific discovery and inventory mechanisms won’t go away, no more than Gopher has.”

Page 45: Things will Change - Usenix Keynote UCMS'14

“Just as Hypertext provided an implicit graph, linking and building relationships between websites — our next generation of web technologies will offer an explicit graph to provide discovery and inventory.”

Page 46: Things will Change - Usenix Keynote UCMS'14

Changing Things

Page 47: Things will Change - Usenix Keynote UCMS'14

“The worst thing I have to say about Heat is that OpenStack as a whole tends to be overly insular, m a k i n g t h e a d h o c u s e o f components such as Heat, an uncommon exercise. Still, Heat supports standalone installation.”

Page 48: Things will Change - Usenix Keynote UCMS'14
Page 49: Things will Change - Usenix Keynote UCMS'14

“In some ways, Chef might already offer many of the right things for the next generation, if only at a relatively local, non-global scale.”

Page 50: Things will Change - Usenix Keynote UCMS'14

Now you have 2TRILLIONProblems

Page 51: Things will Change - Usenix Keynote UCMS'14

”What we need today are hyper-connected Things”

Page 52: Things will Change - Usenix Keynote UCMS'14
Page 53: Things will Change - Usenix Keynote UCMS'14

“MQTT solves important problems related to accessing sensor data, but not all the problems of accessing and controlling things.”

Page 54: Things will Change - Usenix Keynote UCMS'14

Things at REST…

Page 55: Things will Change - Usenix Keynote UCMS'14

“The primary issue with REST is that it’s not a protocol. It is at best a guideline. That’s not strict enough for building a hyper-connected web.”

Page 56: Things will Change - Usenix Keynote UCMS'14

“Protocols such as MQTT provide value as a buffer to support idempotency for REST access to Things, but this works better for retr ieving data, rather than creating or updating it.”

Page 57: Things will Change - Usenix Keynote UCMS'14

Things as Services

Page 58: Things will Change - Usenix Keynote UCMS'14

Proto-types

Page 59: Things will Change - Usenix Keynote UCMS'14

“MQTT itself is a protocol, not a document-type… but if it doesn’t do all the things we need, we either need a different protocol, or multiple.”

Page 60: Things will Change - Usenix Keynote UCMS'14

“Every time you create a new standard to solve a problem, you have two problems.”

Page 61: Things will Change - Usenix Keynote UCMS'14
Page 62: Things will Change - Usenix Keynote UCMS'14

Upgrade the Internet

Page 63: Things will Change - Usenix Keynote UCMS'14

“We want to do more. We want devices to connect. We want those devices to know not just who to speak to, but how to speak to others.”

Page 64: Things will Change - Usenix Keynote UCMS'14

“Google could be

super seded by

t h e S e m a n t i c

Web”

— Tim Berners-Lee

Page 65: Things will Change - Usenix Keynote UCMS'14

“Recognizing that what we want is a Semantic Web, gives us context for researching and understanding the efforts that have come before.”

Page 66: Things will Change - Usenix Keynote UCMS'14

Semantic Web

Page 67: Things will Change - Usenix Keynote UCMS'14

“The RDF and OWL efforts have been nearly complete failures.”

Page 68: Things will Change - Usenix Keynote UCMS'14

“The Semantic Web should not just express the context of things, but provide discoverability.”

Page 69: Things will Change - Usenix Keynote UCMS'14

Now… time for something different.

Page 70: Things will Change - Usenix Keynote UCMS'14

“libswarm builds libchan, which builds on top of existing protocols such as SPDY and HTTP2, or WebSockets.”

Page 71: Things will Change - Usenix Keynote UCMS'14

“This new Internet, or web, needs to be about all Things, not all Devices. Where all services are Things and all Things are services.”

Page 72: Things will Change - Usenix Keynote UCMS'14

“We need new services and c o n f i g u r at i o n m a n a g em e nt solutions that work across devices, clouds, and containers.”

Page 73: Things will Change - Usenix Keynote UCMS'14

“We need to bet on free, open, and semantic hyper-connected protocols — whatever those protocols may be.”

Page 74: Things will Change - Usenix Keynote UCMS'14

“Today, we are changing our servers, but tomorrow — We want to change the world.”

Page 75: Things will Change - Usenix Keynote UCMS'14

Thank you.