56
Web to Cloud WebIoTBig DataMLCloud John R Williams, MIT

Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

  • Upload
    others

  • View
    2

  • Download
    1

Embed Size (px)

Citation preview

Page 1: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Web to Cloud

Web🡪IoT🡪Big Data🡪ML🡪Cloud

John R Williams, MIT

Page 2: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be
Page 3: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be
Page 4: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Change is not necessary. Survival is not mandatory. – Edward Demming

Page 5: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Education is being Disrupted

Page 6: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

How can we survive and thrive?

Page 7: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

• Internet and Web 1970-2000• Internet of Things 2001• Smart Phone 2007• Big Data ~2009• Machine Learning ~2012 • Rise of the Robots ~2012• Cloud Native / DevOps ~present

A Gemba Walk Around the Technologies

Page 8: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Any New Field Produces an Arbitrary, Annoying Language. Immersion course

Page 9: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

The Internet

TCP Packets

Page 10: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Sir Tim Berners-LeeWorld Wide Web 1990HTML MarkupHTTP 1991

The Digital Revolution was started by him – Who is he?

Page 11: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

• 1983 DNS servers map URLs to IPhttp://www.mit.edu 🡪 18.58.1.131

• 1990 HTML layout

• Invented URIs (Universal Resource Identifiers)

• In 1991 HTTP 0.9 : GET, POST

• 1995 Browser - Netscape Browser

1990 Sir Tim Berners Lee Invents World Wide Web

Page 12: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Netscape Browser

Page 13: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Breden EichJavascript1995

1995 Brenden Eich Invents JavaScript in 10 days

Page 14: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

2004 First Web Apps - HTML 5

Page 15: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

2004 Ian Hickson – HTML5

Page 16: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be
Page 17: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

2005

Page 18: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

2013

IoT - Big Data Explosion

Page 19: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Stephen Miles, Sanjay Sarma and John Williams

Sanjay Sarma

Abel Sanchez and John Williams

MIT AutoID Laboratory 2001-present

Abel Sanchez John R Williams 2004-Present

Page 20: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

MIT Auto-ID Laboratory

IoT and Supply Chainshttp://geospatial.mit.edu

Page 21: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

One Goal of IoT was Visibility into the Supply Chain

Page 22: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Barcode = Manufacturer No. + SKU

Page 23: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Visibility into the Supply Chain

Page 24: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

http://epc.amazon.com/search?q=67890+10479832

Link to the Web

Page 25: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

EPCIS = Electronic Product Code Information System

Page 26: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

2 Billion 5 Billion 6 Billion 10 Trillion

1882050807+ = EPC

Company PrefixItem Reference

Unique Serial Number

The Internet of Things Rough Numbers

Item identification- epc code...

The Electronic Product Code issued globally by GS1

Page 27: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

IoTdeviceseverywhere

Gartner Inc. forecast that 6.4B connected things will be in use worldwide in 2016, up 30 percent from 2015, and will reach 20.8B by 2020. In 2016, 5.5M new things will get connected each day, Gartner estimates

What, When, Where, Why (4W)

Page 28: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Use Case – Tax on Cigarettes

2 trillion sold per year

Page 29: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Counterfeit Drugs

Page 30: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Tamiflu Drug Counterfeiting

Page 31: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

IoT Video Huawei Vision

Page 32: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Smart Phone Platform

GPS

Your phone knows who you are, where you are, who you contact, what you say, what you buy, the money you have in the bank, how many steps you take in a day, whether you are sick, how you sleep – it better be your best friend !!!

One Device Producing Big Data

Page 33: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Era of Mobile Computing

Page 34: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

More Data- Drone Lidar Data

Page 35: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

AgTech in California Wine Country

Page 36: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Big Geospatial Data - Smart City

Page 37: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Drone Lidar Data – Electric Power Lines

Page 38: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

FAANGS

Rise of the Cloud and Big Data Platforms

Page 39: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Coordination Platforms

Page 40: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

AgTech Platform – Monsanto tells Farmers What to Do

Page 41: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

FANGs Know Their Customers

Page 42: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Evolution of Platforms – Move to the Browser

Operating System

Hardware

Applications

Virtual Machine

Operating System

Hardware

Applications

Frameworks

Operating System

Hardware

Applications

Browser EngineBro

wse

r

Page 43: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

The MEAN Stack

Page 44: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

New Generation of Huge Web Apps

• Web apps are really really big• gmail ~500,000 loc

JavaScript• amazon.com ~600,000 loc

JavaScript• espn.com ~900,000 loc

JavaScript• cnn.com ~1,500,000 loc

JavaScript• Not uncommon to see 1 MB

of JavaScript sent client (minified)

Page 45: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Node.js – Web Server

Note: Linear Scalability

LinkedInMicrosoftYahoo!GithubWalmartUberVoxerEbay

Page 46: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Over 1 million

Libraries

Page 47: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

JavaScript Package Downloads

Page 48: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

What are the steps for Digital

Transformation and how do we start?

Page 49: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

How do we design an agile organization ?

Can a small company compete?

Page 50: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Page 51: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

Page 52: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

People killed by technological disasters1900-2011

Page 53: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

V- VolatileU- UncertainC - ComplexA - Ambiguous

It’s a VUCA world

Page 54: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Strategic Thinking

• John Boyd - OODA

• David Snowden –Cynefin

• David Marquet - Leadership

• Qiao Liang - Warfare

Page 55: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Architecting & Engineering Software Systems

©MIT GeoSpatial Data Center, Feb. 2018

System Complexity and Management- Dave Snowdon

8:37 The Cynefin Framework

https://www.youtube.com/watch?v=N7oz366X0-8

John Boyd - OODA

How do deal with VUCA ?

Page 56: Web to Cloud · Architecting & Engineering Software Systems ©MIT GeoSpatial Data Center, Feb. 2018 IoT devices everywher e Gartner Inc. forecast that 6.4B connected things will be

Sense