38
The Microsoft Azure Platform for IoT Dr Christian Geuer-Pollmann / @chgeuer / chgeuer@microsoft / http://aka.ms/chgeuer

MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

  • Upload
    mongodb

  • View
    377

  • Download
    0

Embed Size (px)

DESCRIPTION

Presented by, Dr Christian Geuer-Pollmann, Senior Technology Evangelist at Microsoft. The presentation gives a solid overview to the Microsoft Azure platform, with a special emphasis on scenarios for IoT workloads. First, Christian provides an introduction to Microsoft Azure’s IaaS compute and networking infrastructure (i.e. virtual machines, virtual networks, load balancers and HA concepts). The second part of the presentation focuses on higher-order services in Azure, such as relational data bases, machine learning, search, and NoSQL offerings. Last, Christian explains how the Azure Service Bus and the Intelligent Systems Services fit into the overall IoT landscape.

Citation preview

Page 1: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

The Microsoft Azure Platform for IoT

Dr Christian Geuer-Pollmann / @chgeuer / chgeuer@microsoft / http://aka.ms/chgeuer

Page 2: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

whiteboardclown

cloud architect

codemonkey

that’s me

Page 3: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Device Support for IoT

Cloud Services for IoT

.NET MF and Gadgeteer

TI Sensor Tag Intel Gallileo

Service Bus

ISS

Compute

Storage

ML

Page 4: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

microsoft azure

Page 5: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

azure globally

Page 6: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

dublin, ireland53°19'28.7"N 6°27'17.2"W

a.k.a. azure region „Europe North“

how the satellite sees it

Page 7: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

how a helicopter sees it

Page 8: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

how a cab driver sees it

Page 9: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

ping power pipe

(many) containers

what‘s in it

Page 10: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

how I see it

Page 11: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

azure compute

Page 12: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

cloud computing – workload patterns

tCom

pute

Inactivity

Period

t

t

t

On and OffOn & off workloads (e.g. batch job)Over provisioned capacity is wasted Time to market can be cumbersome

Unpredictable BurstingUnexpected/unplanned peak in demand Sudden spike impacts performance Can’t over provision for extreme cases

Com

pute

Growing FastSuccessful services needs to grow/scale Keeping up w/ growth is big IT challenge Cannot provision hardware fast enough

Com

pute

Predictable BurstingServices with micro seasonality trends Peaks due to periodic increased demandIT complexity and wasted capacity

Com

pute

Page 13: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

cloud computing

consume

Software-as-a-ServiceSaaS

build

Platform-as-a-ServicePaaS

host

Infrastructure-as-a-Service

IaaS

web sitescloud servicesvirtual

machines

Page 14: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

cloud computing

Packaged Software

Storage

Servers

Networking

O/S

Middleware

Virtualization

Data

Applications

Runtime

You m

anag

e

Infrastructure

(as a Service)

Storage

Servers

Networking

O/S

Middleware

Virtualization

Data

Applications

Runtime

Man

ag

ed b

y v

en

dor

You m

anag

e

Platform(as a Service)

Man

ag

ed b

y v

en

dor

You m

anag

e

Storage

Servers

Networking

O/S

Middleware

Virtualization

Applications

Runtime

Data

Software(as a Service)

Man

ag

ed b

y v

en

dor

Storage

Servers

Networking

O/S

Middleware

Virtualization

Applications

Runtime

Data

Page 15: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

some selected platform services

Page 16: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

some selected platform services …

SQLAzure RDBMS as a Service

HDInsight Hadoop Cluster as a Service

APIManagement

API Proxy for Security, etc.AzureCache Redis Cache as a Service

MachineLearning Machine Learning as a Svc

TrafficManager DNS Loadbalancer

Document DB Managed NoSQL Doc DB{

}Azure Search Managed Search Service

Page 17: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

enterprise-grade partner services avail though the portal

Page 18: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

service bus

Page 19: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Smart Grid System

large scale eventing / command-control

“Last Mile”

Devices numbers at “utility” scale

Send targeted notifications

Large scale notifications and

broadcast

Smart Grid System

Smart Grid System

Page 20: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Push vs. Pull

‘Push’ is a sender initiated activity that results in delivery of a message to a receiver without the receiver explicitly asking for one or a particular message

Intermediary

Broker

‘Pull’ is a receiver initiated activity that delivers stored messages to the receiver in a context that the receiver controls. The context is decoupled from the ‘Push’ style send operation

Page 21: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Queues

Load LevelingReceiver receives and processes at its own pace. Can never be overloaded. Can add receivers as queue length grows, reduce receiver if queue length is low or zero. Gracefully handles traffic spikes by never stressing out the backend.

Offline/BatchAllows taking the receiver offline for servicing or other reasons. Requests are buffered up until the receiver is available again.

Queue

Page 22: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Queues

Load BalancingMultiple receivers compete for messages on the same queue (or subscription). Provides automatic load balancing of work to receivers volunteering for jobs.Observing the queue length allows to determine whether more receivers are required.

Queue

Page 23: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Topics

TopicSubSubSub

Message DistributionEach receiver gets its own copy of each message. Subscriptions are independent. Allows for many independent ‘taps’ into a message stream. Subscriber can filter down by interest.

Constrained Message Distribution (Partitioning)Receiver get mutually exclusive slices of the message stream by creating appropriate filter expressions.

Page 24: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

service bus

• Pub/Sub Message Broker• Queues, Topics & Subscriptions, Notification Hubs, Relay• Connect devices via open protocols

• AMQP • http• (MQTT)

• Pull vs. Push • Security• Battery Life (device determines chattiness)

• Scale• Deploy additional scale units (stamps) per million devices

Page 25: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

machine learning

Page 26: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

26

Page 27: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Azure Machine Learning — from data to results

Azure Portal

Azure Ops Team

ML Studio

Data Scientist

HDInsight

Azure Storage

Desktop Data

Azure Portal & ML API service

Azure Ops Team

ML API service Developer

ML Studio

• Access and prepare data• Create, test and train

models• Collaborate • One click to stage for

production via the API service

Azure Portal & ML API service

• Create ML Studio workspace

• Assign storage account(s)• Monitor ML consumption• See alerts when model is

ready• Deploy models to web

service

ML API service and the Developer

• Tested models available as an url that can be called from any end point

Page 28: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Intelligent Systems Service

Page 29: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Inaccessible data

Limited flexibility

Incompatible with infrastructure Unreliable service

Slow implementationUnsecure data and assets

Connect ExtendConfigur

e AdministerHarness

The IoT ecosystem has been fragmented

Secure?

Page 30: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

IncreasedAgility

Accessible data

Flexible and extensible solution

Finished service provided by

An integrated solution

Intelligent Systems Service

Connect ExtendConfigure AdministerHarness

Partner built

TrustedPlatform

Accelerated Time-to-value

Compatible with existing infrastructure

Faster implementation Protect data and assets

Reliable service

Protect

Page 31: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Accelerate implementation and time-to-value

Connect directly to ISS or though a local gateway (for constrained devices)

Enable broad connectivity options

OSS Agent (C-library) for arbitrary systems

Connect across a range of endpoints

Intelligent Systems Service SDK for Windows

Connect quickly

Existing apps through OData

Integrate existing devices and infrastructure

Connect

Agent

Agent

Agent

Agent

Agent

Gateway

Page 32: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Optimize performance and reliability

preferences adding or decommissioning deviceschanging alarm actions and severity levelsadding new rules changing connectivity and storage options

Reduce costs with a finished SaaS solution that does not require development time and building infrastructure

Use built-in metadata that works with multiple data schema to drive intelligent actions and insights such as command and control

Configure alarms and response options; ISS provides a number of alarms that can be configured and customized to support a number of response options

Drive intelligent actions Adjust as needs change

Deploy out-of-the-box cloud services Automate alarms and response options

Configure

Page 33: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Produce data-driven business insights

Apply configurable and customizable business rules to enable alarming and eventing based on ingressed data and through a complex event processing engine

Capture machine-generated, user-generated and transaction data using a variety of protocols: MQTT, AMQP, HTTPS and plug-in protocols

Enable data ingress to Azure Tables, SQL Azure and on-premises SQL, and access Intelligent Systems Service BLOB data seamlessly with your HDInsight account

Use common tools such as Excel and HDInsight for deep analytics, and enable data egress through OData interfaces to other analytics tools both cloud-based and on-premises

Simplify analysis with rationalized data Apply business rules

Capture a variety of data Use familiar analytics tools

Harness

101011101010101010101001010101010101011010101010101110101001010011010101010101011010101010100101010110101010101001101010111010

1010101

Page 34: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Achieve new levels of control

Support configuration of connected devices so specific actions are taken on device groups rather than on an individual basis, reducing manual intervention

Use the Intelligent Systems Service Operator Portal to remotely manage devices, including monitoring, maintenance, data transfer and deployment of software

Securely log in from remote devices and products to retrieve data, control devices, and diagnose and resolve issues

Group endpoints for simplified management

Operate from a central dashboard Manage remotely

Administer

Leverage the command and control dashboard to support multiple management activities such as distributing packages, sending commands and setting timed transmissions

Distribute packages and commands

Page 35: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Innovate and grow on a flexible platform

Work with familiar SI, ISV and OEM partners that have deep industry expertise to create rich, customized experiences and vertical solutions

Connect your on-premises environment with solution services running in the Azure public cloud

Incorporate new devices, apps, data and infrastructure into your existing setup with the Intelligent Systems Service SDK or the public SDK

Address variable demands with scalable and efficient data collection and storage in the Azure cloud through support of Azure Tables and Azure BLOB

Capitalize on cloud capabilities Innovate with third-party solutions

Integrate existing systems Scale as needed

+

Extend

Page 36: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Secure your data with automatic geo-replication of data across datacenters that are geographically separate

Simplify security relationships by using secure protocols like HTTPS and AMQP

Enable data ingress and egress to and from the cloud via secure protocols with the Azure Service Bus

Federate granular permissions to ensure the right people get the right access, and manage permissions with a consistent approach across datacenters and the cloud

Transport data through secure channels Access full data recovery features

Unify protection system-wide Configure granular permissions

Feel confident your data is protected

Protect

01011100

Page 37: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Thank you / [email protected]

Build with PaaS Use as SaaS

Page 38: MongoDB IoT City Tour STUTTGART: The Microsoft Azure Platform for IoT

Q & A