Upload
mongodb
View
377
Download
0
Embed Size (px)
DESCRIPTION
Presented by, Dr Christian Geuer-Pollmann, Senior Technology Evangelist at Microsoft. The presentation gives a solid overview to the Microsoft Azure platform, with a special emphasis on scenarios for IoT workloads. First, Christian provides an introduction to Microsoft Azure’s IaaS compute and networking infrastructure (i.e. virtual machines, virtual networks, load balancers and HA concepts). The second part of the presentation focuses on higher-order services in Azure, such as relational data bases, machine learning, search, and NoSQL offerings. Last, Christian explains how the Azure Service Bus and the Intelligent Systems Services fit into the overall IoT landscape.
Citation preview
The Microsoft Azure Platform for IoT
Dr Christian Geuer-Pollmann / @chgeuer / chgeuer@microsoft / http://aka.ms/chgeuer
whiteboardclown
cloud architect
codemonkey
that’s me
Device Support for IoT
Cloud Services for IoT
.NET MF and Gadgeteer
TI Sensor Tag Intel Gallileo
Service Bus
ISS
Compute
Storage
ML
microsoft azure
azure globally
dublin, ireland53°19'28.7"N 6°27'17.2"W
a.k.a. azure region „Europe North“
how the satellite sees it
how a helicopter sees it
how a cab driver sees it
ping power pipe
(many) containers
what‘s in it
how I see it
azure compute
cloud computing – workload patterns
tCom
pute
Inactivity
Period
t
t
t
On and OffOn & off workloads (e.g. batch job)Over provisioned capacity is wasted Time to market can be cumbersome
Unpredictable BurstingUnexpected/unplanned peak in demand Sudden spike impacts performance Can’t over provision for extreme cases
Com
pute
Growing FastSuccessful services needs to grow/scale Keeping up w/ growth is big IT challenge Cannot provision hardware fast enough
Com
pute
Predictable BurstingServices with micro seasonality trends Peaks due to periodic increased demandIT complexity and wasted capacity
Com
pute
cloud computing
consume
Software-as-a-ServiceSaaS
build
Platform-as-a-ServicePaaS
host
Infrastructure-as-a-Service
IaaS
web sitescloud servicesvirtual
machines
cloud computing
Packaged Software
Storage
Servers
Networking
O/S
Middleware
Virtualization
Data
Applications
Runtime
You m
anag
e
Infrastructure
(as a Service)
Storage
Servers
Networking
O/S
Middleware
Virtualization
Data
Applications
Runtime
Man
ag
ed b
y v
en
dor
You m
anag
e
Platform(as a Service)
Man
ag
ed b
y v
en
dor
You m
anag
e
Storage
Servers
Networking
O/S
Middleware
Virtualization
Applications
Runtime
Data
Software(as a Service)
Man
ag
ed b
y v
en
dor
Storage
Servers
Networking
O/S
Middleware
Virtualization
Applications
Runtime
Data
some selected platform services
some selected platform services …
SQLAzure RDBMS as a Service
HDInsight Hadoop Cluster as a Service
APIManagement
API Proxy for Security, etc.AzureCache Redis Cache as a Service
MachineLearning Machine Learning as a Svc
TrafficManager DNS Loadbalancer
Document DB Managed NoSQL Doc DB{
}Azure Search Managed Search Service
enterprise-grade partner services avail though the portal
service bus
Smart Grid System
large scale eventing / command-control
“Last Mile”
Devices numbers at “utility” scale
Send targeted notifications
Large scale notifications and
broadcast
Smart Grid System
Smart Grid System
Push vs. Pull
‘Push’ is a sender initiated activity that results in delivery of a message to a receiver without the receiver explicitly asking for one or a particular message
Intermediary
Broker
‘Pull’ is a receiver initiated activity that delivers stored messages to the receiver in a context that the receiver controls. The context is decoupled from the ‘Push’ style send operation
Queues
Load LevelingReceiver receives and processes at its own pace. Can never be overloaded. Can add receivers as queue length grows, reduce receiver if queue length is low or zero. Gracefully handles traffic spikes by never stressing out the backend.
Offline/BatchAllows taking the receiver offline for servicing or other reasons. Requests are buffered up until the receiver is available again.
Queue
Queues
Load BalancingMultiple receivers compete for messages on the same queue (or subscription). Provides automatic load balancing of work to receivers volunteering for jobs.Observing the queue length allows to determine whether more receivers are required.
Queue
Topics
TopicSubSubSub
Message DistributionEach receiver gets its own copy of each message. Subscriptions are independent. Allows for many independent ‘taps’ into a message stream. Subscriber can filter down by interest.
Constrained Message Distribution (Partitioning)Receiver get mutually exclusive slices of the message stream by creating appropriate filter expressions.
service bus
• Pub/Sub Message Broker• Queues, Topics & Subscriptions, Notification Hubs, Relay• Connect devices via open protocols
• AMQP • http• (MQTT)
• Pull vs. Push • Security• Battery Life (device determines chattiness)
• Scale• Deploy additional scale units (stamps) per million devices
machine learning
26
Azure Machine Learning — from data to results
Azure Portal
Azure Ops Team
ML Studio
Data Scientist
HDInsight
Azure Storage
Desktop Data
Azure Portal & ML API service
Azure Ops Team
ML API service Developer
ML Studio
• Access and prepare data• Create, test and train
models• Collaborate • One click to stage for
production via the API service
Azure Portal & ML API service
• Create ML Studio workspace
• Assign storage account(s)• Monitor ML consumption• See alerts when model is
ready• Deploy models to web
service
ML API service and the Developer
• Tested models available as an url that can be called from any end point
Intelligent Systems Service
Inaccessible data
Limited flexibility
Incompatible with infrastructure Unreliable service
Slow implementationUnsecure data and assets
Connect ExtendConfigur
e AdministerHarness
The IoT ecosystem has been fragmented
Secure?
IncreasedAgility
Accessible data
Flexible and extensible solution
Finished service provided by
An integrated solution
Intelligent Systems Service
Connect ExtendConfigure AdministerHarness
Partner built
TrustedPlatform
Accelerated Time-to-value
Compatible with existing infrastructure
Faster implementation Protect data and assets
Reliable service
Protect
Accelerate implementation and time-to-value
Connect directly to ISS or though a local gateway (for constrained devices)
Enable broad connectivity options
OSS Agent (C-library) for arbitrary systems
Connect across a range of endpoints
Intelligent Systems Service SDK for Windows
Connect quickly
Existing apps through OData
Integrate existing devices and infrastructure
Connect
Agent
Agent
Agent
Agent
Agent
Gateway
Optimize performance and reliability
preferences adding or decommissioning deviceschanging alarm actions and severity levelsadding new rules changing connectivity and storage options
Reduce costs with a finished SaaS solution that does not require development time and building infrastructure
Use built-in metadata that works with multiple data schema to drive intelligent actions and insights such as command and control
Configure alarms and response options; ISS provides a number of alarms that can be configured and customized to support a number of response options
Drive intelligent actions Adjust as needs change
Deploy out-of-the-box cloud services Automate alarms and response options
Configure
Produce data-driven business insights
Apply configurable and customizable business rules to enable alarming and eventing based on ingressed data and through a complex event processing engine
Capture machine-generated, user-generated and transaction data using a variety of protocols: MQTT, AMQP, HTTPS and plug-in protocols
Enable data ingress to Azure Tables, SQL Azure and on-premises SQL, and access Intelligent Systems Service BLOB data seamlessly with your HDInsight account
Use common tools such as Excel and HDInsight for deep analytics, and enable data egress through OData interfaces to other analytics tools both cloud-based and on-premises
Simplify analysis with rationalized data Apply business rules
Capture a variety of data Use familiar analytics tools
Harness
101011101010101010101001010101010101011010101010101110101001010011010101010101011010101010100101010110101010101001101010111010
1010101
Achieve new levels of control
Support configuration of connected devices so specific actions are taken on device groups rather than on an individual basis, reducing manual intervention
Use the Intelligent Systems Service Operator Portal to remotely manage devices, including monitoring, maintenance, data transfer and deployment of software
Securely log in from remote devices and products to retrieve data, control devices, and diagnose and resolve issues
Group endpoints for simplified management
Operate from a central dashboard Manage remotely
Administer
Leverage the command and control dashboard to support multiple management activities such as distributing packages, sending commands and setting timed transmissions
Distribute packages and commands
Innovate and grow on a flexible platform
Work with familiar SI, ISV and OEM partners that have deep industry expertise to create rich, customized experiences and vertical solutions
Connect your on-premises environment with solution services running in the Azure public cloud
Incorporate new devices, apps, data and infrastructure into your existing setup with the Intelligent Systems Service SDK or the public SDK
Address variable demands with scalable and efficient data collection and storage in the Azure cloud through support of Azure Tables and Azure BLOB
Capitalize on cloud capabilities Innovate with third-party solutions
Integrate existing systems Scale as needed
+
Extend
Secure your data with automatic geo-replication of data across datacenters that are geographically separate
Simplify security relationships by using secure protocols like HTTPS and AMQP
Enable data ingress and egress to and from the cloud via secure protocols with the Azure Service Bus
Federate granular permissions to ensure the right people get the right access, and manage permissions with a consistent approach across datacenters and the cloud
Transport data through secure channels Access full data recovery features
Unify protection system-wide Configure granular permissions
Feel confident your data is protected
Protect
01011100
Thank you / [email protected]
Build with PaaS Use as SaaS
Q & A