23
Azure Stream Analytics Deep Dive

Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

  • Upload
    others

  • View
    38

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Azure Stream Analytics

Deep Dive

Page 2: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

What is a Streaming Unit?

What are the key components of an ASA job?

What input and output types can I select in

ASA?

How can queries help me obtain the data I

need?

How do I use the ASA portal to explore a job

and select data inputs / outputs?

Learning ObjectivesAzure Stream Analytics: Deep Dive

Page 3: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

REAL-TIME STREAMING

DATA

DEVICES

SENSORS

WEBSITES

SOCIAL MEDIA

APPLICATIONS

INFRASTRUCTURE

SYSTEMS

Key ComponentsAzure Stream Analytics: Deep Dive

Page 4: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Key ComponentsAzure Stream Analytics: Deep Dive

3 Data Sources

2 Input Types

Similar to SQL Query Language

Output to Other AZURE Services

Page 5: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

STREAMING UNIT

Key ComponentsAzure Stream Analytics: Deep Dive

COMPUTATION POWER

CPU

MEMORY

READ AND WRITE RATES

END USER

MAX THROUGHPUT

Page 6: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

ASA Job Features

DEMO

Overview

Activity Log

Access Control (IAM)

Tags & Locks

Page 7: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Play Video

Page 8: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Job Topology

DEMO

Inputs

Functions

Query

Output

Page 9: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Play Video

Page 10: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

DEMO

Configure

General

Monitoring

Support +

Troubleshooting

Other ASA Job Features

Page 11: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Play Video

Page 12: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Input TypesAzure Stream Analytics: Deep Dive

DATA STREAM

REFERENCE

DATA

Page 13: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

BLOB STORAGEIOT HUBEVENT HUB

DATA STREAM

Page 14: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

SQL

Reference DataAzure Stream Analytics: Deep Dive

CSV

JSON

AVRO

Page 15: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Reference DataAzure Stream Analytics: Deep Dive

100Mb

Max

Big File: 150 Mb

75 Mb

75 Mb

Page 16: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

DEMO

Input Types

Input Alias

Source Type

Source > Data Stream

Source > Reference

Data

Page 17: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Play Video

Page 18: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Multiple jobs – Multiple inputs and outputs

Similar to T-SQL query language

Static Data

QueriesAzure Stream Analytics: Deep Dive

Page 19: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

QUERYINPUT OUTPUT

SQL DATABASE

BLOB

STORAGE

EVENT HUBS

OutputsAzure Stream Analytics: Deep Dive

TABLE STORAGE

SERVICE BUS

QUEUE

SERVICE BUS

TOPIC

DOCUMENTDB

POWER BI

AND DATA LAKE

STORE

Page 20: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

DEMO

Output Types

Power BI

SQL Database

Page 21: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Play Video

Page 22: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max

Streaming Units

Key Components of an ASA Job

Input Types > Data Streams / Reference Data

Queries > Language Similar to T-SQL

Output Types > SQL Database / Power BI, among others

Application in the ASA portal

Page 23: Azure Stream Analytics Deep Dive - tetranoodle.com€¦ · Reference Data Azure Stream Analytics: Deep Dive CSV JSON AVRO. Reference Data Azure Stream Analytics: Deep Dive 100Mb Max