DEEP DIVE ON AZURE MLFOR DEVELOPERS

How many dogs can

you find in 4 seconds?

How many dogs can

you find in 4 seconds?

Who had 12?

DEEP DIVE ON AZURE MLFOR DEVELOPERS

THOMASMARTINSENCEO AND FOUNDING PARTNER

HAZELCLARKE SENIOR DATA SCIENTIST

BLUEFRAGMENTSTECHNOLOGY AND INNOVATION

Microsoft Cloud Gold Partner

Microsoft Application Gold Partner

Xamarin Premier Consulting Partner

● AI Services in Azure

● Azure Machine Learning

● Machine Learning Tools for Developers

DEEP DIVE ON AZURE ML

AI ADOPTION TODAY

BUSINESS VALUE IN AI

extent that it makes

sense and can be done.

It must be easy to get

information and the

information must be given

when and where it’s needed.

The machine must be a

support in daily work and help

make even more qualified

decisions.

AI ML

NN

AI SERVICES IN AZURE

Pre-built AI servicesAzure Cognitive Services

AI SERVICES IN AZURE

Conversational AIAzure Bot Service

Custom AIAzure Machine Learning

Pre-built AI servicesAzure Cognitive Services

AI SERVICES IN AZURE

Conversational AIAzure Bot Service

Custom AIAzure Machine Learning

COGNITIVE SERVICES

Vision SpeechLanguage KnowledgeSearch

Computer Vision

Content Moderator

Emotion

Face

Video Indexer

LUIS

Spell Check

Linguistic Analysis

Text Analytics

Translator

Web Language Model

Speech

Speaker Recognition

Translator

Custom

Academic

Entity Linking

Exploration

QnA Maker

Recommendations

Autosuggest

Image

News

Video

Web

Entity

Custom

Vision Service

Custom

Language Understanding

Custom

Speech

Custom

Search

Custom

Decision Service

COMPUTER VISION APIS

Description [“Tags”:["water", "swimming", "sport", "pool", "person", "man”]

"Captions": [ { "Text": "a man swimming in a pool of water", "Confidence": 0.8909298}]]

Categories [“name”: “people_swimming”, “score”: 0.099609375]

Adult Content False

Adult Score 0.18533889949321747

Faces [“age”: 27, “gender”: “Male”, “faceRectangle”: {“left”: 472, “top”: 258, “width”: 199, “height”: 199}]

Color Foreground White

Color Background Gray

Color Accent #19A4B2

FACE API

• Face Detection

Detect one or more human

faces in an image

• Face identification

Search and identify faces.

• Similar face search

Easily find similar-looking faces.

• Face grouping

Organise many unidentified

faces together into groups,

based on their visual similarity.

{

"FaceId":"9099224a-bd77-42b5-b1d2-2641560c0528",

"FaceRectangle":{

"Top":124,

"Left":459,

"Width":227,

"Height":227

},

"FaceAttributes":{

"Hair":{

"Bald":0.01,

"Invisible":false,

"HairColor":[

{

"Color":"brown",

"Confidence":1.0

},

{

"Color":"blond",

"Confidence":0.69

},

{

}

EMOTION API

• Recognise emotions in

images

The Emotion API takes a facial

expression in an image as an

input, and returns the

confidence across a set of

emotions for each face in the

image, as well as bounding box

for the face, using the Face

API.

{

"FaceRectangle":{

"Top":141,

"Left":356,

"Width":123,

"Height":123

},

"Scores":{

"Anger":2.45541414E-05,

"Contempt":0.000249862962,

"Disgust":4.51454434E-05,

"Fear":0.001153976,

"Happiness":5.58101638E-05,

"Neutral":0.004939176,

"Sadness":1.091316E-05,

"Surprise":0.993520558

}

},

{

"FaceRectangle":{

"Top":157,

"Left":216,

"Width":87,

"Height":87

COGNITIVE SERVICESDEMO

Pre-built AI servicesAzure Cognitive Services

AI SERVICES IN AZURE

Conversational AIAzure Bot Service

Custom AIAzure Machine Learning

DIGITAL ASSISTANTS

● My bicycle is stolen

● My bike is stolen

● Somebody took my tandem

● My bike got nicked

● My wheels are gone

● F**#!, they took me iron horse

● During the act of drinking a nice beer a rascal took advantage of me

enjoying that particular beer and relieved me of my dear bicycle, god

bless his soul

“MY BICYCLE IS STOLEN”

BOT SERVICEDEMO

Pre-built AI servicesAzure Cognitive Services

AI SERVICES IN AZURE

Conversational AIAzure Bot Service

Custom AIAzure Machine Learning

AZURE MACHINE LEARNING

● Machine Learning – NLP/Deep learning

● Speech recognition

● Optimisation

● Robotics

ARTIFICIAL INTELLIGENCE

● Supervised

● Unsupervised

● Reinforcement learning

MACHINE LEARNING

● Prepare Data

● Build & Train

● Deploy

MACHINE LEARNING

TOOLS FOR DEVELOPERS

● Drag and drop modules

● Add Python and R codes

● Easy web service deployment

● Opens the world of ML to anyone with internet

● Slower performance

● Limited modules

AZURE ML STUDIO

AZURE ML STUDIODEMO

● Improved data preparation capacity

● Github link to keep earlier code versions

● An excellent transition from Studio

● Still in the early stages

AZURE ML WORKBENCH

AZURE ML WORKBENCHDEMO

“Visual Studio Tools for AI is an extension that supports deep

learning frameworks including Microsoft Cognitive Toolkit (CNTK),

Google TensorFlow, Theano, Keras, Caffe2 and more. You can use

additional deep learning frameworks via the open architecture.

Visual Studio Tools for AI leverages existing code support for

Python, C/C++/C#, and supplies additional support for Cognitive

Toolkit BrainScript.”

https://www.visualstudio.com/downloads/ai-tools-vs/

VS TOOLS FOR AI

VS TOOLS FOR AIDEMO

● Building more intelligent applications

● Train and implement pre-built AI components

● Work with Data Scientists on custom AI models

DEVELOPERS

● AI Services in Azure

● Azure Machine Learning

● Machine Learning Tools for Developers

DEEP DIVE ON AZURE ML

THANK YOUHELLO@BLUEFRAGMENTS.COM