Enhancing Your Cloud Applications with Artificial Intelligence

- Elliot Turner

CEO & Founder, AlchemyAPI

Enhancing your Cloud Applications with Artificial Intelligence

A.I.? What exactly are we talking about?

Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014

HAL? Killer Robots? IBM Watson?

A.I. = Smarter Applications (not Killer Robots)


A.I.: Increasingly Embedded Everywhere


Monitoring your credit card transac2ons for fraud… Recommending products on Amazon.com... Understanding your voice in Google Now... Analyzing your tax returns… Reading your handwri2ng on personal checks… Correc2ng spelling mistakes in your TPS report…

Using A.I. Cloud APIs - No PhD Required


Speech Recognition Machine Translation

Computer Vision Natural Language Processing

Question Answering Machine Learning

Building an A.I.-enabled Sample Application


"Est-ce que toxique?" "Is this poisonous?"

Example app: "Voice + visual assistant for hikers in any country"

Intended use case: Answer verbal and visual questions about plants and animals encountered on a hike


Cloud APIs provide speech recognition capability to any network-enabled device, across 19+ different

spoken languages.

What you can do: respond to spoken commands, transcribe audio and video files, search audio

streams for specific key phrases ...

Moving beyond the keyboard: Speech Recognition

Integrating Speech Recognition into your App


●  APIs support uploading audio files or streaming audio data in real-time ●  Providers include Nuance and AT&T:

○  https://developer.att.com/apis/speech ○  http://dragonmobile.nuancemobiledeveloper.com/public/index.php

Speech recognition 1-liner: curl --data-binary @speech.wav -H "Content-Type: audio/wav" -H "Authorization: $AUTH_TOKEN" -H "Accept: application/xml" http://api.att.com/speech/v3/speechToText Hint: use X-SpeechContext to set different transcription modes (web search, local search, dictation)

Integrating Speech Recognition into your App


curl --data-binary @speech.wav -H "Content-Type: audio/wav" -H "Authorization: $AUTH_TOKEN" -H "Accept: application/xml" http://api.att.com/speech/v3/speechToText

{ "Recognition": { "Status": "Ok", "ResponseId": "3125ae74122628f44d265c231f8fc926", "NBest": [ { "Hypothesis": "this is some transcribed speech", "LanguageId": "en-us", "Confidence": 0.9, "Grade": "accept", "ResultText": "This is some transcribed speech",

Moving beyond the keyboard: Computer Vision


Cloud APIs provide the ability to recognize objects (buildings, cars, ...), logos, and faces contained

within photographs.

What you can do: drive search in your application with camera-phone images, automatically organize

photo libraries, "visually" index video files, filter inappropriate content ...

Integrating Computer Vision into your App


●  APIs automatically tag photos with what they contain ●  Providers include Moodstocks, AlchemyAPI, and Koaaba:

○  https://moodstocks.com/ (logos & barcodes) ○  http://alchemyapi.com/ (3d objects: cats, dogs, buildings, …) ○  http://www.koaaba.com/ (logos + wine bottles)

Computer Vision 1-liner: curl --data-binary @photo.jpg ”http://access.alchemyapi.com/image/ ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_KEY

Integrating Computer Vision into your App


curl --data-binary @photo.jpg "http://access.alchemyapi.com/calls/image/ ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_KEY

"imageKeywords": [ { "text": "boxing", "score": "0.970688" }, { "text": "sport", "score": "0.930862" }, { "text": "person", "score": "0.710949" },


Cloud APIs provide automatic translation of text across dozens of different languages.

What you can do: automatically translate foreign-language content for your users, real-time

translation of forum posts or chat sessions, search within foreign language documents ...

Breaking down language barriers: Machine Translation

Integrating Machine Translation into your App


●  APIs automatically translate between dozens of languages. ●  Providers include Google and Microsoft:

○  https://developers.google.com/translate/ ○  http://datamarket.azure.com/dataset/bing/microsofttranslator

Language Translation 1-liner:

curl "https://www.googleapis.com/language/translate/v2?key=$INSERT-YOUR-KEY&source=en&target=de&q=Hello

%20world"

Integrating Machine Translation into your App


"translations": [ { "translatedText": "¿Dónde está mi hotel?" } ]

"Where is my hotel?"

curl "https://www.googleapis.com/language/translate/v2?key=$INSERT-YOUR-KEY&source=en&target=es&q=Where+is+my

+hotel?"


Cloud APIs provide the ability for computers to derive "meaning" from text (documents, web pages,

tweets, …)

What you can do: tag documents by topic, drive content recommendation engines, contextually

target advertisements ...

Reading like a Human: Natural Language Processing

Integrating Natural Language Processing into your App


●  APIs automatically tag documents, extract facts and events, ... ●  Providers include AlchemyAPI and OpenAmplify:

○  http://www.alchemyapi.com/ ○  http://www.openamplify.com/

Named entity tagging + sentiment analysis 1-liner: curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=I+am+coming+to+Denver!"


"language": "english", "entities": [ { "type": "City", "relevance": "0.33", "sentiment": { "type": "positive", "score": "0.325672" }, "count": "1", "text": "Denver", "disambiguated": { "name": "Denver", "website": "http://www.denvergov.org", "dbpedia": "http://dbpedia.org/resource/Denver", "freebase": "http://rdf.freebase.com/ns/m.02cl1"

"I am coming to Denver!"

Integrating Natural Language Processing into your App

curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=I+am+coming+to+Denver!"

Expert in a box: Question Answering


Cloud APIs provide the ability to answer natural language questions, such as "Who invented the

Segway?"

What you can do: leverage questions like "was this company acquired?" to trigger processes in data pipelines or GUI displays, automatically answer

questions from your own corpus of data ...

Integrating Question Answering into your App


●  APIs automatically answer questions posed in plain English ●  Providers include IBM Watson and Wolfram Alpha:

○  https://www.ibmdw.net/watson/docs/ (QA from text) ○  http://products.wolframalpha.com/api/ (QA from data)

IBM Watson Example API Call JSON: { "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." } }

Integrating Question Answering into your App


"answers": [ { "id": 0, "text": "Michael Jackson", "confidence": 0.42276 },

{ "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." } }

Automated reasoning: Machine Learning


Cloud APIs provide the ability to automate many types of tasks such as labeling data or predicting

things.

What you can do: predict a prospect's likelihood of conversion based on historical data, identify fraud and other anomalous activities, analyze customer

churn ...

Integrating Machine Learning into your App


●  APIs enable black-box training of prediction models based on submitted training data

●  Providers include Google Prediction API and BigML:

○  https://developers.google.com/prediction/ (API only) ○  https://bigml.com/ (API + Web GUI)

Integrating Machine Learning into your App


Step 1: Collect some data

Step 2: Train a model

Step 3: Make some predictions

Putting it all together: Sample A.I. App Workflow


Use AT&T Speech API to accept speech input

Use Google Translate to convert from French to English

"Est-ce que toxique?"

"Is this poisonous?"

Take a picture of the item the question is about

Use AlchemyAPI to interpret the photograph "fly agaric"

Use IBM Watson to answer the question Is this poisonous + fly agaric

Example app: "Voice + visual assistant for french hikers"

Thanks for listening! Questions ?


Elliot Turner CEO & Founder, AlchemyAPI

[email protected] Twitter: eturner303

Technology

Enhancing Your Cloud Applications with Artificial Intelligence