Artificial Intelligence at Work - Assist Workshop 2016 - Nick Triantos - SRI

POWER THROUGH SIMPLICITY:THE TRANSFORMATION OF COMPUTING THROUGH ARTIFICIAL

INTELLIGENCE

Nick Triantos, Managing Director, SRI Ventures

About SRI

Wearable Robotics

The InternetComputer Mouse

Cybersecurity

Siri

Autonomous Robotics Space & Comms

Diagnostic Ultrasound

ARTIFICIAL INTELLIGENCEIN THE WORKPLACE

"AI Is About To Go Mainstream And Reshape The Workplace", TechCrunch, Sept 2015

AI-POWEREDBUSINESS APPS

AI USE IN THEENTERPRISE

"2015 State of Artificial Intelligence & Big Data in the Enterprise", NarrativeScience

Machine Learning

VPA

Decision Support

Reporting

Analytics

Robotics

All of the Above

0% 6% 12% 18% 24%

WHAT MACHINE LEARNING CAN DO

Image Credit: Scikit-learn

Categorization

"What is this thing?"

Supervised Categorization"Which known thing is this?"

Unsupervised categorization"Which things are similar?"

Data Analysis

Regression"Predict a numeric result"

Dimensionality Reduction"What's important here?"

SPEECH RECOGNITION

APPROACHING "GOOD ENOUGH"

"KPCB INTERNET TRENDS 2016 ", Mary Meeker, Kleiner Perkins, p. 117

SPEECH RECOGNITION TODAY

"KPCB INTERNET TRENDS 2016 ", Mary Meeker, Kleiner Perkins, p. 119

USER INTERFACE IS STILL USEFUL

VOICE: MIXED BLESSING

The Good

• Access any part of user interface instantly

• Easy and convenient

• Adaptable & Personalized

The Less Good

• Can fail with connectivity loss

• Some security challenges

• Harder to create expressive user interface

OVERVIEW OF CURRENTVIRTUAL ASSISTANTS

GOOGLE ASSISTANT

• Google Home & Google Allo

• Context-aware responses

• Leverages the other data Google knows about you

• Only available through Google apps so far "This is not a thing that's going to figure itself out in 2016. It's going to be a long journey."– Mario Queiroz, VP Product, Google

AMAZON ECHO

• Fun cloud-based platform

• Excellent hardware for far-field voice recognition

• Excellent ASR and getting even better

• Extensible, and now appearing in non-Amazon products

• Very limited capability to have a conversation

• Requires connectivity

APPLE SIRI

• Siri coming to MacOS

• Limited conversational context

• Opening Siri to developers (at last)

FACEBOOK "M"

• 100% human-powered today

• Goal to be 100% machine-driven in 5 years

• Access to huge database of your interests and those of your friends

• Heavy overlap with core ad serving technologies

CHALLENGES OF BEING TOOGENERAL PURPOSE

– The Simpsons, 1994

DEEP KNOWLEDGE&

THE RISE OF VIRTUAL SPECIALISTS

SRI VIRTUAL ASSISTANT ("VPA")

• Deeply conversational

• Well-suited as "Virtual Specialist"

• Custom speech recognition models

• Highly customizable ontologies

• Embedded in numerous platforms

• Can work without the cloud

MORE NATURAL COMMUNICATION

FLOW

Transfer €200 to checking.

From which account?

How does my savings look?

Your savings balance is €2.200.

Should I continue the transfer?

Will there be any fees?

No, your savings account has unlimited free transfers

OK, go ahead and transfer the money.

Your €200 transfer from savings to checking is complete.

DOMAIN SPECIFIC KNOWLEDGE

Transfer

From To

Account

Savings Checking

Restrictions

Restrictions

Balance

Warnings

! Fee warning

Balance warning!

SPECIALIZED VIRTUAL ASSISTANTS

PERSONALIZING THE EXPERIENCE

SOCIAL INFLUENCES

• Opaque adaptable recommendations

• Leverage huge pool of data in social networks

• Likely to dramatically improve over time

• Allow for high-value advertising if done well

EMOTION DETECTION

Virtual Assistant Platform

PERSONALIZATION HUB

Present a better experience, personalized to the user, based on:

• Who the user is

• What the user usually likes

• What state the user is in

• Where and when the interaction with the user occurs

Context aware

Emotion detection

Preferencelearning

Biometric ID

Application

Understanding Humans

PERSONALIZING THE EXPERIENCE

YouTube: Meskel Square, Addis Abeba, Ethopiahttps://www.youtube.com/watch?v=UEIn8GJIg0E

YouTube: Autonomous Intersection Management, UT Austinhttps://www.youtube.com/watch?v=4pbAI40dK0A

CLOSING THOUGHTS

• Cheap sensors + machine learning = feasible AI

• Early tools are rough, but rapidly improving

• Virtual specialists & AI will be able to augment and later replace some jobs

• Collect data now, learn from it quickly, or be passed by those who do

Nick Triantosnick.triantos@sri.com@triantos

Thank you