Rana el Kaliouby - Emotion AI Developer Day 2016

@affectiva

Humanizing Technology with Emotion AI

Rana el Kaliouby, PhDCo-founder and CEOAffectiva@kaliouby

Emotions influence every aspect of our lives

@affectiva @kaliouby

From our health and wellbeing @affectiva @kaliouby

What we purchase @affectiva @kaliouby

How we learn @affectiva @kaliouby

To the decisions we make @affectiva @kaliouby

And how we connect with each other @affectiva @kaliouby

We are surrounded by hyper-intelligent technologies


With massive cognitive and autonomous abilities


All these systems have high “I.Q”But no EQ (Emotional Intelligence)


Yet our interactions with technology are rapidly becoming…

more conversational

more relational


What if technology could identify emotions as humans can?


What if computers could tell the difference between…

a smirk? a smile

What if our cars knew if we were getting angry

and could make our brakes more responsive? @affectiva @kaliouby

What if doctors could objectively measure how you are feeling

the way they measure our other vital signs?

What if live broadcasters could identify an audience’s emotion in real time

And adapt their stream accordingly? @affectiva @kaliouby

What if social robots, could actually be “social” ?

Your smart refrigerator could identify how you felt and suggest a food that matched your emotion.

What if every device in the internet of things had an emotion chip and could make personalized suggestions based on your mood?


Our vision is to humanize technology with Emotion Intelligence


By enabling machines to be emotion-awareAnd by allowing businesses to get emotion analytics


Affectiva measures facial expressions of emotion

Demo App AffdexMe

available in:


Applications of Emotion AI cut across every aspect of our daily lives .. Ultimately Emotion AI will become ubiquitous

Media and entertainment

Advertising Human resources Automotive Robotics

Healthcare and quantified self

Video communication Online education Devices Gaming


1/3 of Fortune Global 100


Emotions are memory markers, they influence brand awareness and drive purchase decisions. Major brands use Affectiva to quantify consumer emotion engagement with their content and brands

A movie studio uses emotion analytics to determine viewers showed surprise during trailer

And adjust it to make it more suspenseful

A game developer could identify the

key emotional points in a game

And create monetization triggers around those events

Little Dragon is the first mobile app responsive to the emotional state of each learner, for a happy, personalized, and effective learning experience.

Little DragonLearning App


TEACHING

FEEDBACKATTUNEMENT

World’s First Augmented Reality Smart-Glass-System empowers children and adults with autism to teach themselves crucial social and cognitive skills using Affectiva emotion recognition tech.

Helping individuals on the autism spectrum


Giphy - one of the world’s largest image search engines

uses our SDK to label and classify GIFs

TrueCar L.E.D.(Light Emotion Data)

Unique sensory concert experience

Captures real time, crowd-sourced emotive information

Displays data with a dazzling, interactive LED light show to transform the traditional concert experience

@affectiva

Tega learning companion for kids

Mabu is a social robot for terminally ill patients

Jibo

Xprize

incorporated our SDK as a cornerstone of their $5M Articificial Intelligence prize

So how do we make Emotion AIubiquitous?

@affectiva

By giving developers easy access to our technology so they can emotion-enable their own apps & digital experiencesSoftware Development KitEmbed real time emotion sensing and analytics in your own productsAvailable for:

Android Linux iOS Web/JavaScript macOS Unity Windows

Get SDK at: developer.affectiva.com

Free for most organizations under $1M in annual revenue @affectiva @kaliouby

1

Nuanced facial expressions

@affectiva

Lip Suck Lip Pucker Lip Press

Smile Lip Corner Depressor Nose Wrinkle Chin Raise Mouth Open

Attention Brow Furrow Brow Raise Inner Brow Raise Eye Closure

Smirk Upper Lip Raise

A range of emotions

Valence: how positive or negative a person’s facial expressions

Engagement: overall level and intensity of the emotion

@affectiva

A person’s appearance

Gender:identifies the human perceptionof gender expression

Ethnicity: Person’s ethnicity

Disgust

@affectiva

Age:Estimate age bucket (10 yrs)

Glasses: presence of eye or sun glasses

And emojis

Laughing Smiley Relaxed Wink

Kissing Stuck Out Tongue Stuck Out Tongue and Winking Eye Scream

Flushed Smirk Disappointed Rage

@affectiva

By building a strong Emotion AI community, sharing technical information and how developers are using Emotion AIComing in Q1 2017

• New developer portal at: developer.affectiva.com• Technical How-To Content, newsletter and blogs• Knowledgebase• Developer Hero Profiles showcasing what developers are working

on• Affectiva hackathon: EmotionLab ‘17


2

Developer portal – Visits!

By providing the best emotion recognition technology ever!Recently announced: SDK 3.1

• Tracking 6 new facial expressions for total of 20• Estimate age range and identify ethnicity• Added Unity support for Android and iOS• Added Web Platform / JavaScript Language support• Free for most organizations under $1M in annual revenue


3

By providing the best emotion recognition technology ever!


3

Coming soon:

• Simpify app integration for Linux and Windows App Developers• Improved Face detector and tracker• Updates to Emotion Models• Add support for Raspberry PI• Emotion event tracking API

Emotion AI Framework – Overview Building a framework to:• Discover and learn complex patterns of human emotion. • Scale up our data exploration efforts as we approach the diverse set of partners and use

cases where we believe we can drive value.• Training expression and emotion classifiers from diversified data sources • Help partners gain value from their emotion data through

o Emotion analytics and visualizationso Predictors

Retail kiosk recommendations based on your reaction

Smartphones that react to your mood

Cars that sense emotion and engage people in it

Games that adapt to players in real

time

Social robots with empathy

Remote healthcare monitors emotional state

Better Education outcomes with adaptive learning

systems

Together we will build a future where technology is enriched with emotion

Tell us: what will you build?


#emodev16#EmotionAI

Get started todaydeveloper.affectiva.com