62

Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 2: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Click to see the opening montage.

Page 3: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

1946: ENIAC heralds the dawn of Computing

Page 4: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

I propose to consider the question:

“Can machines think?”

--Alan Turing, 1950

1950: Turing asks the question….

Page 5: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

1956: A new field is born

We propose that a 2 month, 10

man study of artificial

intelligence be carried out

during the summer of 1956 at

Dartmouth College in Hanover,

New Hampshire.

- Dartmouth AI Project

Proposal; J. McCarthy et al.;

Aug. 31, 1955.

Page 6: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

1996: EQP proves that

Robbin’s Algebras are all boolean

[An Argonne lab program] has come up with a major mathematical

proof that would have been called creative if a human had thought of it.

-New York Times, December, 1996

----- EQP 0.9, June 1996 -----

The job began on eyas09.mcs.anl.gov, Wed Oct 2 12:25:37 1996

UNIT CONFLICT from 17666 and 2 at 678232.20 seconds.

---------------- PROOF ----------------

2 (wt=7) [] -(n(x + y) = n(x)).

3 (wt=13) [] n(n(n(x) + y) + n(x + y)) = y.

5 (wt=18) [para(3,3)] n(n(n(x + y) + n(x) + y) + y) = n(x + y).

6 (wt=19) [para(3,3)] n(n(n(n(x) + y) + x + y) + y) = n(n(x) + y).

…….

17666 (wt=33) [para(24,16426),demod([17547])] n(n(n(x) + x) ….

Page 7: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

1997: HAL 9000 becomes operational

in fictional Urbana, Illinois

…by now, every intelligent person knew that

H-A-L is derived from Heuristic ALgorithmic

-Dr. Chandra, 2010: Odyssey Two

Page 8: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

1997: Deep Blue ends Human

Supremacy in Chess

I could feel human-level intelligence across the room

-Gary Kasparov, World Chess Champion (human)

vs.

In a few years, even a single victory

in a long series of games would be the triumph of human genius.

Page 9: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

For two days in May, 1999, an AI Program called Remote Agent

autonomously ran Deep Space 1 (some 60,000,000 miles from earth)

Real-time Execution

Adaptive Control

HardwareS

cripted

Ex

ecutiv

e

Generative

Planner &

Scheduler

Generative

Mode Identification

& Recovery

Scripts

Mission-levelactions &resources

component models

ESL

Monitors

GoalsGoals

1999: Remote Agent takes

Deep Space 1 on a galactic ride

Page 10: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2002: Computers start passing

Advanced Placement Tests

… a project funded by

(Microsoft Co-founder) Paul

Allen attempts to design a

“Digital Aristotle”.

Its first results involve

programs that can pass High

School Advanced Placement

Exam in Chemistry…

Page 11: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2005: Cars Drive Themselves

Stanley and three other cars drive themselves over a 132 mile mountain road

Page 12: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2005: Robots play soccer

(without headbutting!)

2005 Robot Soccer:

Humanoid league

Page 13: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2006: AI Celebrates its Golden Jubilee…

1956: A new field is born

We propose that a 2 month, 10

man study of artificial

intelligence be carried out

during the summer of 1956 at

Dartmouth College in Hanover,

New Hampshire.

- Dartmouth AI Project

Proposal; J. McCarthy et al.;

Aug. 31, 1955.

Page 14: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2007: Robots Drive on Urban Roads

11 cars drove themselves on urban streets (for DARPA Urban Challenge)

Page 15: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2010: Watson defeats Puny Humans in

Jeopardy!

And Ken Jennings pledges obeisance to the new Computer Overlords..

Page 16: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

2014: Robots (instead of them foreigners)

Threaten to Take all your jobs

Winding Our Way

Down To Wall-E:

Adventures in

Artificial Intelligence

Page 17: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Agenda

• What is AI

• AI’s Successes and Expectations

• What is involved in doing AI

• Some ongoing projects in my lab

• Your questions?

Page 19: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 20: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

What if we are writing intelligent

agents that interact with humans?

The COG project

The Robotic care givers

Mechanical flight

became possible

only when people

decided to stop

emulating birds…

Page 21: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Open only for Humans; Droids and Robots should go for CSE 462 next door ;-)

Page 22: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Do we want a machine that beats humans in chess or a machine that thinks like humans

while beating humans in chess?

DeepBlue supposedly DOESN’T think like humans..

(But what if the machine is trying to “tutor” humans about how to do things?)

(Bi-directional flow between thinking humanly and thinking rationally)

Page 23: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 24: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 25: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 26: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Default Position Useful for teaming with humans

Useful for tutoring systems

(a form of teaming)

Page 27: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Agenda

• What is AI

• AI’s Successes and Expectations

• What is involved in doing AI

• Some ongoing projects in my lab

• Your questions?

Page 28: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 29: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

What AI can do is as important as

what it can’t yet do..

• Captcha project

Page 30: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Agenda

• What is AI

• AI’s Successes and Expectations

• What is involved in doing AI

• Some ongoing projects in my lab

• Your questions?

Page 31: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

What Makes Agent Design Hard?

Page 32: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

A: A Unified Brand-name-Free Introduction to Planning Subbarao Kambhampati

Environment

What action next?

Page 33: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

A: A Unified Brand-name-Free Introduction to Planning Subbarao Kambhampati

Environment

Goals

(Static vs. Dynamic)

(Observable vs. Partially Observable)

(perfect vs. Imperfect)

(Deterministic vs. Stochastic)

What action next?

(Instantaneous vs. Durative)

(Full vs. Partial satisfaction)

Page 34: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Architectures for Intelligent Agents

Wherein we discuss why do we need representation, reasoning and learning

Page 35: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

(Model-based reflex agents)

How do we write agent programs for these?

Page 36: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

This one already assumes that the “sensorsfeatures” mapping has been done!

Page 37: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

EXPLICIT MODELS OF THE ENVIRONMENT

--Blackbox models

--Factored models

Logical models

Probabilistic models

(aka Model-based Reflex Agents)

Page 38: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

It is not always obvious what action to do now given a set of goals

You woke up in the morning. You want to attend a class. What should your action be?

Search (Find a path from the current state to goal state; execute the first op)

Planning (does the same for structured—non-blackbox state models)

State Estimation

Planning

Page 39: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Representation Mechanisms:

Logic (propositional; first order)

Probabilistic logic

Learning

the models

Search

Blind, Informed

Planning

Inference

Logical resolution

Bayesian inference

How the course topics stack up…

Page 40: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Learning

Dimensions:

What can be learned?

--Any of the boxes representing

the agent’s knowledge

--action description, effect probabilities,

causal relations in the world (and the

probabilities of causation), utility models

(sort of through credit assignment), sensor

data interpretation models

What feedback is available?

--Supervised, unsupervised,

“reinforcement” learning

--Credit assignment problem

What prior knowledge is available?

-- “Tabularasa” (agent’s head is a blank

slate) or pre-existing knowledge

Page 41: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Agenda

• What is AI

• AI’s Successes and Expectations

• What is involved in doing AI

• Some ongoing projects in my lab

• Your questions?

Page 42: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Planning for Human-Robot Teaming

Crowd-sourced planning

Event-analytics

Page 44: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Teach Me How To Work:

Natural Language Model Updates

Undergraduate

Student Summer

Project

Page 45: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Crowd-Sourced Planning

Yochan lab, Arizona State University

manhattan_gettingto

Page 46: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

62

AI-MIX: Crowd Sourced Planning

AI-MIX (Automated Improvement of Mixed Initiative eXperiences)

Commanders

Goal & event generation

A sub-system of RADAR

Page 47: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

63

AI-MIX: Crowd Sourced Planning

Force Structure (PDDL) • Reduces flexibility

Extract Structure • Plans from textual descriptions rather than actions

Interpretation

Steering (Model-lite)

Constraint Checking • Quantitative constraints

Constructive Critiques • Actively help creation and refinement of a plan:

suggesting new plan fragments, new ways of decomposing the current plan or set of goals

Winner of the "People's Choice Award" for the best demo at ICAPS 2014!

A sub-system of RADAR

Page 48: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Since the dawn of civilization, people congregated

in town squares to discuss events

The emergence of social media has now created a sprawling virtual town square,

whose scope is vast, and whose chatter can be captured!

opening exciting possibilities for analyzing what people are actually saying..

Page 49: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Which part of the event did a

tweet refer to?

What’s the relation between

event and tweets?

Page 50: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

ET-LDA [AAAI’12, ICWSM’12, MMW’12]

Specific

Specific

Specific

General

Specific

General

Specific

General

General

Page 51: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Event Tweets

Determine tweet type

C(t)~Bernoulli(λ)

Determine which

segment a tweet (word)

refers to

S(t) ~ Categorical(γ)

Determine word’s

topic in event

Zs~multinomial(θ)

Tweets word’s topic

Zt~multinomial(ψ) or

Zt~multinomial(θ)

Page 52: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

ET-LDA [AAAI’12, ICWSM’12, MMW’12]

Frequency of specific tweets

Event-tweets alignment

Evolution of specific tweets

Page 53: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Specific

Specific

Specific

General

Specific

General

Specific

General

General

SocSent [IJCAI’13]

Page 54: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

ET-LDA & SocSent for Event sensemaking

DeMA for Event recognition

Alice for Event engagement prediction

Eventics, automated toolbox to conduct

in-depth analysis of 3 core tasks in

event analytics

How people respond to events on Twitter

What factors affect crowd’s engagement in events

Our toolbox enables a richer

perspective about

Page 55: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Summary & Additional

Resources

• Talked about

– What AI is

– AI’s Successes and Expectations

– What is involved in doing AI

– Some ongoing projects in my lab

– Your questions?

Page 56: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Agenda

• What is AI

• AI’s Successes and Expectations

• What is involved in doing AI

• Some ongoing projects in my lab

• Your questions?

Page 57: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Questions Submitted

• What policy, if any, has been created surrounding this new and developing

technology? Is there any work being done to use AI to improve human

cognition and performance?

• What are ways of combating the existential risks that are put forth by the

development of AI?

• Do you believe that there will ever be functioning domestic humanoid robots

for retail for the general population? (Not just Roombas, bur actual human

looking and functioning bots, or would there too much of an ethical debate on

if it is human?)

• Could we give AI the feeling of curiosity, leading them to have desires for

physical things?

Page 58: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced
Page 59: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

• Yes!

– But this is not going to

be just a question of

hardware

– The robots need to

track the

beliefs/desires/intentio

ns of the humans

• ..and thus our work on

Human-Robot teaming..

Page 60: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

• Feeling of Curiosity—

– Yes

– Exploration/Exploitatio

n tradeoff in

Reinforcement

Learning

• Desires for physical

things..

– Hmm..

Page 61: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Questions Submitted

• What policy, if any, has been created surrounding this new and developing

technology? Is there any work being done to use AI to improve human

cognition and performance?

• What are ways of combating the existential risks that are put forth by the

development of AI?

• Do you believe that there will ever be functioning domestic humanoid robots

for retail for the general population? (Not just Roombas, bur actual human

looking and functioning bots, or would there too much of an ethical debate on

if it is human?)

• Could we give AI the feeling of curiosity, leading them to have desires for

physical things?

Page 62: Click to see the opening montage.rakaposhi.eas.asu.edu/barrett-talk.pdf · Crowd-sourced planning Event-analytics . Human-Robot Teaming 59 Search and report (rescue) ... Crowd Sourced

Summary & Additional

Resources

• Talked about

– What AI is

– AI’s Successes and Expectations

– What is involved in doing AI

– Some ongoing projects in my lab

– Your questions?