S.C. Shapiro

cse@buff

alo

An Intelligent Interface to a GISStuart C. Shapiro

Professor, CSE

Director, SNePS Research Group

Member, Center for Cognitive Science

Faculty Member, Interdisciplinary MS

in Computational Linguistics

Faculty Participant, IGERT

S.C. Shapiro

cse@buff

alo

Introduction

S.C. Shapiro

cse@buff

alo

Long-Term Goal

• Theory and Implementation of

Natural-Language-Competent

Computerized Cognitive Agent/Robot

• and Supporting Research in

Artificial Intelligence

Cognitive Science

Computational Linguistics.

S.C. Shapiro

cse@buff

alo

Research Areas

• Knowledge Representation and Reasoning

• Cognitive Robotics

• Natural-Language Understanding

• Natural-Language Generation.

S.C. Shapiro

cse@buff

alo

Goal• A computational cognitive agent that can:

– Understand and communicate in English; – Discuss specific, generic, and “rule-like” information;– Reason;– Discuss acts and plans;– Sense;– Act;– Maintain a model of itself;– Remember and report what it has sensed and done.

S.C. Shapiro

cse@buff

alo

Cassie

• A computational cognitive agent– Embodied in hardware– or Software-Simulated– Based on SNePS and GLAIR.

S.C. Shapiro

cse@buff

alo

SNePS• Knowledge Representation and Reasoning

– Propositions as Terms

• SNIP: SNePS Inference Package– Specialized connectives and quantifiers

• SNeBR: SNePS Belief Revision

• SNeRE: SNePS Rational Engine

• Interface Languages– SNePSUL: Lisp-Like– SNePSLOG: Logic-Like– GATN for Fragments of English.

S.C. Shapiro

cse@buff

alo

GLAIR Architecture

Knowledge Level

Perceptuo-Motor Level

Sensory-Actuator Level NL

Vision

Sonar

MotionProprioception

Grounded Layered Architecture with Integrated Reasoning

SNePS

S.C. Shapiro

cse@buff

alo

Interaction with CassieEnglish

(Statement, Question, Command)

(Current) Set of Beliefs[SNePS]

(Updated) Setof Beliefs[SNePS]

Actions[SNeRE]

(New Belief)[SNePS]

English sentence expressingnew belief answering question reporting actions

Answer[SNIP]

GATN Parser

GATN Generator

ReasoningClarification DialogueLooking in World

Reasoning

S.C. Shapiro

cse@buff

alo

Example Cassies& Worlds

S.C. Shapiro

cse@buff

alo

BlocksWorld

S.C. Shapiro

cse@buff

alo

FEVAHR

S.C. Shapiro

cse@buff

alo

FEVAHRWorld Simulation

S.C. Shapiro

cse@buff

alo

UXO Remediation

CassieCorner flag

NonUXO object

Corner flag

UXO

Batterymeter

Corner flag

Drop-off zone

Field

Safe zone

RechargingStation

S.C. Shapiro

cse@buff

alo

Crystal Space Environment

S.C. Shapiro

cse@buff

alo

Princess from “The Trial, The Trail”A VR drama by Josephine Anstey

S.C. Shapiro

cse@buff

alo

Vacuum Cleaner Cassie

Using Byron Weber Becker’s Java Karel

S.C. Shapiro

cse@buff

alo

Magellan ProTM Mobile Robotfrom

iRobot

S.C. Shapiro

cse@buff

alo

A GIS Interface AgentBased onJun Xu, 2003, Implement an Intelligent ArcView User

Interface Using SNePS, Proceeding of the 23rd Annual ESRI User Conference, San Diego, California, July 7-11, 2003.

Stuart C. Shapiro, Hans Chalupsky, Hsueh-Cheng Chou, and David M. Mark. Intelligent user interfaces: Connecting ARC/INFO and SNACTor, a semantic network based system for planning actions. In Proceedings of the Twelfth Annual ESRI User Conference, V. 3, pages 151-165. Environmental Systems Research Institute, Redlands, California, 1992.

S.C. Shapiro

cse@buff

alo

View1 is a view.

Statetheme is a theme.

Open view1.

Add statetheme to view1.

S.C. Shapiro

cse@buff

alo

Add laketheme to view2.

Add rivertheme to view2.

S.C. Shapiro

cse@buff

alo

Add roadtheme to view1.

S.C. Shapiro

cse@buff

alo

Find New York in statetheme.

Zoom in statetheme.

S.C. Shapiro

cse@buff

alo

Zoom out statetheme.

Add citytheme to view1.

S.C. Shapiro

cse@buff

alo

Find San Diego in citytheme.

Zoom in citytheme.

Show table of citytheme.

S.C. Shapiro

cse@buff

alo

For More Information

• Shapiro: http://www.cse.buffalo.edu/~shapiro/

• SNePS Research Group: http://www.cse.buffalo.edu/sneps/– Meets Fridays 9-11, 242 Bell Hall– Join us!