Endsley_slides.pdf

8/12/2019 Endsley_slides.pdf

1/32

SA Technologies, Inc.

Bringing Cognitive Engineering to the

Information Fusion Problem:Creating Systems that Understand Situations

Mica R. EndsleySA Technologies, Inc

Presentation to Fusion 2011Chicago July 2011


2/32


Goals for Computer Models of SA

Augment human decision making

Must be capable ofsharing its SA

Replace human decision making


3/32


What do we mean by Computer SA?

Do computers have awareness ?

SA = Model of the current situation


4/32


Computer SA

Model of the current situation Perception of elements Comprehension of meaning Projection of future status

World State


5/32


Field Needs To Move From Level 0/1 FusionTo Higher Level Data Fusion

Where are we?Where are they?What is the weather?What is the terrain?

Highest priority threatDeviation from planCombat readinessLevel of risk to assetsPriority of information

Areas needing coverage

SpecificRequirementsCan be DefinedFor a Given Position

Predicted enemy COAsPredicted friendly COAsPredicted impact of friendly

actions on enemy COAsPredicted location of weapons

systemsPredicted effects of weatherPredicted effects of terrainPredicted enemy objectives


6/32


Challenges for SA

Lots of Data Some relevant/some not Varying levels of reliability

Lots of Noise Transmission issues Conflicting data

Limited Bandwidth Limited Processors


7/32


Learning fromHuman Situation Awareness

State Of TheEnvironment

Decision

SITUATION AWARENESS

Performance Of

Actions

PerceptionOf ElementsIn CurrentSituation

ComprehensionOf CurrentSituation

ProjectionOf FutureStatus

Feedback

Level 1 Level 2 Level 3

Abilities Experience Training

Goals & Objectives Preconceptions (Expectations)

Individual Factors

Information ProcessingMechanisms

Long TermMemory Stores Automaticity

Task System Factors

System Capability Interface Design Stress & Workload Complexity Automation

Endsley, 1988, 1995


8/32


Mechanisms of SA

Goals

Active Goal Selects Model

Perception Comprehension Projection

Directs Attention

Mental Model

ProvidesComprehension& Projection

SA Guides Selectionof Active Goal


9/32


What Allows People to AchieveHigh Levels of SA?

Mental Model

Schema Prototypical & Expected Objects Scenes Order of Events

What information is attended to

How information is interpretedand integrated

What projections are made CriticalCues

Comprehension Projection

Situation Model (SA)

External Cues Perception


10/32


Evolution of Mental (Computer) Models

FeedbackLearning

A1

B1

C1 C2

B2

C3

Model A

Prediction ofworld state

Comparison toactual world state

A1

B1

C1 C2

B3

C3 c4

Model A

Refinement of Model- better categorization- more categories- better transition functions


11/32


Situation Model must CaptureUncertainty (Confidence Level)

State of theEnvironment Decision

SITUATION AWARENESS

Perceptionof Elementsin CurrentSituation

Level

Projectionof Future

Status

Comprehensionof CurrentSituation

Level 2 Level 3

U 1 U 2 U 3 U d

Missing data Reliability of data Conflicting data

Timeliness of data Ambiguous/noisy data

Mapping of datato relevantcategories/

schema

Future inherentlyuncertain

Models for

prediction onlyprobabilistic

Probability thatselected courseof action will

result in desiredoutcome

As fusion level goes up, so does need tosupport confidence assessments

Endsley, Bolte & Jones, 2003


12/32


Information Confidence & Uncertainty

SituationAwareness

Confidence

Level

Good Poor

High

Low

GoodOutcome

Do Nothing(Ineffectual)

BadOutcome

OkayOutcome

(Delay)

Christ et. al. (1994) and Endsley and Jones (1997)

SA and Confidence Levelin that SA will EffectWillingness to Act &

Outcome


13/32


Levels vs Stages

Perception Comprehension Projection

Levels 2 & 3Can be usedTo drive the searchFor Level 1 info

Default values from the

mental model canprovide reasonablevalues, even when nolevel 1 info has beenperceived on anelement

Perception, Comprehension & Projection are not necessarily linear stages

Decide: Needmore info

Act: DirectedSearch

Confidence in SA


14/32


Meaning is not DeterminateDepends on Goals

Meaning is in the eye of the beholder

Workplace Obstacle

Terrorist Target

Sightseeing


15/32


Situation Awareness - Driven by AlternatingData Driven and Goal Driven Processing

! Goal Driven Processing (Top-down)! Goals Determine Selection of Model for Interpreting

Information! Goals Determine Development of Level 2 SA! Goals Direct Attention

! Data Driven Processing (Bottom-up)! Salient Cues Catch Attention

! Cues Interpreted! Options Generated/Evaluated! Option Selected! Appropriate Actions taken

Goal 1 Goal 2 Goal 3 Goal 4 Goal 5

Goal 2 Goal 3 Goal 5

Goal 5

Goals are key organizing

feature for cognitive work


16/32


Transitioning Goals

MainGoal

Subgoal1

Subgoal

1.1

Subgoal

1.2

Subgoal2

Subgoal

2.1

Subgoal

2.2

Subgoal

2.3

Activationcriteria

Activationcriteria


17/32


Goals & Mental Models in SA

MENT L

MODEL

C T I O N S

E N V I R O N M E N T

G O L S

(IDEAL STATE)

P L N S

(PROJECTED STATE)

S I T U T I O N

W R E N E S S

S C R I P T S

(OUTCOME)

(SITUATION MODEL)


18/32


Summary

Information from the world is filtered through the users senses to form SA.SA influences goal activation, active goals drive mental model selection, and mental

models direct attention to sensory information.

Perception Comprehension Projection SituationAwareness Action

Decision

GoalMentalModel

MentalModel

MentalModel

MentalModel

Directs attention Influencesgoal

Selectsmodel


19/32


Approaches to Fusion

Bottom up

Elements(Level 1)

Comprehension

(Level 2)

Projection(Level 3)


20/32


Approaches to Fusion

Top Down

Elements(Level 1)

Comprehension(Level 2)

Projection(Level 3)


21/32


Computer Models of SA Will Need:

An internal Mental Model

of the system/environment Defines Relevant

Provides Dynamic Information Prioritization Provides Mechanism for Dynamic Integration of Data Creating

Meaning Comprehension required Projections required

Active Learning and Model Refinement Links to Schema and Scripts for Prototypical Situations

Goals Pre-requisite to Relevance and Meaning There are frequently Multiple Goals which Vary in Priority Need a Mechanism for Goal Prioritization

Critical Cues to Trigger Goal Priorities


22/32


Towards Methods for CreatingUsable Computer Models of SA

Where are we?Where are they?What is the weather?What is the terrain?

Highest priority threatDeviation from planCombat readinessLevel of risk to assets

Priority of information Areas needing coverage

SpecificRequirementsCan be DefinedFor a Given Position

Predicted enemy COAsPredicted friendly COAsPredicted impact of friendly

actions on enemy COAsPredicted location of weapons

systemsPredicted effects of weatherPredicted effects of terrainPredicted enemy objectives


23/32


Goal Directed Task Analysis

1.0Major Goal

1.1Subgoal

1.2Subgoal

1.3Subgoal

Decisions Decisions Decisions

SA Requirements:Level 3 - ProjectionLevel 2 - ComprehensionLevel 1 - Perception




24/32


Example Logistics Officer

!"#$%"#$ '$#% ()"*#$)++ ,-)). /$#%+ 0112 +/..3#)*

0415678)9% :/%/6) +/..3;

$))*+ 7: /$#%+

40()97AA)$* D3379"%#7$ 7:

L"$*

>4M!"#$%"#$ B/*C)% %7 H/..76%

'$#% ()"*#$)++

M41?776*#$"%) N6"$+.76%"%#7$

M4

Documents

Endsley_slides.pdf