1

IE/TC455

INDE/TC 455:User Interface Design

Module 13.0 – InterfaceTechnology

2

IE/TC455

Three more interface considerations

• What is the best allocation of

responsibility between the human and the

tool?

• What is the best

representational/interaction construct?

• Which technology choose to implement?

3

IE/TC455

Technology for the Interface

4

IE/TC455

Which technology to choose?

• To match the task– Mobility– Automation

• To match the user (persona?)– Child vs. adult– disabled

• To work in the environment– Outside– inside

• Other– Aesthetics (form)– Efficiency (function)– Effectiveness (form + function)

5

IE/TC455

Tools versus Technology

• Decide what your tool should do first

• Design a representational construct

• Then decide how to implement that functionality

with technology

• Refine form for aesthetics

• May require iteration

• Use thinking hats

6

IE/TC455

Important Considerations

• Responsiveness

– Actions have direct results

– User acts intuitively and spontaneously

• Permissiveness

– User can do anything reasonable

– Do and undo

– Different paths to task completion

• Consistency

– Same interface style for all applications

from Human Interface Guidelines: The Apple Desktop Interface

7

IE/TC455

Technology subsystems

#1 Technology to get signals to the user.= displays

#2 Technology get signals from the user.

= controls

8

IE/TC455

Sensing

Information

Processing

Psychomotor

Performance

Operator

Display

Machine

Control

Human-Machine Systems

9

IE/TC455

Human Interface Model -- Level 3

HUMAN PROCESSES

CO

GN

ITIV

E

PE

RC

EP

TU

AL

SE

NS

OR

Y

PS

YC

HO

MO

TO

R

DIS

PL

AY

CO

NT

RO

L I

NP

UT

MACHINE PROCESSES

PR

OC

ES

SIN

G

PR

OG

RA

MM

ING

SIGNAL

TRANSFER

DIRECT PATH

USER

MODEL OF

MACHINE

DESIGNER

MODEL OF

USER

MACHINEINDIRECT PATH

A PRIORI

KNOWLEDGE

TRAINING

EXPERIENCEEXPERIENCE

META COMMUNICATION

TASK

10

IE/TC455

Interface technologiesC

OG

NIT

IVE

PE

RC

EP

TU

AL

SE

NS

OR

Y

PS

YC

HO

MO

TO

R

DIS

PL

AY

CO

NT

RO

L I

NP

UT

PR

OC

ES

SIN

G

PR

OG

RA

MM

ING

controls

displays

•Signal Level–Transfer of physical signals across machine andhuman boundaries

11

IE/TC455

Human Signal Input Parameters

• Sensation-transducer– Signal intensity– Resolution– Contrast/modulation– Color– Dynamic range– Update rate– Throughput delays– Interference

12

IE/TC455

Human Signal Output Parameters

• Psychomotor—transducer– Movement (head, eyes, hand, body)– Event (eye blink)– Utterance (vibration of vocal chords)

• Physiological—transducer– Electro-myography– Electro-encephalography– Electro-cardiography– Electro-oculography– Galvanic skin response

13

IE/TC455

Technology transducers

• Displays– Visual

– Acoustic

– Tactile (haptic)

– Smell

– Taste

• Controls– Handheld

– Fingers

– Feet

– Body

– Head

– Eyes

– Speech

14

IE/TC455

Technology Matrix

Taste

Olfactory

Tactile

Acoustic

Real image

Virtual imageVisual

ControlDisplayModality

15

IE/TC455

Visual displays

16

IE/TC455

Visual Display transduction

• Photon source– Phosphor (cathode ray tube)– Solid state emitter (light emitting diodes)– Light modulators (liquid crystal)– Lasers– Plasma

• Photon manipulation– modulation– scanning

• Photon representation– Real image– Virtual image

17

IE/TC455

Real image displays

18

IE/TC455

Real Image Display Packaging

• Panel display (monitor)

• Tablet display

• Handheld display (e.g. PDA, cellphone)

• Projection Display

• Electronic paper

19

IE/TC455

Palm Pilot - Stylus Input

20

IE/TC455

Tablet computer

21

IE/TC455

Plasma display

22

IE/TC455

Bendable video displays

23

IE/TC455

Electronic paper

24

IE/TC455

Xerox electronic paper

25

IE/TC455

Virtual Image Displays

Real &

Virtual Images

27

IE/TC455

Real Image

28

IE/TC455

Virtual image

29

IE/TC455

Virtual image x 2

30

IE/TC455

Virtual image x 3

31

IE/TC455

Virtual display?

32

IE/TC455

TYPES OF VIRTUAL VISUAL DISPLAYS

occludedsee-thru

multiplexed

33

IE/TC455

eye multiplexed virtual displays

Early Furness Patent

Virtual Vision Personal Eyewear Display

Wearing Virtual Vision Display

Virtual image inset into real world

Entertaining the patient!

Entertaining little patients!

Parkinson’s disease

42

IE/TC455

first helmet-mounted display (1967)

43

IE/TC455

Occluded virtual displays

Flat Panel vs. VRD

Matrix Element Display

Matrix of 1,000,000 pixels

Virtual Retinal Display

One pixel

Color Virtual Retinal Display

VRD Demo*

*courtesy BBC Tomorrow*courtesy BBC Tomorrow’’s Worlds World

MicrovisionSimulation and Medical Display

Scanning

Engine

Combiner

Relay Optics

VRD in action!

49

IE/TC455

See-through virtual displays

50

IE/TC455

See-through virtual displays

Low vision findings - 1

Mean Percent Difference- Matched

Luminance VRD and Red CRT

-20.00-10.00

0.0010.0020.0030.0040.0050.00

3.15 1.88 1.22 0.74

Character Size

(Visual Angle Subtended)

Perc

en

t (%

)

All Subjects

Optical Causes

Retinal Causes

Low Vision Findings - 2

Which Display Was

Perceptually Clearer?

VRD (10)

CRT (2)Same (2)

MEMs Scanning Technology

VRD as a personal eyewear display

55

IE/TC455

Other visual display variants

56

IE/TC455

Interactive big screens

57

IE/TC455

#4 HI SPACE

• Collaborativeinteraction

• Tangible interface• Gestural recognition• Joint project with

Battelle PNL• Companion to Magicbook• Seattle Art Museum

58

IE/TC455

HALO Display

59

IE/TC455

60

IE/TC455

61

IE/TC455

Simulated Immersive Display (SID)

62

IE/TC455

CAVE Automatic Virtual Environment

63

IE/TC455

CAVE

64

IE/TC455

Holographic display

65

IE/TC455

66

IE/TC455

TV on a T-shirt

67

IE/TC455

Cloaking cloak

68

IE/TC455

Acoustic displays

69

IE/TC455

Acoustic displays

• Monaural sound

• Stereophonic sound

• Binaural sound (true 3D sound)– Sacred space

• Active Noise reduction

• Audio icons (earcons)

70

IE/TC455

‘sound effect’ earcons

71

IE/TC455

Some more earcons

http://www.dcs.gla.ac.uk/~stephen/earconexperiment1/2Close.AIFF

http://www.dcs.gla.ac.uk/~stephen/earconexperiment1/2Copy.AIFF

http://www.dcs.gla.ac.uk/~stephen/earconexperiment1/2Open.AIFF

http://www.dcs.gla.ac.uk/~stephen/earconexperiment1/2Delete.AIFF

72

IE/TC455

Whoopee cushion

73

IE/TC455

Tactile displays

74

IE/TC455

NIST Tactile Display - 1

75

IE/TC455

NIST Tactile Display - US Map

76

IE/TC455

NIST Tactile Display - Face

77

IE/TC455

NIST Tactile Display - graphics

78

IE/TC455

Tactile back display

79

IE/TC455

Tactile ear display

80

IE/TC455

Controllers

Or human input devices

81

IE/TC455

Input devices

82

IE/TC455

Hand & feet controllers

83

IE/TC455

84

IE/TC455

Flight simulation controllers

85

IE/TC455

Direct Manipulation = touch screen

86

IE/TC455

Direct manipulation with Dataglove

87

IE/TC455

Initial Exploration.

88

IE/TC455

Gesture-based Interaction With3D Displays.

• Intuitive interaction, easy to learn.

89

IE/TC455

SVM Recognizer.

90

IE/TC455

Palm Pilot - Stylus Input

91

IE/TC455

early helmet sight (1968)

92

IE/TC455

visor projected sight/display

93

IE/TC455

Super Cockpit revisited

94

IE/TC455

Eye control systems