A Nose Gesture Interface Device: Extending Virtual Realities

A Nose Gesture Interface Device: Extending Virtual Realities

2

Saved the most important for last

“A Nose Gesture Interface Device: Extending Virtual Realities”

Tyson R. Henry, Scott E. Hudson, Andrey K. Yeatts, Brad A. Myers, and Steven Feiner, Proceedings of UIST ‘91, November 11 - 13, 1991, Hilton Head, NC, pp. 65-68

http://www.acm.org/pubs/citations/proceedings/uist/120782/p65-henry/

3

Some of the most important VR work ever published Had its own special session at

UIST ‘91 Reprinted in Presence (the main

VR journal), April 1992.

Will recreate the presentation here

A Nose Gesture Interface Device: Extending Virtual RealitiesTyson Henry* University of New MexicoScott Hudson* Carnegie MellonAndrey Yeatts University of ArizonaBrad Myers Carnegie MellonSteven Feiner Columbia University

*at the University of Arizona in 1991

5

Motivation

Current virtual reality systems are just too limited

Goal: improved sense of presenceExtensions to other

sensesFull body interaction

6

Rhino-Virtual Realities

The potential of the nose has been sorely neglected in previous systems

To remedy this we have developed ...

7

The DATANOSE™

8

Offers Support for True Multi-Modal Interaction

Works with conventional graphical interfaces...

9

10

A New Suction Based Dragging Technique: “Hoovering”

11

Also works with older (text based) interface styles...

12

13

Hardware Design

The Early Prototypes…

14

First Prototype

Fully functional– Exceeded all specs

But unexpectedly did not gain user acceptance

15

Design iteration

Next prototypes miniaturized the olfactory output system and explored new commercially appealing packaging...

16

Rabbit Nose Platform

Worked better, but whiskers interfered with interaction

17

Next Iteration

Didn’t work very well...

18

Pig Nose Platform

Issues with users squealing

19

Dog Nose Platform

Drooling problems...

20

This one didn’t work at all

Subjects had an inexplicable urge to tell bad puns

21

After a few small modifications it worked better

But pun problem persisted

22

The final prototype...

23

Groucho Marx Nose Platform

24

DATANOSE™ Features

Full featured miniature olfactory I/O system

Fully mobile operation

25

Works in the lab...

26

Down the hall...

27

To places mobile computing has never gone before...

28

Advanced Interaction Techniques

3D Rotation Task– True User-Centered Rotation

29

30

31

32

33

34

Interacting with Multiple Devices

The DATANOSE™ works smoothly with conventional I/O devices...

35

Keyboard

36

Mouse

37

Valuators (Knobs)

38

Also has great potential in computer supported cooperative work applications...

39

40

Finally, can support fluid interaction with large data sets...

41

42

Applications:An Example Virtual World

Searched for an appropriate application domain...

43

Applications:An Example Virtual World

Implemented: Dog’s World–A user’s view

44

45

46

47

CSCW Extensions:

The Collaborative Dog’s World...

48

49

A New Toolkit

To avoid the high cost of developing rhino-interfaces, a new toolkit was developed

SYSTEM– An acronym standing for...

50

A New Toolkit

To avoid the high cost of developing rhino-interfaces, a new toolkit was developed

SYSTEM– a System that reallY doeS creaTE

user interfaces that have really nice featuMs

51

Uses The Seeheim Model

A major advance in itself

52

More Important ...

We have been able to answer the most important research question about the model...

53

Uses The Seeheim Model

What is that little box at the bottom!?!

54

Important Discovery

The Seeheim model works much better if you put everything in the little box

An improved model...

55

Improved Model

56

The Final SMELL-HEIM Model

57

Another Major Advance

A completely new approach to dialog management– Did an extensive literature search

Never been done before– Will revolutionize UI software work

58

Another Major Advance

A completely new approach to dialog management– Did an extensive literature search

Never been done before– Will revolutionize UI software work

Finite State Machine Controllers!

59

SYSTEM supports easy to use graphical editor for FSM controllers

60

SYSTEM supports easy to use graphical editor for FSM controllers

61

Usability Testing

Significant new testing after the paper was submitted

62

User Testing Results

Really Really Liked ItReally Liked ItSort of Liked It

Hated ItSubject #1 Subject #2

63

User Testing Results

Both users really really liked it!

Really Really Liked ItReally Liked ItSort of Liked It

Hated ItSubject #1 Subject #2

64

Future Work

Extending to other body parts

– DATA ARM™

– DATA EYEBALLS™

65

66

Future Work (cont.)

Extending to other body parts

– DATA FOOT™– DATA MOUTH™

Warning: Our research shows that these devices should not be used together!

67

Conclusion

Overall a dramatic breakthrough in virtual

research

Questions?

69