18
Next Generation UI Microsoft Kinect Andreas Schabus Microsoft Österreich [email protected]

MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Next Generation UI Microsoft Kinect

Andreas Schabus Microsoft Österreich

[email protected]

Page 2: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Next Generation UI?

Page 3: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

The Evolution of UIs U

ser

pro

du

ctiv

ity

Time

Batch

Command Line

Graphical User

Interfaces

1940s-1950s 1960s-1970s 1980s-today

Natural User Interfaces?

tomorrow

computer syntax, too detailed

icons, menus keyboard

mouse

human syntax images & videos touch, gestures, conversational,

intent

Page 4: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Natural User Interfaces (NUIs)

Minority Report, 2002

Page 5: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

http://blogs.technet.com/b/microsoft_blog/archive/2011/01/26/microsoft-is-imagining-a-nui-future-natural-user-interface.aspx

In Germany, 79% think NUI will improve their quality

of life

Page 6: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

http://blogs.technet.com/b/microsoft_blog/archive/2011/01/26/microsoft-is-imagining-a-nui-future-natural-user-interface.aspx

In Germany, 82% think NUI will stimulate the economy

Page 7: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Brain Waves

Mind control

Mood Recognition

NUI Input Methods

Computer Vision

Facial Recognition

Spatial Recognition

Augmented Reality

Gesture Sensing

Audio Recognition

Voice Command

Natural Speech

Ambient Noise

Touch

Single Touch

Multi-Touch

Pen Input

Sensors

Geospatial Sensing

Accelerometers

Biometrics

Ambient Light

Page 8: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

NUI Output Methods

Audio

Speech Synthesis

Audible Feedback

Tactile

Haptic Feedback

Tactile Feedback

Force Feedback

Visual

Graphical Interface

Visual Feedback

Avatar

Page 9: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Bionic Contact Lenses

http://research.microsoft.com/en-us/collaboration/focus/health/contact-lens.aspx

Page 10: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Muscle Sensing Armband

Measure electrical activity with Electromyography (EMG)

http://research.microsoft.com/en-us/um/redmond/groups/cue/MuCI/

Page 11: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Today?

Page 12: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Touch Hardware Ecology

Capacitive Capacitive Infrared Vision system Stylus

Page 13: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Horizontal Vertical

Page 14: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Microsoft Kinect

Page 15: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

RGB CAMERA

MULTI-ARRAY MIC MOTORIZED TILT

3D DEPTH SENSORS

Microsoft Kinect

Page 16: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Kinect for Windows SDK

http://research.microsoft.com/en-us/um/redmond/projects/kinectsdk/

Page 17: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

NUI Skeleton Tracking

Page 18: MobileMonday Austria #11 - Usability - Next generation UI - Microsoft Kinect

Thank You!