Transferring Sensing to a Mixed Virtual and Physical Experience

Yi-Ching (Janet) Huang National Taiwan University

2014.09.01

Our eyes help us perceive and understand the visual world

Can we use different ways to sense what we see?

1. reverse the original sensing

2. transfer to another sense

3. extend sensing and support developing ability

Reverse the original function

input

output

Scopophobic Kitties in WonderlandStories Behind the Scene of a Gaze Contingent Environment

hide

show

’’

’

Eye Tracking in Physical Space

reactive region 30˚Pilot Studies

Transfer sensing

Seeing Aural An Installation Transferring the Materials You Gaze to Sounds You Hear

Can we help an artists create art works in a proper way?

Gaze-Based Drawing Assistant

Help proportion and perspective, and preserve drawing style

subject #1 subject #2 subject #3

support visual memory aideye gaze pattern

• A Cyber-Physical system enables various possibilities for creating amazing works.

• We explored a mixed virtual and physical experience by reversing, transferring and extending the original sense ability.

Thanks & QA