Innovative wearable interfaces: an exploratory analysis of paper-based interfaces with camera-glasses device unit

2014. 11. 25

Bonhyun Koo

Yun Zhou *, Tao Xu †, Bertrand David †, and Rene´ Chalon †

* CNRS, Universite´ Lyon, France† CNRS, Ecole Centrale de Lyon, France

Personal and Ubiquitous Computing (2014)

Contents

1. Introduction (Goal and Contributions)

2. Related Works

3. Overview of Innovative User Interface - Innovative UI & Scenario

- EDI (Environment Dependant Interface)

- EII (Environment Independent Interface)

4. Design of MobilePaperAccess - Input Technique

- Paper Surface

5. Implementation - Wearable Configuration

- Finger & Mask Motion

- Augmented Paper & Digital Visual Feedback

- Application

6. Evaluation

7. Summary & Future works

1. Goal and Contributions

Background- Traditional user interfaces, used on the desktop computer (WIMP), is no longer appropriate for ubiquitous computing

Goal-To Introduce available solutions to enable ubiquitous interac-tion Nomadism and Mobility (MobilePaperAccess)

- To create a true contextualization (based on the user’s location or independent of it)

2. Related WorksWearable Input Techniques : Miniaturization & Interaction

Wearable Output Techniques : Challenges (Insufficient lumens & High resolutions)

Paper Interaction To bridge the digital and real world as a light and economical way

objectGesture (Minput) Stylus (FACT) Gesture (Sixsense)

Pico-Projector Head-won displays (Eyeglass-Based Systems For Wearable Computing) Handheld mobile phones

Interaction Palette(IR reflective markers)

Quickies (Media Lab.)

3. Overview of Innovative User InterfaceRelationship between (a) IEI (In-Environment Interface) (b) EDI (Environment Dependent Interface) (c) EII (Environment Independent Interface)

3. Innovative User Interface (Scenarios)

Scenarios (in the smart city)

1) Alice wants to discuss w/ Yan.2) (Bob is out of office)3) Alice checks Bob’s schedule(sends him a date request)

public placeOutsideBob’s door

(In a library)Alice is looking through books when he suddenly remembers that he needs toDiscuss with another new member John.He opens his notebook and finds a predefined paper-based interface

3. Innovative User Interface (EDI and EII) • EDI Interface

• EII Interface

specific locations

location free

4. Design of MobilePaperAccess

• Input Techniques

4. Design of MobilePaperAccess • Paper Surface Design

29.7cm

21.0cmPaper

The average forward grip reach : 74.3cm

Color Marker (c), (d)

ARToolKit Tag (a), (b)

5. Implementation (Wearable Configuration) • It consists of (1) camera-glasses device unit and (2) a laptop for calculation

Small screen(PC Viewer)Micro-Optical SV-6

Web-Cam (RGB 640x480)

Laptop

(2)

(1)

5. Implementation (Finger and Mask Motion)• Object Tracking (based on the OpenCV - MeanShift&CamShift algorithm)

1) Counting the number of tracking points,

2) If (the number of points >= predefined condition) then Regard this action as a pointing

5. Implementation (Augmented Paper)Augmented Paper Types (a), (b), (c), and (d)

Digital Visual Feedback

Color marker

Color marker

Augmented Book

ARToolkit Tag

6. EvaluationParticipants : 12 students

Stood

Sat &Stood(freely)

Participants : 12 students - 7 males, 5 females- Mean age : 23.2- Average height : 171.8cm

6. Evaluation

7. Summary & Future works

Q & A

[MeanShift & CAMShift]