11

RodDirect :RodDirect :Two-Dimensional Input Two-Dimensional Input

with Stylus Knobwith Stylus Knob

Motoki Miura and Susumu KunifujiMotoki Miura and Susumu KunifujiJapan Advanced Institute of Science and Japan Advanced Institute of Science and

Technology, JAPANTechnology, JAPAN

MobileHCI2006@Espoo FinlandMobileHCI2006@Espoo Finland

22

OutlineOutline

MotivationMotivation RodDirectRodDirect

– ConceptConcept– ApplicationsApplications– Implementation of PrototypeImplementation of Prototype

ExperimentExperiment ConclusionConclusion

33

Conventional Input Devices for Conventional Input Devices for Portable HandheldsPortable Handhelds

Consideration of Size and WeightConsideration of Size and Weight Common input devicesCommon input devices

– Buttons/Hot keysButtons/Hot keys– Touch sensitive panel with stylus penTouch sensitive panel with stylus pen– Mini KeyboardMini Keyboard– Jog DialJog Dial

Touch panel is versatile, but…Touch panel is versatile, but…– Often requires precise tapping for small GUI objectsOften requires precise tapping for small GUI objects– Stylus pen is necessary for precise tappingStylus pen is necessary for precise tapping– Drawing/Storing actions disturb smooth interactionDrawing/Storing actions disturb smooth interaction

44

Augmented ApproachAugmented Approach

Exploit physical movement with natural Exploit physical movement with natural interactioninteraction– Efficient use of device portabilityEfficient use of device portability

Embed sensorsEmbed sensors– Position & Orientation [“Chameleon”, Fitzmaurice Position & Orientation [“Chameleon”, Fitzmaurice

et al. 1993]et al. 1993]– Tilting [Rekimoto 1996]Tilting [Rekimoto 1996]– Tactile(Haptic) [Harrison et al. 1998][Hinckley et al. Tactile(Haptic) [Harrison et al. 1998][Hinckley et al.

2000]2000] Data transfer in real world contextData transfer in real world context

– HyperPalette [Ayatsuka et al. 1999]HyperPalette [Ayatsuka et al. 1999]– Toss-it [Yatani et al. 2004]Toss-it [Yatani et al. 2004]

55

Trend of new device development Trend of new device development

Attaching more sensors on handheldAttaching more sensors on handheld– Detect natural behavior of human with handling deDetect natural behavior of human with handling de

vicesvices– Recognize intension of userRecognize intension of user

We agree the direction of approachWe agree the direction of approach However, we should make full use of conventiHowever, we should make full use of conventi

onal hardware as much as possibleonal hardware as much as possible

66

RodDirectRodDirect Novel, simple and versatile interaction Novel, simple and versatile interaction

techniquetechnique RodDirect utilize stylus pen as a knob/cylinder RodDirect utilize stylus pen as a knob/cylinder

Two types of stylus movement in Two types of stylus movement in the stylus holder are associated the stylus holder are associated with parameterswith parameters– (1) Twist (Rotation)(1) Twist (Rotation)– (2) Push/Pull (Sliding)(2) Push/Pull (Sliding)

User can control two parameters User can control two parameters intuitively and simultaneouslyintuitively and simultaneously

77

88

MetaphorsMetaphors(Scrolling and Moving object)(Scrolling and Moving object)

99

Applications using RodDirect Applications using RodDirect

Block Breaker Space Invader

Application Switching SchedulerMap Browser

1010

Application: Map BrowserApplication: Map Browser

2D ScrollingZooming by rotating while pressing button“Crutching” by pressing button

1111

Application SwitchingApplication Switching(conceptual demo)(conceptual demo)

Twisting for switch commandPulling out determines screen mode

1212

Application: SchedulerApplication: Scheduler(mixed with touch screen interaction)(mixed with touch screen interaction)

2D ScrollingTapping & Holding to move item

1313

Game: Block BreakerGame: Block Breaker

Controlling pad position directly by rotating/sliding

1414

Game: Space InvaderGame: Space Invader

Controlling cannon position directly by slidingShot by rotating (player can control laser speed by rotation speed)

1515

PrototypePrototype(Optical mouse sensor detects (Optical mouse sensor detects

movements of stylus)movements of stylus)

800 counts/inch, 420 counts/rotation, 1200 counts/one-way slide

1616

Implementation of PrototypeImplementation of Prototype

PC receives location of stylus as ordinary mouse PC receives location of stylus as ordinary mouse positionposition

PC-PDA connection (ActiveSync) to transmit location PC-PDA connection (ActiveSync) to transmit location to PDAto PDA

Application on PDA processes the locationApplication on PDA processes the location

USB port

TCP/IP

1717

User’s MeritsUser’s Merits

Natural and IntuitiveNatural and Intuitive User can operate with User can operate with normal stylusnormal stylus Physical constraint of holder decreases Physical constraint of holder decreases

difficulty of operationdifficulty of operation– non-dominant hand control is also possiblenon-dominant hand control is also possible

Friction keeps the position of stylusFriction keeps the position of stylus– User can suspend/resume tasks User can suspend/resume tasks

immediatelyimmediately

1818

Manufacturer’s MeritsManufacturer’s Merits

The sensor is relatively smallThe sensor is relatively small– It can be embedded in the device It can be embedded in the device – Few restriction in exterior designFew restriction in exterior design

Not expensiveNot expensive Provides new experience for usersProvides new experience for users

1919

Tasks and Interactions with handheldTasks and Interactions with handheld

LaunchApplication

Hot Key

1DScrolling

2DScrolling

DiscreteTap&Drag

(ex.Inputting Text)

Cursor KeysJog Dial

RodDirect

Touch Panel with Stylus

Cost ofOperations(incl. Pre/PostTasks)

Task Complexity

2020

ExperimentExperiment

Purpose: Investigate efficiency of RodDirectPurpose: Investigate efficiency of RodDirect Task: Scroll to center target & press buttonTask: Scroll to center target & press button Target appears on Target appears on

1280x1200 virtual screen1280x1200 virtual screen 9 participants9 participants 4 input methods4 input methods

– DragDrag– WalkWalk– TiltTilt– RodDirectRodDirect

Captured time to complete taskCaptured time to complete task

2121

DragDrag(panning by pushing background)(panning by pushing background)

2222

WalkWalk(similar to Touch-n-go [MacKay et al. 2005])(similar to Touch-n-go [MacKay et al. 2005])

2323

TiltTilt

(PhidgetAccelerometer attached on behind)

2424

RodDirectRodDirect

2525

Result (Estimated marginal means)Result (Estimated marginal means)Estimated marginal means of time (sec)

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

Rod Drag Walk Tilt

Input Method

Tim

e (s

ec)

Bonferroni pair-wise comparison revealed:Rod<<WalkRod<<TiltDrag<<WalkDrag<<TiltWalk<<Tilt

But no significant differences found between Rod and Drag

**

**

2626

Fitting to MacKenzie modelFitting to MacKenzie model(MT = a + b log(MT = a + b log22(Distance/Size + 1)(Distance/Size + 1)

Slope (b)Slope (b) RodRod:547:547 DragDrag:769:769 WalkWalk:844:844 TiltTilt:785:785Rod

Drag

Walk

Tilt

2727

FindingsFindings

RodDirect can operate as fast as tap&dragRodDirect can operate as fast as tap&drag– Rod becomes faster when larger target size, Rod becomes faster when larger target size,

longer target distancelonger target distance User CommentsUser Comments

– Drag suits for precise controlDrag suits for precise control– Drag exhausted user by back/forth draggingDrag exhausted user by back/forth dragging– Participants disrupted by reflections from room Participants disrupted by reflections from room

light in Tiltlight in Tilt Tilt is not best for screen-attentive tasksTilt is not best for screen-attentive tasks

– Touch panel was worn out by frequent scratchTouch panel was worn out by frequent scratch

2828

ConclusionConclusion

RodDirectRodDirect– novel, simple and versatile interaction techniquenovel, simple and versatile interaction technique– Suitable for mobile appliancesSuitable for mobile appliances

Relatively small sensorRelatively small sensorLess influence on exterior design if embeddedLess influence on exterior design if embedded

– Effective for scrolling task Effective for scrolling task RodDirect can be applied not only PDA with styluRodDirect can be applied not only PDA with stylu

s but also “rod antenna” of cellular phones but also “rod antenna” of cellular phone

2929

Questions & commentsQuestions & comments

Thank you for your attentions!!Thank you for your attentions!!

Contact:Contact:– Motoki MiuraMotoki Miura– miuramo@jaist.ac.jpmiuramo@jaist.ac.jp– http://css.jaist.ac.jp/~miuramo/http://css.jaist.ac.jp/~miuramo/

3030

3131

Longer StylusLonger Stylus

Length:Original: 94mmLonger : 110mm (+16mm)

(To Prevent pushing in entirely)