AR phoneAR phone

University of SydneyUniversity of Sydney

IntroductionIntroduction

• University of SydneyUniversity of Sydney• Adam Hudson, Mark Assad, Dan Cutting.Adam Hudson, Mark Assad, Dan Cutting.

AR phoneAR phone

• Virtual objects in real worldVirtual objects in real world• Fiducial markers position virtual objectsFiducial markers position virtual objects• InaccessibleInaccessible (when viewed through (when viewed through

expensive glasses)expensive glasses)• Non-intuitiveNon-intuitive (when viewed (when viewed

with computer and web cam).with computer and web cam).

AR phoneAR phone

AR phoneAR phone

IDEAIDEA• Use common mobile device as a view port.Use common mobile device as a view port.

MOTIVATIONMOTIVATION• Increase Increase accessibilityaccessibility• Make Make more intuitivemore intuitive..

AR phoneAR phone

APPROACHAPPROACH• Smart-phone (Ericsson P800)Smart-phone (Ericsson P800)• CameraCamera• Large screenLarge screen• BluetoothBluetooth• Too slow for video processing.Too slow for video processing.

• Offload processing to server using Offload processing to server using Bluetooth.Bluetooth.

AR phoneAR phone

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

BluetoothBluetoothCameraCamera

DisplayDisplay

Find fiducial marker

Augment image

QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.

BluetoothBluetoothCameraCamera

DisplayDisplay

Find fiducial markerAugment image

AccessAccesspointpoint

AR serverAR server

TCP/IPTCP/IP

APPLICATIONAPPLICATION

• Allan Richards’ usability study - real time Allan Richards’ usability study - real time gaze analysis (http://eyeresponse.com).gaze analysis (http://eyeresponse.com).

APPLICATIONAPPLICATION

MESSAGING SYSTEMMESSAGING SYSTEM• Markers placed around buildingMarkers placed around building

• Eg. office doorEg. office door• Marker provides locationMarker provides location• Can be associated with an identityCan be associated with an identity

• Take a photo with the phoneTake a photo with the phone• Phone provides owner’s identityPhone provides owner’s identity

APPLICATIONAPPLICATION

MESSAGING SYSTEM (cont.)MESSAGING SYSTEM (cont.)• Imaging server returns a message to the phoneImaging server returns a message to the phone

• Can be general: Eg. “Bob will be out of the office till Can be general: Eg. “Bob will be out of the office till 12:30pm”12:30pm”

• Or personalised: Eg. “I had to leave urgently, so I’ve Or personalised: Eg. “I had to leave urgently, so I’ve moved our meeting to 1pm”moved our meeting to 1pm”

• Provides context to an intelligent environmentProvides context to an intelligent environment• Eg. “Adam was standing outside Bob’s door at 11am”Eg. “Adam was standing outside Bob’s door at 11am”

Virtual fruitVirtual fruit