Mitsubishi Electric Research Laboratories Raskar

Ramesh RaskarMitsubishi Electric Research Labs (MERL)

Cambridge, MA, USA

Pocket ProjectorsPocket ProjectorsAll-in-one Solution for Mobility, Augmentation, CommunicationAll-in-one Solution for Mobility, Augmentation, Communication

Mitsubishi Electric Research Laboratories Raskar

Ultimate Ultimate PersonalPersonal Display ? Display ?

Mitsubishi Electric Pocket ProjectorMitsubishi Electric Pocket Projector DLP based with DLP based with RR, , GG, , BB LEDs LEDs Instant on, battery-pack Instant on, battery-pack Available Now Available Now

Mitsubishi Electric Research Laboratories Raskar

Pro’s and Con’sPro’s and Con’s

1. Large image with small device

2. Image overlay on real object– Ideal for augmentation

3. Superposition of images– Higher resolution, brightness

Issues– Ambient bright light– Affected by display surface reflectance

Mitsubishi Electric Research Laboratories Raskar

Aware ProjectorAware Projector

Mitsubishi Electric Research Laboratories Raskar

Find tag location using

handheld Projector

Find tag location using

handheld Projector

Photosensing

Wireless Tags

Photosensing

Wireless Tags

Many geometric ops Many geometric ops

R F I R F I

R F I DR F I D

Interactive stabilized projection

Interactive stabilized projection

(Radio Frequency Id & (Radio Frequency Id & GeometryGeometry))

GG

Siggraph 2004Siggraph 2004

Mitsubishi Electric Research Laboratories Raskar

Augmented Reality with Augmented Reality with Photosensing RFID and Handheld ProjectorPhotosensing RFID and Handheld Projector

Siggraph 2004Siggraph 2004

Mitsubishi Electric Research Laboratories Raskar

• ‘Personal’ display• Shrinking portable devices that carry more data• Opportunity to switch between personal and public

• Modular – Low cost mass market product– Will become building block

• Platforms: TV, Stereoscopic, advertising, etc• Process: Tiling, Jittering, Superposition, Steering

Mitsubishi Electric Research Laboratories Raskar

Shader Lamps: Shader Lamps: Changing Virtual IlluminationChanging Virtual Illumination

Raskar, Welch, Low, Bandyopadhyay, “Shader Lamps: Animating Real Objects with Image Based Illumination,” Eurographics Rendering Worksop (EGRW 2001)

Mitsubishi Electric Research Laboratories Raskar

Mitsubishi Electric Research Laboratories Raskar

Poor Man’s PalacePoor Man’s Palace

Mitsubishi Electric Research Laboratories Raskar

Pocket ProjectorPocket Projector• Modular

– Building block of every type of display

• All-in-one– Display with small device size – Augment image overlay on real objects– Communicate with tagged world (RFID, Sensors)– Collaborate using shared projection

merl.com

Mitsubishi Electric Research Laboratories Raskar

END

Mitsubishi Electric Research Laboratories Raskar

Handheld ProjectorHandheld Projector

iLamps 2002 RFIG Lamps 2003-04

Pocket Projector 2004-05

Mitsubishi Electric Research Laboratories Raskar