40
iSuppli Corporation 22 nd Annual Flat Information Displays Conference Pocket Projectors All-in-one Solution for Mobility, Augmentation, Communication Ramesh Raskar Senior Research Scientist Mitsubishi Electric Research Labs, Cambridge, MA

Raskar Pocket Proj Fid2005presented

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Raskar Pocket Proj Fid2005presented

iSuppli Corporation22nd Annual Flat Information Displays Conference

Pocket ProjectorsAll-in-one Solution for Mobility, Augmentation, Communication

Ramesh Raskar Senior Research Scientist

Mitsubishi Electric Research Labs, Cambridge, MA

Page 2: Raskar Pocket Proj Fid2005presented

iSuppli Corporation22nd Annual Flat Information Displays Conference

Ramesh Raskar

Mitsubishi Electric Research Labs (MERL)Cambridge, MA, USA

Pocket ProjectorsAll-in-one Solution for Mobility, Augmentation, Communication

Page 3: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 3

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Ultimate Personal Display ?

Mitsubishi Electric Pocket Projector DLP based with R, G, B LEDs Instant on, Battery-pack Available Now

Page 4: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 4

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

DLP® 0.55” ChipLED life >10,000 hoursSVGA 800 x 600~ 250 LUX in brightnessInputs VGA, RCA & S VideoBattery ~ 2.5 hoursActual Size: 4.85”W x 1.85”H x 3.82”HWeight ~ 1 pound (450g)

Page 5: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 5

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Page 6: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 6

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Small Projector…

Estimated Possible Partner Device for Attachment

Projected2005 Sales

Projected 2006 Sales

Portable DVD Players 1,545,000 1,845,000

Digital Camera 20,161,000 21,893,000

Gaming Systems 60,000,000 64,200,000

Others (ie. RV’s, PDA’s, etc.) (Very rough estimate only)

50,000,000 55,000,000

Rough Base Totals 131,706,000 142,938,000

Estimates and Projections Quoted from Various Sources

Big Projections…

Page 7: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 7

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Possible Partner Device for Attachment

Projected2005 Sales

Projected 2006 Sales

Rough Base Totals 131,706,000 142,938,000

Conservative Early Adopter Estimate

0.034% 0.084%

Possible Sales in Units 44,780 120,067

Average Consumer Electronic Adoption Rate 0.34% during the first year of product introduction 0.84% during the second year 1.54% during the third year

Page 8: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 8

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Problems

Brightness: LEDs and OpticsPrice: $699+Applications: ?

Page 9: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 9

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Brightness and Power• More LEDs for illumination

Heat: Better thermal designs Cost: LEDs are expensive ! Size: Complex optics for multi-LEDs

• White boost Equivalent to transparent part of color wheel All 3 R,G,B LEDs on at the same time

• Blacks LED Dimming

• Limits Difficult to match lamp based, AC powered projectors Need to think about other applications

Page 10: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 10

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

ApplicationsUnderstanding Projector Pro’s and Con’s

1. Large image with small device

2. Image overlay on real object– Ideal for augmentation

3. Superposition of images– Higher resolution, brightness

Issues Ambient bright light Screens: Affected by display surface reflectance

Page 11: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 11

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Page 12: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 12

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Image Overlay on Real Objects Decoupled device Non-planar surfaces

Page 13: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 13

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Image Overlay on Real Objects Decoupled device Non-planar surfaces

Machine Projection Projector for non-display apps

Page 14: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 14

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Image Overlay on Real Objects Decoupled device Non-planar surfaces

Machine Projection Projector for non-display apps

Page 15: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 15

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Small group presentations

Pocket monitorPDA, Digital Camera, Mobile phones, Video iPods

Gaming displaysPortable home theater Camping entertainmentIn-Car entertainment

Compact Tiled Displays (VideoWall)

Decoupled Image Size

Page 16: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 16

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Pocket Projector Developments

iLamps 2002 RFIG Lamps 2003-04

Pocket Projector 2004-05

Page 17: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 17

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Stabilized Desktop-like Interaction

Sensor support What components are needed ?

Page 18: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 18

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Page 19: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 19

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Desktop-like Interaction

Mouse Simulation •Cursor follows handheld projector motion• Pre-warped image remains stable

Page 20: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 20

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Image Quasi-Stabilization

Eliminate hand jitter using inertial sensors+camera

Page 21: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 21

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Absolute Stabilization

Image stays registered with world features

Page 22: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 22

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Image Overlay on Real Objects Decoupled device Non-planar surfaces

Machine Projection Projector for non-display apps

Page 23: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 23

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Changing Texture and Virtual Lighting

Raskar, Welch, Low, Bandyopadhyay, “Shader Lamps” (2000)

Page 24: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 24

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Page 25: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 25

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Image Overlay on Objects

Raskar, vanBaar, Beardsley et al, Siggraph 2003

Page 26: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 26

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

New Opportunities

Aware Projectors Decoupled display size

Image Overlay on Real Objects Decoupled device Non-planar surfaces

Machine Projection Projector for non-display apps

Page 27: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 27

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Machine ‘Projection’Images consumed not by humans but by other machines

Project images to assist machine computation

Unique compared to other display technologies

Optical CommunicationOptical EtchingVisual coding

Robot Guidance

Machines consume images

Machines Produce images

Page 28: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 28

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Maskless Lithography

DLP Micro-mirror arrayFast parallel operation on optical resists

OpticalResists

Page 29: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 29

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Parallel Switching and Routing at ~100KHzFixed diffraction grating + Optical switches

Optical Networking Gear

Page 30: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 30

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Pocket Projector = Glorified Remote Control

+ Glorified Laser Pointer

Optical Communication

Page 31: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 31

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Find tag location using

Pocket Projector

Photosensing

Wireless Tags

Many geometric ops

R F I R F I D

Interactive stabilized projection

(Radio Frequency Id & Geometry)G

Siggraph 2004

Page 32: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 32

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Conventional Passive RFID

Micro Controller

Memory Computer

READER

Micro Controller

Memory

Page 33: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 33

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Using Projector to Interact with Tagged Books in a Library

With RFID, get list of books in RF range

With Precise Location Data Find which books are out of sorted order !

Page 34: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 34

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Prototype Tag

RF tag + photosensor

Page 35: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 35

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Support for handheld projection + RF Reader

Page 36: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 36

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

RFIG: Finding Tag Location and Image Overlay

Siggraph 2004

Page 37: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 37

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Directions for PocketProjector

‘Personal’ display• Shrinking portable devices that carry more data• Opportunity to switch between personal and public

Modular Low cost mass market product Will become building block

• Platforms: TV, Stereoscopic, Advertising, VideoWalls etc• Process: Tiling, Jittering, Superposition, Steering

Page 38: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 38

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

Mitsubishi Pocket Projector

Mobility Limited Brightness but new Applications

All-in-one Display large with small device size Augment image overlay on real objects Communicate with tagged world (RFID, Sensors) Collaborate using shared projection

[email protected]

Page 39: Raskar Pocket Proj Fid2005presented

iSuppli Corporation22nd Annual Flat Information Displays Conference

Mitsubishi PocketProjector™

LED-Based DLP® Projector

Page 40: Raskar Pocket Proj Fid2005presented

FID 2005 – An iSuppli Event Slide 40

Mitsubishi Electric Research Labs Pocket Projectors Raskar, Nov 05Mitsubishi Electric Research Labs, Cambridge MA Pocket Projectors Raskar, Nov 05

END