Microvision Nomad Augmented Vision System - 國立臺灣大學web.phys.ntu.edu.tw/lclab/level2/11-1-LCD Application-A1.pdf · Microvision’s Nomad® Augmented Vision System: The

© 2003 Microvision, Inc.All Rights Reserved.

Microvision’s Nomad® Augmented Vision System: The How and the Why SID Pacific Northwest Chapter Meeting June 11, 2003

Microvision’s Nomad® Augmented Vision System:

The How and the Why

Thomas E. SankoVice President, Marketing

Microvision, Inc.June 11, 2003



Welcome to Microvision!

• AgendaIntroductionsMicrovision overviewHow does it workWhy should I careQ&ADemosAdjournDinner



Information in the Form of Light

Scanned Beam Technology Image

CaptureDisplays



Microvision Background

• Founded 1993NASDAQ: MVIS

• 180 employees15 PhD’s, 50 Engineers, & 25 Researchers

• Located in Bothell, WA67,500 Sq ft.Facility

• Strong Intellectual Property66 issued US patents89 plus US applications pendingOver 200 new disclosures

• Technical CapabilitiesImage Quality/ElectronicsPhotonics & OpticsScanner DevelopmentMEMS Testing and Clean RoomsEnvironmental TestingLow Volume Manufacturing



Microvision Partners



Near-eye Displays

• OccludedLook-around, look-downVirtual reality

• Non-occluded (see-through)Augmented visionAugmented reality



Nomad ND1000: How It Works

Dr. Lance EvansDirector, Display Products

Microvision, Inc.

June 11, 2003

• Product Overview• System Block Diagram• Scanned Beam Technology Overview• Image Quality

Topics:



Introducing Nomad ND1000

Display Resolution: SVGA 800 x 600 pixelsField of View: 23 x 17 degreesDisplay Color: Monochrome RedLuminance: 1 to 800 fLNo. of Gray Shades: up to 32 shadesHeadworn Weight: <18 ounces (502 gms)Eye Clearance: >20 mmDepth of Focus Adj: 1 ft. to InfinityOperating Environment: 0o to 45o C, 10 to 95% RHBattery life: up to 8 hours

NOMAD Augmented Vision System:Worlds’ First MEMS-based, see-through, daylight readable display



Nomad ND1000 Components

Display Module

Headgear

DM-VCEM Cable

Belt

VCEM

Video Source



Video/Control Electronics Module (VCEM)

Video & PowerConnectors

Brightness,Contrast,

Power on/off

Set-Up ModeIndicators

DM-VCEMCable



Nomad ND1000 Headgear



Technology Overview

How Scanned Beam Technology Works

• Single (triple for full color) light beam from LED or Laser Diode is sole light source

• Display raster (like CRT) is created from single scanning MEMS mirror

• Resultant image is delivered to eye via classical optics

Inherent Benefits

• LED/Laser Diode/Laser provides high brightness and efficiency, low cost

• Single MEMS mirror provides simplicity/low cost (DLP has hundreds of thousands of MEMS mirrors)

• CRT-like raster provides superior image quality

• Architecture allows for flexibility in design space



Nomad ND1000 Block Diagram

Video Control

External World Light

Light to Human Eye

SVGA or VGAVideo

SourceVideo In

A/D & FrameBuffer

(with Gamma andbrightness comp)

BatteryPower

D/A Laser Signal

Scanner DriveElectronics

Laser Shut Down

BufferBuffer

Vertical Drive

Horiz Drive

MEMsScanner

LaserDiode

Optical Combiner

FocusLens

LaserC

urrentSource

Drive

PhotoDiode

Video / ControlElectronics Module

Scanner Engine

Laser Assy

EPE

Scanner Interconnect

Scanner PZR Feedback

Opt

ic/M

echa

nica

l Ass

y

Scanner DSPControl

Display Module

Laser SafetyMonitor

Laser LightFeedback

BrightnessCntl

Scanner PositionFeedback

MonitorFunctionality

Monitor MTBF > 725,000 HrsMonitor MTBF > 725,000 Hrs

Per MIL-HDBK-217F(Worst Case, Commercial Components)



Display Module Opto-Mechanical Design(Isometric View)



Display Module Opto-Mechanical Design(Section View)

Exit Pupil Expander (EPE):• Diffractive Optic Element (DOE)• Micro Lens Array (MLA)

Laser Diode15 mW, 638 nm

Display Module Electronics

MEMS Scanner

Focus Lens

Fold MirrorViewer Optic



Nomad ND1000 Optics Path/Attenuation

BeamAperture

8 degreecone

Laser Diode modulationDuty cycle

12mm

15 mw LaserDiode

2-dimensionalScanning

MicroMirror

FocusingLens

Light Diffuser Made of Diffractive Optical Elements ReflectionMirror

Eye

OcularLens



Biaxial MEMS Scanner

Horizontal scan mirror

Vertical drive coils

Electrostatic drive plates

~7 mm

~7 mm

Packaged device sample

Micro-Electro-Mechanical Systems (MEMS) is the integration of mechanical elements, sensors, actuators, and electronics on a common silicon substrate

through the utilization of microfabrication technology.

Micro-Electro-Mechanical Systems (MEMS) is the integration of mechanical elements, sensors, actuators, and electronics on a common silicon substrate

through the utilization of microfabrication technology.



MEMS Mirror Parameters

• MEMS mirror size: 1.5mm x 1.5mm • Horizontal:

� Electrostatic drive� Bi-directional sinusoidal scan @resonance frequency� Scanning frequency: ~19,000Hz� Maximum mechanical scanning angle: +/- 5.5o

� Horizontal over-scan: 10%

• Vertical:� Sawtooth (ramp) electromagnetic drive� Vertical maximum mechanical scanning angle: +/- 3.8o

� Vertical scanning frequency: 60Hz



Display Performance Evaluation Station

CCD

Matroxframe

grabberCPU

Ocular

DOE

MEMS LD NomadTM

Display UUT

Test parameters:FOV

DistortionContrast ratio

Modulation depth

Test parameters:Maximum luminanceDynamic range ratio

Dimming ratioLuminance uniformity



Image Quality Data … Unit S/N 061 Summary

• Luminance: 864 fL• Dynamic Range: 51,739• Contrast Ratio: 197:1• Dimming Ratio: 3262:1



Image Quality Data … Contrast

860.00 5.18 699.00 3.28 fL

4.62 664.00 6.14 831.00 fL

833.00 7.74 684.00 3.87 fL

2.84 644.00 3.55 805.00 fL

Measured contrast 1: 161.7Calibration contrast 1: 894.6462

197.4Display Contrast = 1 :(for comparison purposes, the Contrast of a ViewSonic P817 CRT is: 174)



Image Quality Data … Code to Luminance

Nomad Serial No. 00061

0.01

0.1

1

10

100

1000

10000

0 50 100 150 200 250

Code (0-255)

Lum

inan

ce (f

L)

RedGreenBlue



Image Quality Data … Dynamic Range

White Screen: Black Screen: Dynamic Range:

714 0.01 51739

Luminance measurements in fL (measured with a 4mm aperture):(for comparison purposes, the Dynamic Range of a ViewSonic P817 CRT is: 210)



Image Quality Data … Uniformity

Nomad Serial No. 00114784 Point Luminance Uniformity

1 3 5 7 9 11 13 15 17 19 21 23 25 27S1

S6S11

S16S21

S26

0.0

100.0

200.0

400.0

500.0

600.0 500.000-600.000400.000-500.000300.000-400.000200.000-300.000100.000-200.0000.000-100.000300.0Luminance (fL)



Why should I care?

• Increased Productivity• Improved Quality• Enhanced Safety

It’s all about money!

$$$



Nomad Markets

• Military• Aerospace• Medical• Industrial



Application Categories

• Navigation, alignment, and positioning

• Electronic performance support systems

• Real-time monitoring



Nomad Applications

Marine Navigation

GIS SurveyingGPS Machine ControlMarine NavigationIndoor MeasurementVehicle Operation Precision Alignment

Computer-Assisted Ortho SurgeryUltrasound-Guided BrachytherapyUltrasound-Guided Needle Biopsy

Aerial Cartography Aerial SprayingAircraft NavigationAircraft Instrument Flight (private)Avionics OEM (Commercial / Business HUD)Firefighting (precision drop)

Navigation, alignment, and positioning

Real-time monitoring

Electronic performance support systems

Application Category

Market

Sensor VisionSecurity Intelligence/reconnaissance

Aviation MROVehicle MRO Military/

Government

Police Patrol/Fire & Emergency WarehousingSensor Vision Security Package Delivery

Aviation MROVehicle MRO Field Service Technicians Factory Machine MRO Utility Workers Wheel Alignment

Industrial

Critical Care/Anesthesia DisplayTelemedicine Clinical Info SystemsTelemedicine Medevac/EMTInterventional Cardiology

Image-Guided SurgeryMedical

Police Patrol/Fire & EmergencyAir AmbulanceEICAS (Engine instrument crew alert system for heavy lift)

Aviation preflight / flight check listsAircraft Operating Procedures / ManualGeneral

Aviation



Nomad Applications

ECG

John Doe • 540-78-9054 • BD

1/22/70

Critical Data

HR 71♥

BP 128/78

SpO2 70

Allergies: Penicillin Sulfa Drugs



Aerospace Applications



Aerospace Market Applications

• Precision Navigation & ControlAerial CartographyAerial SprayingAircraft Navigation (pilot)Aircraft Instrument Flight – GA (EFIS)Aircraft / Avionics OEMsFirefighting (precision drop)

• Computer-Aided ProceduresAviation preflight / check listsAircraft Operating Procedures



Benefits of Augmented Vision

• CRITICAL FLIGHT INFORMATION ALWAYS IN VIEWINCREASED SAFETY

Back-up to avionicsFOCUS on the Situation Outside the Cockpit

INCREASED PRODUCTIVITYREDUCED PILOT WORKLOAD (through reduced instrument scanning)

•

Moving Map Flight Instrument System(EFIS)



Benefits of Augmented Vision

Aerial SprayingThermal Imaging Aerial Cartography

• CRITICAL FLIGHT INFORMATION ALWAYS IN VIEWINCREASED SAFETY

Low passes require visual contact with terrain FOCUS on the Situation Outside the Cockpit (coverage and obstacles)

INCREASED PRODUCTIVITYREDUCED PILOT WORKLOAD (through reduced instrument scanning

INCREASED QUALITYFirst pass coverage (very accurate)Eliminates multiple passes to achieve full coverage



Military Applications



Military and Government ApplicationsMilitary and Government Applications

• Precision Navigation & ControlSoldier – digitized battlefieldAircraft – Digitization Without Aircraft ModificationUnmanned Vehicles – Aerial / GroundHomeland Security – port and coastal patrolVehicle Fire Control –Special Operations – Situational awareness

• Computer-Aided ProceduresMaintenance / Repair / OverhaulSimulation

• Real Time MonitoringMedicalSystems Monitoring



Soldier Systems

»CRITICAL MISSION INFORMATION ALWAYS IN VIEW

»SAFETY - Improved Situational Awareness

»head up »hands free

»PRODUCTIVITY - Increased operational effectiveness

»Accurate mission execution»Efficiency through battlefield digitization knowledge

»IMPROVED MISSION EFFECTIVENESS



Tactical Wireless Network

Increased Mission Effectiveness


»Blue Force (friendly) tracking

»Enemy locations identified


»Accurate mission execution

»Efficiency through battlefield digitization knowledge



Special Operations Forces

»Increased Mission Effectiveness

»Missions accomplished without incident


»Identified hazards

»Accurately mapped paths


»Efficiency through digitized knowledge



Medical Applications



Medical Segment ApplicationsMedical Segment

Navigation/Alignment/Positioning »Ultrasound-Guided Brachytherapy »Ultrasound-Guided Needle Biopsy»Computer-Assisted Orthopedic Surgery»Image-Guided Surgery

Electronic Performance Support Systems»Telemedicine & Clinical Info Systems»Radiologic Image Viewing

Real-Time Data Monitoring»Critical Care/Anesthesia Display»Telemedicine Medevac/EMT



General Medical BenefitsGeneral Medical BenefitsMedical Segment

Navigation/Alignment/Positioning »Productivity-Clinicians can see their hands, the target and the patient all at once»Quality-Improve outcomes, increase success rate, shorten procedure»Safety- Improve patient safety

Electronic Performance Support Systems»Productivity-Clinicians can see their hands, the target and the patient all at once»Quality-Improve outcomes, success rate shorten procedure»Safety- Improves patient safety

Real-Time Data Monitoring»Productivity- Clinicians can monitor critical patient data while performing other tasks»Quality – Improves response time in emergencies, allows clinician more time watching patient»Safety – Patient safety enhanced through faster response time



Specific Medical Benefits

Computer-Assisted Orthopedic Surgery (total knee replacement)•No need to look away at monitor

improves surgeon accuracy in positioning hands and toolscuts operative time improves concentration

•Increased implant accuracy provides longer implant service life improved patient gait fewer re-operations lower cost of care faster patient recovery

•Shorter procedure times Saves hospital money Faster patient recovery Reduces cost Improves patient satisfaction



Industrial Applications



Augmented Vision for Industry

Do It Faster … Better … Safer!



Faster, Better, Safer = Substantial ROI

•Customer SatisfactionGetting it right the first time, every time

Greater accuracyTimely job completion

•Increased Worker & Operation Efficiency•Reduced Training Costs•Reduced Downtime•Fewer Mistakes & Costly Re-dos•Extended Operating Hours•Enhanced Safety for Mobile Workers



Navigation/Alignment/Positioning

GIS Surveying Machine ControlHead-up, Hands-Free Precision Control

•Situational awareness•Productivity•Accuracy•Eliminate costly mistakes•Enhanced safety

H

0.000 m

Hz 390.4690 C + Ph

0.000 m

• Xyh Hz=0 ↑h/ihHOLD →2

Marine Navigation Indoor/Outdoor Precision Measurement

Laser TrackersMeasurement Arms



Electronic Performance Support

Automotive MRO Assembly & Testing

Aircraft MRO

See-ThroughTask Centric Data

•Eliminate wasted time finding data

•Get it right the first time, every time

•Eliminate guessing•Reduce downtime•Productivity gains – 40%



Real Time Monitoring

Process Control Sensor VisionJust in Time Data at the Critical Moment

Safety – Safety - Safety•Full situational awareness at all times

•Focus on hazardous environments & conditions

•Reduce Accidents



Honda Case Study

• Study: electrical diagnostic procedureA-B and B-A comparisons Nomad vs. conventional paper-based procedureUsed two different technicians

• Average time savings per task: 39%• Similar results obtained in

Precision manufacturing (Boeing)Ambulance maintenance (AMR)Construction machine control (Topcon)



Q&A

Q&A



Demonstrations

• Demo roomAugmented VisionAugmented Reality (with 3DOF head tracker)



Thanks for attending!

NASDAQ:MVIS

www.microvision.com

Documents

Microvision Nomad Augmented Vision System - 國立臺灣大學web.phys.ntu.edu.tw/lclab/level2/11-1-LCD Application-A1.pdf · Microvision’s Nomad® Augmented Vision System: The