Microvision s Nomad Augmented Vision System: The How and the Why

Transcription

1 Microvision s Nomad Augmented Vision System: The How and the Why Thomas E. Sanko Vice President, Marketing Microvision, Inc. June 11, 2003

2 Welcome to Microvision! Agenda Introductions Microvision overview How does it work Why should I care Q&A Demos Adjourn Dinner

3 Information in the Form of Light Scanned Beam Technology Displays Image Capture

4 Microvision Background Founded 1993 NASDAQ: MVIS 180 employees 15 PhD s, 50 Engineers, & 25 Researchers Located in Bothell, WA 67,500 Sq ft.facility Strong Intellectual Property 66 issued US patents 89 plus US applications pending Over 200 new disclosures Technical Capabilities Image Quality/Electronics Photonics & Optics Scanner Development MEMS Testing and Clean Rooms Environmental Testing Low Volume Manufacturing

5 Microvision Partners

6 Near-eye Displays Occluded Look-around, look-down Virtual reality Non-occluded (see-through) Augmented vision Augmented reality

7 Nomad ND1000: How It Works Dr. Lance Evans Director, Display Products Microvision, Inc. June 11, 2003 Topics: Product Overview System Block Diagram Scanned Beam Technology Overview Image Quality

8 Introducing Nomad ND1000 NOMAD Augmented Vision System: Worlds First MEMS-based, see-through, daylight readable display Display Resolution: Field of View: Display Color: Luminance: No. of Gray Shades: Headworn Weight: Eye Clearance: Depth of Focus Adj: Operating Environment: Battery life: SVGA 800 x 600 pixels 23 x 17 degrees Monochrome Red 1 to 800 fl up to 32 shades <18 ounces (502 gms) >20 mm 1 ft. to Infinity 0 o to 45 o C, 10 to 95% RH up to 8 hours

9 Nomad ND1000 Components Display Module Headgear DM-VCEM Cable Belt VCEM Video Source

10 Video/Control Electronics Module (VCEM) DM-VCEM Cable Brightness, Contrast, Power on/off Set-Up Mode Indicators Video & Power Connectors

11 Nomad ND1000 Headgear

12 Technology Overview How Scanned Beam Technology Works Single (triple for full color) light beam from LED or Laser Diode is sole light source Display raster (like CRT) is created from single scanning MEMS mirror Resultant image is delivered to eye via classical optics Inherent Benefits LED/Laser Diode/Laser provides high brightness and efficiency, low cost Single MEMS mirror provides simplicity/low cost (DLP has hundreds of thousands of MEMS mirrors) CRT-like raster provides superior image quality Architecture allows for flexibility in design space

13 Nomad ND1000 Block Diagram Video / Control Electronics Module Display Module SVGA or VGA Video Source Video In A/D & Frame Buffer (with Gamma and brightness comp) Video Control D/A Laser Signal Laser Current Source Laser Assy Drive Laser Diode Battery Power Brightness Cntl Scanner DSP Control Laser Safety Monitor Scanner Position Feedback Laser Shut Down Laser Light Feedback Photo Diode Focus Lens Monitor Functionality Scanner Drive Electronics Scanner Engine Scanner Interconnect Buffer Buffer Horiz Drive Vertical Drive Scanner PZR Feedback MEMs Scanner Optic/Mechanical Assy Monitor Monitor MTBF MTBF > 725, ,000 Hrs Hrs EPE Per MIL-HDBK-217F (Worst Case, Commercial Components) External World Light Optical Combiner Light to Human Eye

14 Display Module Opto-Mechanical Design (Isometric View)

15 Display Module Opto-Mechanical Design (Section View) Display Module Electronics Laser Diode 15 mw, 638 nm MEMS Scanner Exit Pupil Expander (EPE): Diffractive Optic Element (DOE) Micro Lens Array (MLA) Focus Lens Viewer Optic Fold Mirror

16 Nomad ND1000 Optics Path/Attenuation 2-dimensional Scanning Micro Mirror Beam Aperture 8 degree cone 15 mw Laser Diode Focusing Lens Light Diffuser Made of Diffractive Optical Elements Reflection Mirror Laser Diode modulation Duty cycle Eye 12mm Ocular Lens

17 Biaxial MEMS Scanner Horizontal scan mirror ~7 mm Vertical drive coils ~7 mm Electrostatic drive plates Packaged device sample Micro-Electro-Mechanical Micro-Electro-Mechanical Systems Systems (MEMS) (MEMS) is is the the integration integration of of mechanical mechanical elements, elements, sensors, sensors, actuators, actuators, and and electronics electronics on on a a common common silicon silicon substrate substrate through through the the utilization utilization of of microfabrication microfabrication technology. technology.

18 MEMS Mirror Parameters MEMS mirror size: 1.5mm x 1.5mm Horizontal: Electrostatic drive Bi-directional sinusoidal frequency Scanning frequency: ~19,000Hz Maximum mechanical scanning angle: +/- 5.5 o Horizontal over-scan: 10% Vertical: Sawtooth (ramp) electromagnetic drive Vertical maximum mechanical scanning angle: +/- 3.8 o Vertical scanning frequency: 60Hz

19 Display Performance Evaluation Station Matrox frame grabber CPU MEMS LD Nomad TM Display UUT DOE CCD Test parameters: FOV Distortion Contrast ratio Modulation depth Test parameters: Maximum luminance Dynamic range ratio Dimming ratio Luminance uniformity Ocular

20 Image Quality Data Unit S/N 061 Summary Luminance: 864 fl Dynamic Range: 51,739 Contrast Ratio: 197:1 Dimming Ratio: 3262:1

21 Image Quality Data Contrast fl fl fl fl Measured contrast 1: Calibration contrast 1: Display Contrast = 1 : (for comparison purposes, the Contrast of a ViewSonic P817 CRT is: 174)

22 Image Quality Data Code to Luminance Nomad Serial No Luminance (fl) 10 Red Green Blue Code (0-255)

23 Image Quality Data Dynamic Range White Screen: Black Screen: Dynamic Range: Luminance measurements in fl (measured with a 4mm aperture): (for comparison purposes, the Dynamic Range of a ViewSonic P817 CRT is: 210)

24 Image Quality Data Uniformity Nomad Serial No Point Luminance Uniformity Luminance (fl) S6 S1 S26 S21 S16 S11

25 Why should I care? Increased Productivity Improved Quality Enhanced Safety It s all about money! $$$

26 Nomad Markets Military Aerospace Medical Industrial

27 Application Categories Navigation, alignment, and positioning Electronic performance support systems Real-time monitoring

28 Nomad Applications Application Category Market Navigation, alignment, and positioning Electronic performance support systems Real-time monitoring General Aviation Aerial Cartography Aerial Spraying Aircraft Navigation Aircraft Instrument Flight (private) Avionics OEM (Commercial / Business HUD) Firefighting (precision drop) Aviation preflight / flight check lists Aircraft Operating Procedures / Manual Police Patrol/Fire & Emergency Air Ambulance EICAS (Engine instrument crew alert system for heavy lift) Medical Computer-Assisted Ortho Surgery Ultrasound-Guided Brachytherapy Ultrasound-Guided Needle Biopsy Image-Guided Surgery Critical Care/Anesthesia Display Telemedicine Clinical Info Systems Telemedicine Medevac/EMT Interventional Cardiology Industrial GIS Surveying GPS Machine Control Marine Navigation Indoor Measurement Vehicle Operation Precision Alignment Aviation MRO Vehicle MRO Field Service Technicians Factory Machine MRO Utility Workers Wheel Alignment Police Patrol/Fire & Emergency Warehousing Sensor Vision Security Package Delivery Military/ Government Marine Navigation Aviation MRO Vehicle MRO Sensor Vision Security Intelligence/reconnaissance

29 Nomad Applications E C G John Doe /22/70 BD Critical Data HR 71 BP 128/78 SpO2 70 Allergies: Penicillin Sulfa Drugs

30 Aerospace Applications

31 Aerospace Market Applications Precision Navigation & Control Aerial Cartography Aerial Spraying Aircraft Navigation (pilot) Aircraft Instrument Flight GA (EFIS) Aircraft / Avionics OEMs Firefighting (precision drop) Computer-Aided Procedures Aviation preflight / check lists Aircraft Operating Procedures

32 Benefits of Augmented Vision Moving Map Flight Instrument System(EFIS) CRITICAL FLIGHT INFORMATION ALWAYS IN VIEW INCREASED SAFETY Back-up to avionics FOCUS on the Situation Outside the Cockpit INCREASED PRODUCTIVITY REDUCED PILOT WORKLOAD (through reduced instrument scanning)

33 Benefits of Augmented Vision Thermal Imaging Aerial Cartography CRITICAL FLIGHT INFORMATION ALWAYS IN VIEW Aerial Spraying INCREASED SAFETY Low passes require visual contact with terrain FOCUS on the Situation Outside the Cockpit (coverage and obstacles) INCREASED PRODUCTIVITY REDUCED PILOT WORKLOAD (through reduced instrument scanning INCREASED QUALITY First pass coverage (very accurate) Eliminates multiple passes to achieve full coverage

34 Military Applications

35 Military and Government Applications Precision Navigation & Control Soldier digitized battlefield Aircraft Digitization Without Aircraft Modification Unmanned Vehicles Aerial / Ground Homeland Security port and coastal patrol Vehicle Fire Control Special Operations Situational awareness Computer-Aided Procedures Maintenance / Repair / Overhaul Simulation Real Time Monitoring Medical Systems Monitoring

36 Soldier Systems»CRITICAL MISSION INFORMATION ALWAYS IN VIEW»SAFETY - Improved Situational Awareness»head up»hands free»productivity - Increased operational effectiveness»accurate mission execution»efficiency through battlefield digitization knowledge»improved MISSION EFFECTIVENESS

37 Tactical Wireless Network Increased Mission Effectiveness»SAFETY - Improved Situational Awareness»Blue Force (friendly) tracking»enemy locations identified»productivity - Increased operational effectiveness»accurate mission execution»efficiency through battlefield digitization knowledge

38 Special Operations Forces»Increased Mission Effectiveness»Missions accomplished without incident»safety - Improved Situational Awareness»Identified hazards»accurately mapped paths»productivity - Increased operational effectiveness»efficiency through digitized knowledge

39 Medical Applications

40 Medical Segment Applications Medical Segment Navigation/Alignment/Positioning»Ultrasound-Guided Brachytherapy»Ultrasound-Guided Needle Biopsy»Computer-Assisted Orthopedic Surgery»Image-Guided Surgery Electronic Performance Support Systems»Telemedicine & Clinical Info Systems»Radiologic Image Viewing Real-Time Data Monitoring»Critical Care/Anesthesia Display»Telemedicine Medevac/EMT

41 General Medical Benefits Medical Segment Navigation/Alignment/Positioning»Productivity-Clinicians can see their hands, the target and the patient all at once»quality-improve outcomes, increase success rate, shorten procedure»safety- Improve patient safety Electronic Performance Support Systems»Productivity-Clinicians can see their hands, the target and the patient all at once»quality-improve outcomes, success rate shorten procedure»safety- Improves patient safety Real-Time Data Monitoring»Productivity- Clinicians can monitor critical patient data while performing other tasks»quality Improves response time in emergencies, allows clinician more time watching patient»safety Patient safety enhanced through faster response time

42 Specific Medical Benefits Computer-Assisted Orthopedic Surgery (total knee replacement) No need to look away at monitor improves surgeon accuracy in positioning hands and tools cuts operative time improves concentration Increased implant accuracy provides longer implant service life improved patient gait fewer re-operations lower cost of care faster patient recovery Shorter procedure times Saves hospital money Faster patient recovery Reduces cost Improves patient satisfaction

43 Industrial Applications

44 Augmented Vision for Industry Do It Faster Better Safer!

45 Faster, Better, Safer = Substantial ROI Customer Satisfaction Getting it right the first time, every time Greater accuracy Timely job completion Increased Worker & Operation Efficiency Reduced Training Costs Reduced Downtime Fewer Mistakes & Costly Re-dos Extended Operating Hours Enhanced Safety for Mobile Workers

46 Navigation/Alignment/Positioning Head-up, Hands-Free Precision Control Situational awareness Productivity Accuracy Eliminate costly mistakes Enhanced safety GIS Surveying H m Hz C + P h m Xyh Hz=0 h/ih HOLD 2 Marine Navigation Machine Control Indoor/Outdoor Precision Measurement Laser Trackers Measurement Arms

47 Electronic Performance Support See-Through Task Centric Data Automotive MRO Assembly & Testing Eliminate wasted time finding data Get it right the first time, every time Eliminate guessing Reduce downtime Productivity gains 40% Aircraft MRO

48 Real Time Monitoring Just in Time Data at the Critical Moment Process Control Sensor Vision Safety Safety - Safety Full situational awareness at all times Focus on hazardous environments & conditions Reduce Accidents

49 Honda Case Study Study: electrical diagnostic procedure A-B and B-A comparisons Nomad vs. conventional paper-based procedure Used two different technicians Average time savings per task: 39% Similar results obtained in Precision manufacturing (Boeing) Ambulance maintenance (AMR) Construction machine control (Topcon)

50 Q&A Q&A

51 Demonstrations Demo room Augmented Vision Augmented Reality (with 3DOF head tracker)

52 Thanks for attending! NASDAQ:MVIS