mems and sensors in automotive applications on the road to autonomous vehicles: hud and adas

Don’t just think outside the box. See outside the box.

MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADASJari HonkanenRev. 0.3; Nov 10, 2016

2 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.11/23/2016

What are Autonomous Vehicles? Self-driving cars with sensors [and MEMS] able to observe and understand surroundings

11/23/20163 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.

Agenda

Autonomous Vehicles• Evolution of Automation• Market Opportunity• Enabling Sensor Technologies • Case Study:

• MicroVision MEMS for HUD Applications• MicroVision MEMS for LIDAR Applications

• Conclusions & Call to Action


Evolution of Automation SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,

ranging from complete driver control to complete autonomy.

Levels 0-2: Human Driver monitors the driving environment

Source: MarketWatch research, SAE International


Automated Functions Today Manual Driving

Automatic Transmission Cruise Control ABS & Stability System Electric Power Steering

Assisted Driving – Human Driver in Control Adaptive Cruise Control Collision Warning System Lane Departure Warning Lane Keep Assist Head-Up Display (HUD)

Blind Spot Monitor Parking Assist Traffic Sign Recognition Adaptive High Beams


Evolution of Automation SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,

ranging from complete driver control to complete autonomy.

Levels 0-2: Human Driver monitors the driving environment

Levels 3-5: Automated Driving System monitors the driving environment


Automated Functions in the Future Automated Driving System in Control

Level 3: Within known, limited environments (such as freeways), the driver can safely turn their attention away from driving tasks.

Source: https://en.wikipedia.org/wiki/Autonomous_car

Level 4: The automated system can control the vehicle in all but a few environments such as severe weather. The driver must enable the automated system only when it is safe to do so. When enabled, driver attention is not required.

Level 5: Other than setting the destination and starting the system, no human intervention is required. The automatic system can drive to any location where it is legal to drive.


Market Opportunity: Evolution of Automotive Electronics Value in cars is shifting from chassis and drivetrain into electronics and sensors.

1950 1960 1970 1980 1990 2000 2010 2020 20300%

10%

20%

30%

40%

50%

60%

1%3% 4%

10%

15%

20%

30%

35%

50%

Automotive electronics cost as a percentage of total car cost (1950 - 2030)

Source: Statista


Market Opportunity: Growing Automotive Sales 2015 record auto sales in the U.S. at 17.5M

1990 - 1999 2000 - 2012 2013 2014 2015 2016 20200

20

40

60

80

100

120

39.2

52.57

68.65 71.17 72.37 74.39

100

Number of cars sold worldwide annually from 1990 to 2020 (in million units)

Source: Statista

Global car sales are expected to exceed 100 million units by 2020


Possible Sensor technologies for Autonomous Vehicles

Lidar

Camera

Radar

GPS

Ultrasonic

Odometry

Central Computer Inertial

Sensors


Sensors enabling Autonomous Vehicles to “see”

Source: Delphi

Camera• Camera records video interpreted by computer

vision algorithms.

• Pros: Can distinguish and classify objects, suchas signs, lane markings, traffic lights. May also be able to classify more complex objects suchas animals and pedestrians.

• Cons: Can only see what camera cansee, challenges in low light or brightsun light`



Source: Delphi

Radar• Car transmits radio waves and interprets the

back reflection from objects

• Pros: Can detect large objects and can easily calculate speed and distance. Works in all weather and lighting conditions, day or night.

•Cons: Cannot distinguish color or differentiate between objects. All same size objects look thesame.



Source: Delphi

LIDAR• Car transmits light pulses and interprets the

back reflection from objects

• Pros: Can detect specific objects and calculate distance. Can detect lines and edges of the road.Works during day and in the dark at night,

•Cons: In inclement weather, the light can reflect from rain, snow, or fog, reducing the effectiveness and detection range.


Sensor Technologies: One size does not fit all Autonomous Vehicles will utilize variety of sensor technologies Different Sensors have different strengths and weaknesses Multiple sensors for redundancy and safety Sensor Fusion

Source: Design News, April 2016

Case Study: MEMS for Automotive Head-Up Display (HUD)


Safety improvement for Assisted Driving - HUD• A Head-Up Display (HUD) overlays essential

information on top of the driving scene ahead so that the driver can consume the information without taking eyes of the road.

• Essential information may include • For Manual Driving:

• Speed• Gear & RPM• Navigation info

• For Assisted Driving: • Adaptive Cruise Control state• Lane Departure Warning• Blind Spot Warning• Obstacle Ahead Alert• Traffic Signs

Source: Continental


Application Industry Drivers Industry Growth

AR / VR Display 194%Personal Mobility

Heads-Up Display

27%Driver Safety & Infotainment

Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 – 2019, Source: TechNavio;

Case Study: MEMS for Automotive Laser HUD

Platform Technology

3D Imaging & Sensing

23.4%Information Capture

MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across multiple markets – at the heart of which is MicroVision’s MEMS scanner

Mobile Projection Anytime, Anywhere Content Sharing 32.4%


PicoP® Scanning Technology - Projection Display

Red laser

Green laserBlue laser

2D MEMSMicro mirror

Case Study: How PicoP® Scanning Technology Works

A single MEMS scanning mirror

in an extremely tiny, low power package


Case Study: PicoP® Scanning Technology for HUD

Optical Layout of MEMS Scanned Laser Virtual Image HUD

Realization of MEMS Scanned Laser Virtual Image HUD


Laser Scanning HUD installed in car

dash

Virtual image 1.5 - 2.5m away

Virtual image seen within eyebox

Image reflected off coated windshield or combiner

Case Study: MEMS Virtual Image HUD Overview


Case Study: Benefits of using MEMS Laser Scanning for HUD

Embedded

Aftermarket

Image Quality

• Highest Contrast Ratio• Widest Color Gamut• No Background Glow• Sunlight Readable

Display Performance

• High System Brightness• Large Field of View • Large Dimming Ratio• Small Display Engine Size• High Brightness / Power Ratio

Case Study: MEMS for Automotive Mid-Range LIDAR


Today: LIDAR in Autonomous Vehicle Prototypes• Single long-range LIDAR• Typically mounted on the roof of the car• Environmental mapping and modeling

Today’s Representative LIDAR Specs• Range: 100 – 150m• FOV: 360° x 30°• Data rate: 300k – 2.2M points/sec• Frame rate: 5 – 20Hz• Horizontal Resolution: 900 – 3,600• Vertical Resolution: 16 – 64• Price: $8K - $80K


Applications for mid-range high resolution computer vision

Rear collision warning

Parking Assist

Parking Assist

Cross traffic alert

Stop and Go

Blind Spot Detection

Curb Detection

Lane Assist and Departure warning


Application Industry Drivers Industry Growth

AR / VR Display 194%Personal Mobility

Heads-Up Display

27%Driver Safety & Infotainment

Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 – 2019, Source: TechNavio;

Case Study: MEMS for Automotive LIDAR

Platform Technology

3D Imaging & Sensing

23.4%Information Capture

MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across multiple markets – at the heart of which is MicroVision’s MEMS scanner

Mobile Projection Anytime, Anywhere Content Sharing 32.4%


2D MEMSMicro mirror

IR laser

IR Photodiode

Case Study: How MEMS Technology for mid-range LIDAR works

IR laser

IR laser

👈

👈


Case Study: Mid-Range Automotive LIDAR• Multiple cost effective mid-range LIDARs for performing

different functions• High resolution vision• Multiple sensors for redundancy and safety

Mid-Range LIDAR Target Specs• Range: 10-15m• FOV: 90° x 30°• Data rate: 5.5M points/sec• Frame rate: 30Hz• Horizontal Resolution: 512• Vertical Resolution: 360


Case Study: Benefits of using MEMS Laser Scanning for Mid-Range LIDAR

Low Persistence

(~15ns)

Enables blur free capture of moving

objects

Cost Effective

(Re-uses existing MEMS technology)

Enables new class of applications

Highest Resolution(~5.5M points/sec)

Enables advanced applications

Smallest Size(Thinnest at 6mm)

Enables new class of form factors

Dynamic(Programmable

Resolution and Frame Rate)

Enables both slower high resolution and

faster lower resolution captures depending on

the application or driving situation

Conclusion & Call-to-Action


Challenges ahead for Autonomous Vehicles (Trouble in Paradise)• Vehicle innovations tend to be realized more slowly than other technological advances due to their

high costs, slow fleet turnover and strict safety requirements. Technical obstacles that need to be addressed:

• Software reliability• Car’s sensing and navigation systems susceptibility to different types of weather conditions

or deliberate interference (jamming and spoofing)• Securing car’s central computer from hacking• Availability to high-quality, accurate, and up to date maps• Availability of radio spectrum for V2V (vehicle-to-vehicle) and V2I (vehicle-to-infrastructure)

communications• Legislation and regulations need to catch up:

• Implementation of legal framework and establishment of government regulations for autonomous vehicles.

• Insurance, who is liable for accidents of autonomous vehicles?

• Individual perceptions and attitudes need to evolve:• Resistance by individuals to forfeit control of their cars• Customer concern about the safety of driverless cars• Loss of driving-related jobs. Resistance from professional drivers and unions.


Conclusion & Call to Action • The value of cars are shifting from chassis and drivetrain to electronics,

sensors, and software.-> Large opportunity for MEMS & Sensors industry

• And finally, automation in cars can bring significant benefits to the society in large: reduced accidents and traffic fatalities, less pollution, increased productivity.

-> Opportunity to MEMS & Sensor industry to do good and do well at the same time

• However, designing MEMS to meet automotive quality standards can be challenging

-> Consider automotive requirements from the beginning

• Automotive supply chain can be complex and difficult to penetrate-> Look to partner with established OEM, Tier 1, or Tier 2 companies (depending on the application)

DON’T JUST THINK OUTSIDE THE BOX.SEE OUTSIDE THE BOX.

© 2016 MICROVISION, INC. ALL RIGHTS RESERVED.

PICOP IS A REGISTERED TRADEMARK OF MICROVISION, INC. ALL OTHER TRADEMARKS ARE THE PROPERTY OF THEIR RESPECTIVE OWNERS.