driver monitoring how it works › wp-content › uploads › 2019 › 05...how it works introfilm...

28
Martin Krantz, CEO Smart Eye GSA Europe, München, 11 April 2019 Driver Monitoring How it works

Upload: others

Post on 06-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Martin Krantz, CEO Smart EyeGSA Europe, München, 11 April 2019

Driver Monitoring How it works

Page 2: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Introfilm från MILK

Page 3: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Bridging the gap

between man

and machine

by developing groundbreaking eyetracking technology that

understands, assists and predicts human intentions and actions

Page 4: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

IR light

Reflection

Iris + Pupil

Head + face

Smart Eye Hardware

Smart Eye Software

Multi – camerasolution

Behavioural insights

Page 5: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Made in Sweden

Page 6: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Automotive solutions

Research Instruments

Page 7: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

100 employees

Nasdaq First North (SEYE.ST)

20 years of experience

Global presence

Unique software and hardware products

Sweden HQGöteborg

US OfficeDetroit

China OfficeChongqing

Japan OfficeTokyo

Page 8: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Market leading in automotive and premium research-based eye tracking

Page 9: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Automotive Solutions

Page 10: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

The automotive evolution

Automotive Solutions

Page 11: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Global road accidents

1 200 000 casualties every year.

50 000 000 injuries every year.

Driver monitoring will reduce the numbers and eye tracking will be a key prerequisite for autonomous driving. Enabling

safe, sustainable transportation in the future.

Automotive Solutions

Page 12: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Infrared light is used to create a reflection on each eye´s cornea

Hardware -agnosticplatform

1

Page 13: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

2Image data capturedby camera

3In the SoC (System on Chip), Smart Eye’s algorithms then identify e.g. eye and head position, driver features, iris and pupil behaviour.

4The data is processed in different applications, deciding whether the driver is sleepy, inattentive or in a bad mood. The application may or may not be developed by Smart Eye

5The data sent over to the CAN (Car Area Network) - bus allows the application to interact with other subsystems

6Actuators receive commands to e.g. take over steering or send out a warning to the driver to stop.

Automotive Solutions

Page 14: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

The safety and conveniencefeatures oftomorrow

Page 15: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Passengermonitoring

Speechidentification

Alertness

Sleep HMIinteraction

Enhancedwarning system

Identication FullAi-suite

Automotive Solutions

Page 16: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Automotive Solutions

Page 17: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

EUROPEAN COMMISSION

”Europe on the Move”

EURO NCAP

”2025 Roadmap”

UNITED NATIONS

”Safer vehicles”

Automotive Solutions

Page 18: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Level 1 – Manual drive

Level 2 – Assisted driving

Level 2+ – Highly assisted driving

Level 3 – Fully automated on certified roads

Vehicle/ Driver

Driver

Driver

Driver

Level 4 – Fully automated on certified roads

Vehicle/Driver?

Level 5- Fully automated, no driver, certified roads

Vehicle

SAE automation level Responsibility HD map DMS

Required

Not required

Not required

Not required

Required

Required

FS, NCAP

FS, NCAP

NCAP

NCAP

FS, NCAP

Not required

VehiclesWith DMS

Driver monitoring vs. automation level

L2 L3 L4 L5New proposal EU GVSR 2018/0145(COD) mandates drowsiness and inattention warning

Page 19: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

BMW X3, X4, X5 and 8 coupe launched in 2018-19

Today Smart Eye software has been awarded for 43 car models with 6 different OEMs

Automotive Solutions

new platform, launch in 2020

Page 20: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Ai

Automotive Solutions

Page 21: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

DMS Facial Expressions

Fa

Page 22: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Body pose and action recognition

• Out of position

• Behaviour likeDrinking

SmokingDialing

• Interaction in between passengers

Page 23: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Object classificationForgotten items, baby seat occupation, driver state and gender

Page 24: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Feature detection

• Occupied seating positions

• Safety belt status

Page 25: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Automotive Supply chain

OEM Automotivemanufacturers

Tier 1 Supplies OEMs with complete systems

Tier 2 Supplies Tier 1:s with parts for a system

Customer application

Smart Eye embedded software

Page 26: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

Two decadesof research

available

Time to market

Evaluation kit

Production Program

Automotive Solutions

Page 27: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

One insightat a time

Page 28: Driver Monitoring How it works › wp-content › uploads › 2019 › 05...How it works Introfilm från MILK Bridging the gap between man and machine by developing groundbreaking

See further