driver fatiguedetector · 2019-12-18 · driver fatigue is 100,000 per year. ......

24
1 Department of Electrical and Computer Engineering Preliminary Design Presentation Driver Fatigue Detector Advisor: Professor Pouraghily Member: Jiong Wang Hongyu Ba Yachen Liu

Upload: others

Post on 05-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

1Department of Electrical and Computer Engineering

Preliminary Design Presentation

Driver Fatigue DetectorAdvisor: Professor PouraghilyMember: Jiong Wang

Hongyu BaYachen Liu

Page 2: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

2Department of Electrical and Computer Engineering

Team Members

Hongyu Ba Jiong Wang(leader) Yachen LiuHardware Hardware software

Page 3: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

3Department of Electrical and Computer Engineering

Contents

• Problem statement

• Feasibility analysis

• Design alternative

• Team roles and schedule

Page 4: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

4Department of Electrical and Computer Engineering

How significant is the problem?

• In China, The number of traffic accidents caused by driver fatigue is 100,000 per year.

• 71,000 people are injured in accidents by driver fatigue in China

• Worldwide, In the freight industry, 57% of fatal truck traffic accidents are due to driver fatigue.

Problem statement

Page 5: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

5Department of Electrical and Computer Engineering

The disadvantages of current products

• Mercedes-Benz:The "Blink Monitoring" systemØ driver's blink frequency and the duration of each closed eye.Ø only has a fatigue driving monitor for more than two million.

• “SMART EYE” Company in SwedenØ eye detection and facial expression detection.Ø multiple cameras

Problem statement

Page 6: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

6Department of Electrical and Computer Engineering

Problem statement

The aims of our design

• Non-invasive

• Continuous

• Real-time

• Accurate

Page 7: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

7Department of Electrical and Computer Engineering

Deoxyhemoglobin

Oxyhemoglobin

Activity/oxidation reaction

• Normally, the blood oxygen content maintains a relative dynamic balance.

breath/Oxygen supply

Feasibility Analysis

Page 8: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

8Department of Electrical and Computer Engineering

• Biology:Fatigue state The ability of HbR to bind the oxygen↓The activity needs to kept going The content of HbR ↑ and the content of HbO ↓.

Feasibility Analysis

Page 9: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

9Department of Electrical and Computer Engineering

• Clinical Medicine:Blood oxygen content < normal value The content of HbR ↑ and the content of HbO ↓ Main symptoms : fatigue, drowsiness and lethargy.

Feasibility Analysis

Page 10: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

10Department of Electrical and Computer Engineering

• The content of HbR and HbO in the blood can reflect the physiological state of the human body.

• the change of the two can be used to understand the activity level of the human body.

Feasibility Analysis

Page 11: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

11Department of Electrical and Computer Engineering

Feasibility Analysis

Page 12: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

12Department of Electrical and Computer Engineering

“Gold standard" for fatigue monitoring.

Feasibility Analysis

Reference:Zengyong L .Assessment of cerebral oxygenation during prolonged simulated driving using near infrared spectroscopy: its implicationsfor fatigue development Eur J Appl (2009) 107:281–287

Page 13: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

13Department of Electrical and Computer Engineering

• FNIRS (Functional Near Infrared Spectroscopy)

Ø Jobsis in 1977 demonstrated NIRS could detect the oxygen changes in blood

Ø HbR , HbO in the blood and theirtotal blood volume have three absorption peaks at 735 nm , 850 nm and 805nm respectively.

Reference:Jöbsis, F.F.(1977) Noninvasive, Infrared Monitoring of Cerebral and Myocardial Oxygen Sufficiency and Circulatory Parameters. Science, 198, 1264-1267.

Principle

Feasibility Analysis

Page 14: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

14Department of Electrical and Computer Engineering

PrinciplePhotoelectric Effect

This change in the electrical properties of the object due to the illumination of light is the photoelectric effect.

Ø the object emits electrons, Ø or changes the electrical conductivity of the object, Ø or causes the object to generate a photoelectromotive force.

Feasibility Analysis

Page 15: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

15Department of Electrical and Computer Engineering

• Two significant parameters: Ø Responding speedØ Sensitivity

Photoelectric Sensors

Feasibility Analysis

Page 16: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

16Department of Electrical and Computer Engineering

Multiple Photoelectric SensorsTypes Responding

speedSensitivity

Siliconphotodiode

Medium (10KHz) low

Avalanchephotodiode

Fast (>100MHz) High

Photomultipliertube(*)

Fast (>100MHz) high

Charge-coupleddevice

Slow (1KHz) medium

Feasibility Analysis

Page 17: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

17Department of Electrical and Computer Engineering

Design Alternatives

Capsules of the Cerebral Cortex

ARM FPGA

Alarm System

BuzzerPower Supply Unit

Light Controller Data Processing and Calculation

Light Source Driving Module

Near Infrared Source

A/D Conversion Module

Photoelectric Sensor

Page 18: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

18Department of Electrical and Computer Engineering

Reflected Light Signal

Electric Signal1

Electric Signal2

DigitalSignal

Emitted Light Signal

Brain to be Tested

Photosensitive Detector

Signal Processing Module

Analog to Digital Conversion Module

Design Alternatives

Signal Conversion Process

Page 19: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

19Department of Electrical and Computer Engineering

Design Alternatives

• DE1-SoC• HardwareØ FPGA -- Dealing with Data and

CalculationØ ARM -- Control Module• AlgorithmØ Light Source Driving AlgorithmØ Data operation Algorithm

Page 20: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

20Department of Electrical and Computer Engineering

Hardware• LEDsØ 735nm -- HbRØ 850nm – HbOØ 805nm -- blood volumn• Light Source Driver chipØ Driving three LEDs with different wavelength

Design Alternatives

Page 21: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

21Department of Electrical and Computer Engineering

Design Alternatives

Hardware• Photoelectric sensorØ Convert optical signals into analog signals

• A/D converterØ Convert analog signals into digital signals

Page 22: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

22Department of Electrical and Computer Engineering

Feasibility Analysis

Page 23: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

23Department of Electrical and Computer Engineering

Buget

Infrared Sources:50$ * 3 =150$AD Convertor : 70$Photoelectric Sensor :70$Driver chips : 30$Others : 150$Total : 470$

Page 24: Driver FatigueDetector · 2019-12-18 · driver fatigue is 100,000 per year. ... •Mercedes-Benz:The "Blink Monitoring" system Ødriver's blink frequency and the duration of each

24Department of Electrical and Computer Engineering

Fatigue Driving Detector

Thank you!Questions?