driver distraction management using sensor data cloud

Driver Distrac+on Management Using Sensor Data Cloud

Funded by: Informa0on Society Innova0on Fund (ISIF) Asia, 2013-‐2014

Presented by Dr. Md. Abdur Razzaque

Associate Professor, Dept. of Computer Science and Engineering & Group Leader, Green Networking Research Group, CSE, University of Dhaka

Email: [email protected] Web: hWp://gnr.cse.univdhaka.edu

Contents • Introduc)on to Driver Distrac)on • Driver Distrac)on Types, Trends, and Effects • What can be done to address it? • Death rates around the world due to road accidents • Bangladesh Scenario • Our solu)on methodology • Implementa)ons and benefits • Conclusion

2

Introduc)on

Driver Distrac+on Distracted driving is any ac)vity that could divert a person's aFen)on away from the primary task of driving. All distrac)ons endanger driver, passenger, and vehicle safety.

4

These types of distrac)ons include: Ø Tex)ng Ø Using a cell phone or Smartphone Ø Ea)ng and drinking Ø Talking to passengers Ø  Sickness, Tiredness and Micro sleep states Ø Grooming Ø Reading, including maps Ø Using a naviga)on system Ø Watching a video, Adjus)ng a radio, CD player, or MP3 player

Driver Distrac+on Types

5

Driver Distrac+on Trend

6

Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014

Effects of Distracted Driving

7

Young drivers are more risky

Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014 8

Young drivers are more risky


Death Tolls (in USA)

Source: hFp://ar)cles.la)mes.com/2010/sep/24/news/la-‐heb-‐distracted-‐driving-‐20100924 10

Ø  Approximately 0.5% increase per year

What can be done?

What can be done about it?


What can be done about it?

13

Effects of Driver Health Condi+on

Source: Na)onal Highway Traffic Safety Administra)on. Facts and Sta)s)cs. Available from hFp://www.distrac)on.gov/content/get-‐the-‐facts/facts-‐and-‐sta)s)cs.html. Accessed April 2, 2014

14

Death Rates per 100K Vehicles Rank Country Death Rate 1 Namibia 53.4 6 Thailand 42.9 20 Malaysia 34.5 67 China 20.8 77 India 18.7 90 Bangladesh 16.4 107 United States 13.9 109 South Korea 13.7 175 Singapore 5.3 180 United Kingdom 4.8 189 Japan 3.8 192 Maldives 2.4

Source: World Health Organiza)on -‐ 2011 15

Bangladesh Scenario

Bangladesh Scenario •  Poor level of study and analysis •  Poor measures to mi)gate road accidents •  3000 kilometer-‐long na)onal highways •  100 kilometers path is earmarked as high risk zone for accidents. •  37% of the accidents take place in the na)onal highways and 12% of the accidents occurred in the regional highways •  Virtually no measures have been taken to make the highways safe

Source: H.M. Ahsan, M.A. Raihan & M. Rahman, ”A study on car involvement in road traffic accidents in Bangladesh”, 1st Civil Engineering Congress, December 22-‐24, 2011, Dhaka, Bangladesh . 17

Annual Road Fatali+es in BD

Source: 3. ARI database, BUET 18

Death Tolls in BD Road Accidents

We are concerned of every vic)m who has lost their lives in road accidents. But fatali)es include some of the most influen)al persons and celebri)es. Some glimpse of them are… • On October, 1993, Jahanara Kanchan, the wife of a salient actor Ilias Kanchan had been killed in a road crash. • On March, 2007, Manjarul Islam Rana, a na)onal cricketer was killed in a motor bike accident. • On August, 2011, a severe road accident took lives of Mishuk Munier, a prominent producer and Tareq Masud, one the greatest director and film-‐maker along with other three people.

19

Death Tolls in BD Road Accidents…

• On October, 2012, South Asian Games gold-‐winning shooter and na)onal shoo)ng coach Firoz Hossain was killed in a fatal road accident along with his family. • On July 11, 2011, 44 school children were killed in road accident in ChiFagong. • On February 15, 2014, 7 school children were killed and 50 others were injured in a bus accident in Jessore. • Almost every year minibus accidents take several lives of the students of DU, BUET and many other universi)es. • The death toll is so severe in Bangladesh, the newspaper contains several reports on road accidents almost everyday.

20

Our Solu)on

Driver Distrac+on Management Using Sensor Data Cloud

Objec+ves

• Design and development of bio-‐signal monitoring system for drivers • Develop driver’s physical movement & driving performance monitoring system • Real-‐)me sensing data collec)on to server system • Develop cloud compu)ng system for processing data and making intelligent decisions • Build user friendly cloud data access interface

23

Sensed Data

•  Driver’s drunken status •  Blood pressure •  Body temperature •  Heart rate •  Drowsiness/Sleepy status •  Talking behavior •  Car loca)on and speed •  Engine status and control

24

Technologies Used

• Sensors and sensing systems • Embedded systems • Wireless communica)on systems • Cloud Compu)ng systems • Web services • Mobile Applica)ons

25

System Architecture

Alcohol sensor

Camera sensor

Temperature sensor

Embedded Controller System

26

Blood pressure Heart Rate

Contactless Temperature Sensor Module (TMP006)

27

• Working principle This sensor uses a thermopile to absorb the infrared energy emiFed from the object being measured and uses the corresponding change in thermopile voltage to determine the object temperature • Features 1) Sensor Voltage: 7 uV/C 2) Local Temperature: -‐40 C to +125 C 3) Supply Current: 3.7V ~ 5.0V 4) Temp Resolu)on (Max) (bits): 14 5) Interface: I2C,SMBus 6) Remote Sensor Accuracy (Max) (+/-‐ C): 3 7) Local Sensor Accuracy (Max) (+/-‐ C): 1

MQ-‐3 Alcohol level detector sensor

• Opera)ng voltage: DC 3-‐5V • Dual signal output (analog and TTL o/p • High sensi)vity and good selec)vity for ethanol vapor • Long service life and reliable stability • Rapid response and recovery characteris)cs • Size: 32mm x 22mm x 22mm(L * W * H) • Applica)on: For motor vehicle drivers and the other non-‐drinking workers on-‐site inspec)on, also for other places of ethanol vapor detec)on, alcohol detec)on range: 10 ~ 1000ppm.

28

High Defini+on Camera

•  Captures frames of images to scru)nize the driver’s lip movements to detect if the driver is talking •  We analyze driver’s eye blink rate to detect if the driver is drowsy or looking out of the road

29

Blood Pressure and Heart Rate

•  Blip care is a digital blood pressure monitoring device with great precision •  It is the world’s first Wi-‐Fi enabled BP monitoring device •  Paired with a Smartphone/RPi hotspot it can upload live data to its website

30

Signal Condi+oning and Data Acquisi+on System • Collects and formats the data from sensors • Sends the data to Raspberry PI

31

LCD Out

Level 3 Shiser

Output to Raspberry PI

Input from TEMP and ALCOHOL sensors

Power

Microcontroller

Raspberry PI

32

Wireless Communica+on Systems

• 3G/ HSPA Modem: •  We use it to transmit the data to cloud database from Raspberry PI. •  We u)lize the faster HSPA technology to ensure beFer connec)vity.

33

System

• Lab experiment at R&D phase:

34

GPS Module

• Loca)on • Speed • Direc)on • Engine Control • SOS Alarm • Area binding

35

System

• The module in real driving:

36

Data Storage and Cloud Services


• Our Requirements are: • Getng compu)ng facili)es for large amount of sensory data. • Getng secured, available and durable data storage for the collected data. • Getng automated management facili)es of the data storage and compu)ng units.

38


• We have employed…

Deployment Manager

39

User Interfaces and Web Services

User Interfaces and Web Services • Project website : hFp://driverdistrac)on.gnrbd.net/

41

Login Here

User Interfaces and Web Services • Project website : hFp://driverdistrac)on.gnrbd.net/

42

User Interfaces and Web Services Driver status Dashboard:

43


44

• Car Posi)on and speed


45

• Body Temperature Graph


46

• Body Temperature Graph


47

• Blood pressure graph:


48

• Alcohol graph:


49

•  Eye status:


50

•  Speaking or not speaking:


51

•  Speaking or not speaking:

Mobile Applica)on

Screenshot of User Applica+on

53

Detec+ng drunken driver using Mobile App

54

55

Detec+ng drunken driver using Mobile App

Feasibility

•  Technical Feasibility •  Further improvements in accuracy, reliability and robustness would make the system technically feasible

•  Economic Feasibility •  Reasonable CAPEX and OPEX for driver distrac)on management unit •  The system would ensure efficient vehicle resource management of a company or organiza)on, and thus it achieves economic benefits for them

•  Behavioral Feasibility •  Awareness and mo)va)on programs are required to make users understand the effec)veness of the driver distrac)on management unit

56

Prospec+ve Usage of Our System

• Bus companies • Transport pool management for company vehicles • Personal vehicle monitoring • Parental control on young drivers • Precision insurance supports • Driver performance database • Security and threat controls by Police

57

Benefits for Drivers

• In case of emergency, a driver can press the red buFon beneath the dashboard and the owner of the vehicle will be informed through SMS. • Insurance companies won’t be able to deny i n s u r an ce s uppo r t s how ing f a l s e acquisi)ons. • The driver distrac)on management system keeps driving records of a driver, which will help him to find a beFer job in the future.

58

Benefits for Drivers (cont…)

• Our system will provide drivers current health condi)on. As a result, the owners won’t enforce drivers to drive vehicles whenever the driver is physically distracted. • The system will help drivers avoid unexpected legal problems whenever accidents occur and the drivers are not responsible. • Finally, the system will contribute greatly to provide safety of driver’s life and property.

59

Project Team Members

60

Dr. Md. Abdur Razzaque Principal Inves)gator

Muhammad Enamul Hoque Chowdhury, Consultant

Amit Kumar Das Research Assistant

Tamal Adhikary Research Assistant

Md. Nazmus Sakib Miazi Research Assistant

Nusrat Mehajabin Research Assistant

Shuvra Chakrabarty Programmer

Media Coverage

61

Media Coverage

62

Our Projects

Completed Projects: • Design and Development of Precision Agriculture Management Informa0on System in Bangladesh •  Funded by: Ministry of Science and Technology (FY: 2012-‐2013), Government of Bangladesh

• Driver Distrac0on Management Using Sensor Data Cloud •  Funded by: Informa)on Society Innova)on Fund Asia (2013-‐2014)

• A Rule Based Bengali Stemmer •  Funded by: Code Crasers Interna)onal, Dhaka (2013)

Current Project: • Real Time Monitoring of Crop Diseases and Pests Using Image Sensor Network Technology •  Funded by: Ministry of Science and Technology (MoST), Government of Bangladesh (FY: 2013-‐2014)

63

Award giving ceremony in 8th IGF at Bali, Indonesia (Oct 2013)

64

Publica+ons

In last two and half years, GNR group has a number of publica)ons • 12 interna)onal journal papers (SCI/SCIE) with good impact factors • Seven IEEE/ACM conference papers • Seven manuscripts are now under review in reputed interna)onal journals and conferences.

The detailed ac0vi0es of the group is available at hWp://gnr.cse.univdhaka.edu

65

Conclusion

• In this work, we have developed a prototype for the proposed solu)on architecture. However, there are addi)onal challenges – • Efficient )mescale determina)on of sensory data collec)on • Ensuring accuracy, product reliability and availability • Deployment of driving performance monitoring sensor devices • Integra)ng all the components into a single product unit that can be delivered to the users • Test deployments of a good number of units in real fields • Fine tuning the hardware and sosware performances • We need more grants/funds to carry out rest of the ac)vi)es

66

driver distraction management using sensor data cloud

Internet