Next Article in Journal
Smart Portable Device Based on the Utilization of a 2D Disposable Paper Stochastic Sensor for Fast Ultrasensitive Screening of Food Samples for Bisphenols
Next Article in Special Issue
Wireless Link Selection Methods for Maritime Communication Access Networks—A Deep Learning Approach
Previous Article in Journal
A Rapid Prototyping Method for Sub-MHz Single-Element Piezoelectric Transducers by Using 3D-Printed Components
Previous Article in Special Issue
A Heterogeneous Ensemble Approach for Travel Time Prediction Using Hybridized Feature Spaces and Support Vector Regression
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unusual Driver Behavior Detection in Videos Using Deep Learning Models

1
Computer Science Department, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
2
Department of Computer Science and Information Technology, University of Sargodha, Sargodha 40100, Pakistan
3
Department of Computer Science, University of Management & Technology, Lahore 54770, Pakistan
4
Nautical Science Department, Faculty of Maritime Studies, King Abdulaziz University, Jeddah 22254, Saudi Arabia
5
Faculty of Computer Science and Information Technology, Virtual University of Pakistan, Lahore 54000, Pakistan
6
Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia
7
Department of Hydrographic Surveying, Faculty of Maritime Studies, King Abdulaziz University, P.O. Box 80401, Jeddah 21589, Saudi Arabia
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(1), 311; https://doi.org/10.3390/s23010311
Submission received: 1 August 2022 / Revised: 19 December 2022 / Accepted: 20 December 2022 / Published: 28 December 2022
(This article belongs to the Special Issue Application of Deep Learning in Intelligent Transportation)

Abstract

Anomalous driving behavior detection is becoming more popular since it is vital in ensuring the safety of drivers and passengers in vehicles. Road accidents happen for various reasons, including health, mental stress, and fatigue. It is critical to monitor abnormal driving behaviors in real time to improve driving safety, raise driver awareness of their driving patterns, and minimize future road accidents. Many symptoms appear to show this condition in the driver, such as facial expressions or abnormal actions. The abnormal activity was among the most common causes of road accidents, accounting for nearly 20% of all accidents, according to international data on accident causes. To avoid serious consequences, abnormal driving behaviors must be identified and avoided. As it is difficult to monitor anyone continuously, automated detection of this condition is more effective and quicker. To increase drivers’ recognition of their driving behaviors and prevent potential accidents, a precise monitoring approach that detects abnormal driving behaviors and identifies abnormal driving behaviors is required. The most common activities performed by the driver while driving is drinking, eating, smoking, and calling. These types of driver activities are considered in this work, along with normal driving. This study proposed deep learning-based detection models for recognizing abnormal driver actions. This system is trained and tested using a newly created dataset, including five classes. The main classes include Driver-smoking, Driver-eating, Driver-drinking, Driver-calling, and Driver-normal. For the analysis of results, pre-trained and fine-tuned CNN models are considered. The proposed CNN-based model and pre-trained models ResNet101, VGG-16, VGG-19, and Inception-v3 are used. The results are compared by using the performance measures. The results are obtained 89%, 93%, 93%, 94% for pre-trained models and 95% by using the proposed CNN-based model. Our analysis and results revealed that our proposed CNN base model performed well and could effectively classify the driver’s abnormal behavior.
Keywords: abnormal behaviors; drowsiness; driver; deep learning; human activity; surveillance abnormal behaviors; drowsiness; driver; deep learning; human activity; surveillance

Share and Cite

MDPI and ACS Style

Abosaq, H.A.; Ramzan, M.; Althobiani, F.; Abid, A.; Aamir, K.M.; Abdushkour, H.; Irfan, M.; Gommosani, M.E.; Ghonaim, S.M.; Shamji, V.R.; et al. Unusual Driver Behavior Detection in Videos Using Deep Learning Models. Sensors 2023, 23, 311. https://doi.org/10.3390/s23010311

AMA Style

Abosaq HA, Ramzan M, Althobiani F, Abid A, Aamir KM, Abdushkour H, Irfan M, Gommosani ME, Ghonaim SM, Shamji VR, et al. Unusual Driver Behavior Detection in Videos Using Deep Learning Models. Sensors. 2023; 23(1):311. https://doi.org/10.3390/s23010311

Chicago/Turabian Style

Abosaq, Hamad Ali, Muhammad Ramzan, Faisal Althobiani, Adnan Abid, Khalid Mahmood Aamir, Hesham Abdushkour, Muhammad Irfan, Mohammad E. Gommosani, Saleh Mohammed Ghonaim, V. R. Shamji, and et al. 2023. "Unusual Driver Behavior Detection in Videos Using Deep Learning Models" Sensors 23, no. 1: 311. https://doi.org/10.3390/s23010311

APA Style

Abosaq, H. A., Ramzan, M., Althobiani, F., Abid, A., Aamir, K. M., Abdushkour, H., Irfan, M., Gommosani, M. E., Ghonaim, S. M., Shamji, V. R., & Rahman, S. (2023). Unusual Driver Behavior Detection in Videos Using Deep Learning Models. Sensors, 23(1), 311. https://doi.org/10.3390/s23010311

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop