Search Results (129)

Given its substantial contribution to traffic accidents, one of the main goals of intelligent driver-assistance systems has become the detection and mitigation of driver fatigue to enhance driving safety and comfort. Among various approaches, vision-based facial analysis using deep learning has emerged as an effective and non-intrusive method for identifying driver drowsiness, as a key manifestation of fatigue. However, current drowsiness detection models do not account for demographic factors like gender, even though recent research has shown gender behavioral differences such as eye closure duration, blink frequency, yawning patterns, and facial muscle relaxation. In this paper, we present a fine-grained multi-stream transformer architecture that incorporates gender-awareness and shifted-windows attention for spatial feature fusion. Integrating gender embedding, by modulating the region-based features, allows the model to effectively learn gender-conditioned drowsiness features to minimize bias and diluted representations. Using the NTHU-DDD dataset, we evaluated two-stream and three-stream variants for gender-aware and gender-agnostic across three facial region contexts: the face region with a 20% margin, bare face region, and key facial regions (face, eyes, and mouth). A comprehensive ablation study was conducted to identify the most effective model setup. The results demonstrate that incorporating gender embedding improves detection performance, achieving an accuracy of 95.47% on the evaluation set. Moreover, using the proposed three-stream model (SWT-DD-3S) produced better results. Full article

Driver fatigue detection (DFD) in low-light nighttime driving environments is crucial for road safety, but it remains challenging due to degraded image quality and computational constraints. This paper proposes a real-time three-stage framework specifically designed for nighttime driver fatigue detection, integrating low-light image enhancement, joint face and facial landmark detection, and geometry-based fatigue judgment. In the initial stage, the framework utilizes the Zero-Reference Deep Curve Estimation (Zero-DCE) algorithm to improve the visual quality of input images under low-light conditions. Subsequently, a novel lightweight single-stage detector, You Only Look Once for Joint Face and Facial Landmark Detection (YOLOJFF), is introduced for efficient joint localization. Finally, fatigue judgment is performed in real-time by calculating the Eye Aspect Ratio (EAR) and Mouth Aspect Ratio (MAR) from the detected landmarks and using a sliding time window strategy. Experimental results demonstrate that the enhancement module significantly improves detection performance. The YOLOJFF model achieves a favorable balance, with 90.9% precision, 87.6% mean Average Precision (mAP), and 5.2 Normalized Mean Error (NME), while requiring only 3.7 million (M) parameters and running at 107.5 FPS. The proposed framework provides a robust and efficient solution for real-time DFD in nighttime scenarios. Full article

Background/Objectives: Electroencephalography (EEG) is a promising modality for fatigue detection because it directly reflects neural states; however, it is hindered by the need for subject-specific calibration and its reliance on unstable labeling. Moreover, classical EEG features are sensitive to intrinsic brain rhythm variations, causing pronounced domain shifts that degrade performance across sessions and subjects. Methods: Motivated by the biological fatigue rebound mechanism, we propose a robust cross-subject metric which we name Short-Term Second-Order Differential Entropy (ST-SODE). ST-SODE effectively suppresses the interference of background brain rhythms, enhancing robustness to cross-domain drift; consequently, its one-dimensional output can provide an indication of fatigue states without additional model training. Results: ST-SODE is validated on the public driving fatigue regression dataset SEED-VIG and on a private Vigilance classification dataset based on the N-Back task. ST-SODE achieves a correlation coefficient of 0.56 on SEED-VIG dataset (vs. 0.4 for differential entropy, DE) and a binary classification accuracy of 93.75% on the Vigilance dataset, outperforming other EEG-based fatigue metrics. Conclusions: ST-SODE offers a reliable solution for deployment in fields such as driving, manufacturing, and healthcare, where it could reduce safety incidents caused by fatigue. Full article

Car accidents remain a leading cause of death worldwide, with drowsiness and distraction accounting for roughly 25% of fatal crashes in Ecuador. This study presents a real-time driver monitoring system that uses computer vision and deep learning to detect fatigue, distraction, and emotions from facial expressions. It combines a MobileNetV2-based CNN trained on RAF-DB for emotion recognition and MediaPipe’s 468 facial landmarks to compute the EAR (Eye Aspect Ratio), the MAR (Mouth Aspect Ratio), the gaze, and the head pose. Tests with 27 participants in both real and simulated driving environments showed strong results. There was a 100% accuracy in detecting distraction, 85.19% for yawning, and 88.89% for eye closure. The system also effectively recognized happiness (100%) and anger/disgust (96.3%). However, it struggled with sadness and failed to detect fear, likely due to the subtlety of real-world expressions and limitations in the training dataset. Despite these challenges, the results highlight the importance of integrating emotional awareness into driver monitoring systems, which helps reduce false alarms and improve response accuracy. This work supports the development of lightweight, non-invasive technologies that enhance driving safety through intelligent behavior analysis. Full article

Drowsy driving and sudden medical emergencies are major contributors to traffic accidents, necessitating continuous, non-intrusive driver monitoring. Since current technologies often struggle to balance accuracy with practicality, this study presents the design, fabrication, and validation of a smart steering wheel prototype. The device integrates dry-contact electrocardiogram (ECG), photoplethysmography (PPG), and inertial sensors to facilitate multimodal physiological monitoring. The system underwent a two-stage evaluation involving a single participant: laboratory validation benchmarking acquired signals against medical-grade equipment, followed by real-world testing in a custom electric research vehicle to assess performance under dynamic conditions. Laboratory results demonstrated that the prototype captured high-quality signals suitable for reliable heart rate variability analysis. Furthermore, on-road evaluation confirmed the system’s operational functionality; despite increased noise from motion artifacts, the ECG signal remained sufficiently robust for continuous R-peak detection. These findings confirm that the multimodal smart steering wheel is a feasible solution for unobtrusive driver monitoring. This integrated platform provides a solid foundation for developing sophisticated machine-learning algorithms to enhance road safety by predicting fatigue and detecting adverse health events. Full article

Driver fatigue detection based on electroencephalography (EEG) signals has gained increasing attention for enhancing road safety. However, existing deep learning models often treat EEG data as generic time-series inputs, neglecting the inherent hierarchical and spatial–temporal structure of brain activity, which limits their interpretability and generalization. To address this, we propose a novel Residual Polynomial Network (RPN) that explicitly models the positive and negative activation patterns in EEG signals through a polarity-aware architecture. The RPN integrates polarity decomposition, residual learning, and hierarchical feature fusion to capture discriminative neurophysiological dynamics while maintaining model transparency. Extensive experiments are conducted on a real-world driving fatigue dataset using a subject-wise 10-fold cross-validation protocol. Results show that the proposed RPN achieves an average classification accuracy of 97.65%, outperforming conventional machine learning and deep learning baselines including SVM, KNN, DT, and LSTM. Ablation studies confirm the effectiveness of each component, and Sankey diagram analysis provides interpretable insights into feature-to-class mappings. This work not only advances the state of the art in EEG-based fatigue detection but also offers a more transparent and physiologically plausible deep learning framework for brain signal analysis. Full article

Drowsy driving is a major contributor to road accidents, as reduced vigilance degrades situational awareness and reaction control. Reliable assessment of alertness versus drowsiness can therefore support accident prevention. Key gaps remain in physiology-based detection, including robust identification of microsleep and transient vigilance shifts, sensitivity to fatigue-related changes, and resilience to motion-related signal artifacts; practical sensing solutions are also needed. Using Electroencephalogram (EEG) recordings from the MIT-BIH Polysomnography Database (18 records; >80 h of clinically annotated data), we framed wakefulness–drowsiness discrimination as a binary classification task. From each 30 s segment, we extracted 61 handcrafted features spanning linear, nonlinear, and frequency descriptors designed to be largely robust to signal-quality variations. Three classifiers were evaluated—k-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Decision Tree (DT)—alongside a DT-based bagging ensemble. KNN achieved 99% training and 80.4% test accuracy; SVM reached 80.0% and 78.8%; and DT obtained 79.8% and 78.3%. Data standardization did not improve performance. The ensemble attained 100% training and 84.7% test accuracy. While these results indicate strong discriminative capability, the training–test gap suggests overfitting and underscores the need for validation on larger, more diverse cohorts to ensure generalizability. Overall, the findings demonstrate the potential of machine learning to identify vigilance states from EEG. We present an interpretable EEG-based classifier built on clinically scored polysomnography and discuss translation considerations; external validation in driving contexts is reserved for future work. Full article

Driving fatigue poses a serious threat to road safety. To detect fatigue accurately and thereby improve vehicle safety, this paper proposes a novel semi-dry electrode with the ability to automatically replenish the conductive fluid for monitoring driving fatigue. This semi-dry electrode not only integrates the advantages of both wet and dry electrodes but also incorporates an automatic conductive fluid replenishment mechanism. This design significantly extends the operational lifespan of the electrode while mitigating the limitations of manual replenishment, particularly the risk of signal interference. Additionally, this study adopts a transfer learning approach to detect driving fatigue by analyzing electroencephalography (EEG) signals. The experimental results indicate that this method effectively addresses the issue of data sparsity in real-time fatigue monitoring, overcomes the limitations of traditional algorithms, shows strong generalization performance and cross-domain adaptability, and achieves faster response times with enhanced accuracy. The semi-dry electrode and transfer learning algorithm proposed in this study can provide rapid and accurate detection of driving fatigue, thereby enabling timely alerts or interventions. This approach effectively mitigates the risk of traffic accidents and enhances both vehicle and road traffic safety. Full article

Driver fatigue is a primary factor in traffic accidents and poses a serious threat to road safety. To address this issue, this paper proposes a multi-feature fusion fatigue detection method based on an improved YOLOv8 model. First, the method uses an enhanced YOLOv8 model to achieve high-precision face detection. Then, it crops the detected face regions. Next, the lightweight PFLD (Practical Facial Landmark Detector) model performs keypoint detection on the cropped images, extracting 68 facial feature points and calculating key indicators related to fatigue status. These indicators include the eye aspect ratio (EAR), eyelid closure percentage (PERCLOS), mouth aspect ratio (MAR), and head posture ratio (HPR). To mitigate the impact of individual differences on detection accuracy, the paper introduces a novel sliding window model that combines a dynamic threshold adjustment strategy with an exponential weighted moving average (EWMA) algorithm. Based on this framework, blink frequency (BF), yawn frequency (YF), and nod frequency (NF) are calculated to extract time-series behavioral features related to fatigue. Finally, the driver’s fatigue state is determined using a comprehensive fatigue assessment algorithm. Experimental results on the WIDER FACE and YAWDD datasets demonstrate this method’s significant advantages in improving detection accuracy and computational efficiency. By striking a better balance between real-time performance and accuracy, the proposed method shows promise for real-world driving applications. Full article

Enhancing road safety requires an accurate assessment of the drivers’ mental states. The Driver Status Test App (DSTA) is designed to detect conditions such as intoxication, fatigue, and cognitive impairment in simulated driving environments. Utilizing a dual-platform approach, it integrates mobile data collection via React Native and Firebase with web-based management using React and TypeScript. The mobile application conducts real-time assessments of cognitive and motor functions, while the web interface offers data visualization, trend analysis, and results exportation. DSTA evaluates driver impairment through metrics such as tracking, precision, balance, and choice reaction, producing an objective impairment score. These assessments are rapid, scalable, and adaptable for various research and regulatory purposes. The composite scoring framework differentiates between impaired and unimpaired states, making DSTA valuable for driver training programs, regulatory assessments, and autonomous vehicle research, where monitoring human factors is crucial. Full article

Long COVID (LC), also known as post-acute sequelae of COVID-19 infection (PASC), is a heterogeneous and debilitating chronic disease that currently affects 10 to 20 million people in the U.S. and over 420 million people globally. With no approved treatments, the long-term global health and economic impact of chronic LC remains high and growing. LC affects children, adolescents, and healthy adults and is characterized by over 200 diverse symptoms that persist for months to years after the acute COVID-19 infection is resolved. These symptoms target twelve major organ systems, causing dyspnea, vascular damage, cognitive impairments (“brain fog”), physical and mental fatigue, anxiety, and depression. This heterogeneity of LC symptoms, along with the lack of specific biomarkers and diagnostic tests, presents a significant challenge to the development of LC treatments. While several biological abnormalities have emerged as potential drivers of LC, a causative factor in a large subset of patients with LC, involves reservoirs of virus and/or viral RNA (vRNA) that persist months to years in multiple organs driving chronic inflammation, respiratory, muscular, cognitive, and cardiovascular damages, and provide continuous viral antigenic stimuli that overstimulate and exhaust CD4⁺ and CD8⁺ T cells. In this review, we (i) shed light on persisting virus and vRNA reservoirs detected, either directly (from biopsy, blood, stool, and autopsy samples) or indirectly through virus-specific B and T cell responses, in patients with LC and their association with the chronic symptomatology of LC; (ii) explore potential mechanisms of inflammation, immune evasion, and immune overstimulation in LC; (iii) review animal models of virus reservoirs in LC; (iv) discuss potential T cell immunotherapeutic strategies to reduce or eliminate persistent virus reservoirs, which would mitigate chronic inflammation and alleviate symptom severity in patients with LC. Full article

Background/Objectives: Mental fatigue during driving, whether passive (arising from monotony) or active (caused by cognitive overload), is a critical factor for road safety. Despite the growing interest in monitoring techniques based on neurophysiological signals, current biomarkers are primarily validated only for detecting passive mental fatigue under monotonous conditions. The objective of this study is to evaluate the sensitivity of the MDrow index, which is based on EEG Alpha band activity, previously validated for detecting passive mental fatigue, with respect to active mental fatigue, i.e., the mental fatigue occurring in cognitively demanding driving scenarios. Methods: A simulated experimental protocol was developed featuring three driving scenarios with increasing complexity: monotonous, urban, and urban with dual tasks. Nineteen participants took part in the experiment, during which electroencephalogram (EEG), photoplethysmogram (PPG), and electrodermal activity (EDA) data were collected in addition to subjective assessments, namely the Karolinska Sleepiness Scale (KSS) and the Driving Activity Load Index (DALI) questionnaires. Results:The findings indicate that MDrow shows sensitivity to both passive and active mental fatigue (p < 0.001), thereby demonstrating stability even in the presence of additional cognitive demands. Furthermore, Heart Rate (HR) and Heart Rate Variability (HRV) increased significantly during the execution of more complex tasks, thereby suggesting a heightened response to mental workload in comparison to mental fatigue alone. Conversely, electrodermal measures evidenced no sensitivity to mental fatigue-related changes. Conclusions: These findings confirm the MDrow index’s validity as an objective and continuous marker of mental fatigue, even under cognitively demanding conditions. Full article

Fatigue and distracted driving are among the leading causes of traffic accidents, highlighting the importance of developing efficient and non-intrusive driver monitoring systems. Traditional camera-based methods are often limited by lighting variations, occlusions, and privacy concerns. In contrast, millimeter-wave (mmWave) radar offers a non-contact, privacy-preserving, and environment-robust solution, providing a forward-looking alternative. This study introduces a novel deep learning model, RTSFN (radar-based temporal-spatial fusion network), which simultaneously analyzes the temporal motion changes and spatial posture features of the driver. RTSFN incorporates a cross-gated fusion mechanism that dynamically integrates multi-modal information, enhancing feature complementarity and stabilizing behavior recognition. Experimental results show that RTSFN effectively detects dangerous driving states with an average F1 score of 94% and recognizes specific high-risk behaviors with an average F1 score of 97% and can run in real-time on edge devices such as the NVIDIA Jetson Orin Nano, demonstrating its strong potential for deployment in intelligent transportation and in-vehicle safety systems. Full article

Driving fatigue is a crucial factor affecting road traffic safety. Accurately assessing the driver’s fatigue status is critical for accident prevention. This paper explores the assessment methods of driving fatigue under different conditions based on multimodal physiological and behavioral data. Physiological data such as heart rate, brainwave, electromyography, and pupil diameter were collected through experiments, as well as behavioral data such as posture changes, vehicle acceleration, and throttle usage. The results show that physiological and behavioral indicators have significant sensitivity to driving fatigue, and the fusion of multimodal data can effectively improve the accuracy of fatigue detection. Based on this, a comprehensive driving fatigue assessment model was constructed, and its applicability and reliability in different driving scenarios were verified. This study provides a theoretical basis for the development and application of driver fatigue monitoring systems, helping to achieve real-time fatigue warnings and protections, thereby improving driving safety. Full article

Driving fatigued is a prevalent issue frequently contributing to traffic accidents, prompting the development of automated fatigue detection methods based on various data sources, particularly reliable physiological signals. However, challenges in accuracy, robustness, and practicality persist, especially for cross-subject detection. Multimodal data fusion can enhance the effective estimation of driver fatigue. In this work, we leverage the advantages of multimodal signals to propose a novel Multimodal Attention Network (TMU-Net) for driver fatigue detection, achieving precise fatigue assessment by integrating electroencephalogram (EEG) and electrooculogram (EOG) signals. The core innovation of TMU-Net lies in its unimodal feature extraction module, which combines causal convolution, ConvSparseAttention, and Transformer encoders to effectively capture spatiotemporal features, and a multimodal fusion module that employs cross-modal attention and uncertainty-weighted gating to dynamically integrate complementary information. By incorporating uncertainty quantification, TMU-Net significantly enhances robustness to noise and individual variability. Experimental validation on the SEED-VIG dataset demonstrates TMU-Net’s superior performance stability across 23 subjects in cross-subject testing, effectively leveraging the complementary strengths of EEG (2 Hz full-band and five-band features) and EOG signals for high-precision fatigue detection. Furthermore, attention heatmap visualization reveals the dynamic interaction mechanisms between EEG and EOG signals, confirming the physiological rationality of TMU-Net’s feature fusion strategy. Practical challenges and future research directions for fatigue detection methods are also discussed. Full article