Next Article in Journal
Blind Cyclostationary-Based Carrier Number and Spacing Estimation for Carrier-Aggregated Direct Sequence Spread Spectrum Cellular Signals
Previous Article in Journal
Exploring and Visualizing Multilingual Cultural Heritage Data Using Multi-Layer Semantic Graphs and Transformers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals

by
Wenwen Chang
,
Wenchao Nie
*,
Renjie Lv
,
Lei Zheng
,
Jialei Lu
and
Guanghui Yan
School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
*
Author to whom correspondence should be addressed.
Electronics 2024, 13(18), 3742; https://doi.org/10.3390/electronics13183742
Submission received: 31 August 2024 / Revised: 14 September 2024 / Accepted: 18 September 2024 / Published: 20 September 2024
(This article belongs to the Section Bioelectronics)

Abstract

:
Monitoring the driver’s physical and mental state based on wearable EEG acquisition equipment, especially the detection and early warning of fatigue, is a key issue in the research of the brain–computer interface in human–machine intelligent fusion driving. Comparing and analyzing the waking (alert) state and fatigue state by simulating EEG data during simulated driving, this paper proposes a brain functional network construction method based on a phase locking value (PLV) and phase lag index (PLI), studies the relationship between brain regions, and quantitatively analyzes the network structure. The characteristic parameters of the brain functional network that have significant differences in fatigue status are screened out and constitute feature vectors, which are then combined with machine learning algorithms to complete classification and identification. The experimental results show that this method can effectively distinguish between alertness and fatigue states. The recognition accuracy rates of 52 subjects are all above 70%, with the highest recognition accuracy reaching 89.5%. Brain network topology analysis showed that the connectivity between brain regions was weakened under a fatigue state, especially under the PLV method, and the phase synchronization relationship between delta and theta frequency bands was significantly weakened. The research results provide a reference for understanding the interdependence of brain regions under fatigue conditions and the development of fatigue driving detection systems.

1. Introduction

According to statistics from the Ministry of Public Security of China, as of the end of September 2023, China’s motor vehicle ownership reached 430 million, with an increase of more than 10 million over the last year, and the trend in growth has been maintained every year. The continuous growth in the number of motor vehicles has brought tremendous pressure to traffic safety. Among the many factors that lead to traffic accidents, fatigue driving is one of the most common causes. Fatigue is defined as a state of decreased physical or mental activity, which usually occurs when people engage in physical or mental activities for a long time, and affects their daily life [1]. Fatigue driving refers to the decline in physical function caused by the driver’s continuous driving for a long time or insufficient rest [2]. The state may make it difficult for the driver to stay alert, resulting in the driver’s lack of concentration, increased reaction time, and weakened judgment and decision-making ability, thereby increasing the risk of traffic accidents. According to statistics, about 20–30% of traffic accidents are caused by fatigue driving, 5% to 15% of accidents result in death, and about 50% of people have experienced fatigue driving [3].
Therefore, it is crucial to monitor the driver’s physical condition through wearable sensing devices and provide accurate warnings and interventions on possible fatigue states in order to improve the reliability of the driving system and ensure driving safety. At present, the detection methods for fatigue driving are roughly divided into subjective detection methods and objective detection methods [4]. Subjective detection methods include filling out questionnaires and subjective evaluation scales [5,6]. In objective detection, the first category is based on analysis of the vehicle’s motion parameters [7], such as lane position and the standard deviation of steering wheel motion [8]. The second category is based on analysis of the driver’s facial expressions and eye tracking data [9,10]. The third category is based on the driver’s physiological signals, including Electrocardiogram (ECG) [11], Electrooculogram (EOG) [12], Electromyography (EMG) [13], and Electroencephalogram (EEG) [14]. Subjective detection methods usually serve as auxiliary means in fatigue driving detection. Among objective detection methods, the methods based on vehicle motion parameters and human external features are easily affected by road conditions and lighting levels. In contrast, detection based on physiological signals can accurately assess the driver’s fatigue and mental state. Among them, EEG signals can directly and objectively reflect the current mental state of the brain due to their high temporal resolution and the wearable and portable nature of the acquisition equipment. It is considered to be the most effective method for fatigue driving identification [14].
In recent years, scholars have conducted a series of tests on the process of fatigue driving based on EEG signal collection and analysis. Zeng et al. [14] used two feature extraction methods, power spectral density (PSD) and empirical mode decomposition (EMD). They decomposed the data into multiple intrinsic mode function (IMF) components through EMD, extracted the features of each IMF component, combined these components at the feature points to form the feature vector of the EEG, and used Support Vector Machine (SVM) and K-Nearest Neighbors (KNN) for classification, with an average accuracy of over 80%. Chinara et al. [15] proposed a sleepiness detection model based on single-channel EEG signals, using wavelet packet transform to extract the time domain features of EEG signals, and achieved a relatively good accuracy. Rashid et al. [16] proposed a new channel-selection algorithm based on a correlation coefficient and an integrated classifier based on the random subspace k-nearest neighbor to improve the classification performance of EEG data in driver fatigue detection. The robustness of the method was verified by extracting features using PSD. Experimental results show that the combination of a correlation coefficient, PSD, and KNN can improve the accuracy of a driver fatigue detection system based on EEG signals. Gao et al. [17] proposed a convolutional recurrent neural network based on a log-Mel spectrum (LogMel-CRNN) for fatigue driving detection. First, EEG signals are subjected to one-dimensional convolution to achieve short-time Fourier transformation, and the log-Mel spectrum is obtained through the Mel filter group. The obtained log-Mel spectrum is then input into the fatigue detection model to complete the fatigue detection task of EEG signals, with an accuracy rate of over 80%. Zhang et al. [18] proposed a multidimensional feature selection and fusion method based on EEG signals to identify the mental fatigue of drivers. The corresponding time domain, frequency domain, and nonlinear features were generated in the corresponding bands. On this basis, a three-layer feature selection method based on logistic regression, one-way analysis of variance, and recursive feature elimination was proposed to solve the problem of feature redundancy, and a good accuracy rate was achieved on SVM. Wang et al. [19] proposed a driving fatigue detection method based on a brain functional network. In the construction of a brain functional network, partial directional coherence was used to calculate the correlation between EEG signal channels. Then, a support vector machine was used as a classifier to extract graph-related features for fatigue detection. The results showed that low-frequency rhythms are easier to identify than high-frequency rhythms. Wang et al. [20] studied the effect of fatigue driving on the reorganization of dynamic functional connections through temporal brain network analysis, and quantitatively compared the alert and fatigue states in a simulated driving experiment. The study found that the spatiotemporal topological structure of dynamic functional connections was significantly disintegrated, which was manifested as reduced global temporal efficiency and increased local temporal efficiency in the fatigue state. In particular, the frontal lobe and parietal lobe were shown to be the brain areas most susceptible to fatigue driving. Qin et al. [21] proposed a method based on directed brain networks of EEG signals to reveal the impact of driving fatigue on the brain’s information processing ability. Based on the EEG signal current source density obtained by source analysis, a directed brain network of fatigue driving was constructed using a directed transfer function. The study found that the average clustering coefficient and average path length gradually increased with the increase in driving time. Especially in the theta band, there were obvious differences in the networks under awake and fatigue driving states. Zhou et al. [22] proposed a driving fatigue detection method based on a functional brain network and studied the optimal combination of features and algorithms. First, the correlation between each EEG signal channel was calculated using the Pearson correlation coefficient to construct a functional brain network. Then, the functional brain network features were extracted and combined, and different machine learning algorithms were used as classifiers for fatigue detection. Finally, the optimal combination of features and algorithms was obtained.
At present, the feature extraction of fatigue driving occurs mostly in the time domain, frequency domain, and time–frequency domain. There are few descriptions of the spatial domain activity characteristics of the driver’s brain activity in the fatigue state during driving. More in-depth discussions are needed on the spatial characteristics of brain activities corresponding to the driving process. The mining and learning of spatial domain features can provide new ideas and methods for representing and identifying fatigue driving characteristics. In view of this, this paper proposes a fatigue driving detection method based on the spatial characteristics of EEG signals. Firstly, based on the PLV and PLI methods, the functional brain networks of the five frequency bands of EEG signals are constructed and the characteristics are analyzed, respectively, to reveal the spatial network structure characteristics corresponding to the driving process. Then, through the statistical analysis of the network feature parameters, the feature parameters sensitive to fatigue and alertness are selected to form feature vectors. Finally, the machine learning algorithm is used to classify and identify the above results. The results of this study demonstrate that the PLV method is an efficient and successful EEG signal feature extraction technique. It also shows that EEG signals can be a promising tool for fatigue driving detection in actual driving tasks and have great potential in future research. The roadmap of this study is shown in Figure 1.

2. Materials and Methods

2.1. Description of Dataset

This paper uses the public dataset of simulated driving tasks released by National Chiao Tung University [23], which includes 52 simulated driving experiments and EEG data collection. The subjects were aged between 22 and 28 years old and were required to participate in a continuous driving task at a speed of 100 km/h. The experiment simulated a driving situation on a four-lane highway at night, requiring the subjects to keep the vehicle in the center of the lane. Lane deviation events were randomly introduced during driving, which induced the vehicle to deviate from the original driving lane to both sides. When the deviation occurs, the subject needs to immediately correct the vehicle trajectory by adjusting the steering wheel, which is the start of the reaction, and drive the vehicle back to the original driving lane, which is the end of the reaction, thus completing a trial experiment. The interval between two experiments is 5–10 s. While the subjects were completing the above driving tasks, their EEG signals were collected synchronously. During driving, EEG signals were collected using 32-channel international standard Ag/AgCl EEG electrodes, including 30 EEG signal electrodes and 2 reference electrodes. The contact impedance between all electrodes and the skin was kept below 5 kΩ, and the online sampling rate of the EEG signals was 500 Hz. The experimental scene and paradigm are shown in Figure 2.

2.2. Data Preprocessing

The EEGLAB toolbox was used to preprocess the EEG data. Based on the conclusions in the literature [24,25], the first 10 min after the start of the experiment were defined as the alert driving state, and the last 10 min of the experiment were defined as the fatigue driving state. There are four types of events in the experiment, deviation onset (left), deviation onset (right), response start, and response end. In this study, only events with the response start type are considered. Referring to the conclusions of the existing literature [26,27], the 2 s before the response start and the 4 s after the response start are taken as one epoch (6 s). The 52 experiments were divided into two groups according to the experimental duration. The first group had an experimental time of 60 min, and the second group had an experimental time of 90 min. This was to facilitate a comparative analysis of the experimental results. According to the results in the literature [28], the driving process of the subjects in both groups of experiments reached the level of fatigue. Since the number of epochs in each experiment was different, the minimum number of epochs in all experiments was 33. In order to facilitate unified processing, 33 was selected as the number of epochs corresponding to alert driving and fatigue driving for each subject. In the end, a total of 3432 epochs were obtained in the two groups of experiments, which were used to complete the subsequent spatial network structure feature analysis. Finally, the EEG signal was filtered into five frequency bands: delta (1–4 Hz), theta (4–8 Hz), alpha (8–13 Hz), beta (13–30 Hz), and gamma (30–50 Hz).

2.3. Functional Brain Network Construction

The brain is the human body’s advanced nerve center and the biological basis of human intelligence and complex thinking. Since driving behavior is a comprehensive and complex cognitive process, which includes decision-making ability, execution ability, spatial perception, and visual information processing, it requires the coordination of each brain region to complete. Therefore, measuring the brain activity state and fatigue level during driving from the perspective of the whole brain can provide new specific indicators for fatigue driving detection and identification. This paper will use the phase locking value and phase lag index algorithms to construct a functional brain network.
Phase synchronization analysis is often used to evaluate the interdependence between different brain regions. Compared with analysis methods based on amplitude correlation, it is less susceptible to volume conduction effects and provides a richer representation of interdependence. Lachaux et al. [29] proposed a method that can directly quantify the transient phase locking between two neural electrical signals. The phase locking value (PLV) is calculated using the relative phase difference to characterize the phase synchronization degree and information transmission process between the two signals. It is very suitable for measuring the synchronization between EEG signals of each channel. Phase-based methods have achieved good results in other areas of EEG signals. Wang et al. [30] proposed a multi-channel EEG emotion recognition method based on a PLV and graph convolutional neural network. The multi-channel EEG features were modeled as graph signals using a brain network built based on a PLV, and EEG emotion classification was performed on this basis. Experiments were conducted on the emotional EEG datasets SEED and DEAP datasets, and the accuracy of both datasets exceeded 70%. Cui et al. [31] calculated the PLV of EEG signals under different emotional states and combined the CNN model to classify the emotional states in five frequency bands. The results showed that the model can recognize EEG emotions with an accuracy rate of 85%, proving the effectiveness of the phase-based method. Xi et al. [32] designed and conducted a series of memory experiments with different memory loads or target forms, while collecting EEG signals. After slicing the EEG signals, the PLV of the Gamma frequency band was calculated, and the brain functional network was constructed after binarization. The extracted network characteristics were input into the machine learning model for classification, and good performance was achieved.
The following are used the steps to calculate PLV:
First, the instantaneous phase of the signal is calculated using the Hilbert transform; θ a t represents the instantaneous phase locking value at time point a:
θ a t = arctan x ~ ( t ) x ( t )
x ~ ( t ) is the Hilbert transform of x ( t ) , and the transformation formula is as follows:
H [ x ( t ) ] = x ( t ) 1 π t = 1 π + x ( τ ) t τ d τ = x ~ ( t )
Then, calculate the PLV:
PLV = 1 N t = 1 N e j θ a t θ b t
where θ a t θ b t represents the phase difference between two time points; n represents the total number of sampling points of the EEG signals. In this study, since the epoch length is 6 s and the sampling rate is 500 Hz, n = 500 × 6 = 3000. The PLV ranges from 0 to 1. The larger the value, the stronger the correlation between the two channels.
The Phase Lag Index (PLI) is used to measure the asymmetry of the phase difference distribution between two signals. The value of the PLI is also between 0 and 1. A value of 0 means no coupling or coupling with a phase difference centered on 0 mod π . The closer to 1, the stronger the phase synchronization. The following are the steps to calculate the PLI:
PLI = s i g n Δ φ t = 1 N t = 1 N s i g n Δ φ t
Δ φ t represents the phase difference between two time points; n is also 3000.
For the 30-channel EEG data, using all epoch data segments corresponding to the fatigue state and alert state, construct the corresponding functional brain network based on the PLV and PLI for the five sub-bands of EEG signals, and expresses it in the form of an adjacency matrix (30 × 30), and complete the calculation of the PLV matrix and PLI matrix for all subjects in turn. Figure 3 shows the electrode position diagram of 30-channel EEG signals.
The electrodes corresponding to rows 1–30 of the adjacency matrix are FP1, FP2, F7, F3, FZ, F4, F8, FT7, FC3, FCZ, FC4, FT8, T3, C3, CZ, C4, T4, TP7, CP3, CPZ, CP4, TP8, T5, P3, PZ, P4, T6, O1, OZ, and O2. Among them, FP1, FP2, F7, F3, FZ, F4, and F8 are located in the frontal lobe; FC3, FCZ, FC4, C3, CZ, C4, CP3, CPZ, CP4, P3, PZ, and P4 are located in the parietal lobe; FT7, FT8, T3, T4, TP7, TP8, T5, and T6 are located in the temporal lobe; and O1, OZ, and O2 are located in the occipital lobe.

2.4. Network Characteristic Measures

Functional brain topology networks can intuitively characterize the interdependence between different brain regions, but the quantitative analysis of network structure needs to be carried out through the statistical description of the characteristic parameters of the network and their relationships, which helps to describe the changing process of the interdependence between brain regions. There are four common characteristic parameters in brain networks:
(1)
Degree (D): indicates the importance of the node in the network.
(2)
Betweenness Centrality (BC): Reflects the importance of a node. The calculation formula is as follows:
B C i = i s t p s t i p s t
where p s t represents the number of all shortest paths from node s to t, and p s t i represents the number of shortest paths passing through node i among all the shortest paths from node s to t.
(3)
Local Efficiency (LE): Represents the efficiency of information transmission between each node and its neighbors in the network, reflecting the connection strength and efficiency of the node in its local neighborhood. The calculation formula is as follows:
L E = 1 N G i ( N G i 1 ) i j G i 1 d i j
where G i represents the graph consisting of node i and its neighboring nodes; d i j represents the distance between node i and node j.
(4)
Clustering Coefficient (CC): Measures the clustering of nodes in the network, which measures the degree of interconnection between a node and its neighboring nodes. The clustering coefficient calculation formula of nodes in the network is as follows:
C i = E i k i ( k i 1 ) / 2 = 2 E i k i ( k i 1 )
where k i represents the number of adjacent nodes of node i; E i represents the actual number of edges between node i and its k i neighbor nodes.
The clustering coefficient of the network can be expressed as
C N = 1 N i = 1 N C i
where n represents the number of nodes in the network.

3. Experiments and Results

3.1. PLV Average Matrix and PLI Average Matrix

The PLV matrix and PLI matrix constructed in each frequency band under the alert state and fatigue state in the two groups of experiments were averaged. Figure 4a,b and Figure 5a,b show the averaged PLV matrix and PLI matrix of the first and second groups of experiments, respectively. The PLV intensity and PLI intensity of the EEG channel are represented by color bars ranging from blue (close to 0) to yellow (close to 1).
It can be seen intuitively from the figure that in each group of experiments, there are certain differences in each sub-band under the alert driving state and the fatigue driving state. It is more obvious in the PLV method, especially in the connection strength of the delta and theta bands. The value of PLV in the alert state is significantly higher than that in the fatigue state. This shows that in the alert state, the synchronization between various brain regions is stronger and information transmission is more effective. In the fatigue state, this synchronization is weakened, which may lead to a decline in brain function and a decrease in reaction speed. The difference in connection strength in the gamma band is not as obvious as in other bands, which indicates that the brain may work relatively stably in the high-frequency band in alert and fatigue states, and is not as susceptible to state changes as the low-frequency band. Because it is the result after the overall average, this intuitive difference shows obvious specificity in the network structure.

3.2. Threshold Selection

In the process of network construction, as shown in Figure 3, the electrode positions of the 30 channels were defined as nodes, and the PLV and PLI values between different nodes were defined as the connecting edges of the network, so as to obtain the corresponding functional brain network topology. In the process of using PLV and PLI to measure the phase dependence between two electrodes, due to the presence of noise in the signal, there are often certain weak connection edges, which cannot represent the true connection relationship between brain regions. Therefore, it is necessary to select a threshold for screening and then eliminate the weak connection edges.
Shown in Figure 6a,b are the probability distribution diagrams of the PLV and PLI values of all epochs of the five sub-bands corresponding to the two groups of experiments. This paper selects the upper quartile in the statistical distribution diagram as the threshold of the corresponding network. As can be seen from the figure, the thresholds of each band in the two groups of PLV experiments are 0.47, 0.48, 0.45, 0.36, and 0.32 and 0.46, 0.47, 0.46, 0.36, and 0.32, respectively, and the thresholds of each band in the two groups of PLI experiments are 0.16, 0.07, 0.04, 0.05, and 0.03 and 0.09, 0.07, 0.04, 0.05, and 0.03, respectively.

3.3. Network Binarization

Based on the threshold values determined above for each state, the weights in the PLV average matrix and the PLI average matrix that are greater than the threshold are set to 1 (yellow), and the weights that are less than the threshold are set to 0 (red), thereby obtaining the binarization matrix corresponding to each state. Shown in Figure 7a,b are the PLV binarization matrices of the two groups of experiments, and shown in Figure 8a,b are the PLI binarization matrices of the two groups of experiments.
As can be seen from the figure, there are obvious differences between each sub-band in the alert state and the fatigue state in the two groups of experiments, especially in the delta and theta bands. Because the delta and theta bands often correspond to sleepiness and fatigue, the alpha band corresponds to the resting state, the beta band is related to the state of concentration, and the gamma band often corresponds to a high cognitive state. After a long period of driving, drivers will experience some fatigue, which is why the delta and theta bands are more different in the two states.

3.4. Network Topology Analysis

The functional brain network was constructed for the binarized matrix on each sub-band of the two groups of experiments. The functional brain network topological connection diagrams based on the PLV and PLI of the two groups of experiments are shown in Figure 9a,b and Figure 10a,b respectively.
The frontal lobe is the primary area for executive function and decision-making, and its connections with other brain regions are used to perform cognitive tasks and regulate behavior. The parietal lobe is related to functions such as spatial perception and body sensation. The temporal lobe is associated with functions such as hearing, language comprehension, and memory. The occipital lobe is primarily responsible for visual processing, and therefore has connections with other areas for the reception and interpretation of visual information.
As shown in the figures, in the alert state, there is uniform connection between major brain regions such as the frontal lobe, parietal lobe, temporal lobe, and occipital lobe, which reflects the brain’s need for functional coordination and information transmission in the alert state. The even distribution of these connections suggests that when in the alert state, the brain is in a highly active and efficient working state, with fast and effective communication and coordination between different functional areas. However, in the fatigue state, the connections between brain regions are weakened and the brain structure is relatively sparse, which is particularly evident in the brain network constructed by the PLV method. This reflects the reduction in brain functional activity in a state of fatigue. Fatigue may lead to a decline in cognitive and executive functions, affecting aspects such as attention, memory, and decision-making.

3.5. Results of Statistical Analysis

This paper calculated and discussed the above four brain network characteristic parameters for a total of 3432 epoch data segments of EEG signals in each band under the two experimental states obtained by preprocessing, and carried out paired sample t-tests on the above characteristic parameters in the alert state and fatigue state. The results are shown in Table 1.
In the two groups of experiments, in the delta band, there is no significant difference between BC and LE, but there is a significant difference between CC and D. In the gamma band, except for D, there is no significant difference in the other three network parameters. There are significant differences in the network characteristic parameters in the theta, alpha, and beta bands. Finally, the characteristic parameters with significant differences were extracted to form the final feature matrix for subsequent machine learning to complete classification and recognition.

3.6. Analysis of the Results for Classification

For the above two groups of experiments and their corresponding five sub-band data, the brain network characteristic parameter indicators with significant differences were screened out, and the feature matrix was composed of the above four network characteristic parameters and the mixed features (MIX) composed of these four characteristic parameters. The dimension of each network characteristic matrix is 1716 × 30, where 1716 represents the network feature parameters calculated from 33 epochs of 26 subjects in each group under alert and fatigue states, and 30 represents the number of channels. The matrix was sent to the SVM, Naive Bayes (NB), and linear discriminant analysis (LDA) for classification and identification, so as to complete the identification of alert states and fatigue states. In Figure 11a,b, the average accuracy of the network indicators with significant differences under the two methods in the three classification algorithms after ten-fold cross validation is shown.
As can be seen from Figure 11a, among the network characteristic parameters of the brain network constructed based on the PLV method, when SVM is used to classify the mixed features of the beta band of the second group of experiments, the recognition accuracy can reach up to 89.5%. When LDA is used to classify the betweenness centrality features of the alpha band of the first group of experiments, the accuracy is the lowest, but it can also reach 75.4%. From Figure 11b, among the network characteristic parameters of the brain network constructed based on the PLI method, when SVM is used to classify the mixed features of the beta band of the second group of experiments, the recognition accuracy can reach up to 82.5%. When the LDA is used to classify the betweenness centrality features of the alpha band of the first group of experiments, the accuracy was the lowest, but it could still reach 70.5%. The accuracy rates of different network indicators and different classification algorithms are all above 70%, which shows that good results have been achieved. This also shows that the method proposed in this paper is effective. In addition, we adopt two other evaluation criteria, precision and recall, to evaluate the classification performance, as shown in Table 2.

4. Discussion

Vehicle driving requires high coordination and control of the brain, and cooperation among various brain regions is required to complete it. As shown in Figure 9a,b and Figure 10a,b, the functional brain network topological relationships corresponding to alertness and fatigue states are constructed in this paper based on the PLV method and PLI method, respectively. The intuitive analysis shows that, compared with the initial alert state, the interdependence between brain regions in the fatigue state of the driver after 60 min of driving is gradually weakening from the perspective of phase synchronization, in terms of both the low-frequency components of the EEG signal or the corresponding high-frequency components. Compared with the fatigue state after 90 min of driving, the weakening of the delta and theta bands appears to be faster, while the changes in alpha, beta, and gamma bands are not so obvious. A comparison of alert and fatigue states revealed that the changes in low-frequency delta, theta, and alpha bands between fatigue and alert were more obvious, which is consistent with the view that delta and theta waves often appear in deep sleep and drowsiness. As fatigue occurs, the driver’s state tends to be drowsy, the delta and theta band activities increase, but the activity of neurons in each brain region tends to be chaotic, and the phase synchronization relationship between signals gradually weakens. By comparing the PLV method and the PLI method, it is found that the above changes are more obvious in the PLV method.
Comparative analysis found that the recognition effect of mixed-feature parameters is better than that of single-network-feature parameters. This shows that the characteristic parameters of spatial functional brain networks can be used to quantitatively analyze the state of fatigue driving, but the selection of network parameters requires the integration of multi-angle information. The specific combination of parameters is expected to further improve the recognition accuracy, which needs further research.
By comparing the results of the three types of machine learning classifiers, it was found that the recognition effect of the SVM was relatively good. In addition, the recognition effect on the beta band was the best among the five sub-bands. The main reason may be that the beta band mainly corresponds to the state of concentration and is a key band in fatigue detection, which is consistent with the previous research results [33]. Similarly, the recognition effect of the second group of experiments is better than that of the first group of experiments, mainly because the driving time of the subjects in the second group of experiments is 30 min longer than that in the first group of experiments, and the fatigue is relatively stronger. The difference in the brain network characteristics of the EEG signals corresponding to the fatigue state is more obvious, which makes it easier to be detected by the machine learning model.
In order to further illustrate the effectiveness of the method proposed in this paper, a comparative analysis was conducted on the research results of this paper and other methods using the same dataset, as shown in Table 3. Through comparative analysis, it was found that although the method and research ideas proposed in this paper still have room for improvement, on this dataset, the method adopted in this paper achieved relatively ideal results, and the recognition efficiency was better than the existing methods.
Based on the EEG data of simulated driving experiments, this paper completed the characteristic analysis of EEG signals corresponding to alert driving and fatigue driving by constructing brain networks and calculating network characteristic parameters. First, the functional brain network was constructed based on the phase locking value and phase lag index method on the five bands of EEG signals, and the network was quantitatively analyzed based on the characteristic parameters. The characteristic parameters with significant differences were selected to construct feature vectors, and machine learning models such as SVM, NB, and LDA were used for classification and recognition. The recognition accuracy was higher than 70%, and the highest could reach 89.5%. This result proves the effectiveness of this method in fatigue driving recognition.
Through the analysis of the topological structure of brain networks, it was found that there were obvious differences in the functional brain networks between alert and fatigue states. In the alert state, the interaction between brain regions was relatively uniform. This is because the driving process involves decision-making, executive function, auditory function, and visual processing, which require synergy. The connectivity of brain networks in the fatigue state was weakened, and the topological structure was relatively sparse, especially in the delta and theta bands. This is because long-term driving produces fatigue, leading to the depletion of neural resources, which in turn affects the decline of cognitive and executive functions as well as attention, memory, and decision-making. With the advent of the era of intelligent transportation, combined with the development of portable EEG equipment, this study will provide new ideas for the classification and identification of fatigue driving based on EEG signals, and will have a certain reference value for the development of fatigue driving detection systems based on brain–computer interfaces.

Author Contributions

W.C.: methodology, visualization, investigation, and writing—review and editing; W.N.: methodology, visualization, and writing—review and editing; R.L.: investigation and conceptualization; L.Z.: software and visualization; J.L.: data curation and formal analysis; G.Y.: supervision, funding acquisition. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (No. 62366028, No. 62466032), Gansu Provincial Department of Education Youth Doctoral Support Project (No. 2023QB-038), Natural Science Foundation of Gansu Province in China (No. 24JRRA256), and the Major Science and Technology Projects of Gansu Province (No. 23ZDFA012).

Data Availability Statement

The data used to support the findings of this study are available from open databases: https://figshare.com/articles/dataset/Multichannel_EEG_recordings_during_a_sustained-attention_driving_task/6427334/5 (accessed on 5 April 2019).

Acknowledgments

We would like to express our sincere gratitude to the researchers who provided the datasets and the senior researchers who provided relevant research experience.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Van Cutsem, J.; Marcora, S.; De Pauw, K.; Bailey, S.; Meeusen, R.; Roelands, B. The effects of mental fatigue on physical performance: A systematic review. Sports Med. 2017, 47, 1569–1588. [Google Scholar] [CrossRef] [PubMed]
  2. Xu, T.; Wang, H.T.; Lu, G.Y.; Wan, F.; Deng, M.Q.; Qi, P.; Bezerianos, A.; Guan, C.T.; Sun, Y. E-key: An EEG-based biometric authentication and driving fatigue detection system. IEEE Trans. Affect. Comput. 2021, 14, 864–877. [Google Scholar] [CrossRef]
  3. Zhang, G.N.; Yau, K.K.W.; Zhang, X.; Li, Y.Y. Traffic accidents involving fatigue driving and their extent of casualties. Accid. Anal. Prev. 2016, 87, 34–42. [Google Scholar] [CrossRef] [PubMed]
  4. Wang, F.; Wan, Y.X.; Li, M.; Huang, H.Y.; Li, L.; Hou, X.Y.; Pan, J.H.; Wen, Z.F.; Li, J.C. Recent Advances in Fatigue Detection Algorithm Based on EEG. Intell. Autom. Soft Comput. 2023, 35, 97–110. [Google Scholar] [CrossRef]
  5. Jiang, K.; Ling, F.Y.; Feng, Z.X.; Wang, K.; Shao, C. Why do drivers continue driving while fatigued? An application of the theory of planned behaviour. Transp. Res. Part A Policy Pr. 2017, 98, 141–149. [Google Scholar] [CrossRef]
  6. Bener, A.; Yildirim, E.; Özkan, T.; Lajunen, T. Driver sleepiness, fatigue, careless behavior and risk of motor vehicle crash and injury: Population based case and control study. J. Traffic Transp. Eng. 2017, 4, 496–502. [Google Scholar] [CrossRef]
  7. Lan, Z.D.; Zhao, J.; Liu, P.B.; Zhang, C.; Lyu, N.N.; Guo, L. Driving fatigue detection based on fusion of EEG and vehicle motion information. Biomed. Signal Process. Control 2024, 92, 100–107. [Google Scholar] [CrossRef]
  8. Xi, J.F.; Wang, S.Q.; Ding, T.Q.; Tian, J.; Shao, H.; Miao, X.N. Detection Model on Fatigue Driving Behaviors Based on the Operating Parameters of Freight Vehicles. Appl. Sci. 2021, 11, 7132. [Google Scholar] [CrossRef]
  9. Li, K.N.; Gong, Y.N.; Ren, Z.L. A fatigue driving detection algorithm based on facial multi-feature fusion. IEEE Access 2020, 8, 101244–101259. [Google Scholar] [CrossRef]
  10. Wang, X.Y.; Chen, L.F.; Zhang, Y.; Shi, H.L.; Wang, G.; Wang, Q.Z.; Han, J.Y.; Zhong, F.S. A real-time driver fatigue identification method based on GA-GRNN. Front. Public Health 2022, 10, 99–115. [Google Scholar] [CrossRef]
  11. Du, G.L.; Wang, H.J.; Su, K.; Wang, X.Q.; Teng, S.H.; Liu, P. Non-Interference Driving Fatigue Detection System Based on Intelligent Steering Wheel. IEEE Trans. Instrum. Meas. 2022, 71, 1–11. [Google Scholar] [CrossRef]
  12. Shi, J.X.; Wang, K. Fatigue driving detection method based on Time-Space-Frequency features of multimodal signals. Biomed. Signal Process. Control 2023, 84, 85–93. [Google Scholar] [CrossRef]
  13. Wang, L.; Wang, H.; Liu, J.T. Discrimination of driver fatigue based on distortion energy density theory and multiple physiological signals. IEEE Access 2021, 52, 151824–151833. [Google Scholar] [CrossRef]
  14. Zeng, C.Q.; Mu, Z.D.; Wang, Q.J. Classifying driving fatigue by using EEG signals. Comput. Intell. Neurosci. 2022, 85, 75–86. [Google Scholar] [CrossRef]
  15. Venkat, V.; Chinara, S. Automatic classification methods for detecting drowsiness using wavelet packet transform extracted time-domain features from single-channel EEG signal. J. Neurosci. Meth. 2021, 347, 165–175. [Google Scholar]
  16. Rashid, M.; Mustafa, M.; Sulaiman, N.; Abdullah, N.; Samad, R. Random Subspace K-NN Based Ensemble Classifier for Driver Fatigue Detection Utilizing Selected EEG Channels. Trait. Signal 2021, 38, 1259–1270. [Google Scholar] [CrossRef]
  17. Gao, D.R.; Tang, X.; Wan, M.Q.; Huang, G.; Zhang, Y.Q. EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks. Front. Neurosci. 2023, 17, 156–169. [Google Scholar] [CrossRef]
  18. Zhang, Y.H.; Guo, H.Y.; Zhou, Y.J.; Xu, C.J.; Liao, Y. Recognising drivers’ mental fatigue based on EEG multi-dimensional feature selection and fusion. Biomed. Signal Proces. 2023, 79, 104–116. [Google Scholar]
  19. Wang, F.; Wu, S.C.; Ping, J.Y.; Xu, Z.F.; Chu, H. EEG driving fatigue detection with PDC-based brain functional network. IEEE Sens. J. 2021, 21, 10811–10823. [Google Scholar] [CrossRef]
  20. Wang, H.T.; Liu, X.C.; Hu, H.Y.; Wan, F.; Li, T.; Gao, L.Y.; Bezerianos, A.; Sun, Y.; Jung, T.P. Dynamic reorganization of functional connectivity unmasks fatigue related performance declines in simulated driving. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 1790–1799. [Google Scholar] [CrossRef]
  21. Qin, Y.M.; Hu, Z.Y.; Chen, Y.; Liu, J.; Jiang, L.J.; Che, Y.Q.; Han, C.X. Directed brain network analysis for fatigue driving based on EEG source signals. Entropy 2022, 24, 1093. [Google Scholar] [CrossRef] [PubMed]
  22. Zhou, Y.; Zeng, C.Q.; Mu, Z.D. Optimal feature-algorithm combination research for EEG fatigue driving detection based on functional brain network. IET Biom. 2023, 12, 65–76. [Google Scholar] [CrossRef]
  23. Cao, Z.H.; Chuang, C.H.; King, J.K.; Lin, C.T. Multi-channel EEG recordings during a sustained-attention driving task. Sci. Data 2019, 6, 19–26. [Google Scholar] [CrossRef] [PubMed]
  24. Zhang, B.T.; Chang, W.W.; Li, X.L. Fatigue driving detection based on spatial-temporal electroencephalogram features and parallel neural networks. J. Transp. Syst. Eng. Inf. Technol. 2023, 23, 315–325. [Google Scholar]
  25. Zhang, X.W.; Lu, D.W.; Pan, J.; Shen, J.; Wu, M.X.; Hu, X.P.; Hu, B. Fatigue detection with covariance manifolds of electroencephalography in transportation industry. IEEE Trans. Ind. Inform. 2020, 17, 3497–3507. [Google Scholar] [CrossRef]
  26. Chen, J.C.; Wang, H.; Wang, Q.X.; Hua, C.C. Exploring the fatigue affecting electroencephalography based functional brain networks during real driving in young males. Neuropsychologia 2019, 129, 200–211. [Google Scholar] [CrossRef] [PubMed]
  27. Lin, C.T.; Chuang, C.H.; Hung, Y.C.; Fang, C.N.; Wu, D.R.; Wang, Y.K. A driving performance forecasting system based on brain dynamic state analysis using 4-D convolutional neural networks. IEEE Trans. Cybern. 2020, 51, 4959–4967. [Google Scholar] [CrossRef]
  28. Paulo, J.R.; Pires, G.; Nunes, U. Cross-subject zero calibration driver’s drowsiness detection: Exploring spatiotemporal image encoding of EEG signals for convolutional neural network classification. IEEE Trans. Neural Syst. Rehabil. Eng. 2021, 29, 905–915. [Google Scholar] [CrossRef]
  29. Lachaux, J.P.; Rodriguez, E.; Martinerie, J.; Varela, F. Measuring phase synchrony in brain signals. Hum. Brain Mapp. 1999, 8, 194–208. [Google Scholar] [CrossRef]
  30. Wang, Z.M.; Tong, Y.; Heng, X. Phase-locking value based graph convolutional neural networks for emotion recognition. IEEE Access 2019, 7, 93711–93722. [Google Scholar] [CrossRef]
  31. Cui, G.C.; Li, X.Y.; Touyama, H. Emotion recognition based on group phase locking value using convolutional neural network. Sci. Rep. 2023, 13, 3769–3777. [Google Scholar] [CrossRef] [PubMed]
  32. Xi, J.; Huang, X.L.; Dang, X.Y.; Ge, B.B.; Chen, Y.; Ge, Y. Classification for Memory Activities: Experiments and EEG Analysis Based on Networks Constructed via Phase-Locking Value. Comput. Math. Methods Med. 2022, 8, 38–53. [Google Scholar] [CrossRef] [PubMed]
  33. Zhao, C.L.; Zhao, M.; Yang, Y.; Gao, J.F.; Rao, N.N.; Lin, P. The reorganization of human brain networks modulated by driving mental fatigue. IEEE J. Biomed. Health Inform. 2016, 21, 743–755. [Google Scholar] [CrossRef] [PubMed]
  34. Li, R.L.; Lan, Z.R.; Cui, J.; Sourina, O.; Wang, L.B. EEG-based recognition of driver state related to situation awareness using graph convolutional networks. In Proceedings of the 2020 International Conference on Cyberworlds (CW), Caen, France, 29 September–1 October 2020. [Google Scholar]
  35. Liu, Y.S.; Lan, Z.R.; Cui, J.; Sourina, O.; Müller, W. Inter-subject transfer learning for EEG-based mental fatigue recognition. Adv. Eng. Inform. 2020, 46, 53–60. [Google Scholar] [CrossRef]
Figure 1. The roadmap of this study.
Figure 1. The roadmap of this study.
Electronics 13 03742 g001
Figure 2. Experimental scene and paradigm.
Figure 2. Experimental scene and paradigm.
Electronics 13 03742 g002
Figure 3. Electrode location diagram.
Figure 3. Electrode location diagram.
Electronics 13 03742 g003
Figure 4. (a): The PLV average matrix of the second group of experiments. (b): The PLV average matrix of the second group of experiments.
Figure 4. (a): The PLV average matrix of the second group of experiments. (b): The PLV average matrix of the second group of experiments.
Electronics 13 03742 g004
Figure 5. (a): The PLI average matrix of the second group of experiments. (b): The PLI average matrix of the second group of experiments.
Figure 5. (a): The PLI average matrix of the second group of experiments. (b): The PLI average matrix of the second group of experiments.
Electronics 13 03742 g005
Figure 6. (a): PLV matrix frequency distribution histogram and threshold. (b): PLI matrix frequency distribution histogram and threshold.
Figure 6. (a): PLV matrix frequency distribution histogram and threshold. (b): PLI matrix frequency distribution histogram and threshold.
Electronics 13 03742 g006
Figure 7. (a): The first group of the experimental PLV binarization matrix. (b): The second group of the experimental PLV binarization matrix.
Figure 7. (a): The first group of the experimental PLV binarization matrix. (b): The second group of the experimental PLV binarization matrix.
Electronics 13 03742 g007
Figure 8. (a): The first group of the experimental PLI binarization matrix. (b): The second group of the experimental PLI binarization matrix.
Figure 8. (a): The first group of the experimental PLI binarization matrix. (b): The second group of the experimental PLI binarization matrix.
Electronics 13 03742 g008aElectronics 13 03742 g008b
Figure 9. (a): The diagram of the first group of experiments, based on the PLV functional brain network topology connection. (b): The diagram of the second group of experiments, based on the PLV functional brain network topology connection.
Figure 9. (a): The diagram of the first group of experiments, based on the PLV functional brain network topology connection. (b): The diagram of the second group of experiments, based on the PLV functional brain network topology connection.
Electronics 13 03742 g009aElectronics 13 03742 g009b
Figure 10. (a): The diagram of the first group of experiments, based on the PLI functional brain network topology connection. (b): The diagram of the second group of experiments, based on the PLI functional brain network topology connection.
Figure 10. (a): The diagram of the first group of experiments, based on the PLI functional brain network topology connection. (b): The diagram of the second group of experiments, based on the PLI functional brain network topology connection.
Electronics 13 03742 g010
Figure 11. (a): Classification accuracy of brain network feature parameters based on PLV. (b): Classification accuracy of brain network feature parameters based on PLI.
Figure 11. (a): Classification accuracy of brain network feature parameters based on PLV. (b): Classification accuracy of brain network feature parameters based on PLI.
Electronics 13 03742 g011
Table 1. (a): Differences in the characteristic parameters of the first group of experiments. (b): Differences in the characteristic parameters of the second group of experiments.
Table 1. (a): Differences in the characteristic parameters of the first group of experiments. (b): Differences in the characteristic parameters of the second group of experiments.
(a)
PLVPLI
BCCCDLEBCCCDLE
delta/**//**/
theta********
alpha********
beta********
gamma//*///*/
(b)
PLVPLI
BCCCDLEBCCCDLE
delta/**//**/
theta********
alpha********
beta********
gamma//*///*/
Notice: / indicates no significant difference; * indicates p < 0.05.
Table 2. (a): Classification performance evaluation based on PLV. (b): Classification performance evaluation based on PLI.
Table 2. (a): Classification performance evaluation based on PLV. (b): Classification performance evaluation based on PLI.
(a)
The First Group of ExperimentsThe Second Group of Experiments
BCCCDLEMIXBCCCDLEMIX
Precision
(%)
theta77.9180.4580.6882.1184.2584.2583.4985.8285.0386.89
alpha75.6378.5278.3080.8983.0882.6782.9684.4184.2884.66
beta78.2681.7881.9682.1585.0286.2484.5287.2984.9388.12
Recall
(%)
theta80.8584.3584.3685.1488.0687.8187.4289.3388.1590.75
alpha77.6281.2881.4384.8786.1686.2286.2888.0287.8387.92
beta81.1585.2285.6185.6688.7289.3287.8990.2588.4691.78
(b)
The First Group of ExperimentsThe Second Group of Experiments
BCCCDLEMIXBCCCDLEMIX
Precision
(%)
theta72.8573.5576.2874.2078.4978.3177.1178.5874.7280.08
alpha72.1672.2975.2671.7975.8275.4375.4277.6474.2578.86
beta73.8973.7877.5875.3678.9676.8577.3680.0675.9280.73
Recall
(%)
theta76.6876.2180.4577.9682.4282.0680.2682.5178.6884.06
alpha75.1475.2978.9675.6379.9478.6779.7181.6378.2282.46
beta77.4376.6281.5479.0482.8580.2481.3383.7479.8384.89
Table 3. Comparison between studies.
Table 3. Comparison between studies.
ResearchersResearch MethodsAverage Accuracy (%)
Paulo et al. [28]Recurrence Diagram/Gramian angular field75.87/74.53
Li et al. [34]Spectral spatial model70.60
Liu et al. [35]Maximum independence Domain adaptation73.01
This paperSpatial characteristics (PLV)86.47 (SVM)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Chang, W.; Nie, W.; Lv, R.; Zheng, L.; Lu, J.; Yan, G. Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals. Electronics 2024, 13, 3742. https://doi.org/10.3390/electronics13183742

AMA Style

Chang W, Nie W, Lv R, Zheng L, Lu J, Yan G. Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals. Electronics. 2024; 13(18):3742. https://doi.org/10.3390/electronics13183742

Chicago/Turabian Style

Chang, Wenwen, Wenchao Nie, Renjie Lv, Lei Zheng, Jialei Lu, and Guanghui Yan. 2024. "Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals" Electronics 13, no. 18: 3742. https://doi.org/10.3390/electronics13183742

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop