1. Introduction
During driving, drivers usually receive more than 80% of traffic environment information through their vision [
1,
2]. The sudden changes of driver’s eye movement are closely associated with road traffic crashes. Therefore, it is necessary to investigate drivers’ eye movement changes for improving road safety.
Transportation scholars have explored drivers’ visual search modes in various types of roads [
3,
4,
5,
6,
7,
8] (e.g., mountain roads, roundabouts, overpasses, curved roads, and grassland roads) and different driving environments [
9,
10,
11,
12,
13,
14,
15] (e.g., road construction, tunnel entrances, tunnel lighting environments, and traffic signs and billboards). It was found that drivers’ eye movements change with the driving environment.
Previous research suggests that there are relationships among driving anxiety, visual search mode, and driving behavior. Taylor et al. [
16] found that drivers with high anxiety are more likely to make mistakes during driving, based on the results of a questionnaire survey. Pourabdian [
17] used the Manchester Driving Behavior Questionnaire and the Spielberg State–Trait Anxiety Scale to analyze the relationship between trait anxiety level and inappropriate driving behavior, and found that trait anxiety level is prone to causing driver distraction and forgetfulness. Wester et al. [
18] found that with a high level of anxiety, drivers have an increased fixation frequency in the central area and a decreased fixation frequency on both sides (narrowed attention). Anxiety can narrow driver attention, which results in ignoring important peripheral information and increased driving risk [
19].
There have been a number of studies showing driver’s eye movement characteristics. Hills et al. [
20,
21] found that driver’s eye movements change with the level of driving experience. It is not easy for novice drivers to apply appropriate eye-movement patterns to match the hazardousness of the road. Foy et al. [
22] studied the relationship between driver’s mental workload and eye movement characteristics. It was found that an increased mental workload leads to wider visual search breadth and longer gaze duration. Le et al. [
23] combined a vestibulo-ocular reflex model with a visual-kinematic reflex model to explore the effects of psychological load on driver’s eye movement. Based on the findings, they developed a system to monitor drivers’ visual behavior. Bakhit et al. [
24] analyzed the relationship between eye scanning behavior and different levels of driving tasks, and also developed two measures for distracted driving.
Drivers’ eye-movement analysis has received increasing attention in traffic safety research. Li et al. [
25] analyzed drivers’ eye-movement characteristics in accident-prone areas, focusing on drivers’ cognitive workload and fixation point distribution. The findings of the study were used to provide effective strategies to improve road safety. He et al. [
11] analyzed the effects of highway tunnel lighting environment on driving safety, using drivers’ eye movement parameters. Hills et al. [
20] explored the vertical eye-movement carryover from one task to a second task, and found that it is one potentially distracting effect on the safety of novice drivers. Oviedo-Trespalacios et al. [
26] conducted a systematic literature review to identify the impacts of roadside advertising signs on driver behavior and road safety. The findings suggested that roadside advertising can increase crash risk, particularly when signs that are frequently changed. Vignali et al. [
27] examined pedestrians’ first-fixation distance of the crosswalk to optimize the crosswalk design from a perspective of accident prevention. Costa et al. [
28] analyzed drivers’ first-fixation distance and fixation duration distributions to vertical road signs in order to identify the fixation time for the driver to correctly identify a road sign. Lantieri et al. [
29] explored the effect of gateways to reduce the amount of distraction, through analyzing drivers’ eye movement data.
In summary, most research on drivers’ eye movements has focused on exploring drivers’ eye movement characteristics, as well as the relationship between visual search mode and driving emotion. Few studies have attempted to investigate the change points of eye movement characteristics with mathematical models and algorithms. This paper will use the least squares of change-point estimation to detect and analyze eye movement changes of female drivers in anxiety.
2. Materials and Methods
The change-point method is a powerful tool to detect whether any changes have occurred [
30,
31,
32,
33,
34]. It can determine the number of changes and estimate the time and location of each change. It is also capable of detecting small changes, and is preferable particularly when dealing with large data sets. Generally, a change-point analysis characterizes the changes accurately, controls the error rate strongly, is robust to outliers, and is simple to use. Wang et al. have applied the change-point models to analyze traffic flow theory, including the mean change-point model [
35], the non-linear probability change-point model [
36], the least squares method, and the local comparison method [
37]. Therefore, the change point method was used for detecting drivers’ eye movement changes in this study.
2.1. Formulation of the Change-Point Model
In a change-point problem, there are a series of observations, which are mostly arranged according to the time of their occurrence. At an unknown moment, if the distribution of samples or their numerical characteristics suddenly change, the moment is probably the point of change. Assuming that Xi is a sample from the matrix X, we want to study the samples in order to determine whether there is a significant change in the matrix, where the change occurs, and how large the change is. Assuming that only one change occurs, the sample Xi before and after the change-point follows a normal distribution with variance , but the expected value of the distribution varies. The location of the change is denoted as m (unknown). Therefore, the issue of “whether there is a change” can be considered to a hypothesis test question under the premise that “” are mutually independent, and follow a normal distribution with variance :
Null hypothesis H: (no change-point);
Alternative hypothesis K: for
m,
, and
where
m (unknown) is called a change-point, that is, “the point in time when a sudden change occurs”. If null hypothesis is rejected, the position of change-point m and the change range (jump degree)
will be determined. The analysis process of change point is shown in
Figure 1.
2.2. Least Square Method of the Change-Point Analysis
2.2.1. Mean Change-Point Model with Known Number of Change Points
Firstly, we determine a natural number
q, and the number of change points should be less than
q. Compared to the sample size
n,
q is a rather small number. The discrete data model of the mean change-point problem is:
where
Xi stands for the sample (as in Equation (1)),
n represents the number of observation positions, and
. If
, mi is the change point. Random error
(
i = 1, …,
n) is assumed to be independent, with equal variance
and expected value 0.
2.2.2. Least Square Method of the Change-Point Search
The sum of the squared differences between observed and theoretical values is chosen as objective function, in order to obtain the minimum value as the point estimate of the population parameter.
The objective function is established as follows:
Here,
.
remain unchanged; finding the minimum value of
, we obtain:
Equation (3) reaches the minimum. By substituting Equation (4) into Equation (3), we get:
In the range of , Equation (5) is adjusted iteratively to reach the minimum. The steps are:
- (1)
Set a set of initial values ();
- (2)
Select the first two terms of Equation (5); the sum is calculated by:
where
Y1 and
Y2 are calculated by Equation (4) based on the initial values
.
m2 remains unchanged, and
m1 is adjusted in a range of 1 <
m1 <
m2 to minimize W; that is,
n =
m2,
q = 1. W reaches the minimum value
m1, denoted as
.
- (3)
The sum of the second and third terms of Equation (5) is determined by substituting
into
m1; we obtain:
where
Y2 and
Y3 are calculated by Equation (4). However,
m1 is replaced by
, and
and
m3 remain unchanged, while
is adjusted within
to minimize W. W reaches the minimum value
m2, denoted as
.
- (4)
and m4 remain unchanged, and m3 is adjusted to get . Iteratively, a set of new values , …, are obtained. Take them as initial values, go back to the first step to get another set of new values , …, , and then go back to the first step. This iterative process continues until there is no adjustment needed (the new value exactly equals to the previous one). The final value, which is denoted as , can be used as an estimate of the change-point . The minimum value of T in Equation (3) is T(), denoted as .
2.2.3. Estimating the Number of Change-Points
When analyzing the change-point problems, we follow the following steps: the first step is to detect if there is a change-point or not. If the null hypothesis (no change-point) is accepted, it means that there will be no change-point (the test method is presented below); if it is rejected, at most, q change points are allowed to be proposed. The following methods are used: put q = k in Equation (3) and determine the minimum value Tk of T, that is T1, , Tk. We can see T1 ≥ T2 ≥ ≥ Tk. Considering the structure of Equation (3) and the minimum value of formula at , if there are only k change points, Tk is not much greater than TK+1. Otherwise, if there are more than k, Tk is significantly higher than TK+1 (the jump size of parameter mean at the change-point should be considered). The following empirical rules are often used to study practical problems: if the values decrease dramatically from T1 to Tk and keep flattening after that, the estimated value of the change-point is k. After determining k, q in Equation (3) is substituted by k, and the values of are obtained by minimizing T as the estimate of the change-point position.
The minimum value of (in Equation (5)) can be considered as , which is more than 1. A number slightly larger than 1 can be set, such as 1.1, making the change-point estimate.
2.2.4. Hypothesis Test Problem of Change-Point
Regarding the problem of “whether there is a change-point or not”, the hypothesis testing procedure is shown below. The null hypothesis
denotes a hypothesis in which there is no change-point. That is, in Equation (2),
. The variances of samples
(not divided by degrees of freedom, the same below) are given by:
Divide samples
into two segments,
and
, calculate their variances respectively, and put them together:
and
are the arithmetic means of the segments
and
, respectively. To simplify, use the identity below:
As can be seen,
Si ≤
S, and each sample has an equal variance of
:
If there is no change-point, all the samples have the same expectation, and the second item on the right side of Equation (11) is 0. If there is a change-point, this term is generally non-zero. Therefore, the change-point increases the gap between
S and
Si. The minimum value of
S2,
,
Sn is denoted as
S*
Moreover, the following test method can be used: when
the null hypothesis
is rejected; that is, the original change-point is identified. Otherwise,
is accepted.
C is an appropriately defined limit, which is determined by
If
is known, for a given level
,
2.2.5. Measurement of the Change-Point Magnitude
In Equation (2),
bk+1 −
bk is known as the jump degree at change-point
mk, which can be used as a measure of the change-point magnitude. If there is
q change points, the estimated values are
from small to large, and then the jump degree at the
i change-point is estimated by
2.3. Data Collection
2.3.1. Participants
In this study, we chose female drivers for analysis, because compared to men, women are more likely to experience anxiety [
38,
39] and get involved in road traffic accidents [
40,
41]. A total of 36 female novice extroversion drivers were selected to collect eye movement data. Subject driving propensity was determined using the driving propensity questionnaire developed by Wang et al. [
42].
Table 1 presents drivers’ driving propensity and their behavior. If a subject drove more than 10,000 kilometers, he would be defined as an experienced driver, and a novice driver otherwise [
43]. Participants were aged between 21 and 45 years, and their driving age ranged from 1 to 23 years. In addition, all the subjects had normal hearing, vision (or corrected vision), and color vision.
2.3.2. Experimental Material and Equipment
• Emotion-induction materials
The International Affective Picture System (IAPS) and the Chinese Affective Picture System (CAPS) were used as emotional induction materials. The IAPS is an emotional tool which is generally acknowledged around the world, and the CAPS is an emotional instrument that adapts to the social and cultural context of China. Various anxiety-inducing materials were used in the experiments, including visual materials (e.g., words and pictures, light variation in driving environment), auditory materials (e.g., noisy and irregular sounds), multi-channel materials (e.g., videos and movies), olfactory materials (e.g., cigarettes and durian), and taste materials (e.g., balsam gourd and licorice). Parts of the anxiety induction material are shown in
Figure 2.
• Experimental equipment
The experimental equipment includes a comprehensive experimental vehicle (equipped with 32-channel Lidar, laser distance sensor, SG299GPS non-contact multi-function speedometer, CTM-8A non-contact multi-function speedometer, vehicle recorder, Tobii eye tracker, WTC-1 pedal power manipulator, high-definition camera, and laptop, etc.), a high-fidelity driving simulation platform, camera, Tobii Studio software, recorder, IR-Marker, and wedge foam, etc. Parts of the experimental equipment are shown in
Figure 3 and
Appendix A Table A1.
• Driving route
The selected route includes Beijing Road, Renmin West Road, Nanjing Road, and Xincun West Road in Zibo city (as shown in
Figure 4, total length of 5.6 km). The real driving experiments were conducted on sunny days and favorable road conditions. All the subjects were novice drivers. Considering that it is difficult for drivers to maintain calm state in high-traffic-volume roads, the driving experiments in calm were carried out during the off-peak time on Saturday and Sunday morning. Meanwhile, driving experiments under anxiety were conducted at the early peak and late peak from Monday to Friday. In the driving simulations, a two-lane one-way road with various scenarios was designed (as shown in
Figure 5), including unimpeded road, road maintenance, traffic accident, and a curve. A set of pre-defined obstacles on the roads were designed to maintain or increase drivers’ anxiety level during driving.
2.3.3. Experimental Procedure
The driving experiments include real vehicle experiment and driving simulation. Using real driving experiments to collect data is time-consuming, expensive, and difficult to organize. Therefore, it is difficult to obtain a large amount of real driving experimental data. Driving simulation can be used as a supplement to real vehicle experiment, because it is safety, low-cost, and easy to control. Each subject was involved in one real driving experiment and one driving simulation driving experiment on different days. All the experiments were completed in one month.
• Preparation
Before each experiment, the IR-Markers of Tobii eye tracker were fixed on the front windshield by a 4 × 6 matrix, and were also placed on the rearview mirror, steering wheel, and dashboard, in accordance with the requirements. The IR-Marker distribution is shown in
Figure 6. It can be noted that the IR-Markers were placed to the left since drivers sat on the left side of vehicle. The wedge foam was used to be an offset to the tilt angle of the front windshield in order to ensure that drivers were directly in front of the IR-Markers. Researchers calibrated the eye tracker for each driver strictly before experiment, to collect high-quality and accurate data.
• Emotion induction and driving experiments
Anxiety is generally divided into two types: state anxiety and trait anxiety. State anxiety is a temporary emotional response to exogenous stimuli. Trait anxiety is a relatively stable personality feature, which has nothing to do with external stimuli. Anxiety in this study includes drivers’ state anxiety induced in the experiments, and their own trait anxiety. The driving experiment process involving calmness and anxiety is shown in
Figure 7.
• Assessing the level of induced anxiety
It is necessary to assess if subjects’ anxiety is induced to a certain level of arousal, because too little or too much arousal can adversely affect subjects’ performance in experiments. During the driving experiments, the facial expression, action, road conditions, driving speed, and pedal strength were recorded in real time with the video monitoring system, speedometer, and pedal dynamics instrument. Subjects were asked to describe their self-perception of emotion in the conversation with experimenters. After the driving experiment, each subject was asked to watch the video immediately and report his emotional experience. The data segments of subject’s anxiety were determined through the Beck Anxiety Inventory, the Self-Rating Anxiety Scale, and subjects’ physiological characteristics such as facial expressions, voice signals, and behavioral actions. The selected data segments were used for the subsequent process and analysis.
Table 2 shows the level of anxiety on the Beck Anxiety Inventory and Self-Rating Anxiety Scale. The anxiety induction was considered successful if subjects had a score of 26 points or more on the Beck Anxiety Inventory, and a score of 60 points or more on the Self-Rating Anxiety Scale for anxiety symptoms [
45,
46]. Therefore, only moderate and severe anxiety were selected for analysis in this study.
2.4. Eye Movement Feature Extraction
Subjects were involved in the experiments, in which they were induced to feel either calm or anxious. The experimental data were divided into segments of 100 s each, and a total of 864 effective segments were obtained. Parts of data segments are shown in
Table 3.
In this paper, statistical analysis was performed using SPSS Statistics 23.0 (IBM, NY, USA) where the confidence interval was set at 95%. The paired
t-test was used to determine whether there is a difference between calm and anxiety in driver’s eye movement characteristics. The results are demonstrated in
Table 4.
The results show that there is a significant difference in fixation count and fixation duration between states of calmness and anxiety (p < 0.05). Drivers have a lower fixation count and a longer fixation duration in a state of anxiety as compared to calmness. Therefore, the two indicators were selected as input parameters in the model, which were used to analyze drivers’ eye movement characteristics in a state of anxiety.
2.5. Data Selection and Analysis
To simplify analysis, only 100 segments of the drivers’ area of interest from the front window were selected and analyzed in this paper. The fixation count and fixation duration for each segment are shown in
Figure 8 and
Figure 9.
The least squares method of change-point analysis was used to quickly detect the time and locations of change points to greatly reduce the effects of random interference on eye movement characteristics, following the process shown in
Figure 10.
3. Results and Discussion
Table 5 and
Table 6 show the analysis results of the fixation count and fixation duration using the least squares method. Because the algorithm yields a strong sensitivity for eye movement data, a significance level of
α = 0.001 was selected, and
β = 1.01 was chosen to control the number of simulation cycles.
Combined with the heat map and gaze plot map of Tobii Studio (shown in
Figure 11), drivers’ eye movement data in anxiety were analyzed. Heat maps use different colors to show participants’ attention areas in an image. Using colors on a scale from red to green, heat maps show the highest number of gazes in red. Gaze plot maps show drivers’ eye movements towards the area of interest, where the size of dot represents the duration of a fixation.
The least squares method was used to identify the change points, considering the features of fixation count and fixation duration together. Big changes in eye-movement were found in the 10th, 59th, 65th, and 67th segments. To prevent premature convergence, β was calibrated as 1.01 and the algorithm was repeatedly run. Finally, it was determined that the change points occurred in the 10th and 65th segments, where the changes in both fixation count and fixation duration are significant.
Combining with the heat map and gaze plot map, it was found that greater fixation count, higher fixation duration, and greater attention bias appear in the 10th and 65th segments than in others. This might be attributed to the changes in road environment. In the 10th segment, a road traffic accident occurred. This made drivers feel more anxious and pay more attention to the accident scene, which resulted in more gaze points and longer fixation duration. There was a sharp curve in the 65th segment. Drivers had to pay more attention to the curved road, and hold their gaze for longer periods of time. These findings are consistent with the results obtained by the above algorithm.
5. Conclusions
This study used various materials to induce drivers’ anxiety, and then conducted real driving experiments and driving simulations to collect drivers’ eye-movement data. We analyzed the differences between calmness and anxiety in drivers’ eye movement characteristics, using the least squares method of change point to detect eye movement changes of drivers with anxiety. The main findings are demonstrated as follows.
(1) There are significant differences between calmness and anxiety in driver’s fixation count and fixation duration. Female drivers have a lower fixation count and a longer fixation duration in anxiety than in calmness.
(2) Female drivers show a greater fixation count, higher fixation duration, and greater attention bias in scenes with traffic accidents or sharp curves, than in others.
(3) The least squares method of change point analysis is effective to detect eye movement changes of female drivers in anxiety.