Next Article in Journal
A Twisted String, Flexure Hinges Approach for Design of a Wearable Haptic Thimble
Next Article in Special Issue
Remaining Useful Life Prediction of Lithium-Ion Batteries Based on Deep Learning and Soft Sensing
Previous Article in Journal
Model-Based Design Optimization of Soft Polymeric Domes Used as Nonlinear Biasing Systems for Dielectric Elastomer Actuators
Previous Article in Special Issue
Optimized Control of Virtual Coupling at Junctions: A Cooperative Game-Based Approach
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality

School of Automotive and Traffic Engineering, Hefei University of Technology, Hefei 230009, China
*
Author to whom correspondence should be addressed.
Actuators 2021, 10(9), 210; https://doi.org/10.3390/act10090210
Submission received: 30 July 2021 / Revised: 19 August 2021 / Accepted: 26 August 2021 / Published: 28 August 2021

Abstract

:
Reasonably foreseeable misuse by persons, as a primary aspect of safety of the intended functionality (SOTIF), has a significant effect on cooperation performance for lane keeping. This paper presents a novel human–machine cooperative control scheme with consideration of SOTIF issues caused by driver error. It is challenging to balance lane keeping performance and driving freedom when driver error occurs. A safety evaluation strategy is proposed for safety supervision, containing assessments of driver error and lane departure risk caused by driver error. A dynamic evaluation model of driver error is designed based on a typical driver model in the loop to deal with the uncertainty and variability of driver behavior. Additionally, an extension model is established for determining the cooperation domain. Then, an authority allocation strategy is proposed to generate a dynamic shared authority and achieve an adequate balance between lane keeping performance and driving freedom. Finally, a model predictive control (MPC)-based controller is designed for calculating optimal steering angle, and a steer-by-wheel (SBW) system is employed as an actuator. Numerical simulation tests are conducted on driver error scenarios based on the CarSim and MATLAB/Simulink software platforms. The simulation results demonstrate the effectiveness of the proposed method.

1. Introduction

Intelligent vehicle and automated driving technologies have attracted growing attention for their significant advantages, including improved security, better convenience, and greatly reduced congestion costs [1,2,3]. Automated driving technology is classified into six levels by the Society of Automotive Engineers (SAE) [4,5]. Fully automatic driving technology has the challenges of legal restrictions, accident responsibility, and perception difficulties. As a feasible transition for automated driving at the present stage, cooperative driving possesses vital academic value. Meanwhile, cooperative driving for lane keeping has been developed to reduce the driver’s workload and satisfy driver intentions [6,7,8,9].
However, driver error has become an important issue of road safety around the world [10,11]. According to statistics from the National Highway Traffic Safety Administration (NHTSA), there are approximately 60,000 traffic accidents that take place due to driver sleepiness-related problems every year [12]. In addition, driver errors contribute entirely or partially to nearly 90% of road accidents [13]. Reasonably foreseeable misuse by persons is a principal aspect of SOTIF [14]. Meanwhile, driver error due to distractions or drowsiness is a critical factor that leads to lane departure [15].
Many cooperative control methods have been developed to prevent lane departure and reduce traffic accidents, including integrated control of steering and braking [16], a shared authority allocation strategy [17,18], a fuzzy logic approach [19], a multi-state model-based end-to-end method [20], a sliding mode (SM) control algorithm [21], and an active disturbance rejection control (ADRC) algorithm [22]. Nevertheless, these studies only emphasize lane keeping performance through continuous intervention and neglect driving freedom.
Benloucif et al. [23] considered driving freedom in a lane keeping task and proposed a cooperative trajectory-planning method according to driver actions and intentions. Wang et al. [24] developed a novel lane keeping system, and a single-point preview model is utilized to describe driver steering behavior. Sentouh et al. [25] introduced a control authority allocation method based on energy spent by the driver, driver satisfaction level, and contradiction level between the driver and autonomous controller. The above studies emphasize driving freedom and neglect the effect of driver error on lane keeping performance.
Therefore, a proper balance between lane keeping performance and driving freedom is a challenge when driver error takes place. The evaluation of driver error is one premise for achieving the balance. Zhang et al. [26] proposed a novel shared-control scheme and tested the method in a driver error scenario. Guo et al. [27] designed an MPC-based shared-steering control method. The controller took over control when the driver released the steering wheel. Merah et al. [28] used a fuzzy controller to describe driver behaviors, such as when the driver reacted badly. However, the above studies lack a theoretical analysis of driver manipulation error. Driver manipulation error evaluation is challenging due to the dynamic variation in driver behaviors and driving scenarios.
The cooperative control system (CCS) contains two basic categories based on the control framework, including coupled shared control and uncoupled shared control [29]. Coupled shared control is relevant to haptics feedback control, and the human–machine interacts through force feedback [30]; human–machine conflicts come out due to physical coupling. Uncoupled shared control is also known as indirect shared control, which works by integrating the outputs of the driver and the CCS using weighted summation. The SBW system is suitable for implementing indirect shared control without direct physical conflicts [31,32]. Accordingly, the driver’s control authority depends on how we design the cooperative controller. Based on this, the indirectly shared control framework is employed in our scheme.
The cooperative control authority allocation is the crucial point for achieving the balance. Zhang et al. [26] proposed a shared control scheme for lane keeping with a fixed authority. Guo et al. [27] designed an MPC-based shared steering control method. This method ensures seamless control transfer between the system and the driver. Nguyen et al. [33] developed a dynamic authority for shared lateral control, with the authority factor being a bell-shaped function with respect to driver activity. Li et al. [34] developed a dynamic authority related to driving risk; driver authority rises with increases in driving risk in this design principle. However, driver authority should be reduced in a timely manner if driver error caused the driving risk.
To resolve the above shortcomings, we develop a novel cooperative control scheme for lane keeping with consideration of driver error. The highlights of this paper are:
(1)
A cooperative control scheme achieves a proper balance between lane keeping performance and driving freedom.
(2)
Dynamic driver error, as a primary aspect of SOTIF, is assessed by the proposed model based on a typical driver model in the loop.
(3)
A dynamic authority allocation method adapts to variations in driver error, lane departure, and velocity.
This paper is divided into five sections. Section 2 presents related dynamic models. Section 3 introduces the proposed cooperative control method; the safety evaluation strategy is designed and, additionally, the dynamic authority allocation method and an MPC-based controller are presented. In Section 4, the results are detailed and analyzed. Section 5 provides the conclusions of this study.

2. Related Dynamic Models

The related dynamic models used for cooperative control contain a vehicle dynamics model and an SBW system model.

2.1. Vehicle Dynamics Model

The vehicle dynamics model is shown in Figure 1. By applying Newton’s law to the vehicle’s center of gravity, the dynamic model can be written as [35]:
  m x ¨ = m y ˙ φ ˙ + 2 ( C f s f + C r s r ) + 2 C f ( δ f y ˙ + a φ ˙ x ˙ ) δ f   m y ¨ = m x ˙ φ ˙ + 2 C f ( δ f y ˙ + a φ ˙ x ˙ ) + 2 C r ( b φ ˙ y ˙ x ˙ ) I z φ ¨ = 2 a C f ( δ f y ˙ + a φ ˙ x ˙ ) 2 b C r ( b φ ˙ y ˙ x ˙ ) Y ˙ = x ˙ sin φ + y ˙ cos φ X ˙ = x ˙ cos φ y ˙ sin φ
where m is the vehicle mass, x ˙ and x ¨ are the longitudinal velocity and acceleration, y ˙ and y ¨ are the lateral velocity and acceleration, a and b are the distances from the center of gravity to the front and rear axles, respectively, φ ˙ and φ ¨ are the yaw rate and yaw acceleration, C f and C r are the stiffness coefficients on the front and rear tires, s f and s r are the slip ratios on the front and rear tires, δ f is the front wheel steering angle, I z is the yaw inertia along the axis z , Y ˙ and X ˙ are the vehicle lateral and longitudinal velocities in the inertial frame, and φ is the vehicle orientation (yaw angle) in the inertial fame.
Equation (1) can be rewritten in the following compact form:
ξ · t = f ξ t , u t
where the state and input vectors are ξ = y ˙ , x ˙ , φ , φ ˙ , Y , X ] T and u = δ f .

2.2. Steer-by-Wire System Model

The architecture of the SBW system is illustrated in Figure 2. The steering wheel angle sensor can detect the actual driver steering angle, and the steering angle can be transmitted to the front wheel subsystem. The function of the front wheel subsystem is to track the expected front wheel steering angle.
The differential equation of the front wheel steering motor can be written as [36]:
T m = J m δ ¨ m + B m δ ˙ m + k f ( δ m G m x r r p ) / G m
where T m , δ m , J m , and G m are the steering motor output torque, angular position, moment of inertia, and reduction ratio, respectively. B m is the steering motor shaft damping, k f is the steering actuator assembly stiffness, x r is the rack displacement, and r p is the pinion radius.
The front wheel steering angle δ f = δ m / G m can be obtained. The steering motor goal is to track the front wheel steering angle by generating output torque. The steering motor’s output torque can be expressed as
T m = k m I m
The equation of the steering motor can be written as:
U m = R m I m + L m I ˙ m + k m δ ˙ m
where U m , R m , I m , L m and k m are the voltage, resistance, current, inductance and electromotive force constant, respectively.
The differential equation of the rack can be expressed as:
M r x ¨ r + B r x ˙ r + F r = k f ( δ m G m x r r p ) / r p
where M r and B r are the rack mass and damping, and F r is the resistance force equivalent to the rack.
The resistance force can be shown as:
F r = T l l l + T r l r
where T l and T r are the self-aligning moments of the left and right kingpins, and l l and l r are the lengths of the left and right steering arms.

3. Human–Machine Cooperative Control Method Design

In this section, first, a novel human–machine cooperative control scheme is presented. In the following, a safety evaluation strategy is designed. Then, a dynamic authority allocation method is proposed for achieving a proper balance between lane keeping performance and driving freedom. Besides, an MPC-based controller is developed to generate an optimal steering angle for lane keeping.

3.1. Human–Machine Cooperative Control Scheme

As shown in Figure 3, the cooperative control scheme contains two intelligent agents (driver and CCS). The actual driver steering behavior is detected by a sensor. At the same time, an MPC-based CCS controller is developed for lane keeping. Additionally, a safety evaluation strategy is proposed for safety supervision, containing real-time assessments of driver error and lane departure risk. Then, a dynamic authority allocation method is designed to weigh lane keeping performance and driving freedom. Finally, the SBW system is used as an actuator, and a feedback PID is employed to reduce the deviation of the cooperative steering angle and actual steering angle.

3.2. Safety Evaluation Strategy

The main objective of this section is to assess driver manipulation error and the effect of driver manipulation error on lane keeping performance.

3.2.1. Safety Evaluation Model of Lane Departure Risk

This section is used to evaluate the lane departure risk caused by driver error and determine a basic cooperative domain by weighing lane departure risk and driving freedom. The lane departure risk can be evaluated based on the extension model [37,38]. The design process of the extension model contains the extraction of characteristic variables, division of the extension set, calculation of the correlation degree, and decision of the measure model.
(1)
Extraction of characteristic variables
As for the depiction of lane departure status, the lateral position deviation y L and the direction deviation ψ L are extracted as characteristic variables, which are used to form a two-dimensional extension set.
(2)
Division of the extension set
The extension set includes a classical domain, an extensive domain, and a non-domain, as shown in Figure 4a. The classical domain describes a relatively safe state with small lateral position and direction deviations. The extensive domain represents a relatively dangerous state with a large lane departure risk. The non-domain describes an extreme state, in which the vehicle will collide with the curb.
(3)
Calculation of the correlation degree
The correlation degree refers to the correlation function value based on current characteristic variables. It is assumed that the permitted ranges of the lateral position deviation and direction deviation are y L I and ψ L I ( I = 1 , 2 ). The optimal point is origin point O . As shown in Figure 4a, Q is the current system state point. The intersections of O Q and the classical domain and extensive domain are Q 1 , Q 2 , Q 3 , and Q 4 . Thus, the two-dimensional extension set is transformed into a one-dimensional set, as depicted in Figure 4b.
It is assumed that the classical domain is < Q 2 , Q 3 > = X j and the extensive domain is < Q 1 , Q 2 > < Q 3 , Q 4 >   = X k . The extensive distances of Q and the classical and extensive domains are ρ ( Q , X j ) and ρ ( Q , X k ) . For example, ρ ( Q , X k ) is given by:
ρ ( Q , X k ) = Q Q 2 , Q < , Q 2 > Q Q 2 , Q < Q 2 , 0 > Q Q 3 , Q < 0 , Q 3 > Q Q 3 , Q < Q 3 , + >
The correlation function K ( S ) is written as:
K ( S ) = ρ ( Q , X k ) D ( Q , X k , X j )
where D ( Q , X k , X j ) = ρ ( Q , X k ) ρ ( Q , X j ) .
(4)
Decision of the measure model
The measure model can be divided by the correlation function and the decision principle, shown as follows:
Classical domain: M 1 = S K ( S ) > 1 .
Extensive domain: M 2 = S 0 K ( S ) 1 .
Non-domain: M 3 = S K ( S ) < 0 .
The correlation function K ( S ) describes the correlation degree to the above three domains. Additionally, the correlation function reflects the lane departure risk; for example, the lane departure risk increases when the correlation function value decreases.

3.2.2. Safe Evaluation Model of Dynamic Driver Error

A typical driver model in the loop is developed to supervise actual driver behavior to deal with uncertainty and variability. The typical driver model is written as:
δ d = a r c t a n ( Y P Y c ) cos φ ( X P X c ) sin φ ( X P X c ) cos φ + ( Y P Y c ) sin φ
where δ d is the expected front wheel steering angle controlled by the typical driver, X p and Y p are the longitudinal and lateral positions of the preview point, and P , X c and Y c are the longitudinal and lateral positions of the center of mass of the vehicle in the inertial frame.
The deviation between the actual driver steering angle and the expected one changes; normal change cannot result in lane departure. To reduce the impact of changing deviation on the evaluation of driver error, the steering angle deviation E d is calculated in a period of time and written as follows:
E d = t t t δ S W t t t δ d i s
where δ S W is the actual steering wheel angle controlled by the actual driver, i s is the steering gear ratio, and Δ t is the manipulation error updated time.
The evaluation of the driver manipulation error degree is defined as:
γ ( t ) = E d δ t h d i s , if   E d   δ t h d i s 1 ,   e l s e
where δ t h d is the deviation threshold of the steering angle.
The driver manipulation error changes from light to severe with increases in the error value. γ = 1 is defined as the full driver manipulation error.

3.3. Dynamic Authority Allocation Method

This section aims to generate a dynamic shared authority to achieve an adequate balance between lane keeping performance and driving freedom. To this end, the safety assessment results proposed above are employed for authority allocation. Concretely, in the classical domain, lateral deviations are minor, and the vehicle is in a safe region. Therefore, the driver has complete driving freedom, and the dynamic CCS authority function is written as:
Γ a ( t ) = 0 ,   if   K ( S )   >   1  
The control authority is adjusted according to the lane departure risk and driver manipulation error degree in the extensive domain. As for a regular driver, a small lane departure risk is frequent because the driver cannot keep the vehicle in the lane centerline all the time. Thus, the driver has complete driving freedom if the driver has no manipulation error, and the lane departure risk is small. The dynamic CCS authority function is written as:
Γ a ( t ) = 0 ,   if   γ ( t ) = 0   a n d   K ( S ) 0.8
The CCS assists the driver in lane keeping if the driver has manipulation errors or the correlation function value is less than 0.8. Unlike the constant control authority allocation method, the driver manipulation error, lane departure risk, and relative velocity are related to the CCS control authority weight. The dynamic CCS authority function is defined as:
Γ a ( t ) = 0.2 + 1 1 + e τ 1 1 λ τ 2 γ + τ 3 K + σ ,   if   γ t > 0   or   K ( S ) < 0.8
where the relative velocity is defined as λ = y ˙ / y ˙ d e s , y ˙ d e s = 30 m/s, τ 1 , τ 2 and τ 3 are the adjustment coefficients, and σ is a constant.
With CCS continuous intervention, the lane departure risk declines, and the CCS control authority weight goes down to zero. However, lateral deviations increase due to driver manipulation error γ ( t ) > 0 , and the CCS intervenes again quickly. For avoiding frequent interventions, the dynamic CCS authority function is:
Γ a ( t ) = 0.2 + 1 1 + e τ 1 1 λ τ 2 γ + τ 3 K + σ ,   i f   Γ a ( t T ) > 0   a n d   γ t > 0  
In the non-domain, the vehicle can collide with the curb. The CCS has complete control authority and adopts emergency manipulation, which will be researched in our future work. The dynamic CCS authority function is:
Γ a ( t ) = 1 ,   i f   K ( S ) < 0  
The driver control authority Γ d ( t ) is shown as:
Γ d t = 1 Γ a t
The cooperative steering angle is written as:
δ f = Γ d δ d + Γ a δ a
The pseudocode of the cooperative control authority allocation approach is depicted in Algorithm 1. The dynamic CCS authority function is shown in Figure 5a,b. The CCS authority adapts to variations in driver error, lane departure risk, and relative velocity. For dealing with the lane departure risk caused by driver manipulation error, the CCS allocation function value rises with increases in the degree of driver manipulation error. Furthermore, the lane departure risk is important for authority allocation. The CCS authority is negatively related to lane departure risk. It should be noted that relative velocity is also a vital factor for cooperative design. As for same driver steering error, the CCS authority rises with increases in relative velocity to rapidly correct driver error and adapt to variations in steering sensitivity of the vehicle.
Algorithm 1 Pseudocode of the cooperative control authority allocation.
Input: correlation function K , driver manipulation error degree γ ( t ) , sampling time T,
expected driver steering angle δ d , CCS steering angle δ a
Output: cooperative steering angle δ f
1:if  K (S) < 0
2: then Γ a ( t ) 1
3:else if  K S 0 and K S 1
4:  if  γ ( t ) = 0 and K ( S ) 0.8
5:   then Γ a t 0
6:  else
7:     Γ a t 0.2 + 1 1 + e τ 1 ( 1 λ ) τ 2 γ + τ 3 K + σ
8:  end if
9:else
10:  if  Γ a t T   > 0   and   γ ( t ) > 0
11:   then Γ a t 0.2 + 1 1 + e τ 1 ( 1 λ ) τ 2 γ + τ 3 K + σ
12:  else
13:     Γ a t 0
14:  end if
15:end if
16:if  Γ a t > 1
17: then Γ a t 1
18:end if
19: Γ d t 1 Γ a t // Variable driver control authority weight
20: δ f Γ d δ d + Γ a δ a // Cooperative control steering angle
21:return  δ f

3.4. MPC-Based CCS Controller Design

The goal of the CCS controller is to avoid lane departure and reduce CCS intervention time to as little as possible. Thus, the CCS controller maintains a lateral position deviation equal to 0.4 m in the extension domain.
The vehicle dynamics model used as the predictive model for the MPC-based controller has been expressed in Equation (2). The nonlinear model needs to be linearized because of the strict real-time requirement. By applying the control sequence u t = u * t to Equation (2), the state equation is shown as:
ξ · t = f ξ t , u * t
where u ( t ) is the optimal control vector, and ξ t are the state vectors.
For expanding Equation (2) in Taylor series around the point ( ξ t , u * t ), and discarding the high-order terms, it can be depicted as:
ξ · t = f ξ t , u * t + f ξ ξ t = ξ t u t = u * t ξ t ξ t +   f u ξ t = ξ t u t = u * t u t u * t
The subtraction of Equation (20) from Equation (21) is:
ξ · t = A t ξ t + B t u t + d t
where the Jacobian matrix A t and B t are calculated as:
A t = f ( ξ ( t ) , u ( t ) ) ξ ξ t , u * t , B t = f ( ξ ( t ) , u ( t ) ) u ξ t , u * t , d t = ξ · t A t ξ t B t u * t
For discretizing the data, the first-order difference quotient is used and the expression is:
ξ k + 1 t = A k , t ξ k t + B k , t u k t + d k , t
where d k , t = ξ k + 1 t A k , t ξ k t B k , t u * k t , A k , t = I + T A t , B k , t = T B t , and T is the system sampling time.
The control variables u k t convert into the control increment Δ u k t to limit the control increment; the state equation is described as:
ξ ˜ k + 1 t = A ˜ k , t ξ ˜ k t + B ˜ k , t u k t + d ˜ k , t
where A ˜ k , t = A k , t B k , t 0 m × n I m , B ˜ k , t = B k , t I m , 0 m × n is a matrix with nm zeros, 0 m is a column vector of m zeros, and I m is an identity matrix of dimension m.
Assuming:
ξ ˜ ( k t ) = ξ ( k t ) u ( k 1 t ) , d ˜ k , t = d k t 0 m ,   u k t = u k t u k 1 t .
The output vector η k t of the predictive model is:
η k t = C ˜ k , t ξ ˜ k t
where C ˜ k , t = C k , t 0 , C k , t = 0 0 1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 1 0 0 .
To reduce the computation complexity of the controller, the following assumptions are made: A k , t = A t , t , B k , t = B t , t , C k , t = C t , t and k = 1 , , H p .
The objective function is:
J ξ t , u t 1 , u t = k = 1 H p η t + k t η r e f t + k t Q 2 + k = 1 H c 1 u t + k t R 2 + ρ ε 2
where x P = x P x and P R n × n is positive definite, H c and H p are the control horizon and the prediction horizon, η r e f t + k t is the reference path, Q is the weight matrixes, R and ρ are the weight coefficients, and ε is a slack variable.
The optimization problem is described as:
   min u , ε J ξ t , u t , ρ s . t   ξ ˜ k + 1 , t = A ˜ t , t ξ ˜ k , t + B ˜ t , t u k , t + d ˜ k , t    u k , t = u k 1 , t + Δ u k , t    u m i n u k , t u m a x    Δ u m i n Δ u k , t Δ u m a x    ρ 0
The controller output is an optimal control sequence, and the first control vector in this sequence is the optimal front steering angle δ a , which is sent to the cooperative control module for the cooperative control.

4. Results and Discussion

For verifying the effectiveness of the proposed cooperative control method, five different driving scenarios with respect to driver reactions in lane keeping are tested based on a CarSim and Simulink co-simulation platform. The vehicle model is set up in CarSim, and the control algorithm is designed in Simulink. A road adhesion coefficient of 0.85 and a lane width of 3.75 m are set up in CarSim’s virtual environment. The vehicle used for tests is an E-class Sedan, which is defined in CarSim. The vehicle parameters used in the simulation can be found in [35,36], as shown in Table 1. The simulation parameters are shown as following:
y L 1 = 0.4 m, y L 2 = 0.9 m, ψ L 1 = 2 , ψ L 2 = 6 , δ f , min = 10 , δ f , m a x = 10 , δ f , m i n = 0.85 , δ f , m a x = 0.85 , δ t h d = 50 , H p = 20 , H c = 10 , T = 0.02 , Q = d i a g ( 500 , 30 , 15 ) , R = 8 10 4 , ρ = 1000 , τ 1 = 5.6 , τ 2 = 6.4 , τ 3 = 1.2 , σ = 0.8 .

4.1. Comparison of Different Methods at a Straight Road

This scenario is designed to verify the contributions of the proposed scheme by comparison of different methods. The vehicle travels along the center of a straight road for x ˙ = 20 m/s. The driver generates the manipulation error at time t = 3.5 s, and the erroneous steering wheel angle is δ S W = 10 s i n ( 1.57 ( t 3.5 ) ) degrees. There are three methods established for comparison in the above same driving scenario; No CCS denotes that the driver controls the vehicle independently. Inspired by the ideas of Zhang et al. [26] and Guo et al. [27], we establish the constant authority method and authority transfer method; CA CCS denotes that the driver and the CCS share constant control authority with respect to the lateral position deviation. The cooperative control authority is Γ a = 0 , i f 0.4 < y L < 0.4 0.5 ,   e l s e . SA CCS denotes that authority switches smoothly between the driver and the CCS according to the lateral position deviation. The cooperative control authority is Γ a = 0 , i f 0.4 < y L < 0.4 1 ,   e l s e . A first-order inertial element with time lag ta is used to generate a smooth variation between zero and one.
Figure 6a shows that the cooperative steering angle is the optimal output according to the driver steering angle and CCS steering angle. The proposed CCS cannot correct immediately, and the driver has complete control authority when making the wrong steering angle at 3.5 s. At the same time, the lane departure risk (see Figure 6c) and driver manipulation error (see Figure 6d) are evaluated for safety supervision. When the lane departure risk and driver error reach cooperation conditions, intervention by the proposed CCS is triggered. The driver corrects his wrong steering angle, calculated by the reference driver model at 6 s. When the lane departure risk is greater than 0.8, the driver has complete control authority after this time for driving freedom.
The No CCS method results in the vehicle being outside of the lane from 5.25 s to 7.07 s. The CA CCS method results in the vehicle being outside of the lane from 5.7 s to 5.91 s, as shown in Figure 6e. Additionally, the proposed method reduces the maximum lateral deviation by 35.8 percent and 20.4 percent compared to the CA CCS and SA CCS methods, reflecting a good lane keeping performance. From the perspective of driving freedom, the proposed CCS authority is reduced as driver error declines, as shown in Figure 6d. The proposed method decreases cooperative control time by 27.8 percent and 51.6 percent compared to the CA CCS and SA CCS methods. As for yaw stability, according to the vehicle dynamics [39], the modulus of the maximum yaw rate is φ ˙ m a x = μ g / x ˙ and μ is the road adhesion coefficient. The maximum yaw rate is 0.42 rad/s in this scenario. As shown in Figure 6f, the yaw rate of the No CCS method exceeds 0.42 rad/s, and vehicles controlled by other methods are in stable states. It can be concluded that the proposed method achieves a preferable balance between lane keeping performance and driving freedom compared to the other methods in this scenario.

4.2. Comparison of Different Velocities on a Straight Road

This scenario shows the robust performance of the proposed method. Three simulation tests are conducted for x ˙ = 10 m/s, x ˙ = 20 m/s and x ˙ = 30 m/s, respectively. The driver error and simulation environment are the same as Section 4.1. Figure 7a shows the cooperative steering angles under different velocity conditions. The corrective angle generates earlier with increasing velocity due to the fast-increasing lateral deviation in the cooperation process. The contrasts in CCS control authority weights are shown in Figure 7b. CCS intervention time is shorter for x ˙ = 10 m/s, because the lower velocity has a smaller lateral position deviation. Furthermore, authority decreases with declines in speed, and the driver has more driving freedom. The contrasts in lateral position deviations are described in Figure 7c; deviation decreases with reductions in velocity. The proposed method can keep the vehicle traveling in the lane under different velocity conditions in the driver error scenario. Figure 7d shows that yaw rate variations reflect stable states of the vehicle under different velocity conditions.

4.3. Comparison of Different Methods on a Curving Road

To further verify the advantages of the proposed method on a curving road, the No CCS, CA CCS, and SA CCS methods described in Section 4.1 are used for comparison. The road curve equation is Y = X 2 + 600 2 + 600 m, and the vehicle travels along the center of the curving road. The driver maintains a steering wheel angle δ SW = 15 due to driver error from 3.5 s.
As shown in Figure 8a, the proposed CCS cannot immediately correct the error when the driver maintains a wrong steering angle, and the driver has full control authority. Compared with the continuous cooperative control for reducing lateral deviation during the whole driving process, the driver has full driving freedom when the lane departure risk is greater than 0.8, as shown in Figure 8c,d. The angle generated by the proposed method is larger than that of the CA CCS and SA CCS methods at 4.4 s to quickly correct driver error, as shown in Figure 8b. From the perspective of lane keeping performance, the No CCS method results in the vehicle being outside of the lane. The proposed method reduces the maximum lateral position deviation by 46 percent and 31.4 percent compared to the CA CCS and SA CCS methods, as shown in Figure 8e. As for driving freedom, the proposed CCS authority is reduced as driver error declines, as shown in Figure 8d. The proposed method decreases the cooperative control time by 14.4 percent and 18.4 percent compared to the CA CCS and SA CCS methods. As shown in Figure 8f, the yaw rate of the No CCS method exceeds the allowable value 0.42 rad/s, and vehicles controlled by other methods are in stable states.

4.4. Comparison of Different Velocities on a Curving Road

For verifying the robust performance of the proposed method on a curving road, three tests are implemented for x ˙ = 10 m/s, x ˙ = 20 m/s, and x ˙ = 30 m/s, respectively. The driver manipulation error and simulation environment are the same as in Section 4.3.
Figure 9a,b show the cooperative steering angles and cooperative control authority weights under different velocity conditions. The cooperative steering angle is the same as the driver steering angle before 4.32 s because the CCS authority weight is zero. At the cooperative control stage, the controller calculates an optimal angle to correct the driver’s manipulation error. Authority weight decreases with the decrease in speed. As shown in Figure 9c, the deviation decreases with reductions in velocity, and the vehicle travels in the lane under three velocity conditions. The yaw rates reflect the stable states of the vehicle, as shown in Figure 9d.

5. Conclusions

Reasonably foreseeable misuse by persons is a principal aspect of SOTIF. This paper focuses on the effect of driver error on human–machine cooperation for lane keeping. The proposed cooperative control scheme achieves a proper balance between lane keeping performance and driving freedom in driver error scenarios. A safety evaluation strategy is proposed to assess driver error and lane departure risk caused by driver error. A typical driver model in the loop is used for evaluating dynamic driver behavior in real-time. Based on safety evaluation results, an extension model is established and determines the cooperation domain for achieving a basic balance. Furthermore, a dynamic authority allocation strategy is proposed, and the authority adapts to variations in driver manipulation error, lane departure risk, and relative velocity. Meanwhile, an MPC-based controller and SBW actuator are employed for optimal steering angle to correct driver error.
Numerical simulation tests are developed to verify contributions. From the perspective of lane keeping performance, compared with CA CCS and SA CCS methods, the proposed method reduces maximum lateral deviation by 35.8 percent and 20.4 percent on a straight road. It reduces deviation by 46 percent and 31.4 percent on a curving road. As for driving freedom, the proposed method decreases cooperative control time by 27.8 percent and 51.6 percent compared to the CA CCS and SA CCS methods on a straight road. Additionally, the proposed method decreases cooperative control time by 14.4 percent and 18.4 percent compared to the CA CCS and SA CCS methods on a curving road. The results reflect that the proposed scheme achieves a proper balance between lane keeping performance and driving freedom.

Author Contributions

Conceptualization, W.C. and M.Y.; methodology, M.Y.; software, B.C.; validation, M.Y. and L.Z.; formal analysis, Q.W.; investigation, X.L.; resources, W.C.; data curation, B.C.; writing—original draft preparation, M.Y.; writing—review and editing, Q.W. and L.Z.; supervision, Q.W.; project administration, W.C.; funding acquisition, W.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, L.; Zheng, N.; Wang, F. A theoretical foundation of intelligence testing and its application for intelligent vehicles. IEEE Trans. Intell. Transp. Syst. 2020, 99, 1–10. [Google Scholar] [CrossRef]
  2. Wang, X.; Fu, M.; Ma, H.; Yang, Y. Lateral control of autonomous vehicles based on fuzzy logic. Control Eng. Pract. 2015, 34, 1–17. [Google Scholar] [CrossRef]
  3. Borroni, F.; Tanelli, M. A weight approach to the shared-control of lateral vehicle dynamics. In Proceedings of the International Federation of Automatic Control (IFAC), Symposium, Italy, 6–8 June 2018; pp. 305–310. [Google Scholar] [CrossRef]
  4. SAE. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles; Standard No. J3016_201609; Society of Automotive Engineers: Warrendale, PA, USA, 2016; p. 30. [Google Scholar]
  5. Song, L.; Guo, H.; Wang, F.; Liu, J.; Chen, H. Model predictive control oriented shared steering control for intelligent vehicles. In Proceedings of the 29th Chinese Control and Decision Conference, Chongqing, China, 28–30 May 2017; pp. 7568–7573. [Google Scholar] [CrossRef]
  6. Benloucif, M.A.; Nguyen, A.T.; Sentouh, C.; Popieul, J.C. A new scheme for haptic shared lateral control in highway driving using trajectory planning. In Proceedings of the 20th World Congress of the International-Federation-of-Automatic-Control (IFAC), Toulouse, France, 9–14 July 2017; pp. 13834–13840. [Google Scholar] [CrossRef]
  7. Liang, Y.; Yin, Z.; Nie, L. Shared steering control for lane keeping and obstacle avoidance based on multi-objective MPC. Sensors 2021, 21, 4671. [Google Scholar] [CrossRef] [PubMed]
  8. Miller, E.E.; Boyle, L.N. Behavioral adaptations to lane keeping systems: Effects of exposure and withdrawal. Hum. Factors 2019, 61, 152–164. [Google Scholar] [CrossRef]
  9. Bian, Y.; Ding, J.; Hu, M.; Xu, Q.; Wang, J.; Li, K. An advanced lane-keeping assistance system with switchable assistance modes. IEEE Trans. Intell. Transp. Syst. 2019, 21, 385–396. [Google Scholar] [CrossRef]
  10. Liu, W.; Sun, H.; Shen, W. Driver fatigue detection through pupil detection and yawing analysis. In Proceedings of the International Conference on Bioinformatics and Biomedical Technology, Chengdu, China, 16–18 April 2010; pp. 404–407. [Google Scholar] [CrossRef]
  11. NHTSA. Drowsy Driver Detection and Warning System for Commercial Vehicle Drivers: Field Proportional Test Design, Analysis, and Progress; National Highway Traffic Safety Administration: Washington, DC, USA, 2005.
  12. Kaplan, S.; Guvensan, M.A.; Yavuz, A.G.; Karalurt, Y. Driver behavior analysis for safe driving: A survey. IEEE Trans. Intell. Transp. Syst. 2015, 16, 3017–3032. [Google Scholar] [CrossRef]
  13. Tagne, G.; Talj, R.; Charara, A. Design of passivity-based controllers for lateral dynamics of intelligent vehicles. In Proceedings of the IEEE Intelligent Vehicles Symposium, Seoul, Korea, 28 June–1 July 2015; pp. 1044–1049. [Google Scholar] [CrossRef] [Green Version]
  14. ISO. Road Vehicles—Safety of the Intended Functionality (Draft): ISO/PAS 21448; ISO: Geneva, Switzerland, 2018. [Google Scholar]
  15. Lee, J.; Choi, J.; Yi, K.; Shin, M.; Ko, B. Lane-keeping assistance control algorithm using differential braking to prevent unintended lane departures. Control Eng. Pract. 2014, 23, 1–13. [Google Scholar] [CrossRef]
  16. Kang, T.; Kim, D.; Soh, M.; Jang, H.; Jo, H.S.; Park, K. Development of the lane keeping control system using state-varying surface for vulnerable road users. Int. J. Automot. Technol. 2018, 19, 489–498. [Google Scholar] [CrossRef]
  17. Nguyen, A.; Sentouh, C.; Popieul, J. Sensor reduction for driver-automation shared steering control via an adaptive authority allocation strategy. IEEE-ASME Trans. Mechatron. 2018, 23, 5–16. [Google Scholar] [CrossRef]
  18. Huang, M.; Gao, W.; Wang, Y.; Jiang, Z. Data-driven shared steering control design for lane keeping. In Proceedings of the International Federation of Automatic Control (IFAC) Symposium, Guadalajara, Mexico, 20–22 June 2018; pp. 155–160. [Google Scholar] [CrossRef]
  19. Basjaruddin, N.C.; Kuspriyanto; Suhendar; Saefudin, D.; Aryani, S.A. Lane keeping assist system based on fuzzy logic. In Proceedings of the International Electronics Symposium (IES), Surabaya, Indonesia, 29–30 September 2015; pp. 110–113. [CrossRef]
  20. Yuan, W.; Yang, M.; Hao, L.; Wang, C.; Wang, B. End-to-end learning for high-precision lane keeping via multi-state model. CAAI Trans. Intell. Technol. 2018, 3, 185–190. [Google Scholar] [CrossRef]
  21. Du, H.; Man, Z.; Zheng, J.; Cricenti, A.; Zhao, Y.; Xu, Z.; Wang, H. Robust control for vehicle lane-keeping with sliding mode. In Proceedings of the Asian Control Conference (ASCC), Gold Coast, QLD, Australia, 17–20 December 2017; pp. 84–89. [Google Scholar] [CrossRef]
  22. Chu, Z.; Sun, Y.; Wu, C.; Sepehri, N. Active disturbance rejection control applied to automated steering for lane keeping in autonomous vehicles. Control Eng. Pract. 2018, 74, 13–21. [Google Scholar] [CrossRef]
  23. Benloucif, A.; Nguyen, A.B.; Sentouh, C.; Popieul, J.C. Cooperative trajectory planning for haptic shared control between driver and automation in highway driving. IEEE Trans. Ind. Electron. 2019, 66, 9846–9857. [Google Scholar] [CrossRef]
  24. Wang, H.; Cui, W.; Xia, Z.; Jiang, W. Vehicle lane keeping system based on TSK fuzzy extensive control. Proc. Inst. Mech. Eng. Part D-J. Automob. Eng. 2019, 234, 762–773. [Google Scholar] [CrossRef]
  25. Sentouh, C.; Nguyen, A.T.; Rath, J.J.; Floris, J.; Popieul, J.C. Human–machine shared control for vehicle lane keeping systems: A Lyapunov-based approach. IET Intell. Transp. Syst. 2018, 13, 63–71. [Google Scholar] [CrossRef]
  26. Zhang, W.; Zhao, Y.; Zhang, X.; Lin, F. Shared control for lane keeping assistance system based on multiple-phase handling inverse dynamics. Control Eng. Pract. 2019, 93, 104182. [Google Scholar] [CrossRef]
  27. Guo, C.; Sentouh, C.; Popieul, J.C.; Haue, J.B. MPC-based shared control for automated driving systems. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada, 5–8 October 2017; pp. 129–134. [Google Scholar] [CrossRef]
  28. Merah, A.; Hartani, K.; Draou, A. A new shared control for lane keeping and road departure prevention. Veh. Syst. Dyn. 2016, 54, 86–101. [Google Scholar] [CrossRef]
  29. Xing, Y.; Lv, C.; Cao, D.; Hang, P. Toward human-vehicle collaboration: Review and perspectives on human-centered collaborative automated driving. Transport Res. C-Emer. 2021, 128, 103199. [Google Scholar] [CrossRef]
  30. Marcano, M.; Diaz, S.; Perez, J.; Irigoyen, E. A review of shared control for automated vehicles: Theory and applications. IEEE T. Hum.-Mach. Syst. 2020, 50, 475–491. [Google Scholar] [CrossRef]
  31. Li, R.; Li, Y.; Li, S.E.; Burdet, E.; Cheng, B. Driver-automation indirect shared control of highly automated vehicles with intention-aware authority transition. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA, 11–14 June 2017; pp. 26–32. [Google Scholar] [CrossRef]
  32. Li, R.; Li, Y.; Li, S.E.; Zhang, C.; Burdet, E.; Cheng, B. Indirect shared control for cooperative driving between driver and automation in steer-by-wire vehicles. IEEE Trans. Intell. Transp. Syst. 2020, 1–11. [Google Scholar] [CrossRef]
  33. Nguyen, A.T.; Sentouh, C.; Popieul, J.C. Online adaptation of the authority level for shared lateral control of driver steering assist system using dynamic output feedback controller. In Proceedings of the 41st Annual Conference of the IEEE Industrial Electronics Society, Yokohama, Japan, 9–12 November 2015. [Google Scholar] [CrossRef]
  34. Li, M.; Song, X.; Cao, H.; Wang, J.; Huang, Y.; Hu, C.; Wang, H. Shared control with a novel dynamic authority allocation strategy based on game theory and driving safety field. Mech. Syst. Signal Process. 2019, 124, 199–216. [Google Scholar] [CrossRef]
  35. Chen, W.; Yan, M.; Wang, Q.; Xu, K. Dynamic path planning and path following control for autonomous vehicle based on the piecewise affine tire model. Proc. Inst. Mech. Eng. Part D-J. Automob. Eng. 2021, 235, 881–893. [Google Scholar] [CrossRef]
  36. Xie, Y.; Zhao, L.; Chen, W.; Liu, Y. Road feel and return control on low friction coefficient road for steer-by-wire vehicles. J. Mech. Eng. 2019, 55, 148–158. [Google Scholar] [CrossRef]
  37. Wang, H.; Chen, L.; Zhang, W. Lane-keeping control based on an improved artificial potential method and coordination of steering/braking systems. IET Intell. Transp. Syst. 2019, 13, 1832–1842. [Google Scholar] [CrossRef]
  38. Chen, W.; Wang, X.; Tan, D.; Lin, X.; Sun, X.; Xie, Y. Study on the grey predictive extension control of yaw stability of electric vehicle based on the minimum energy consumption. J. Mech. Eng. 2019, 55, 156–167. [Google Scholar] [CrossRef]
  39. Bobier, C.G.; Gerdes, J.C. Staying within the nullcline boundary for vehicle envelope control using a sliding surface. Veh. Syst. Dyn. 2013, 51, 199–217. [Google Scholar] [CrossRef]
Figure 1. Vehicle dynamics model.
Figure 1. Vehicle dynamics model.
Actuators 10 00210 g001
Figure 2. Configuration of steer-by-wire (SBW) system.
Figure 2. Configuration of steer-by-wire (SBW) system.
Actuators 10 00210 g002
Figure 3. The proposed novel human–machine cooperative control scheme for lane keeping.
Figure 3. The proposed novel human–machine cooperative control scheme for lane keeping.
Actuators 10 00210 g003
Figure 4. Extension sets: (a) two-dimensional extension set; (b) one-dimensional extension set.
Figure 4. Extension sets: (a) two-dimensional extension set; (b) one-dimensional extension set.
Actuators 10 00210 g004
Figure 5. CCS authority weight: (a) CCS authority weight with variations in correlation function value and driver manipulation error; (b) CCS authority weight with variations in relative velocity and driver manipulation error.
Figure 5. CCS authority weight: (a) CCS authority weight with variations in correlation function value and driver manipulation error; (b) CCS authority weight with variations in relative velocity and driver manipulation error.
Actuators 10 00210 g005
Figure 6. The comparison results of different methods on a straight road: (a) Front-wheel steering angles of the proposed method; (b) Cooperative steering angles; (c) Lane departure risks; (d) CCS control authority weights; (e) Lateral position deviations; (f) Yaw rates.
Figure 6. The comparison results of different methods on a straight road: (a) Front-wheel steering angles of the proposed method; (b) Cooperative steering angles; (c) Lane departure risks; (d) CCS control authority weights; (e) Lateral position deviations; (f) Yaw rates.
Actuators 10 00210 g006
Figure 7. The comparison results of different velocities on a straight road: (a) Cooperative steering angles; (b) CCS control authority weights; (c) Lateral position deviations; (d) Yaw rates.
Figure 7. The comparison results of different velocities on a straight road: (a) Cooperative steering angles; (b) CCS control authority weights; (c) Lateral position deviations; (d) Yaw rates.
Actuators 10 00210 g007aActuators 10 00210 g007b
Figure 8. The comparison results of different methods on a curving road: (a) Front-wheel steering angles of the proposed method; (b) Cooperative steering angles; (c) Lane departure risks; (d) CCS control authority weights; (e) Lateral position deviations; (f) Yaw rates.
Figure 8. The comparison results of different methods on a curving road: (a) Front-wheel steering angles of the proposed method; (b) Cooperative steering angles; (c) Lane departure risks; (d) CCS control authority weights; (e) Lateral position deviations; (f) Yaw rates.
Actuators 10 00210 g008aActuators 10 00210 g008b
Figure 9. The comparison results of different velocities on a curving road: (a) Cooperative steering angles; (b) CCS control authority weights; (c) Lateral position deviations; (d) Yaw rates.
Figure 9. The comparison results of different velocities on a curving road: (a) Cooperative steering angles; (b) CCS control authority weights; (c) Lateral position deviations; (d) Yaw rates.
Actuators 10 00210 g009
Table 1. Vehicle parameters.
Table 1. Vehicle parameters.
ParameterDescriptionValue
m Total mass1723 kg
I z Vehicle yaw moment of inertia4175 kg m2
a Distance from CG to front axle1.232 m
b Distance from CG to rear axle1.468 m
w Vehicle width1.85 m
C f Front cornering stiffness66,900 N/rad
C r Rear cornering stiffness62,700 N/rad
J m Steering motor moment of inertia0.00054 kg m2
B m Steering motor shaft damping0.00009 N m s/rad
k f Steering actuator assembly stiffness119 N m/rad
G m Steering motor reduction ratio16.5
r p Rack displacement0.007 m
k m Steering motor electromotive force constant0.0506
R m Steering motor resistance0.345 Ω
L m Steering motor inductance0.000238 H
M r Rack mass2.25 kg
B r Rack damping653 N m s/rad
l f Left steering arm length0.138 m
l r Right steering arm length0.138 m
i s steering gear ratio16.5
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yan, M.; Chen, W.; Wang, Q.; Zhao, L.; Liang, X.; Cai, B. Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality. Actuators 2021, 10, 210. https://doi.org/10.3390/act10090210

AMA Style

Yan M, Chen W, Wang Q, Zhao L, Liang X, Cai B. Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality. Actuators. 2021; 10(9):210. https://doi.org/10.3390/act10090210

Chicago/Turabian Style

Yan, Mingyue, Wuwei Chen, Qidong Wang, Linfeng Zhao, Xiutian Liang, and Bixin Cai. 2021. "Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality" Actuators 10, no. 9: 210. https://doi.org/10.3390/act10090210

APA Style

Yan, M., Chen, W., Wang, Q., Zhao, L., Liang, X., & Cai, B. (2021). Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality. Actuators, 10(9), 210. https://doi.org/10.3390/act10090210

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop