Next Article in Journal
Average Consensus over Mobile Wireless Sensor Networks: Weight Matrix Guaranteeing Convergence without Reconfiguration of Edge Weights
Previous Article in Journal
Recent Advances in the Electrochemical Sensing of Venlafaxine: An Antidepressant Drug and Environmental Contaminant
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Road Profile Estimation Using a 3D Sensor and Intelligent Vehicle

1
School of Mechanical and Aerospace Engineering, Jilin University, Changchun 130022, China
2
School of Mechanical Engineering, Yanshan University, Qinhuangdao 066004, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(13), 3676; https://doi.org/10.3390/s20133676
Submission received: 24 May 2020 / Revised: 23 June 2020 / Accepted: 28 June 2020 / Published: 30 June 2020
(This article belongs to the Section Intelligent Sensors)

Abstract

:
Autonomous vehicles can achieve accurate localization and real-time road information perception using sensors such as global navigation satellite systems (GNSSs), light detection and ranging (LiDAR), and inertial measurement units (IMUs). With road information, vehicles can navigate autonomously to a given position without traffic accidents. However, most of the research on autonomous vehicles has paid little attention to road profile information, which is a significant reference for vehicles driving on uneven terrain. Most vehicles experience violent vibrations when driving on uneven terrain, which reduce the accuracy and stability of data obtained by LiDAR and IMUs. Vehicles with an active suspension system, on the other hand, can maintain stability on uneven roads, which further guarantees sensor accuracy. In this paper, we propose a novel method for road profile estimation using LiDAR and vehicles with an active suspension system. In the former, 3D laser scanners, IMU, and GPS were used to obtain accurate pose information and real-time cloud data points, which were added to an elevation map. In the latter, the elevation map was further processed by a Kalman filter algorithm to fuse multiple cloud data points at the same cell of the map. The model predictive control (MPC) method is proposed to control the active suspension system to maintain vehicle stability, thus further reducing drifts of LiDAR and IMU data. The proposed method was carried out in outdoor environments, and the experiment results demonstrated its accuracy and effectiveness.

1. Introduction

In the last three decades, driverless technology has rapidly developed due to people’s willingness to improve living standards, and the need to improve work efficiency. The key issue to driverless vehicles is how to drive to a given place without any traffic accidents. The localization and perception of autonomous vehicles are two significant technological aspects to solve the above issue. Most studies on driverless vehicles used multi-sensors such as inertial measurement units (IMUs), light detection and ranging (LiDAR), and global navigation satellite systems (GNSSs) to achieve vehicle perception and localization [1,2,3,4,5]. Gao [6] proposed a robust localization system that made better use of the relative merits of LiDAR and global positioning systems (GPSs) to correct the data obtained by inertial navigation system (INSs) selectively in outdoor and indoor environments. Experiment results showed that the proposed localization system could maintain meter-level localization accuracy within the experimental period. Wan [7] proposed a robust and precise localization method that could maintain centimeter-level navigation accuracy in some challenging environments. The proposed system used a Kalman filter (KF) algorithm to fuse the data obtained by physical sensors such as GPS, INS, and LiDAR to achieve high localization accuracy and robustness. Wolcott [8] proposed a robust localization system of driverless vehicles based on gaussian probabilistic model. Results showed that the proposed system significantly improved the localization accuracy compared to other methods. Tang et al. [9] presented a navigation system that takes advantage of the complementary characteristics of INS and LiDAR. The proposed system frame used an extended Kalman filter (EKF) algorithm to fuse the information from LiDAR and INS, which ensured that the advantages of each subsystem were fully utilized to achieve long-term stable localization accuracy of autonomous vehicles. Chang [10] proposed a simultaneous localization and mapping (SLAM) navigation system that fused the information obtained by GNSS, INS, and LiDAR to achieve vehicle mapping and localization. The advantage of the proposed method is that it estimated pose information based on graph optimization technology. Experiment results showed that the method could effectively utilize data from GNSS, INS, and LiDAR, and improve the localization accuracy even when the INS data and GNSS signal are unstable. Qin [11] presented a visual-inertial navigation system that used nonlinear analysis and graph optimization technology to obtain accurate and robust pose estimation. Qian [12] investigated a SLAM algorithm that effectively used heading angle and velocity information from INS/GPS to improve the navigation accuracy of vehicles. Experimental results showed that the proposed method achieved centimeter-level horizontal localization accuracy. The authors in [13] proposed a simultaneous localization and mapping method of constructing forest maps using LiDAR, IMU, and GPS. The proposed method generated a 3D map using cloud data points obtained by 3D laser scanners and improved it with a graph optimization algorithm.
Accurate road profile estimation is significant for autonomous vehicles driving on uneven terrain, as it can be used as a reference index for vehicle path planning. Several methods on road profile estimation have been proposed. The authors in [14] used 3D laser scanners to obtain road and environment information for mapping. The presented approach processed cloud data points with a segmentation algorithm and calculated pose information from the obtained local maps. Droeschel [15] presented a simultaneous localization and mapping system that built local dense 3D maps of surrounding environments with a graph-optimization algorithm. Zhao [16] proposed a method for obtaining accurate road profile information using 3D laser scanners, INS, and GPS. The proposed method fused the information from GPS and INS using a KF algorithm to obtain accurate and robust pose information. Peter [17] proposed a novel method for terrain profile estimation that fully considered the errors of measurement system and incorporated uncertainties of 3D laser scanner and INS measurements for yielding a probabilistic elevation map. Wang [18] proposed a method for constructing the terrain profile and extracting preview elevation values based on predicted pose information of vehicles. Results demonstrated that the proposed algorithm achieved centimeter-level accuracy for the estimated elevation map.
The stability of vehicles is an important prerequisite for obtaining high-precision terrain information. However, violent vibrations are inevitable, even with appropriate path planning, for autonomous vehicles driving on uneven roads. One way to solve the problem is to equip the vehicle with an active suspension system to maintain stability when driving on complex terrain. The active suspension system is a significant component of vehicles because it can generate the force between the vehicle body and wheel to compensate vehicle vibration caused by terrain unevenness. A wide range of suspension controllers were proposed [19,20,21,22]. Huang [23] presented an adaptive controller for vehicle active suspension systems to solve the problem of parameter uncertainties. Marzbanrad [24] proposed an optimal control method for vehicle suspension system on uneven terrain. Road elevation values were calculated in advance and as input information to control active suspension systems in this paper. Pan [25] investigated an adaptive control method for active suspension systems to improve ride comfort and handling stability. Youn et al. [26] investigated a preview control method for the semi-active and active suspension systems. The road disturbance information was obtained from the front wheels and used as a preview input of rear wheels of the vehicle. Göhrle [27] proposed a novel preview control method that obtained terrain profile information using a vehicle equipped with ranging sensors and controlled active suspension systems using this information to improve vehicle performance. Result showed that the terrain profile information could be well estimated, and ride comfort and handling stability were also improved with the proposed method. Theunissen et al. [28] proposed an explicit model predictive control method that used the road information obtained by LiDAR as the signal input to control the active suspension system. Experiment results showed that the heave and pitch acceleration of the sprung mass was reduced compared with the passive suspension system and skyhook controllers. The proposed algorithm also required less memory space compared with other methods, because the complex calculation process was operated offline. Du [29] proposed an output feedback control method for vehicle suspension systems that used a nonlinear extended state observer to estimated model uncertainties. The proposed approach could effectively estimate the nonlinear dynamics and mismatch disturbances such as sprung mass, unknown friction coefficient, and measurement noise caused by sensors. Results showed that vehicle ride comfort was significantly improved, and the proposed algorithm could achieve fast convergence, which indicated that the method was more applicable in engineering practice. Sun [30] investigated an active suspension controller that considered the impact of actuator input delay and band with constraints. Experiment results showed that the proposed approach achieved better vehicle performance compared with the traditional approach for active suspension systems. Pan [31] proposed an output feedback finite-time controller for vehicle active suspension systems. The proposed method used a robust first-order sliding mode observer to compensate for the model uncertainties such as mismatch disturbances, unknown parameter, and unmodeled dynamics. Results showed that the proposed controllers could effectively decrease root-mean-square errors of the vehicle vertical velocity and acceleration.
Although the aforementioned methods on road profile estimation could achieve good effects in some scenes, they could cause large errors for a vehicle working on complex uneven terrain. There are also a few scholars who conducted detailed studies on autonomous vehicles driving on complex terrain. For the above motivation, we propose a method for road profile estimation and active suspension control on complex uneven terrain. In Section 2, we introduce the configuration of our autonomous vehicle and the overall flow of our approach. In Section 3, details about the terrain profile estimation method are shown. In Section 4, we propose a method for model predictive control (MPC) with a preview, which uses terrain profile information and IMU/GPS data to control the active suspension system. Lastly, real-world experiments were carried out to demonstrate the accuracy and effectiveness of our approach.

2. System Structure

Autonomous vehicles working on uneven terrain need to consider not only the surrounding environment but also terrain profile information, which is different from autonomous vehicles driving on urban even driveways. Accurate road profile information can be used as a reference index for vehicle-path planning. However, the traditional autonomous vehicles experience violent vibrations when driving on uneven terrain, which leads to drifts of LiDAR and IMU data. Therefore, how to obtain accurate terrain information and drive autonomous vehicles stably and safely on complex roads are two significant issues. In order to solve the above issue, our vehicle was equipped with two GPSs, an IMU, two 3D laser scanners, and an active suspension system, as shown in Figure 1. Location accuracy is a prerequisite for constructing an accurate road profile map. Therefore, our system used real time kinematic (RTK) technology to ensure centimeter-level positioning accuracy of GPS. Our vehicle also serves for open outdoor scenes, so the stability of the positioning system is well-assured. With accurate positioning information, cloud data points obtained by LiDAR were added to the terrain elevation map and further processed by the Kalman filter algorithm. Ultimately, the elevation map information and IMU/GPS data were used as inputs to control the active suspension system to maintain vehicle stability; Figure 2 shows the main steps.

3. Method

3.1. Elevation Map Estimation

Constructing a reliable and accurate elevation map needs to consider the systematic error of sensor measurements. In this section, we propose a method for constructing a probability elevation map. Elevation information in each cell of the map includes not only the estimated evaluation value, but also the confidence boundary of the estimated value. Our method is different than other proposed methods (proposed in [17]) for probability map estimation because our autonomous vehicle has an active suspension system and a global positioning system that can ensure the stability and positioning accuracy of the vehicle, thus further reducing sensor drifts.

3.1.1. Coordinate System Definition

Seven coordinate systems were defined in our autonomous vehicle, namely East-North-Up (ENU) coordinate system G , inertial coordinate system W , map coordinate system M , vehicle coordinate system B k , IMU coordinate system I , local map coordinate system M k , and LiDAR coordinate system L , respectively, as shown in Figure 3.
Suppose that the inertial coordinate system W is fixed in the real environment. Vehicle coordinate system B k , IMU coordinate system I , and LiDAR coordinate system L are fixed in the corresponding position of the vehicle, respectively, and their position relationship can be obtained through calibration technology. Map coordinate system M is also fixed in the real environment, as is the inertial coordinate system W . Local map coordinate system M k moves with the motion of the vehicle and maintains an invariant transformation with vehicle coordinate system B k .

3.1.2. Uncertain Estimation of Location System

The motion of the vehicle can create noise errors because of systematic errors caused by GPS/IMU, which influence the precision of the elevation map. Therefore, errors caused by GPS/IMU need to be considered when constructing the elevation map. A sub-coordinate system was built to describe the coordinate transformation relationship, as shown in Figure 4. Measurement value P expressed in coordinate system B k at time k can be converted to map coordinate system M :
R M P , k M = R M W M + R W P , k M = R M W M + R W P , k W = R M W M + R W B k W + Φ B k W 1 ( R B k P B k )
where Φ B k W 1 ( R B k P B k ) represents the rotation transformation of vector R B k P from coordinate system B k to coordinate system W .
The Gaussian probability distribution of R W B k and Φ W B k can be defined as follows:
{ R W B k N ( R ^ W B k , r , k ) Φ W B k N ( Φ ^ W B k , Φ , k )
where r , k and Φ , k represent the covariance of the pose estimation between the inertial coordinate system W and the vehicle coordinate system B k .
Then, the error propagation of the location system can be calculated as follows [17]:
m o v e , k = J r , k r , k J r , k T + J Φ , k Φ , k J Φ , k T
With Equation (1), the Jacobian matrices can be obtained:
{ J r , k = M R M P , k R W B k W = R W B k W R W B k W + ( R M W W + Φ B k W 1 ( R B k P B k ) ) R W B k W = I J Φ , k = R M P , k M Φ B k W = ( R W B k W + R M W W ) Φ B k W + Φ B k W 1 ( R B k P B k ) Φ B k W = C ( Φ B k W ) T ( R B k P B k ) ×

3.1.3. Uncertain Estimation of LiDAR System

From Figure 3, measurement point P k is generally represented by vector R L P k L in LiDAR coordinate system L . With the transformation from LiDAR coordinate system L to vehicle coordinate system B k , the vector R B k P k B k could be obtained:
R B k P k B k = Φ L B k 1 ( R L P k L ) + R B k L k B k = Φ L B 1 ( R L P k L ) + R B L B
The error propagation of the measurement system can be calculated as follows [17]:
L , k = J L , k M , k J L , k T
where M , k represents the covariance matrix of the LiDAR measurement model, which can be obtained through sensor calibration technology.
The Jacobian matrix can be obtained according to Equation (5):
J L , k = R B k P k B k R L P k L = Φ L B 1 ( R L P k L ) R L P k L + R B L B R L P k L = C ( Φ L B ) T
The truncation error needs to be considered when the cloud data points are added to the corresponding grid cell of the elevation map. In order to reduce computation, the truncation error is set as an invariant value:
σ x 2 = σ y 2 = ( d 2 ) 2
Therefore, covariance matrix P of each grid cell can be defined as follows:
P = [ σ x 2 0 0 0 σ y 2 0 0 0 0 ]
In summary, according to Equations (3), (6), and (9), the error propagation model of an autonomous vehicle system can be expressed as follows:
k = m o v e , k + L , k + P

3.1.4. Elevation Map Update Method

Cloud data points obtained by LiDAR at different times may be added to the same cell of the elevation map with the motion of the vehicle, so an effective algorithm is needed to fuse the cloud data points of the same cell. In this study, the Kalman filter algorithm was used to fuse the cloud data points, which not only improved measurement accuracy, but also effectively utilized the height value variance of each measurement point.
Suppose that the height measurement value and corresponding covariance matrix of a cell are h ^ and σ h ^ 2 , respectively, and the height estimation value and corresponding variance matrix are h k and σ h , k 2 , respectively. The update process of the Kalman filter can be calculated:
{ K k + 1 = σ h , k 2 ( σ h , k 2 + σ h ^ 2 ) 1 h k + 1 = h k + K k + 1 ( h ^ h k ) σ h , k + 1 2 = ( I K k + 1 ) σ h , k 2
With Equation (11), the following equation can be obtained:
{ h k + 1 = σ h , k 2 h ^ + σ h ^ 2 h k σ h , k 2 + σ h ^ 2 σ h , k + 1 2 = σ h , k 2 σ h ^ 2 σ h , k 2 + σ h ^ 2
Sometimes, in the elevation value in the same cell, large drops occur due to vertical objects in the surrounding environment. If the elevation value of the cell is fused by a Kalman filter without any judgment, the updated elevation value is far from the real value. In order to avoid the above case, this study used Mahalanobis distance to judge all measured values before elevation information fusion. Only when the Mahalanobis distance between the estimated elevation value and the new measured value is less than threshold value c is the new measured value added to the cell. The Mahalanobis distance criterion is defined as follows:
d m ( Z k , Z k + 1 ) = ( h ^ h k + 1 ) 2 σ h , k + 1 2 + σ h ^ 2
{ Z k N ( h ^ , σ h ^ 2 ) Z k + 1 N ( h k + 1 , σ h , k + 1 2 )
(1) If h ^ > h k + 1 and d m ( Z k , Z k + 1 ) > c , then:
{ h ^ k + 1 = h ^ σ ^ h , k + 1 2 = σ h ^ 2
(2) If h ^ < h k + 1 and d m ( Z k , Z k + 1 ) > c , then:
{ h ^ k + 1 = h k + 1 σ ^ h , k + 1 2 = σ h , k + 1 2
(3) If d m ( Z k , Z k + 1 ) < c , then the new measured value can be calculated with Equation (12).
In summary, this section proposed a method for elevation map estimation that considers systematic errors caused by GPS/IMU, LiDAR, and map cells. The error-propagation model of vehicle systems was defined to calculate the confidence boundary of the estimated elevation value. Besides, the Kalman filter algorithm and Mahalanobis distance criterion were used to fuse the cloud data points of the same cell. The main flow of elevation map estimation is shown in Figure 5.

3.2. Model Predictive Control with Preview

Our autonomous vehicle was equipped with an active suspension system for solving the problem of vehicle stability when driving on complex uneven terrain, which could be sampled as a nine-degree-of-freedom vehicle model, as shown in Figure 6. The vehicle model consisted of six vertical unsprung masses and degrees of freedom due to the pitch, roll, and vertical motion of the mass center.
According to Newton’s second law, the vertical motion of the body centroid, the pitching rotation, and the roll rotation equations can be obtained as:
{ M Z ¨ = F 1 F 2 F 3 F 4 F 5 F 6 J Y Y θ ¨ = L r ( F 1 + F 2 ) L f ( F 5 + F 6 ) J X X φ ¨ = L a ( F 1 + F 3 + F 5 ) + L b ( F 2 F 4 F 6 )
where F i is the force generated by the actuator; Z , the vertical displacement of vehicle centroid; θ , the pitch angle of vehicle centroid; φ , the roll angle of vehicle centroid; and J X X and J Y Y , the moments of inertia of the X and Y axes, respectively. L r and L f are the distance between the center of mass, and front and rear suspension, respectively. L a and L b are the distance between center of mass, and left and right suspension, respectively.
In the preceding equations, F i ( i = 1, 2, 3, 4, 5, 6) acting as the force between the suspension and the vertical body can be calculated as follows:
F i = K i ( Z M i Z m i ) + C i ( Z ˙ M i Z ˙ m i ) f i ( t )
where K i is stiffness coefficients, C i is damping coefficients, and f i ( t ) is the force generated by actuators. In order to improve the flexibility of vehicle-suspension control, our vehicle-suspension system only consisted of actuators, as shown in Figure 1. Thus, stiffness coefficient K i and damping coefficient C i were set to zero.
The dynamic equation of the vertical motion of the unsprung mass is as follows:
m i Z ¨ m i = K i ( Z M i Z m i ) + C i ( Z ˙ M i Z ˙ m i ) f i ( t ) + K m i ( Z m i W i ) + C m i ( Z ˙ m i W ˙ i )
where K m i and C m i are the stiffness and damping coefficients of the tires, respectively.
According to the spatial motion law of rigid bodies, the dynamic relationship among the six suspension systems and the body centroid can be obtained as:
{ Z M 1 = Z + L r sin θ + L a sin φ Z M 2 = Z + L r sin θ L b sin φ Z M 3 = Z + L a sin φ Z M 4 = Z L b sin φ Z M 5 = Z L f sin θ + L a sin φ Z M 6 = Z L f sin θ L b sin φ
Suppose that the pitch and roll angles are sufficiently small, then the Equation (20) can be rewritten as follows:
sin θ θ , sin φ φ
The Equations (17)–(21) can be rewritten into a state-space formulation:
{ X ˙ M ( t ) = A M X M ( t ) + B M U ( t ) + E W W ( t ) Y M ( t ) = C M X M ( t ) + D M U ( t )
where X M ( t ) and Y M ( t ) denote state and output vectors, respectively; A M , B M , C M , and D M are system matrices; E W is the road disturbance matrix; and W ( t ) is the road disturbance, which can be obtained by the estimated elevation map.
State and output vectors can be expressed as follows:
{ X M = [ Z , θ , φ , Z M 1 ~ Z M 6 , Z ˙ , θ ˙ , φ ˙ , Z ˙ M 1 ~ Z ˙ M 6 ] T Y M = [ Z ¨ , θ ¨ , φ ¨ , ( Z M 1 Z m 1 ) ~ ( Z M 6 Z m 6 ) ] T
where the estimated values Z , θ , and φ were obtained by IMU/GPS mounted on the vehicle body; and Z M i Z m i were obtained from the direct measurement of active suspension actuator displacement.
Control methods have been proposed to optimize Equation (23) to improve vehicle stability. There are two factors that needed to be considered as the suspension-control method of our vehicle. First, our vehicle, being heavy-duty, has strict actuator-performance limits to ensure driving safety. For another, the estimated terrain map needs to be used more effectively, rather than just as a reference index for path planning. Model predictive control was chosen as the actuator-control method because it not only considers actuator limitations in the process of vehicle optimization, but can also effectively apply terrain information to improve control effect. Several model predictive controllers for vehicle active suspension systems have been proposed [21,28], but they did not give a detailed description of estimating elevation map. In this paper, we proposed the method for road profile estimation and model predictive control based on reference [27]. What is more, we gave outdoor experiment results rather than simulation analysis.
To design a model prediction controller, Equation (22) requires first-order Taylor expansion:
X ˙ M ( r ) = f ( X r , U r , W r )
X ˙ M ( t ) = f ( X r , U r , W r ) + f X ( X X r ) + f U ( U U r ) + + f W ( W W r )
Equations (24) and (25) can be rewritten as follows:
X ˜ ˙ M ( t ) = A M X ˜ M + B M U ˜ M + E W W ˜ M
where X ˜ ˙ M ( t ) = X ˙ M ( t ) X ˙ M ( r ) , X ˜ M = X X r , U ˜ M = U U r , W ˜ M = W W r
Then, Equation (26) needs to be linearized as follows:
X ˜ M ( k + 1 ) X ˜ M ( k ) T = A M X ˜ M ( k ) + B M U ˜ ( k ) + E W W ˜ ( k )
With Equation (27), the following equation can be obtained:
X ˜ M ( k + 1 ) = A ˜ M X ˜ M ( k ) + B ˜ M U ˜ M ( k ) + E ˜ W W ˜ M ( k )
where A ˜ M = I + T A M , B ˜ M = T B M , E ˜ W = T E W .
According to Equation (28), the prediction of system states can be given by:
X ˜ M ( k + 1 | k ) = A ˜ M X ˜ M ( k | k ) + B ˜ M U ˜ M ( k | k ) + E ˜ W W ˜ M ( k | k ) X ˜ M ( k + 2 | k ) = A ˜ M X ˜ M ( k + 1 | k ) + B ˜ M U ˜ M ( k + 1 | k ) + E ˜ W W ˜ M ( k | k + 1 ) X ˜ M ( k + N | k ) = A ˜ M X ˜ M ( k + N 1 | k ) + B ˜ M U ˜ M ( k + N 1 | k ) + E ˜ W W ˜ M ( k | k + N 1 )
With Equations (24) and (29), the following equation can be obtained:
X ^ = [ A ˜ M A ˜ 2 M A ˜ N M ] X ˜ M ( k ) + [ B ˜ M 0 0 A ˜ M B ˜ M B ˜ M 0 A ˜ M N 1 B ˜ M A ˜ M N 2 B ˜ M B ˜ M ] U ^ + E ˜ W W ^
Y ^ = C M X ^ + D M U ^
X ^ = [ X ˜ ( k + 1 ) X ˜ ( k + 2 ) X ˜ ( k + 3 ) X ˜ ( k + N ) ] , Y ^ = [ Y ˜ ( k + 1 ) Y ˜ ( k + 2 ) Y ˜ ( k + 3 ) Y ˜ ( k + N ) ] , U ^ = [ U ˜ ( k ) U ˜ ( k + 1 ) U ˜ ( k + 2 ) U ˜ ( k + N 1 ) ] , W ^ = [ W ˜ ( k ) W ˜ ( k + 1 ) W ˜ ( k + 1 ) W ˜ ( k + N 1 ) ]
A generic model predictive controller finds the optimal sequence of control inputs U ^ to minimize cost function J M P C :
min J M P C = min ( Y ^ T P 1 Y ^ + X ^ T P 2 X ^ + U ^ T P 3 U ^ ) U ^ min U ^ U ^ max Δ U ^ min Δ U ^ Δ U ^ max
where P 1 , P 2 , and P 3 are weight matrices of which the parameters can be adjusted to achieve different performance improvements for the vehicle, such as passenger ride comfort, handling stability, and driving safety.
In this study, our objective is to minimize Z ¨ , θ ¨ , and φ ¨ to maintain the stability of the vehicle. With Equation (32), the suspension control inputs U ^ could be calculated and applied to the suspension control.

4. Discussion

Three experiments were carried out to demonstrate the effectiveness and feasibility of our method. The first experiment was to confirm that the proposed MPC method improved the stability of the vehicle compared with the output-feedback-control (OFC) method and a passive suspension system. OFC is a common suspension-control method that uses IMU data as a reference index to adjust the active suspension system. The second experiment was to verify that our method for road profile estimation reduces the drift of LiDAR data, thus obtaining a more accurate and stable elevation map. The third experiment was carried out on continuous uneven terrain to verify the stability of our method for a long period.
Experiments were carried out on the test site with some obstacles, as shown in Figure 7. To carry out the first experiment, we made our vehicle directly pass an obstacle using a passive suspension system, MPC method, and OFC method, respectively. The attitude angle and position information obtained by IMU/GPS is shown in Figure 8. Both the MPC and OFC methods reduced the attitude-angle and vertical-displacement values compared with the passive suspension mode. The root-mean-square (RMS) values of displacement and angle for the vertical, pitch, and roll motions are given in Table 1. RMS values of Z , θ , and φ for the OFC method decrease by 37%, 41%, and 46%, whereas reductions for the MPC were 71%, 70%, and 63% when the vehicle was running at a speed of 35 km/h. These results confirmed the efficiency of the proposed MPC method. Other laboratory data with the vehicle running at a speed of 45 km/h are also shown Table 1. As the results demonstrated, the effectiveness of the two control methods was reduced when the speed of the vehicle increased. However, the MPC method still had a good performance in terms of vehicle stability because it calculated the road input in advance on the basis of the estimated elevation map, which ensured that the input value of the actuators could be calculated in advance.
In order to verify the accuracy of our method for road profile estimation, we made the vehicle pass two obstacles at the same speed using the active and passive suspension system, respectively. The attitude angle and position information obtained by IMU/GPS is shown in Figure 9. Results demonstrated the improvement of vehicle stability using MPC methods, which is the same as the conclusion of previous experiment results. It is difficult to display details of the elevation terrain since cloud data points obtained by LiDAR are very dense, so we imported LiDAR data into MATLAB by means of interpolation technology to show more details. Figure 10a shows the road profile when the vehicle was passing through obstacles in passive suspension mode. When the front wheels of the vehicle passed the obstacle, the vibration of the vehicle body caused drifts of LiDAR data, which caused a large error in the local elevation map (x = 300–450 cm). Details of the local elevation map (x = 300–450, y = 200 cm) are displayed in the local view of Figure 10a. Blue and red lines represent the upper and lower bounds of the confidence interval, respectively, and the green line represents the estimated elevation value. It has been seen that the maximal error of the estimated elevation value was ~5.68 cm, and the confidence interval was not guaranteed to contain the true elevation values. Figure 10b shows the road profile when the vehicle was passing through obstacles in active suspension mode. Results showed that LiDAR drifts were effectively suppressed due to the improvement of vehicle stability. The local view also shows that the maximal error of the estimated elevation value was ~2.20 cm, and the true elevation values were in the confidence interval. These findings further confirm the efficiency and accuracy of the proposed method for road-profile estimation.
To demonstrate the stability of our method for continuous uneven terrain, we made the vehicle pass through a row of obstacles in the active and passive suspension modes, respectively. Attitude angle and position information is shown in Figure 11. Results illustrated that our proposed method still had good stability performance in the suppression of vehicle vibration in the case of continuous road disturbances. Figure 12a shows the local elevation map (x = 0–850, y = 200 cm) when the vehicle was using the active suspension mode. The estimated elevation value approximated the real terrain value, with the maximal error of the estimated elevation value being about 2.15 cm. Figure 12b shows estimated elevation information when the vehicle was using the passive suspension mode. It has been seen that the instability of the vehicle body was aggravated in a continuous-uneven-terrain environment, resulting in more serious drifts of LiDAR data. Furthermore, the Mahalanobis distance criterion also lost its effect in certain positions, which results in cloud data points in the same cell not being able to be effectively fused.

5. Conclusions

This paper proposed a novel method for road profile estimation using LiDAR, IMU/GPS, and a vehicle with an active suspension system. The first was the method to obtain the probability elevation terrain using GPS/INS and 3D laser scanners. The second was the description of a model predictive control method, which fused the IMU/GPS and obtained an elevation map to adjust the vehicle suspension system to maintain the stability of the vehicle. Real experiment results demonstrated that the safety and stability of the vehicle driving on complex uneven terrain could be ensured. The elevation information estimation using our method was also more accurate and stable because it avoided the drifts of LiDAR data. There were also some limitations in the whole study. For example, GPS data is unstable under certain conditions, which led to an imprecise location. Further, the model predictive control method needed a higher computational load compared with other control methods, which limited its application in engineering practice. In the future, we will consider how to further improve the accuracy of elevation maps and vehicle stability on complex roads.

Author Contributions

Conceptualization, W.L.; data curation, T.N.; formal analysis, W.L.; funding acquisition, D.Z.; methodology, T.N.; project administration, D.Z.; software, W.L. and Z.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Key Research and Development Program of China (Grant No. 2016YFC0802900) and Jilin Province Key Research and Development Program of China (Grant No. 20200401130GX).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hemann, G.; Singh, S.; Kaess, M. Long-range GPS-denied aerial inertial navigation with LIDAR localization. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 9–14 October 2016; pp. 1659–1666. [Google Scholar]
  2. Levinson, J.; Thrun, S. Robust vehicle localization in urban environments using probabilistic maps. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation(ICRA), Anchorage, AK, USA, 3–7 May 2010; pp. 4372–4378. [Google Scholar]
  3. Chong, Z.; Qin, B.; Bandyopadhyay, T.; Rus, D. Synthetic 2D LiDAR for precise vehicle localization in 3D urban environment. In Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany, 6–10 May 2013; pp. 1554–1559. [Google Scholar]
  4. Yoneda, K.; Tehrani, H.; Ogawa, T.; Hukuyama, N. LiDAR scan feature for localization with highly precise 3D map. In Proceedings of the 2014 IEEE Intelligent Vehicles Symposium, Dearborn, MI, USA, 8–11 June 2014; pp. 1659–1666. [Google Scholar]
  5. Soloviev, A. Tight coupling of GPS, laser scanner, and inertial measurements for navigation in urban environments. In Proceedings of the 2008 IEEE/ION Position, Location and Navigation Symposium, Monterey, CA, USA, 5–8 May 2008. [Google Scholar]
  6. Gao, Y.; Liu, S.; Atia, M.M.; Noureldin, A. INS/GPS/LiDAR integrated navigation system for urban and indoor environments using hybrid scan matching algorithm. Sensors 2015, 15, 23286–23302. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Wan, G.W.; Yang, X.L.; Cai, R.L.; Li, H.; Zhou, Y.; Wang, H.; Song, S.X. Robust and Precise Vehicle Localization based on Multi-sensor Fusion in Diverse City Scenes. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; pp. 4670–4677. [Google Scholar]
  8. Wolcott, R.W.; Eustice, R.M. Robust LIDAR localization using multiresolution gaussian mixture maps for autonomous driving. Int. J. Robot. Res. 2017, 35, 292–319. [Google Scholar] [CrossRef]
  9. Tang, J.; Chen, Y.; Niu, X.; Wang, L.; Chen, L.; Liu, J.; Shi, C.; Hyyppä, J. LiDAR Scan Matching Aided Inertial Navigation System in GNSS-Denied Environments. Sensors 2015, 15, 16710–16728. [Google Scholar] [CrossRef] [PubMed]
  10. Chang, L.; Niu, X.; Liu, T.; Tang, J.; Qian, C. GNSS/INS/LiDAR-SLAM Integrated Navigation System Based on Graph Optimization. Remote Sens. 2019, 11, 1009. [Google Scholar] [CrossRef] [Green Version]
  11. Qin, T.; Li, P.; Shen, S. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator. IEEE Trans. Robot. 2018, 34, 1004–1020. [Google Scholar] [CrossRef] [Green Version]
  12. Qian, C.; Liu, H.; Tang, J.; Chen, Y.; Kaartinen, H.; Kukko, A.; Zhu, L.; Liang, X.; Chen, L.; Hyyppä, J. An integrated GNSS/INS/LiDAR-SLAM positioning method for highly accurate forest stem mapping. Remote Sens. 2016, 9, 3. [Google Scholar] [CrossRef] [Green Version]
  13. Pierzchała, M.; Giguère, P.; Astrup, R. Mapping forests using an unmanned ground vehicle with 3D LiDAR and graph-SLAM. Comput. Electron. Agric. 2018, 145, 217–225. [Google Scholar] [CrossRef]
  14. Cole, D.M.; Newman, P.M. Using laser range data for 3D SLAM in outdoor environments. In Proceedings of the IEEE International Conference on Robotics and Automation, Orlando, FL, USA, 15–19 May 2006; pp. 1556–1563. [Google Scholar]
  15. Droeschel, D.; Schwarz, M.; Behnke, S. Continuous mapping and localization for autonomous navigation in rough terrain using a 3D laser scanner. Robot. Auton. Syst. 2017, 88, 104–115. [Google Scholar] [CrossRef]
  16. Dingxuan, Z.; Lili, W.; Yilei, L.; Miaomiao, D. Extraction of preview elevation of road based on 3D sensor. Measurement 2018, 127, 104–114. [Google Scholar]
  17. Peter, F.; Michael, B.; Marco, H. Probabilistic Terrain Mapping for Mobile Robots with Uncertain Localization. IEEE Robot. Autom. Lett. 2018, 3, 3019–3026. [Google Scholar]
  18. Wang, L.L.; Zhao, D.X.; Ni, T.; Liu, S. Extraction of preview elevation information based on terrain mapping and trajectory prediction in real-time. IEEE Access 2020, 8, 76618–76631. [Google Scholar] [CrossRef]
  19. Ryu, S.; Park, Y.; Suh, M. Ride quality analysis of a tracked vehicle suspension with a preview control. J. Terramechanics 2011, 48, 409–417. [Google Scholar] [CrossRef]
  20. Youn, I.; Khan, M.A.; Uddin, N. Road disturbance estimation for the optimal preview control of an active suspension systems based on tracked vehicle model. Int. J. Automot. Technol. 2017, 18, 307–316. [Google Scholar] [CrossRef]
  21. Göhrle, C.; Schindler, A.; Wagner, A. Model Predictive Control of semi-active and active suspension systems with available road preview. In Proceedings of the 2013 European Control Conference (ECC), Zürich, Switzerland, 17–19 July 2013; pp. 1499–1504. [Google Scholar]
  22. Mehra, R.; Amin, J.; Hedrick, K.; Osorio, C.; Gopalasamy, S. Active suspension using preview information and model predictive control. In Proceedings of the 1997 IEEE International Conference on Control Applications, Hartford, FL, USA, 5–7 October 1997; pp. 860–865. [Google Scholar]
  23. Huang, Y.; Na, J.; Wu, X.; Liu, X.; Guo, Y. Adaptive control of nonlinear uncertain active suspension systems with prescribed performance. ISA Trans. 2015, 54, 145–155. [Google Scholar] [CrossRef] [PubMed]
  24. Marzbanrad, J.; Ahmadi, G.; Zohoor, H.; Hojjat, Y. Stochastic optimal preview control of a vehicle suspension. J. Sound Vib. 2004, 275, 973–990. [Google Scholar] [CrossRef]
  25. Pan, H.; Sun, W.; Jing, X.; Gao, H.; Yao, J. Adaptive tracking control for active suspension systems with non-ideal actuators. J. Sound Vib. 2017, 399, 2–20. [Google Scholar] [CrossRef]
  26. Youn, I.; Tchamna, R.; Lee, S.H.; Uddin, N.; Lyu, S.K.; Tomizuka, M. Preview suspension control for a full tracked vehicle. Int. J. Automot. Technol. 2014, 15, 399–410. [Google Scholar] [CrossRef]
  27. Göhrle, C.; Schindler, A. Road profile estimation and preview control for low band width active suspension systems. IEEE/ASME Trans. Mechatron. 2015, 20, 2299–2310. [Google Scholar] [CrossRef]
  28. Theunissen, J.; Sorniotti, A.; Gruber, P. Regionless Explicit Model Predictive Control of Active Suspension Systems with Preview. IEEE Trans. Ind. Electron. 2020, 67, 4877–4888. [Google Scholar] [CrossRef]
  29. Du, M.; Zhao, D.; Yang, M. Nonlinear extended state observer-based output feedback stabilization control for uncertain nonlinear half-car active suspension systems. Nonlinear Dyn. 2020, 100, 2483–2503. [Google Scholar] [CrossRef]
  30. Sun, W.; Zhao, Y.; Li, J. Active Suspension Control with Frequency Band Constraints and Actuator Input Delay. IEEE Trans. Ind. Electron. 2012, 59, 530–537. [Google Scholar]
  31. Pan, H.; Sun, W. Nonlinear Output Feedback Finite-Time Control for Vehicle Active Suspension Systems. IEEE Trans. Ind. Inform. 2019, 15, 2073–2082. [Google Scholar] [CrossRef]
Figure 1. Vehicle configuration.
Figure 1. Vehicle configuration.
Sensors 20 03676 g001
Figure 2. System structure.
Figure 2. System structure.
Sensors 20 03676 g002
Figure 3. Automobile coordinate system.
Figure 3. Automobile coordinate system.
Sensors 20 03676 g003
Figure 4. Automobile sub-coordinate system.
Figure 4. Automobile sub-coordinate system.
Sensors 20 03676 g004
Figure 5. Probability map estimation system.
Figure 5. Probability map estimation system.
Sensors 20 03676 g005
Figure 6. Autonomous vehicle model.
Figure 6. Autonomous vehicle model.
Sensors 20 03676 g006
Figure 7. Obstacle at test site.
Figure 7. Obstacle at test site.
Sensors 20 03676 g007
Figure 8. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Figure 8. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Sensors 20 03676 g008
Figure 9. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Figure 9. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Sensors 20 03676 g009
Figure 10. Estimated terrain elevation map. (a) Obtained terrain elevation map in passive suspension mode. (b) Obtained terrain elevation map in active suspension mode.
Figure 10. Estimated terrain elevation map. (a) Obtained terrain elevation map in passive suspension mode. (b) Obtained terrain elevation map in active suspension mode.
Sensors 20 03676 g010
Figure 11. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Figure 11. Time domain plots of heave, pitch, roll, and yaw data obtained by sensors. (a) Pitch angle. (b) Heave position. (c) Roll angle. (d) Yaw angle.
Sensors 20 03676 g011
Figure 12. Estimated terrain elevation value. (a) Obtained data in active suspension mode. (b) Obtained data in passive suspension mode.
Figure 12. Estimated terrain elevation value. (a) Obtained data in active suspension mode. (b) Obtained data in passive suspension mode.
Sensors 20 03676 g012
Table 1. Root-mean-square (RMS) values of vehicle heave, pitch, and roll at different speeds.
Table 1. Root-mean-square (RMS) values of vehicle heave, pitch, and roll at different speeds.
Velocity TypePassiveOFC MPC
35 km/hHeave (cm)4.132.61 (−37%)1.22 (−71%)
Pitch (deg)1.260.74 (−41%)0.39 (−70%)
Roll (deg)1.010.53 (−46%)0.37 (−63%)
45 km/hHeave (cm)5.053.68 (−27%)1.66 (−67%)
Pitch (deg)1.720.62 (−30%)0.61 (−64%)
Roll (deg)1.610.61 (−31%)0.64 (−60%)

Share and Cite

MDPI and ACS Style

Ni, T.; Li, W.; Zhao, D.; Kong, Z. Road Profile Estimation Using a 3D Sensor and Intelligent Vehicle. Sensors 2020, 20, 3676. https://doi.org/10.3390/s20133676

AMA Style

Ni T, Li W, Zhao D, Kong Z. Road Profile Estimation Using a 3D Sensor and Intelligent Vehicle. Sensors. 2020; 20(13):3676. https://doi.org/10.3390/s20133676

Chicago/Turabian Style

Ni, Tao, Wenhang Li, Dingxuan Zhao, and Zhifei Kong. 2020. "Road Profile Estimation Using a 3D Sensor and Intelligent Vehicle" Sensors 20, no. 13: 3676. https://doi.org/10.3390/s20133676

APA Style

Ni, T., Li, W., Zhao, D., & Kong, Z. (2020). Road Profile Estimation Using a 3D Sensor and Intelligent Vehicle. Sensors, 20(13), 3676. https://doi.org/10.3390/s20133676

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop