Next Article in Journal
Evaluation of Multi-Incidence Angle Polarimetric Gaofen-3 SAR Wave Mode Data for Significant Wave Height Retrieval
Next Article in Special Issue
Joint Radar and Communications Waveform Design Based on Complementary Sequence Sets
Previous Article in Journal
Examining Spatio-Temporal Dynamics of Ecological Quality in the Pan-Third Pole Region in the Past 20 Years
Previous Article in Special Issue
Radar and Communication Spectral Coexistence on Moving Platform with Interference Suppression
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reweighted Robust Particle Filtering Approach for Target Tracking in Automotive Radar Application

1
Key Laboratory of Underwater Acoustic Signal Processing, Ministry of Education, Southeast University, Nanjing 210096, China
2
Purple Mountain Laboratories, Nanjing 211111, China
3
Science and Technology on Near-Surface Detection Laboratory, Wuxi 214035, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(21), 5477; https://doi.org/10.3390/rs14215477
Submission received: 7 September 2022 / Revised: 20 October 2022 / Accepted: 20 October 2022 / Published: 31 October 2022
(This article belongs to the Special Issue Radar Remote Sensing for Applications in Intelligent Transportation)

Abstract

:
In view of the decline of filtering accuracy caused by measured outliers in target tracking application, a novel reweighted robust particle filter is proposed to acquire accurate state estimates in an automotive radar system. To infer the importance of each entry in the multidimensional contaminated measurement vector, we employ a weight vector, which follows a Gamma distribution, to model the measured noise and carry out accurate state estimates. Additionally, the particle filter method is employed to perform approximate posterior inference of state estimates in the nonlinear model. The Cramer–Rao lower bound is provided for the performance evaluation of the proposed method. Both simulation and experimental results demonstrate the superiorities of the proposed algorithm over other robust solutions.

1. Introduction

In the field of autonomous driving, automotive radars have become the core sensors due to their all-time and all-weather environmental perception capabilities. Effective target tracking is essential for the autonomous driving systems to formulate correct and timely driving strategies. By clustering the point cloud data of Millimeter Waveform (MMW) radar, the target can be detected and located in the automotive application scenario. However, the occurrence of measurement abnormalities in real-world applications is a common phenomenon that may arise due to reasons such as unexpected disturbances, temporary sensor failures, and calibration errors [1]. A typical example is to track a walking pedestrian on the road through an MMW radar sensor in action. The occlusion of roadside obstacles, such as parked cars, walls, and so on, can corrupt the range measurement, and glint, speckle, and phase noise can contaminate radar data [2,3,4]. The input of most tracking algorithms is the result of target detection. If the target is suddenly lost or temporarily occluded, the target trajectory will be interrupted [5]. Moreover, the clutter cannot be completely filtered out of radar measurements can lead to false detections and causes measurement abnormalities [6]. In addition, the non-line-of-sight (NLOS) multipath propagation of the transmitted electromagnetic wave is also one of a source of measurement abnormalities [7]. The Kalman filter (KF) offers an optimal estimation method for the linear dynamic model with a Gaussian state and measurement noise [8]. However, owing to the complex electromagnetic propagation and changeable environment, the measurement noise is a typical non-Gaussian in the MMW radar sensor and would result in measurement abnormalities, also named outliers. The presence of these outliers may degrade the performance of standard KF, thus yielding poor estimates of the state of interest [9].
A number of efforts have been devoted to addressing the issue. Outliers rejection methods are used in robust state estimation and object tracking [10]. A robust filter approach in [11] has been developed by viewing measurements as clearly distinguished outliers from normal values using Projection Statistics (PS). In [12,13,14], classical recursive approaches are converted into batch-mode regression form and iteratively reweighted least squares algorithms are used to estimate the states. A measurement-weighting-based whitening procedure is designed to distinguish outliers from normal measurements to improve the state estimation accuracy [15]. Another class of approaches is based on the heavy-tailed noise model, such as Student’s t distributions and Laplace distributions [16,17,18,19]. A scalar weight, which follows a Gamma distribution, is introduced for each observed sample such that the variance matrices of measurement noise can be reassessed in the state estimation [20,21]. Filtering and smoothing algorithms, which are much more robust yet only slightly more involved than the standard inference algorithm, are derived by assigning Wishart distribution to the noise covariance matrix [22]. By choosing the inverse Wishart priors, the measurement noise covariance matrices can be inferred based on the variational Bayes (VB) approach [23].
In this paper, a reweighted robust particle filter is proposed to acquire more accurate state estimation with robustness to outliers in the nonlinear model. Motivated by the aforementioned methods in [20,21], we generalize models to the more comprehensive case of multidimensional outlier measurements. Specifically, a weight vector, which follows conditional independent Gamma distribution, is employed to reassess the contribution of each entry in the multidimensional outlier measurement. The proposed method can be regarded as a reweighted robust filter. The particle filter (PF) method is utilized to perform the approximate posterior inference of state estimates. The Cramer–Rao bound of the proposed method is also provided for performance analysis. Both simulations and experiments demonstrate the effectiveness of the proposed method.
Notations: We use lower-case (upper-case) bold characters to denote vectors (matrices). ( · ) T denotes the transpose of a matrix or vector. diag ( x ) represents a diagonal matrix that uses the elements of x as its diagonal elements. p ( · ) denotes the probability density function (pdf). x N ( a , b ) denotes that random variable x follows a Gaussian distribution with mean a and variance b. x R N denotes a real-value vector x with the dimension of N and x R N × M denotes a real-value matrix x with the dimension of N × M .

2. Proposed Model

2.1. Problem Formulation

A typical nonlinear discrete-time state-space model can be expressed as
θ k = f θ k 1 + u k z k = h θ k + n k
where θ k R N and z k R M represent the state vector and measurement vector at time step k, f · and h · denote nonlinear state and measurement functions, respectively, u k R N and n k R M are the zero-mean Gaussian white process noises satisfying u k N 0 , Q and n k N 0 , R , and Q and R are the process noise covariance matrix and measurement noise covariance matrix, respectively. The model in Equation (1) is just regarded to be a typical nonlinear system model, and the system state can be estimated by a nonlinear Kalman filter [24].
In real automotive radar applications, typical representative scenarios are often encountered in which the target of interest may be obscured by other interferences or clutters, and the acquired measurement vector, such as range, velocity, and azimuth, in the automotive radar system would fall outside a valid range and become outliers, since the acquired measurement samples at this time directly come from interferences. The weighted robust Kalman filter method has been developed by introducing a scalar w k into the measurement noise covariance matrix R for the improved estimates of the updated θ k [21]. However, the main limitation of this work is that even if it allows the treatment of multidimensional measurement, a scalar weight is considered for the entire observation vector, thus equally treating all the entries regardless of which entry is corrupted. On the one hand, the entries in the measurement vector represent diverse physical quantities respectively in the real radar system and have diverse signal-to-noise ratios. On the other hand, the variance of each entry is often influenced by the automotive radar system, such as the wider bandwidth radar system, resulting in a smaller range variance and smaller number of receiver channels, leading to a poorer azimuth measurement. Therefore, introducing a scaler in the measurement vector may be not an optimal way to treat them equally.

2.2. Generative Model

To address this issue, we introduce a novel Bayesian algorithm that treats the weights associated with each entry in the measurement vector data probabilistically. In particular, we introduce a weight vector w k to learn the dynamical noise covariance matrix, and a reweighted robust particle filter method is proposed to acquire improved state-space estimates in a nonlinear model in the presence of contaminated measurements. We modify the measurement noise equation as follows by introducing a weight vector w k ,
n k N 0 , W k 1 R ,
where W k R M × M is a diagonal matrix with the weight vector w k = w k , 1 , , w k , M T R M on its diagonal at time step k, and W k 1 is the inverse of the matrix W k . The Gamma prior distribution is introduced for the elements of w k to ensure that they remain positive and is written by
z k | θ k , W k N h θ k , W k 1 R θ k | θ k 1 N f θ k 1 , Q w k , m Gamma w k , m | v m / 2 , v m / 2 ,
where m = 1 , , M , v m is the mth hyperparameter in the vector v for the Gamma distribution. According to Equation (3), the modified model has the capability of dynamically learning the measurement noise covariance and adjusting the weights of each entry in the measurement vector for improved estimates of the state vector with effectively alleviating outliers.

2.3. Reweighted Robust Particle Filter

In this subsection, we develop a reweighted robust particle filter using statistical inference over the aforementioned model. The particle filter, utilizing the Monte Carlo method, is selected to provide approximate posterior estimation in the nonlinear model [25]. The state estimation generally focuses on the expectation calculation of posterior distribution,
E [ g θ | z 1 : k ] = g θ p θ | z 1 : k d θ
where g ( θ ) is the function of the variable θ , and p θ | z 1 : k represents the posterior probability density function for θ given the measurement vector data z 1 : k . However, the posterior distribution p θ | z 1 : k is often difficult to analytically acquire due to the manipulation of the multiple integration. The importance sampling (IS) is often used to perform the posterior distribution by introducing a nominal distribution π θ | z 1 : k that often utilizes a Gaussian distribution,
E [ g θ z 1 : k ] = g θ p θ | z 1 : k π θ | z 1 : k π θ | z 1 : k d θ = g θ p z 1 : k | θ p θ p z 1 : k π θ | z 1 : k π θ | z 1 : k d θ = g θ p z 1 : k | θ p θ π θ | z 1 : k π θ | z 1 : k d θ p z 1 : k | θ p θ π θ | z 1 : k π θ | z 1 : k d θ .
The particle weight ω ( θ ) is defined as
ω ( θ ) = p z 1 : k | θ p θ π θ | z 1 : k .
The Equation (5) can be rewritten by introducing the ω ( θ ) :
E [ g θ z 1 : k ] = g θ ω ( θ ) π θ | z 1 : k d θ ω ( θ ) π θ | z 1 : k d θ s = 1 S g θ s ω ( θ ( s ) ) s = 1 S ω ( θ ( s ) )
where s = 1 , , S , and S is the total number of sampling particles. According to the Markov properties of the model, the particle weights ω k ( s ) can be deduced in the recursion form
ω k ( s ) p z k | θ k ( s ) p θ k ( s ) | θ k 1 ( s ) π θ k ( s ) | θ 0 : k 1 ( s ) , z 1 : k ω k 1 ( s ) .
Generally, π θ k | θ 0 : k 1 , z 1 : k = p θ k | θ k 1 is often used in the importance sampling, and thus the recursion in Equation (8) can be reduced into
ω k ( s ) p z k | θ k ( s ) ω k 1 ( s ) .
According to Equation (9), it is obvious that the problem eventually converts to computation of p z k | θ k , which can be achieved from the marginal likelihood utilizing Bayesian inference. Considering the fact that W k is independent of θ k , we have
p z k | θ k = p z k | θ k , W k p W k | θ k d W k = m = 1 M p z k , m | θ k , w k , m p w k , m d w k , m = m = 1 M 0 N z k , m μ k , m , r m , m w k , m Gam w k , m v m 2 , v m 2 d w k , m = m = 1 M Γ v m 2 + 1 2 Γ v m 2 λ m π v m 1 2 1 + λ m z k , m μ k , m 2 v m v m 2 1 2 .
where μ k , m is the mth element of the vector h θ k ; λ m = r m , m 1 is the mth element on the diagonal of matrix R 1 . The entire reweighted robust particle filter (RR-PF) method is summarized as Algorithm 1.
Algorithm 1 Reweighted Robust Particle Filter
Input: { θ k 1 ( s ) : s = 1 , , S }
Output: θ k , { θ k ( s ) : s = 1 , , S }
1:
Draw new samples: θ ˜ k ( s ) p θ k | θ k 1 ( s ) , s = 1 , , S
2:
Calculate particles weights: ω ˜ k ( s ) in Equations (9) and (10)
3:
Perform resampling with θ ˜ k ( s ) and ω ˜ k ( s ) to acquire θ k ( s ) in Equation (7)
4:
Estimate system state θ k = s = 1 S θ k ( s ) / S
5:
return θ k , { θ k ( s ) : s = 1 , , S }

2.4. Algorithm Analysis

In this subsection, detailed analysis is provided to illustrate the reason why the proposed method is more robust to the outlier compared with the conventional heavy-tail multivariate Student’s t-distributed (CMSt) [26,27]. For comparison, we provide the probability density function (pdf) of the CMSt as
p z k | θ k Γ v 2 + M 2 Γ v 2 1 + ( z k μ ) T R 1 ( z k μ ) v M 2 v 2 .
We take 2D pdfs with M = 2 as an example to illustrate the roles of the robustness to outliers. In this example, z k = [ x k , y k ] T , μ = [ 0 , 0 ] T , R 1 = diag ( [ 1 , 1 ] ) , and v = [ v , v ] T = [ 0.5 , 0.5 ] T are shown in Figure 1. It is observed that both pdfs exhibit heavy-tailed properties, which indicates their robustness to outliers. The differences lie in that there exist quite prominent ridges along the x-axis and y-axis in the proposed pdf, which makes the model more adapted to the changes in the independent variable in the direction perpendicular to the ridges than CMSt.
In order to intuitively show the role of the proposed pdf in the particle filter, we illustrate the evolution of particle weights. In the particle filter, at ( k 1 ) th time step, the particles are acquired with an identical weight to estimate θ k 1 based on the resampling technique, shown in Figure 2a. It is observed that these particle balls have the same sizes, and thus have identical weights, although the particle unreliability is different, as shown in the middle surface in Figure 2a. It is also found that the blue particle ball with a small value in the color bar denotes that this particle is highly reliable, however, the yellow ball with a large value suggests an unreliable particle. At the kth time step, when the new measurement vector data z k are provided, particle weights in the kth time step will evolve according to Equation (9). The evolved result of particle weights in Equation (10) is shown on the top surface, and the result in Equation (11) is provided in the bottom surface.
To clearly illustrate the roles of the pdfs in Equation (10) compared with that in Equation (11), we provide slice plots of the pdfs the along y-axis. It is observed that the plot of the sharper pdf in the proposed method would encourage the contributions from the reliable particle, and it would weaken the particle weight concerning these unreliable particles, shown in the top plot in Figure 2b. It is found that the blue particle ball has a higher weight due to its high reliability in the current time step, whereas the yellow one has a lower weight in the proposed model compared with those in the bottom pdf of the CMSt. In conclusion, the proposed method encourages the contributions from the particle weights of reliable particles and weakens the contributions from the unreliable particles by discriminatively treating the observed vector data. This could be the reason why the proposed method is more robust to outliers and acquires improved state estimates compared with the CMSt method.

2.5. Cramer–Rao Bound for the Model

To further explore the performance bound of the proposed method, CRLB analysis is provided in this section. We first define a latent parameter set concerning the random parameter set p( Θ ); the mean-square error matrix is generally served as a measure of error and is given by
Σ ϵ = MSE ( Θ ^ ) E Θ ^ Θ Θ ^ Θ T ,
where Θ are the latent variable parameter collection, Θ ^ denote estimates of the corresponding variables, and E ( x ) denotes the expectation operator for the variable x.
The Bayesian Information Matrix (BIM), which is commonly employed in time-invariant statistical models, is often used for CRLB analysis and can be written by
J = E Θ Θ ln p ( Θ , Z ) T E Θ ln p ( Θ , Z ) Θ ln p ( Θ , Z ) T ,
where p ( Θ , Z ) is the joint probability distribution, and Θ denotes the first-order partial derivative operator concerning the variable vector Θ , which can be expressed by
Θ = Θ 1 , Θ 2 , T
According to the Bayesian CRLB analysis, we have
Σ ϵ J 1 .
The inequality suggests that the matrix on the left is non-negative.
According to posterior Cramer–Rao bounds analysis, we have the recursive sequence J k of posterior information submatrices for estimating the state vector θ k at the kth time step [28]
J k = D k 22 D k 21 J k 1 + D k 11 1 D k 12 ,
where
D k 11 = E θ k 1 θ k 1 T ln p ( θ k | θ k 1 ) ,
D k 12 = E θ k 1 θ k T ln p ( θ k | θ k 1 ) ,
D k 21 = E θ k θ k 1 T ln p ( θ k | θ k 1 ) = ( D k 12 ) T .
D k 22 can be decomposed into
D k 22 = D k 22 , a + D k 22 , b ,
where
D k 22 , a = E θ k θ k T ln p ( θ k | θ k 1 ) ,
D k 22 , b = E θ k θ k T ln p ( z k | θ k ) ,
The initial information submatrix can be obtained from the prior probability distribution p ( θ 0 )
J 0 = E θ 0 θ 0 T ln p ( θ 0 ) ,
where p ( θ 0 ) denotes the initial prior distribution of the variable vector θ 0 .
Using the nonlinear discrete-time state-space model in Equations (1) and (10), we have
ln p ( θ k | θ k 1 ) = 1 2 θ k f ( θ k 1 ) T Q 1 θ k f ( θ k 1 ) + const ,
ln p ( z k | θ k ) = m = 1 M v m 2 + 1 2 ln 1 + λ m z k , m h ( θ k ) m 2 v m + const .
Then,
D k 11 = E θ k 1 θ k 1 f T ( θ k 1 ) Q 1 θ k 1 f T ( θ k 1 ) T ,
D k 12 = E θ k 1 θ k 1 f T ( θ k 1 ) Q 1 ,
D k 21 = D k 12 T ,
D k 22 = Q 1 + E θ k θ k θ k T ln p ( z k | θ k ) .
It is observed that it is difficult to carry out these integrals, the sequential Monte Carlo method is used to perform the approximations, and we define the variables Λ 11 , Λ 12 , and Λ 22 as
Λ 11 ( θ k 1 ) = θ k 1 f T ( θ k 1 ) Q 1 θ k 1 f T ( θ k 1 ) T ,
Λ 12 ( θ k 1 ) = θ k 1 f T ( θ k 1 ) ,
Λ 22 ( θ k ) = θ k θ k T ln p ( z k | θ k ) .
Therefore, we can rewrite Equations (26)–(29) as follows:
D k 11 = Λ 11 ( θ k 1 ) p ( θ k 1 ) d θ k 1 = p ( z k 1 ) Λ 11 ( θ k 1 ) p ( θ k 1 | z k 1 ) d θ k 1 d z k 1 ,
D k 12 = Λ 12 ( θ k 1 ) p ( θ k 1 ) d θ k 1 = p ( z k 1 ) Λ 12 ( θ k 1 ) p ( θ k 1 | z k 1 ) d θ k 1 d z k 1 ,
D k 22 = Q 1 + Λ 22 θ k ) p ( θ k d θ k = Q 1 + p ( z k ) Λ 22 ( θ k ) p ( θ k | z k ) d θ k d z k .
These integrals can be approximated by the mean of samples after having a series of samples corresponding to the density. We perform T Monte Carlo samples with the time steps of K for the calculation of the expectation instead of the integral operator over z k and obtain the measurement sample matrix Z 1 : T , 1 : K . z t , k 1 denotes the t th measurement sample at the ( k 1 ) th time step. Consequently, Equations (33)–(35) can be calculated by
D k 11 1 T t = 1 T Λ 11 ( θ k 1 ) p ( θ k 1 | z t , k 1 ) d θ k 1
D k 12 1 T t = 1 T Λ 12 ( θ k 1 ) p ( θ k 1 | z t , k 1 ) d θ k 1
D k 22 Q 1 + 1 T t = 1 T Λ 22 ( θ k , z k ) p ( θ k | z t , k ) d θ k
We further perform Monte Carlo samples over the variable θ k instead of an integral operator over θ k at the t th sample, and formulas inside the braces in Equations (36)–(38) can be expressed as
D t , k 11 1 L l = 1 L Λ 11 ( θ t , k 1 ( l ) )
D t , k 12 = D t , k 21 T 1 L l = 1 L Λ 12 ( θ t , k 1 ( l ) )
D t , k 22 1 L l = 1 L Λ 22 ( θ t , k ( l ) , z t , k )
where θ t , k 1 ( l ) and θ t , k ( l ) are, respectively, samples drawn from the posterior distributions of p θ t , k 1 | z t , k 1 and p θ t , k | z t , k , and L is the number of samples. According to the approximate inference method, the Markov Chain Monte Carlo (MCMC) method is utilized to estimate θ t , k with the state transition probability p ( θ k | θ k 1 ) in Equation (24) and the likelihood function p ( z k | θ k ) in Equation (25). The following Equations (33)–(35) and (39)–(41), can be rewritten by
D k 11 1 T t = 1 T 1 L l = 1 L Λ 11 ( θ t , k 1 ( l ) )
D k 12 D k 21 T 1 T t = 1 T 1 L l = 1 L Λ 12 ( θ t , k 1 ( l ) )
D k 22 Q 1 + 1 T t = 1 T 1 L l = 1 L Λ 22 ( θ t , k ( l ) , z t , k )
When the number of samples L is large enough, the estimated results would converge to true values. Finally, we arrive at the resulting Monte-Carlo-based posterior Cramer–Rao bound (MC-PCRB).

3. Simulations and Experiments

In this simulation, we take target tracking in the automotive radar system as an example. The state process model with the constant velocity, which is a typically linear equation, can be expressed by
θ k = f θ k 1 + u k = A θ k 1 + u k
where θ k = x k , y k , x ˙ k , y ˙ k , containing the two-dimensional location x k , y k and the corresponding velocities x ˙ k , y ˙ k of the vehicle. The state transition matrix A can be written by
A = 1 0 Δ T 0 0 1 0 Δ T 0 0 1 0 0 0 0 1
where Δ T denotes the sampling interval of the radar. The nonlinear measurement model in the automotive radar system can be denoted by,
R k ϕ k V k = h x k y k x ˙ k y ˙ k = x k 2 + y k 2 arctan x k y k x k x ˙ k + y k y ˙ k x k 2 + y k 2 .
where R k denotes the measured range of the target at the time step k, ϕ k represents the measured spatial information, and V k is its measured radial velocity.

3.1. Performance Testing on Simulated Data

In this simulation, a spiral trajectory is considered, and the spiral trajectory can be generated by a radius reduction circular motion. Assume that the radar continuously acquires the observed measurement vector, and the measurements containing outliers are generated according to the mixture model
z k | θ k , c k , m U z k | a m , b m , if c k , m = 0 N z k | h θ k , R , if c k , m = 1
where c k , m = 0 indicates a normal measurement from the mth dimension at the kth time step clutter and U ( · ) is a uniform distribution, while c k , m = 1 indicates the measurement vector is a normal one, and noises follow Gaussian distribution with the measurement noise covariance matrix R = diag ( [ 4 , 0.01 , 1 ] ) . The processed noise covariance matrix is assumed to be Q = diag ( [ 0.1 , 0.1 , 0.01 , 0.01 ] ) . Multidimensional outliers caused by interferences or clutters are assumed to be drawn from the uniform distribution with the following parameters: [ a 1 , b 1 ] = [ 10 , 90 ] in the range entry in the measurement vector, [ a 2 , b 2 ] = [ π / 2 , π / 2 ] in the azimuth entry, and [ a 3 , b 3 ] = [ 10 , 10 ] in the velocity entry. The probability of outliers is assumed to be constant over time, that is, c k , m is a Bernoulli random variable with the probability of p ( c k , m = 0 ) = 0.2 . In the particle filter method, the number of particles S is 500, and hyperparameters v are set to be [ 10 , 10 , 10 ] T . The total step number K is 1000 with the sampling interval Δ T of 0.01 s. All the results are implemented on the PC with CPU (Intel Core i7-10700K) using Matlab R2020a.
For the performance evaluation of estimated target location, the root of mean square error (RMSE) and normalized mean square error (NMSE) are defined as performance indexes
RMSE k = x k x k TRUE 2 + y k y k TRUE 2
NMSE = 1 K k = 1 K RMSE k x k TRUE 2 + y k TRUE 2
where θ k = x k , y k , x ˙ k , y ˙ k T denotes the estimated state vector at the step time k. The performance comparisons of tracking results with the conventional particle filter (PF) and other robust solutions, including the weighted robust PF (WR-PF) and the outlier robust extended KF (OR-EKF), are provided in Figure 3. It is observed that the estimated trajectory is the closest to the truth one compared with the WR-PF and OR-EKF methods, and thus the proposed method has the smallest NMSE. Note that the results in the PF method are not provided due to quite a sensitivity to outliers, yielding significantly poor performances.
The performances versus outlier ratios with p ( c k , m = 0 ) are also examined. The outlier ratio varies from 0 % to 50 % , and all other parameters are kept in this simulation. It is reasonable that the NMSEs generally decreases with decreases in the outlier ratios. It is observed that the proposed method has the lowest NMSE across all ratios compared with other methods, as shown in Figure 4.
In addition, we also introduce average Mahalanobis distance as the performance index to evaluate the performance of the entire estimated state-space vector and defined it as
D M = 1 K k = 1 K θ k θ k TRUE Q 1 θ k θ k TRUE
where θ k = x k , y k , x ˙ k , y ˙ k is the true state vector containing the two-dimensional location x k , y k and the corresponding velocities x ˙ k , y ˙ k of the vehicle. θ k denotes the estimated vector of θ k , and Q is the process noise covariance matrix provided in the simulations.
The performance results versus outlier ratios are also examined in Figure 5, the proposed method has the lowest Mahalanobis distance across all ratios, and thus has better performance than those in the WR-PF and OR-EKF methods. Note that the results in the PF method are not provided due to quite a sensitivity to outliers, yielding significantly poor performances.
In the following simulations, diverse types of outliers in the multidimensional measurements are considered to examine the performances of the proposed method. First, we consider only range outliers in the multidimensional measurements, that is to say, the azimuth and velocity entries are abnormal values with p ( c k , 2 ) = p ( c k , 3 ) = 0 . It is found that both PF-based methods have better performances than that in the KF-based method, shown in Figure 6. The main reason may be the nonlinear approximation in the measurement function in the EKF method. These two PF-based outlier-robust methods can effectively address the range outlier issue and acquire comparable NMSEs, even though the NMSEs in the WR-PF method are a little bit smaller than those in the proposed method in the target location estimation, shown in Figure 6a. The possible reason could be that the entry of range is much larger than the other two entries in the multidimensional measurements, and thus the scalar weight in the WR-PF method is learned and estimated to accurately model the measurement noise variances, particularly in the noise variance of the range entry in the multidimensional measurements, such that the lower NMSEs in the target locations can be obtained. However, to evaluate the performance of the entire estimated state-space vector in the filtering methods, the proposed method has the lowest average Mahalanobis distance across outlier ratios, shown in Figure 6b. Therefore, it suggests that the proposed method has better estimation performances in the entire state-space vector estimation by treating the weights associated with each entry in the measurement vector data probabilistically.
Then, we consider only azimuth outliers in the multidimensional measurements, and the other two entries are normal values. The proposed method has the lowest estimated NMSE in both average Mahalanobis distance and NMSE compared with those in the OR-EKF and WR-PF methods, shown in Figure 7. Finally, Figure 8 shows the performance comparisons between the proposed method and the other two robust solutions in the only velocity outliers case, and it is observed that the proposed method has clear performance improvements and has the lowest NMSE and average Mahalanobis distance across normal measurement ratios.
Table 1 shows the average executive comparisons of these robust solutions. It is observed that the executive time of the proposed method is comparable to these PF-based methods, whereas the proposed method has the best performance among them. It is reasonable that the OR-EKF method has the smallest executive time among all these methods owing to its analytical formulation, whereas it generally has slightly poorer performance than the PF-based robust solutions such as the WR-PF and RR-PF methods.

3.2. Cramer–Rao Bound Analysis of the Proposed Algorithm

To further illustrate the estimation performance of the algorithm, we provide the Cramer–Rao Bound for the nonlinear system to serve as the reference for the estimation error. We present the universal MC-PCRB method above for discrete-time state-space models to solve the iterative Cramer–Rao bound at each step in Equation (16). Figure 9 shows the comparison results among these methods. The outlier ratios are assigned to be p ( c k , 1 ) = p ( c k , 2 ) = p ( c k , 3 ) = 0.2 . It is observed that the RMSEs in the outlier robust methods generally decrease with the increases in the time step, except in the conventional PF method. The proposed method is generally close to the PCRLB, and thus has the lowest RMSE. The proposed method has higher RMSEs than the WR-PF method in the early stage because of more parameters to learn. In theory, the proposed method would approach the PCRLB, as long as the number of particles approaches infinity while tracking under a stable state.

3.3. Experimental Results Based on Real Data

In this subsection, real data collected by the automotive millimeter wave (MMW) radar with linear modulated continuous waveform (LFMCW) are used to verify the algorithm’s effectiveness. In the automotive radar application, pedestrian tracking based on the MMW radar is often an issue of great importance. Therefore, we consider pedestrian tracking in these experiments. A 77 GHz millimeter wave radar, whose parameters are shown in Table 2, is used to carry out experiments. An LFMCW waveform with a bandwidth of 4 GHz is used for the high range resolution of 0.0375 m, and the sampling rate of 6.25 MHz is used to acquire raw data. Two-dimensional (2D) Fourier Transform (FT) is firstly implemented on the raw data, and thus the constant false alarm ratio (CFAR) technique is used to acquire the estimates of the range and velocity of the walking pedestrian. Finally, the digital beamforming technique is utilized to obtain the azimuth of the pedestrian. To this end, the measurement vector is acquired for further target tracking. During the data collection of the pedestrian, several artificial blocks are place along the tracking path, and then some outlier measurements occur in the acquired measurement vector.
In the first experiment trial, the pedestrian walked from the location (1.5, 2.5) to the location (−1.5, 2.1) along a straight line. There is an artificial blocker from the location (−0.3, 1.5) to the location (0.3, 1.5). The sketch map is shown in Figure 10. The measurement vector data have some outliers from the 30th to the 37th time step because of crossing the blocker. The acquired measurement vector data are given in Figure 11. It is observed that the measurement vectors involve several obvious outliers at several time steps due to the artificial occlusion or clutters reflected from the complex environment. The tracking results and the corresponding RMSEs are, respectively, shown in Figure 12a,b. It demonstrates that the estimated trajectory in the proposed method is much closer to the true one, and thus it has the lowest RMSE compared with other methods. It is found that there exist a few fluctuations in the interval from the 20th time step and the 35th time step; a possible reason may result from the measurement precision issue of pedestrian walking trajectory in the real experiment, and the true trajectory of the walking pedestrian may be around the preassigned straight line, with some inevitable fluctuations when the pedestrian walked along the straight line in the natural walking state. Although a few fluctuations appear, the RMSEs of the proposed method reach a pretty small level, and they are almost the lowest across time steps compared with other robust solutions.
In the second experiment trial, the slightly complex trajectory, which involves curvilinear motion, turning around, and sharp turning, is considered to verify the effectiveness of the proposed method. The acquired measurement vector data are provided in Figure 13, and it is observed that the measurement vectors have obvious outliers at a few time steps due to the clutters reflected from the complex electromagnetic environment. The tracking results and the corresponding RMSEs are, respectively, shown in Figure 14a,b. They demonstrate that the estimated trajectory in the proposed method is much closer to the true one and almost has the lowest RMSE compared with other robust methods.

4. Conclusions

In this paper, we consider the nonlinear filtering problem in the presence of contaminated measurements. A novel reweighted robust particle filter method was proposed for accurate target tracking in the automotive radar system. We generalized nonlinear filtering to the more comprehensive case of multidimensional outlier measurements and enhanced state vector estimates by probabilistically learning a weight vector for each entry in the multidimension measurement vector. The particle filter technique was adopted to make an approximate posterior in this nonlinear system. We also illustrated the reason that the proposed method is more robust to outliers. Finally, the Cramer–Rao lower bound of the proposed method was also provided. Both simulations and experiments verified the superiority of the proposed method over other robust solutions.

Author Contributions

Conceptualization, Q.W.; methodology, Q.W., L.C., Y.L. and S.Y.; softwarep, L.C.; validation,; formal analysis, Q.W.; investigation, Q.W., Z.W. and H.L.; writing—original draft preparation, Q.W., L.C. and Y.L.; writing—Q.W. and L.C.; supervision, S.Y. and H.L.; funding acquisition, Q.W. All authors have read and agreed to the published version of the manuscript.

Funding

The work was supported in part in part by Key Laboratory of Underwater Acoustic Countermeasure Technology under Grant No. 2022JCJQLB03305, National Natural Science Foundation under Grants No. 91938203, in part by Fundamental Research Funds for the Central University under Grant No. 2242022k30016, in part by National Defense Basis Scientific Research program of China under Grant No. JCKY2019110C143, and in part by Science and Technology on Near-Surface Detection Laboratory Pre-research Fund under Grant No. 6142414200505.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lewis, T. Outliers in Statistical Data, 3rd ed.; John Wiley & Sons: Hoboken, NJ, USA, 1994; p. 608. [Google Scholar]
  2. Du, H.; Wang, W.; Bai, L. Observation noise modeling based particle filter: An efficient algorithm for target tracking in glint noise environment. Neurocomputing 2015, 158, 155–166. [Google Scholar] [CrossRef]
  3. Nigam, N.; Saxena, T.; Richhariya, V. Global high dimension outlier algorithm for efficient clustering outlier detection. In Proceedings of the 2016 Symposium on Colossal Data Analysis and Networking (CDAN), Indore, India, 18–19 March 2016. [Google Scholar]
  4. Zhu, J.; Kia, S. Bias compensation for UWB ranging for pedestrian geolocation applications. IEEE Sens. Lett. 2019, 3, 1–4. [Google Scholar] [CrossRef]
  5. Bai, J.; Li, S.; Huang, L.; Chen, H. Robust detection and tracking method for moving object based on radar and camera data fusion. IEEE Sens. J. 2021, 21, 10761–10774. [Google Scholar] [CrossRef]
  6. Zhou, T.; Yang, M.; Jiang, K.; Wong, H.; Yang, D. MMW radar-based technologies in autonomous driving: A review. Sensors 2020, 20, 7283. [Google Scholar] [CrossRef] [PubMed]
  7. Wu, Q.; Lai, Z.; Amin, M.G. Through-the-wall radar imaging based on Bayesian compressive sensing exploiting multipath and target structure. IEEE Trans. Comput. Imag. 2021, 7, 422–435. [Google Scholar] [CrossRef]
  8. Kalman, R.E. A new appraoch to linear filtering and prediction problems. J. Basic Eng. 1960, 82, 35–45. [Google Scholar] [CrossRef] [Green Version]
  9. Zhai, G.; Wu, C.; Wang, Y. Millimeter wave radar target tracking based on adaptive kalman filter. In Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China, 26–30 June 2018; pp. 453–458. [Google Scholar]
  10. Fang, H.; Haile, M.A.; Wang, Y. Robust extended kalman filtering for systems with measurement outliers. IEEE Trans. Control Syst. Technol. 2022, 30, 795–802. [Google Scholar] [CrossRef]
  11. Mili, L.; Cheniae, M.G.; Vichare, N.S.; Rousseeuw, P.J. Robust state estimation based on projection statistics of power systems. IEEE Trans. Power Syst. 1996, 11, 1118–1127. [Google Scholar] [CrossRef]
  12. Thomas, L.; Mili, L. A robust GM-estimator for the automated detection of external defects on barked hardwood logs and stems. IEEE Trans. Signal Proc. 2007, 55, 3568–3576. [Google Scholar] [CrossRef]
  13. Gandhi, M.A.; Mili, L. Robust kalman filter based on a generalized maximum-likelihood-type estimator. IEEE Trans. Signal Proc. 2010, 58, 2509–2520. [Google Scholar] [CrossRef]
  14. Zhao, J.; Netto, M.; Mili, L. A robust iterated extended kalman filter for power system dynamic state estimation. IEEE Trans. Power Syst. 2017, 32, 3205–3216. [Google Scholar] [CrossRef]
  15. De Palma, D.; Indiveri, G. Output outlier robust state estimation. Int. J. Adapt. Control Signal Proc. 2017, 31, 581–607. [Google Scholar] [CrossRef]
  16. Pich, R.; Sárkká, S.; Hartikainen, J. Recursive weighted robust filtering and smoothing for nonlinear systems using the multivariate student-t distribution. In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing, Santander, Spain, 23–26 September 2012; pp. 1–6. [Google Scholar]
  17. Tapia, E. Gaussian and student-t filtering using implicit measurements via variational bayes. In Proceedings of the IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Reims, France, 21–24 September 2014; pp. 1–6. [Google Scholar]
  18. Wang, H.; Li, H.; Zhang, W.; Wang, H. Laplace l1 robust Kalman filter based on majorization minimization. In Proceedings of the 20th International Conference on Information Fusion (Fusion), Xi’an, China, 10–13 July 2017; pp. 1–5. [Google Scholar]
  19. Wang, G.; Yang, C.; Ma, X. A novel robust nonlinear Kalman filter based on multivariate laplace distribution. IEEE Trans. Circ. Syst. Exp. Brief. 2021, 68, 2705–2709. [Google Scholar] [CrossRef]
  20. Ting, J.-A.; Theodorou, E.; Schaal, S. Learning a weighted robust Kalman filter. In Proceedings of the Machine Learning: ECML 2007, Warsaw, Poland, 17–21 September 2007; pp. 748–756. [Google Scholar]
  21. Ting, J.-A.; Theodorou, E.; Schaal, S. A Kalman filter for robust outlier detection. In Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 29 October–2 November 2007; pp. 1514–1519. [Google Scholar]
  22. Agamennoni, G.; Nieto, J.I.; Nebot, E.M. An outlier-robust Kalman filter. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 1551–1558. [Google Scholar]
  23. Huang, Y.; Zhang, Y.; Wu, Z.; Li, N.; Chambers, J. A novel adaptive kalman filter with inaccurate process and measurement noise covariance matrices. IEEE Trans. Autom. Control 2018, 63, 594–601. [Google Scholar] [CrossRef] [Green Version]
  24. Julier, S.J.; Uhlmann, J.K.; Durrant-Whyte, H. A new approach for filtering nonlinear systems. In Proceedings of the 1995 American Control Conference—ACC’95, Seattle, WA, USA, 21–23 June 1995; pp. 1628–1632. [Google Scholar]
  25. Arulampalam, M.S.; Maskell, S.; Gordon, N.; Clapp, T. A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Proc. 2002, 50, 174–188. [Google Scholar] [CrossRef] [Green Version]
  26. Huang, Y.; Zhang, Y.; Li, N.; Chambers, J. A robust gaussian approximate filter for nonlinear systems with heavy tailed measurement noises. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China, 20–25 March 2016; pp. 4209–4213. [Google Scholar]
  27. Xu, D.; Shen, C.; Shen, F. A robust particle filtering algorithm with non-gaussian measurement noise using student-t distribution. IEEE Signal Proc. Lett. 2014, 21, 30–34. [Google Scholar] [CrossRef]
  28. Tichavsky, P.; Muravchik, C.H.; Nehorai, A. Posterior Cramer-Rao bounds for discrete-time nonlinear filtering. IEEE Trans. Signal Proc. 1998, 46, 1386–1396. [Google Scholar] [CrossRef]
Figure 1. Pdfs of the proposed model and CMSt in the 2D example. (a) Pdf plot of the proposed model. (b) Pdf plot of the CMSt.
Figure 1. Pdfs of the proposed model and CMSt in the 2D example. (a) Pdf plot of the proposed model. (b) Pdf plot of the CMSt.
Remotesensing 14 05477 g001
Figure 2. The evolution of particle weights. (a) 3D plots of evolution of particle weights. (b) slice plots of evolution of particle weights. (Particle weights are denoted by the sizes of their corresponding particle balls, and the particle unreliability is depicted and illustrated by the colors).
Figure 2. The evolution of particle weights. (a) 3D plots of evolution of particle weights. (b) slice plots of evolution of particle weights. (Particle weights are denoted by the sizes of their corresponding particle balls, and the particle unreliability is depicted and illustrated by the colors).
Remotesensing 14 05477 g002
Figure 3. Performance comparisons on simulated data. (a) Estimated target locations. (b) Estimated RMSE.
Figure 3. Performance comparisons on simulated data. (a) Estimated target locations. (b) Estimated RMSE.
Remotesensing 14 05477 g003
Figure 4. Estimated NMSE versus outlier ratios.
Figure 4. Estimated NMSE versus outlier ratios.
Remotesensing 14 05477 g004
Figure 5. Estimated Mahalanobis distance versus outlier ratios.
Figure 5. Estimated Mahalanobis distance versus outlier ratios.
Remotesensing 14 05477 g005
Figure 6. Estimated errors versus only range outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Figure 6. Estimated errors versus only range outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Remotesensing 14 05477 g006
Figure 7. Estimated errors versus only azimuth outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Figure 7. Estimated errors versus only azimuth outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Remotesensing 14 05477 g007
Figure 8. Estimated errors versus only radial velocity outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Figure 8. Estimated errors versus only radial velocity outliers in multidimensional measurements. (a) NMSE comparisons. (b) Mahalanobis distance comparisons.
Remotesensing 14 05477 g008
Figure 9. Bounds comparisons of estimated errors.
Figure 9. Bounds comparisons of estimated errors.
Remotesensing 14 05477 g009
Figure 10. Experiment environment sketch map.
Figure 10. Experiment environment sketch map.
Remotesensing 14 05477 g010
Figure 11. Raw data plots in three-dimensional entries in the measurement vector.
Figure 11. Raw data plots in three-dimensional entries in the measurement vector.
Remotesensing 14 05477 g011
Figure 12. Performance comparisons of tracking results in the real data. (a) Tracking results based on real data. (b) RMSE comparisons.
Figure 12. Performance comparisons of tracking results in the real data. (a) Tracking results based on real data. (b) RMSE comparisons.
Remotesensing 14 05477 g012
Figure 13. Raw data plots in three-dimensional entries in the measurement vector.
Figure 13. Raw data plots in three-dimensional entries in the measurement vector.
Remotesensing 14 05477 g013
Figure 14. Performance comparisons of tracking results in the real data. (a) Tracking results based on real data. (b) RMSE comparisons.
Figure 14. Performance comparisons of tracking results in the real data. (a) Tracking results based on real data. (b) RMSE comparisons.
Remotesensing 14 05477 g014
Table 1. Executive time comparisons.
Table 1. Executive time comparisons.
MethodPFOR-EKFWR-PFRR-PF
Average executive time0.0269 s0.0096 s0.0317 s0.0367 s
Table 2. Parameters for the LFMCW Radar System.
Table 2. Parameters for the LFMCW Radar System.
ParametersDefinitionValues
f c Carrier frequency77 GHz
BBandwidth4 GHz
F s Sampling rate6.25 MHz
TPulse duration50 μ s
FFT r Range FFT points128
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, Q.; Chen, L.; Li, Y.; Wang, Z.; Yao, S.; Li, H. Reweighted Robust Particle Filtering Approach for Target Tracking in Automotive Radar Application. Remote Sens. 2022, 14, 5477. https://doi.org/10.3390/rs14215477

AMA Style

Wu Q, Chen L, Li Y, Wang Z, Yao S, Li H. Reweighted Robust Particle Filtering Approach for Target Tracking in Automotive Radar Application. Remote Sensing. 2022; 14(21):5477. https://doi.org/10.3390/rs14215477

Chicago/Turabian Style

Wu, Qisong, Lingjie Chen, Yanping Li, Zijun Wang, Shuai Yao, and Hao Li. 2022. "Reweighted Robust Particle Filtering Approach for Target Tracking in Automotive Radar Application" Remote Sensing 14, no. 21: 5477. https://doi.org/10.3390/rs14215477

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop