Next Article in Journal
Assessment of Seven Atmospheric Correction Processors for the Sentinel-2 Multi-Spectral Imager over Lakes in Qinghai Province
Previous Article in Journal
Detection of Large-Scale Floods Using Google Earth Engine and Google Colab
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Sequential Joint State Estimation and Track Extraction Algorithm Based on Improved Backward Smoothing

1
College of Electronic Science and Engineering, National University of Defense Technology, Changsha 410073, China
2
National Key Laboratory of Science and Technology on Blind Signal Processing, Chengdu 610041, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(22), 5369; https://doi.org/10.3390/rs15225369
Submission received: 30 September 2023 / Revised: 11 November 2023 / Accepted: 13 November 2023 / Published: 15 November 2023

Abstract

:
In order to further promote the accuracy of state estimation and track extraction capabilities for multi-target tracking, a sequential joint state estimation and track extraction algorithm is proposed in this article. This algorithm is based on backward smoothing under the framework of Labeled Random Finite Set and utilizes label iterative processing to perform outlier removal, invalid short-lived track removal, and track continuity processing in a sequential manner in order to achieve the goal of improving the multi-target tracking performance of the algorithm. Finally, this paper verifies through experimental simulation and measured data analysis that the proposed algorithm has improved the performance of radar multi-target tracking to a certain extent.

1. Introduction

In the process of radar multi-target detection and tracking, due to various reasons (such as detection capability, Doppler Blind Zone [DBZ]) that cause false alarms, missing detections, and other issues, the number of targets may change, and outlier interference and track fracture may occur during the tracking process.
For multi-target tracking in such scenarios, the existing mainstream processing methods include the Joint Probabilistic Data Association (JPDA) method [1], Multiple Hypothesis Tracking (MHT) method [2], and Random Finite Set (RFS) method [3]. Compared to the other two methods, RFS methods model the state and measurement of the target in the form of a random finite set. The random finite set can intuitively represent the status information of the target’s survival, death, and birth, corresponding to the measurement’s detection, missed detection, and false alarm. Therefore, it became a research hotspot once it was proposed. The existing mature RFS methods include Probability Hypothesis Density (PHD) filter [4], Cardinalized PHD (CPHD) filter [5], Cardinality-Balanced Multi-Bernoulli (CB-MeMBer) filter [6], Generalized Labeled Multi-Bernoulli (GLMB) filter [7], and Labeled Multi-Bernoulli (LMB) filter [8]. By integrating the concept of the label with the theory of Random Finite Set, Labeled Random Finite Set theory (Labeled RFS) with the ability to track extraction and management is proposed. Due to the introduction of labels, the multi-target tracker based on Labeled RFS theory can achieve track extraction and management functions through label iterative processing (label iterative processing is a processing method for label-based multi-target tracking algorithms to achieve target track processing through sequential logical processing of target labels). Therefore, further exploring label iterative processing for track extraction and management is a valuable work for achieving sequential track processing.
Afterwards, researchers have further expanded and extended the application of Labeled RFS theory in state estimation and track processing by combining it with smoothing. In order to promote the practical application of the Labeled RFS smoother, the exact closed-form solution (GLMB smoother) was provided in [9], but it has the problem of complex data association and difficulty in domain implementation. In [10], Labeled RFS filtering and smoothing processes were fused to propose a multi-frame GLMB smoother with better performance, but in the implementation process, it requires solving an NP-hard multi-dimensional assignment problem to reduce the computational component. In [11], a One Time Step Lagged δ-GLMB (OL-δ-GLMB) smoother with excellent performance was proposed in the δ-GLMB filter. In [12], an LMB smoother based on forward filtering–backward smoothing (FB-LMB smoother) was proposed, and on this basis, [13] provided the sequential Monte Carlo (SMC) implementation of the smoother and analyzed the linear relationship between the computational complexity of the algorithm and the number of targets. Based on the above work, [14] comprehensively compared the processing performance of MB smoother, CB-MeMBer filter, PHD filter, PHD smoother, LMB filter, and FB-LMB smoother, verifying its effectiveness.
In addition, in complex battlefield environments, due to sensor measurement errors, environmental noise, electromagnetic interference, geographical environment and other factors, sensors often cannot obtain the state information of the target at every moment. Therefore, the target track obtained by the fusion center is usually fragmented and cannot present a unified situation of the target. This type of issue can be uniformly described as a track extraction problem. For the problem of track extraction, in addition to removing outliers and invalid targets to make the estimated track smoother, it is also necessary to solve the problem of track continuity, which includes the problems of track association and track recovery. The existence of the two problems has a chronological relationship, and the accuracy of track association directly affects the result of track recovery.
For the problem of track association, the existing methods at present can be divided into track–track association and point–track association. Track–track association is mostly carried out in the form of batch processing or requires long-term observation results as support, so its instantaneity is difficult to meet; compared to track–track association, point–track association is easier to meet the requirements of real-time processing. However, due to the reduction of intervention information, its accuracy is slightly lower than that of track–track association. Therefore, a compromise is needed. In order to further meet the requirements of instantaneity and effectively manage tracks, this article focuses on point–track association and uses the advantages of Labeled RFS theory in association (to avoid the problem of association) to achieve the goal of sequential management of tracks.
Regarding the issue of track recovery, [15] uses polynomial fitting methods to connect the fractured tracks that satisfy the association relationship. The fitting data uses the location vectors of the last S state points of the old track and the location vectors of the latest S state update points of the new location. However, due to the unknown target motion information in the interruption interval, considering the impact of random errors on the target location, it is necessary to rely on experience to determine the polynomial to fit the fractured track data on each coordinate axis and connect the old track with the new track. The authors of [16] use the first state update point of the new location for smoothing recovery processing based on track association. The authors of [17] use covariance interaction to fuse the predicted tracks of the new and old track segments to obtain the stitched tracks at the interrupted points. The authors of [18] use a FB-LMB smoother to removal filtered outliers and output a smoothed estimation track to improve tracking accuracy. However, due to its output of only the smoothed results of the surviving target, the estimation points adjacent to a missed target are erroneously removed, and this becomes more severe as the smoothing step length increases. The authors of [19] corrected the above problem in [18] and introduced the interference elimination.
In order to further optimize the state estimation and track extraction of the Labeled RFS trackers, this article proposes a sequential joint state estimation and track extraction algorithm based on label iterative processing which combines the LMB filtering with backward smoothing. The advantages of this algorithm are as follows: (1) It can correctly remove interference in real time and output smooth estimated tracks; (2) It integrates track start determination and processing with label iterative processing, enabling it to sequentially process invalid short-lived targets; (3) It integrates label iterative processing with track continuity processing, enabling it to sequentially process track fracture. Figure 1 shows the processing flowchart and improvement points of the algorithm in this paper. The improvement parts are marked in red boxes in the figure. Finally, by comparing with similar algorithms and analyzing the results, its effectiveness is verified in tracking. Table 1 gives the nomenclature table of all the symbols and notations in the article.
The rest of this article is organized as follows. Section 2 first presents the SMC implementation of LMB filter and backward smoothing. Section 3 details the theoretical derivation process and implementation pseudo-code of the proposed algorithm reader’s convenience and replication. Section 4 presents simulation and experimental results to verify the effectiveness of the proposed method. Section 5 introduces the conclusions of the article and future research expectations.

2. The SMC Implementation of LMB Filtering and Backward Smoothing

The Labeled RFS theory represents the state of multiple targets as X = { x 1 , , x i , , x | X | } = ( X , L ) , where x i = ( x i , i ) represents the label state of a single target and i is the label of target x i . X = { x 1 , , x i , , x | X | } and L = { 1 , , i , , | L | } are the state set and label set of multiple targets, respectively, which together form the label multi-target state set X . And | X | = | X | = | L | represents the cardinality (number of targets) of the multi-target state, where X X , L L , Χ X × L , X and L are the state space and label space of the targets, respectively.
When the multi-target state X obeys an LMB distribution [8], its probability density function (PDF) is expressed as follows:
π ( X ) = Δ ( X ) ω ( ( X ) ) p X = Δ ( X ) ω ( L ) p X
where Δ ( X ) = δ | X | ( | ( X ) | ) is the indicator function of different labels; when the labels in X are completely different, Δ ( X ) = 1 , otherwise, Δ ( X ) = 0 ; ω ( L ) = ω ( ( X ) ) is the assumed weight; where the mapping : X × L L makes ( x , ) = , ( X ) = { : ( x , ) X } ; the assumed weight can be calculated by ω ( L ) = L ( 1 r ) L 1 L ( ) r 1 r , where 1 L ( ) is the inclusion function; when L , 1 L ( ) = 0 , otherwise, 1 L ( ) = 1 ; r represents the survival probability of the target x with label ; for p X , if X , then p X = x X p ( x , ) ; where p ( x , ) is the density function of the target x , if X = , then p X = 1 . The above LMB PDF can be equivalently written as π = { ( r , p ) } l L .
The standard LMB filtering process [8] (which includes the prediction and update processes) and the SMC implementation of the LMB backward smoothing process [14] are provided below.

2.1. Prediction

The LMB multi-target posterior PDF at time t 1 is denoted as π t 1 | t 1 L t 1 | t 1 { ( r t 1 | t 1 , { w t 1 | t 1 , i , x t 1 | t 1 , i } i = 1 N t 1 | t 1 ) } L t 1 | t 1 , where { w t 1 | t 1 , i , x t 1 | t 1 , i } i = 1 N t 1 | t 1 represents the set of particles of the density function p t 1 | t 1 , i of track , w t 1 | t 1 , i is the particle weight, x t 1 | t 1 , i is the particle state, and N t 1 | t 1 is the particle number; Similarly, the set of particles of the newborn LMB multi-target PDF at time t can be denoted as π B , t L B , t { ( r B , t , { w B , t , i , x B , t , i } i = 1 N B , t ) } L B , t . Combining with the LMB filter prediction step, the set of particles of the predicted target PDF can be obtained as
π t | t 1 L t | t 1 = { ( r t | t 1 , { w t | t 1 , i , x t | t 1 , i } i = 1 N t | t 1 ) } L t | t 1 = π S , t | t 1 π B , t = { ( r S , t | t 1 , { w S , t | t 1 , i , x S , t | t 1 , i } i = 1 N S , t | t 1 ) } L S , t | t 1 { ( r B , t , { w B , t , i , x B , t , i } i = 1 N B , t ) } L B , t
  • Predict the set of particles of survival targets π S , t | t 1 L S , t | t 1 :
r S , t | t 1 = η S , t | t 1 r t 1 | t 1
w S , t | t 1 , i = P s , t | t 1 ( x t 1 | t 1 , i , ) w t 1 | t 1 , i η S , t | t 1
x S , t | t 1 , i = f t | t 1 ( x t 1 | t 1 , i ) + u i
η S , t | t 1 = i = 1 N t 1 | t 1 P s , t | t 1 ( x t | t 1 , i , ) w t 1 | t 1 , i
where f t | t 1 ( ) is state transition function of a single target, which is selected as the importance sampling density function in the particle filtering [20], u i is the stochastic process noise during the motion process, and P s , t | t 1 ( x t | t 1 , i , ) is the label survival probability.
  • Predict the set of particles of newborn targets π B , t :
The PDF p B , t of the newborn track can be initialized as
p B , t = i = 1 N B , t w B , t , i δ ( x x B , t , i )
where the set of particles x B , t , i , i = 1 , 2 , , N simulates the region in state space X where target birth events may occur. The set of newborn target particles satisfies a certain distribution, and its particle set can be represented by approximating the predicted PDF p B , t of newborn track to particle set { w B , t , i , x B , t , i } i = 1 N B , t . This article adopts the measurement-driven birth approach to generate newborn targets (refer to reference [14] for the specific derivation, which is not repeated here). The LMB distribution of newborn targets at time t is determined by measurement at time t 1 , with each component corresponding to a measurement value at time t 1 . The probability of these newborn targets is represented as
r B , t ( z ) = min ( r B , max ( z ) , ( 1 r U , t 1 ( z ) λ B , t ) ξ Z t 1 1 r U , t 1 ( ξ ) )
r U , t 1 ( z ) = ( I t 1 | t 1 , θ ) ( L t | t 1 ) × Θ I t 1 | t 1   1 θ ( z ) ω t 1 | t 1 ( I t 1 | t 1 , θ )
where λ B , t is the expected number of newborn targets at time t ; r B , max is the preset maximum value of the newborn probability; r U , t 1 ( z ) is the association probability between measurement and hypothesis, and the larger it is, the lower the probability of the newborn target; and ω t 1 | t 1 ( I t 1 | t 1 , θ ) is the assumed association weight at time t 1 , provided by Equation (13). The function 1 θ ( z ) determines whether a hypothetical weight is associated with the measurement z . If associated, add the weight to the association probability. If the measurement z is not associated with any assumptions, then r U , t 1 ( z ) = 0 . ( ) is the subset operation, Θ is the association hypothesis space, θ is the set of association hypothesis, and θ Θ .

2.2. Update

The target measurement set at time t is denoted as Z k , and the particle set of for updating the multi-target posterior PDF is denoted as π t | t L t | t = { ( r t | t , { w t | t , i , x t | t , i } i = 1 N t | t ) } L t | t .
r t | t = ( I t | t 1 , θ ) ( L t | t 1 ) × Θ I t | t 1 ω t | t ( I t | t 1 , θ ) ( Z ) 1 I t | t 1 ( )
x t | t , i = x t | t ( , θ ) , i
w t | t , i = 1 r t | t ( I t | t 1 , θ ) ( L t | t 1 ) × Θ I t | t 1 x t | t ( , θ ) , i ω t | t ( I t | t 1 , θ ) ( Z ) 1 I t | t 1 ( ) w t | t ( , θ ) , i
where
ω t | t ( I t | t 1 , θ ) ω t | t 1 ( I t | t 1 ) [ η Z t θ ] I t | t 1
x t | t ( , θ ) , i = x t | t 1 , i
w t | t ( , θ ) , i = w t | t 1 , i η Z t θ ( x t | t 1 , i , ) η ¯ Z t θ ( )
η ¯ Z t θ ( ) = i = 1 N t | t w t | t 1 , i η Z t θ ( x t | t 1 , i , )
η Z t θ ( x t | t 1 , i , ) = { P d ( x t | t 1 , i , ) g ( z θ ( ) | x t | t 1 , i , ) κ ( z θ ( ) )   ,   θ ( ) > 0   1 - P d ( x t | t 1 , i , ) ,   θ ( ) = 0
where g ( z θ ( ) | x , ) is the likelihood function, P d ( x , ) denotes the detection probability of the target ( x , ) , and κ ( ) represents the density function of the clutter. For more details, please refer to [14].

2.3. Backward Smoothing

In order to further improve tracking accuracy, researchers have introduced backward smoothing. Compared with real-time forward filtering, backward smoothing uses all observations at the current time to estimate the state of the past, utilizing more observation information to obtain a more accurate and smoother track. Subsequently, researchers have combined the Labeled RFS theory with smoothing, further expanding and extending the application in state estimation and track output. LMB backward smoothing can efficiently output a smooth track of multiple targets, so this article applies it. The specific theoretical description is provided below.
Assuming that the forward filtering is performed at time t , and the smoothed posterior PDF from time t to k ( k < t ) is π k | t L k | t ( X k | t ) , then the smoothed posterior PDF from time t to k 1 is π k 1 | t L k 1 | t ( Y k 1 | t ) . From the LMB forward filtering, it is known that π k 1 | k 1 L k 1 | k 1 ( X k 1 | k 1 ) and π k | k 1 L k | k 1 ( X k | k 1 ) both follow the LMB distribution. If π k | t L k | t ( X k | t ) follows the LMB distribution, then π k 1 | t L k 1 | t ( Χ k 1 | t ) still follows the LMB distribution [12], which can be expressed as
π k 1 | t L k 1 | t { ( r k 1 | t , { w k 1 | t , i , x k 1 | t , i } i = 1 N k 1 | t ) } L k 1 | t
where
r k 1 | t = 1 ( 1 r k 1 | k 1 ) ( 1 r k | t ) ( 1 r k | k 1 )
x k 1 | t , i = x k 1 | k 1 , i
w k 1 | t , i = w ˜ k 1 | t , i i = 1 N k 1 | t w ˜ k 1 | t , i
w ˜ k 1 | t , i = ( 1 r k | t ) ( 1 P s , k | k 1 ( x k 1 | k 1 , i , ) w k 1 | k 1 , i ( 1 r k | k 1 ) + r k | t P s , k | k 1 ( x k 1 | k 1 , i , ) w k 1 | k 1 , i r k | k 1 j = 1 N k | t f k | k 1 ( y k | t , j | x k 1 | k 1 , i , ) w k | t , j p k | k 1 , j ( y k | t , i )

3. A Sequential Joint State Estimation and Track Extraction Algorithm Based on Improved Backward Smoothing

In the process of multi-target tracking, there are often issues such as track fracture and track failure. Most algorithms rely on certain strategies to achieve the goal of track extraction. Common track extraction strategies include:
(1) Saving the remaining tracks that are not used at the current time, so that they can be used as the track head at the next time to start the track.
(2) Deleting tracks that do not have updated points at the current time or have a slightly lower number of track points for multiple consecutive times, which may be caused by noise, clutter or interference.
(3) Deleting tracks with a slightly lower number of track points and inconsistent target characteristics, which may be caused by clutter or interfering/jamming targets.
(4) Sorting the track numbers for confirmed tracks and output tracks.
In order to pursue ultimate tracking performance, these strategies are usually managed and processed in batch mode, which makes the algorithm lose the possibility of real-time processing. For better handling of the track continuity, this article proposes a sequential joint state estimation and track extraction algorithm based on improved backward smoothing based on label iterative processing (Figure 2 shows the framework diagram), which not only can effectively remove outliers and short-lived target tracks using backward smoothing, but also further improves the performance of recovering track fracture to achieve sequential state estimation and track extraction of radar multi-target tracking. The steps are as follows.
The following should be noted: (a) The starting time of the loop in steps 2 and 4 is different, like “ t ” and “ t 1 ”. (b) Due to the introduction of backward smoothing, in order to facilitate identification, this article uniformly uses the subscript “ t ” to represent the newborn state, the subscript “ t | t 1 ” to represent the predicted state, the subscript “ t | t ” to represent the updated/posterior state, and the subscript “ k | t ” to represent the smoothed state. Please pay attention to this distinction when reading. (c) In the backward smoothing processing loop, a single cycle plays the role of smoothing the survival-target state and eliminating interference, and multiple cycles play the role of using the target state at the latest moment to repeatedly correct the target state within the smoothing window, including completing the target state in step 4, thus improving the tracking performance at the track fracture. (d) There are three main loops in the algorithm, which are nested within each other. Please pay attention to the internal processing logic. (e) Since the output of the algorithm is obtained through parameter estimation and extraction based on the result of backward smoothing, the final determination result obtained by the algorithm is delayed by l b s steps.
Loop begins.
Step 1: Prediction
Suppose the posterior PDF at time t 1 is π t 1 | t 1 L t 1 | t 1 { ( r t 1 | t 1 , { w t 1 | t 1 , i , x t 1 | t 1 , i } i = 1 N t 1 | t 1 ) } L t 1 | t 1 . In the prediction step of the proposed method, in addition to the prediction process for the survival target and the newborn target process, in order to obtain the target state at the track fracture, the proposed algorithm uses the predicted state of the missed target at the previous time in the backward smoothing processing range to recursively obtain its predicted state at the next time, which is used as the basis for track recovery. Here, the predicted state set that includes the hypothetical predicted state set of the status-pending label set  L P is called the enhanced predicted PDF.
Using Equations (3)–(6), obtain the predicted PDF of the survival target at time t :
π S , t | t 1 L S , t | t 1 = { ( r S , t | t 1 , { w S , t | t 1 , i , x S , t | t 1 , i } i = 1 N S , t | t 1 ) } L S , t | t 1
Using Equations (7)–(9), obtain the predicted PDF of the newborn target at time t :
π B , t L B , t { ( r B , t , { w B , t , i , x B , t , i } i = 1 N B , t ) } L B , t
Using the following steps to obtain the hypothetical predicted PDF of the status-pending label set L P , t | t 1 at time t :
π P , t | t 1 L P , t | t 1 = { ( r P , t | t 1 , { w P , t | t 1 , i , x P , t | t 1 , i } i = 1 N P , t | t 1 ) } L P , t | t 1
r P , t | t 1 = η P , t | t 1 r t 1 | t 2
w P , t | t 1 , i = P p , t | t 1 ( x t 1 | t 2 , i , ) w t 1 | t 2 , i η P , t | t 1
x P , t | t 1 , i = f t | t 1 ( x t 1 | t 2 , i ) + u i
η P , t | t 1 = i = 1 N t 1 | t 2 P p , t | t 1 ( x t | t 1 , i , ) w t 1 | t 2 , i
where the single-target state transition function f t | t 1 ( ) , the survival probability of the status-pending target P p , t | t 1 ( x t 1 | t 1 , i , ) , and the stochastic process noise u i are all set according to the prediction of the survival target.
Combining with the above derivation process, the enhanced predicted PDF at time t is obtained as follows:
π t | t 1 L t | t 1 = { ( r S , t | t 1 , { w S , t | t 1 , i , x S , t | t 1 , i } i = 1 N S , t | t 1 ) } L S , t | t 1 { ( r B , t , { w B , t , i , x B , t , i } i = 1 N B , t ) } L B , t { ( r P , t | t 1 , { w P , t | t 1 , i , x P , t | t 1 , i } i = 1 N P , t | t 1 ) } L P , t | t 1 = { ( r t | t 1 , { w t | t 1 , i , x t | t 1 , i } i = 1 N t | t 1 ) } L t | t 1
Step 2: Update
Assuming that the measurement set Z k is obtained at time t , then according to Equations (10)–(17), the updated/posterior PDF is π t | t L t | t = { ( r t | t , { w t | t , i , x t | t , i } i = 1 N t | t ) } L t | t .
Step 3: Improved backward smoothing
Assuming the backward smoothing step length is l b s , the following are the improved steps for backward smoothing in this article:
f o r   k = t : 1 : k m i n = m a x ( 1 , t l b s )
(1) Firstly, the posterior PDF of the persistent target L p e r s i s t e n t = L k | t L k 1 | k 1 (existing at time k and k 1 simultaneously) is obtained by smoothing, and the smoothed posterior PDF π k 1 | t L p e r s i s t e n t at the next time is obtained from the smoothed posterior PDF π k | t L p e r s i s t e n t at the previous time by backward smoothing in Equations (19)–(22).
(2) By tracing and counting the target label, outliers and the status-pending target are determined based on the label history, and the corresponding state and label of invalid targets are removed.
First, the vanishing label set   L d e a t h = L k | t L ¯ k 1 | k 1 is obtained at time k 1 , and then label tracing and statistics of the vanishing label set   L d e a t h are used to determine the status of the labels. The determination principle is as follows:
In the backward smoothing process at time k 1 , the number of occurrences of each label in the vanishing label set   L d e a t h from time 1 to t (here, time t is used to instead of time k , emphasizing the full utilization of history information before and after the label) is counted, and it is determined whether the number of the historical occurrences of each label exceeds the effective number d t = max ( 1 , l t s d ) . If not, it is determined to be an outlier or an invalid short-lived target (here, it is assumed that the number of historical occurrences of an outlier does not exceed 1, and the number of historical occurrences of the invalid short-lived target does not exceed l t s d ). If it exceeds this number, it is determined to be a missed label set L m i s s e d . The specific discrimination formula is as follows:
L m i s s e d = { i L d e a t h , i = 1 , , | L d e a t h | | n u m ( i L 1 : t ) > d t }
where n u m ( i L 1 : t ) represents the total number of occurrences of label i at time 1 : t . Finally, the missed label set is used to correct the backward smoothing result.
(3) Use the following equation to obtain the preliminarily corrected smoothed posterior PDF π k 1 | t L k 1 | t { ( r k 1 | t , { w k 1 | t , i , x k 1 | t , i } i = 1 N k 1 | t ) } L k 1 | t .
π k 1 | t L k 1 | t = π k 1 | t L p e r s i s t e n t + π k 1 | k 1 L m i s s e d
(4) According to π k | t L k | t { ( r k | t , { w k | t , i , x k | t , i } i = 1 N k | t ) } L k | t , the parameter state is extracted using the K-means clustering algorithm [21] to obtain { ( x ^ k | t , 1 , k | t , 1 ) , , ( x ^ k | t , | L k | t | , k | t , | L K , k | t | ) } L ^ k | t ; x ^ t , i represents the extracted state of the label t , i , and L ^ k | t represents the set of estimated labels corresponding to all estimated target states at time k .
Step 4: Track filling
When there is a duplicate target in the status-pending label set L P , t | t 1 , fill its hypothetical predicted PDF at the fracture.
L r e v i v a l = L t | t L P , t | t 1 f o r   k = t 1 : 1 : k m i n = m a x ( 1 , t l b s ) π k | t L k | t = π k | t L k | t + π k | k 1 L r e v i v a l e n d
Step 5: Update and obtain the status-pending label set L P , t | t 1 for the next moment
L P , t + 1 | t = ϑ ( L P , t | t 1 , l t s d ) L r e v i v a l + L m i s s e d
ϑ ( L P , k | k 1 , l t c ) = { i L P , k | k 1 , i = 1 , , | L P , k | k 1 | | n u m ( i { L P , t | t 1 , , L P , k m i n | k m i n 1 } ) l t c }
where n u m ( ) is defined as above, and k m i n = m a x ( 1 , k l b s ) , l t c is the track start determination length.
Step 6: Normalize weight, resampling, and track pruning
Loop ends.
It should be emphasized here that the algorithm output results are extracted from the parameter estimation of the backward smoothing output results. Because of this, this article achieves the above functions by performing traceback processing on the labels in smoothing processing, which allows the algorithm to correct the filled tracks using the backward smoothing process.
Computational complexity: The main computational cost of the processing algorithm proposed in this article comes from LMB backward smoothing. The computational complexity of backward smoothing is O ( l b s M ( N ) 2 ) , where l b s is the backward smoothing step length, M is the number of tracks, and N is the number of particles approximated by PDF particles for each track. The specific source is the four for loops in back smoothing. The computational complexity of the two parallel inner for loops is O ( ( N ) 2 ) , and then multiplied by the two outers for loops to obtain the final computational complexity of O ( l b s M ( N ) 2 ) .
In order to facilitate readers’ understanding and replication, the pseudo-code of the proposed Algorithm 1 is provided below.
Algorithm 1: Pseudo-Code
Input: π t 1 | t 1 L t 1 | t 1 { ( r t 1 | t 1 , { w t 1 | t 1 , i , x t 1 | t 1 , i } i = 1 N t 1 | t 1 ) } L t 1 | t 1 , Z k ;
Output: { ( x ^ k | t , 1 , k | t , 1 ) , , ( x ^ k | t , | L k | t | , k | t , | L K , k | t | ) } L k | t
f o r   k = 1 : K ( K is the number of simulations)
π t | t 1 L t | t 1 { ( r t | t 1 , { w t | t 1 , i , x t | t 1 , i } i = 1 N t | t 1 ) } L t | t 1 according to (3)–(6) and (23)–(27)
π t | t L t | t = { ( r t | t , { w t | t , i , x t | t , i } i = 1 N t | t ) } L t | t according to (10)–(17)
f o r   k = t : 1 : k m i n = m a x ( 1 , k l b s )
      L d e a t h = L k | t L ¯ k 1 | k 1 L p e r s i s t e n t = L k | t L k 1 | k 1
   L m i s s e d = { i L d e a t h , i = 1 , , | L d e a t h | | n u m ( i L 1 : t ) > d t }
   π k | t L k | t = π k 1 | t L p e r s i s t e n t + π k 1 | k 1 L m i s s e d according to (19)–(22)
e n d
L r e v i v a l = L t | t L P , t | t 1
f o r   k = t 1 : 1 : k m i n = m a x ( 1 , k l b s )
   π k | t L k | t = π k | t L k | t + π k | k 1 L r e v i v a l
e n d
L P , t + 1 | t = ϑ ( L P , t | t 1 , l t s d ) L r e v i v a l + L m i s s e d
 Normalize weight, resampling, and track pruning.
e n d

4. Experiment Analysis

This article takes the tracking of UAV targets under the pulse Doppler (PD) radar system as the research background and combines this with the actual background parameters to verify the effectiveness of the proposed algorithm through simulation data and measured data. The radar’s carrier frequency is 35   GHz , the pulse repetition frequency is 32   kHz , the distance sampling interval is 1 . 875   m , and the number of distance sampling points is 319 . The algorithm is SMC implementation, and the number of particles is set to N = 500 .
The wavelength of the radar can be calculated from its basic parameters as 0 . 0086   m , and the maximum unambiguous velocity is 137 . 14   m / s (the range of unambiguous velocity is from 0 to 137 . 14   m / s ). The maximum unambiguous range is 4688   m . To avoid the effects of velocity and range ambiguity, this article refers to the above data to set the target velocity and observation scenario.
Scenario parameter setting: The scenario setting in this article are the same as those in [18] and the source of the measured data. The observation area is set to [ 800 , 2200 ]   m × [ 120 , 120 ]   m / s with reference to the actual scenario setting. In this article, we compromise and choose a coherent accumulation time of T = 0.025   s , which is 800 for coherent accumulation. At this point, the speed accuracy can reach 0.086   m / s under accurate focusing, fully meeting the tracking requirements.
State transition equation: In this paper, a discrete acceleration model is considered as the state transition equation, and the state variable of a single target is represented as x t = ( x t , t ) = [ p t , p ˙ t , p ¨ t , ] Τ , where p t is the distance, p ˙ t is the radial velocity, and p ¨ t is the radial acceleration. The state transition equation is as follows:
x t = F x t 1 + G υ t 1
where υ t 1 ~ N ( ; 0 , σ w 2 ) is the state noise of x t , G υ t 1 describes the random process noise u i in the particle motion process in Equations (5) and (6), and the state transition matrix F and noise transformation matrix G are, respectively,
F = [ 1 T T 2 2 0 1 T 0 0 1 ] G = [ T 2 2 T 1 ]
The measurement distance and speed are noisy, and the measurement equation is as follows:
z t = [ R t , V t ] Τ + ε t
where the measurement noise is ε t ~ N ( ;   0   ,   Q ε ) , Q ε = d i a g ( σ R 2 , σ V 2 ) . σ R and σ V are the approximate variance of the target’s distance and speed, respectively.
Target measurement noise: Calculate the approximate variance of the target distance and velocity from the measured data, and select σ R 1.875   m and σ V 0.23   m / s . The detection probability of the target is based on the actual scenario settings. The Clutter density function κ ( ) follows the Poisson distribution, and the number of clutters λ c in the observation scene is given in the subsequent parameter settings.
Target motion noise: Based on the analysis of the measured data, the process noise standard deviation for each time step can be set to σ w = 0.5 , and the probability of the survival target and the status-pending target are both set to P s = P p = 0.99 .
Newborn-target probability density parameter settings: r B , max = 0.01 and λ B , t = 0.02 can be set. Considering that the main processing is carried out during the tracking stage, the measurements in the simulation experiment are obtained after the CFAR detection value is condensed by the plot. The estimated value is the filtering output value of the LMB smoother. In addition, the experiment uses measurement-driven target birth to generate new targets. Assuming that p B , t ( x | z ) follows a Gaussian distribution, the variance of the Gaussian distribution is equal to the variance of the observation noise Q ε , and the mean is equal to the value of the state x t 1 = [ p t 1 , p ˙ t 1 , p ¨ t 1 , ] Τ corresponding to the observation z = [ R t 1 , V t 1 ] Τ predicted one step forward, which is expressed as follows:
[ p t , p ˙ t , p ¨ t , ] Τ = [ p t 1 p ˙ t 1 T 1 2 p ¨ t 1 T 2 , p ˙ t 1 + p ¨ t 1 T , p ¨ t 1 ] Τ
This article uses the Optimal Sub-Pattern Assignment (OSPA) distance error to evaluate the tracking performance of the proposed algorithm, which is defined as follows:
d e , c D i s t ( X , Y ) = ( min π Π n 1 n i = 1 m d c ( x i , y π ( i ) ) e + c e ( n m ) n ) 1 e ( m n )
where if m > n , d e , c D i s t ( X , Y ) = d e , c D i s t ( Y , X ) , and when m = n = 0 , d e , c D i s t ( X , Y ) = 0 . X = { x 1 , , x m } and Y = { y 1 , , y n } are finite non-empty subsets of the unlabeled estimated state and real state of targets, respectively. n and m are the cardinality of states; d c ( , ) = min ( c , x y )   , represents the Euclidean distance, and Π n represents all possible permutations on the set { 1 , 2 , , n } ; the parameter c is the truncation distance, which controls the weight of cardinality error and location error. The greater c , the more emphasis OSPA places on the influence of cardinality error. The parameter e determines the sensitivity to outliers. In this article, we set c = 8 and e = 1 .
On the basis of the above, the OSPA distance error is further divided into OSPA location error component and OSPA cardinality error component to separately evaluate tracking accuracy (state estimation) and tracking integrity (cardinality estimation), defined as
d e , c L o c ( X , Y ) = ( 1 n ( min Γ Π n i = 1 m d ( c ) ( x i , y Γ ( i ) ) e ) ) 1 n d e , c C a r d ( X , Y ) = ( 1 n ( c e ( n m ) ) ) 1 n
d e , c C a r d ( X , Y ) = ( 1 n ( c e ( n m ) ) ) 1 n
In addition, due to the use of Monte Carlo simulation in this article, all the OSPA errors provided are the average values in the time dimension. And for the convenience of comparison, the average OSPA error is accumulated and summed over time to obtain a single value of the total OSPA error. In this article, the experiment is carried out in the form of Monte Carlo simulation, the simulation times are set to 100, and the final experimental results are analyzed.

4.1. Description of Processing Effect

4.1.1. Track Start Determination and Processing

The algorithm proposed in this article can effectively discriminate outliers and invalid short-lived targets by tracing and statistics of target labels, and then eliminates the above interferences through backward smoothing to achieve sequential track start determination and processing.
First, track start processing is performed after completing track start determination, using backward smoothing to eliminate interferences like outliers and invalid short-lived targets, and the removal effect depends on the backward smoothing step length l b s . To elaborate, this article conducts simulations of the length of different backward smoothing step length l b s = 3 , 4 , 5 , 6 on the processing of short-lived tracks. The scene setting is provided in Table 2 and the processing effect is shown in Figure 3a. In order to visually demonstrate the processing effect, the experiment avoids interference from motion noise, measurement noise, and clutter.
Figure 3a contains a normal target (T1) and four jamming targets (J1, J2, J3, J4) with point lengths of 3, 4, 5, and 6, respectively. When processed with backward smoothing step lengths of 2, 3, 4, and 5, respectively, the four jamming targets are removed to varying degrees, and the number of removed jamming points depends on the backward smoothing step length. From the experimental result, it can be seen that when the backward smoothing step length is set to l b s = 5 , the track of the four jamming targets can be perfectly removed, achieving the expected effect.
The above experiment demonstrates that the track start processing depends on backward smoothing, while track start determination is determined by the length of the track start determination. On the basis of the above simulation, further analysis is conducted on the processing effect of the algorithm under different track start determination lengths. At this time, the track start determination length is taken as l t s d = 3 , 4 , 5 , 6 , and the backward smoothing step length is taken as l b s = 6 . From Figure 3a, it can be seen that the backward smoothing step length can effectively remove the jamming targets with lengths of 2, 3, 4, and 5 in the scene, while the track start determination length will determine whether the target is a jamming target or a target that does not meet the track start length based on the parameter setting, so as to eliminate it using backward smoothing. The simulation results are shown in Figure 3b.
From the experimental results above, it can be seen that as the track start determination length gradually increases, the jamming targets 1–4 are gradually eliminated, while the normal targets are not affected. The above results verify the track initiation determination and processing effect of the proposed algorithm.

4.1.2. Track Continuity Processing

Another innovation of this article is the fusion of track continuity processing and backward smoothing. This fusion not only fills the target hypothetical predicted PDF as the posterior PDF when the target reappears (detected again), but also modifies it through backward smoothing. Compared to interpolating the estimated points at the fracture through interpolation [18], this approach can be implemented in a sequential manner and also improves tracking performance, which will be further verified in subsequent analysis. In order to further illustrate the track continuity processing of this algorithm, this article conducted simulations according to the scene parameter settings provided in Table 3, which included targets with varying degrees of fracture. The experimental results are simulated under different track continuity processing lengths l t c = 2 , 3 , 4 , 5 . In addition, the track start determination length is set to l t s d = 3 . In this simulation, in order to visually demonstrate the problem, the experimental factors such as motion noise, measurement noise, and clutter interference are also avoided.
The normal target in the simulation scenario includes track fractures with the length of 3, 4, and 5. It can be seen from the experimental results in Figure 4 that, as the track continuity processing length gradually increases, the three different length track fractures are recovered one by one. The above results verify the effectiveness of the proposed algorithm for track continuity processing.

4.1.3. The Influence of Backward Smoothing Step Length on Tracking Performance

In this simulation, interference is considered, and the scene setting is provided in Table 4. Here, the backward smoothing step lengths are l b s = 3 , 4 , 5 , 6 .
Figure 5 gives the real state value and measured value of the simulated scene. Figure 6 and Figure 7 show the specific experimental results. In the algorithm proposed in this article, the step length of backward smoothing is directly related to the length of short-lived targets and track fractures that the algorithm can handle, and also directly affects the estimation performance of the target state. Figure 6 shows the average OSPA distance (referring to the average of multiple results under Monte Carlo simulation) obtained under different backward smoothing step lengths while ensuring the normal processing of short-lived targets and recovering track fractures. Figure 7 shows the total OSPA distance (sum of the average OSPA distances over time) and runtime under different backward smoothing step lengths. Combining Figure 6 and Figure 7, it can be summarized that backward smoothing is beneficial for improving tracking performance, but it is not friendly to computation burden. Therefore, in the processing process, the setting of the backward smoothing step length should be considered as a compromise, and the runtime and tracking performance should be comprehensively considered.

4.2. Multi-Target Scene Simulation

To further verify the tracking performance of the proposed algorithm, an experiment was conducted with the scene setting as shown in Table 5. The experiment included 3 targets, 6 short-lived jamming targets, and clutter. The simulation results are shown in Figure 8, Figure 9, Figure 10 and Figure 11.
Ref. [11] provides a detailed comparison between four smoothers including LMB smoother [12], δ-GLMB-A smoother [22], δ-GLMB filter, and the proposed OL-δ-GLMB smoother. Ref. [14] thoroughly compares the processing performance of MB smoother, CB-MeMBer filter, PHD filter, PHD smoother, LMB filter, and the proposed FB-LMB smoother. Here, the proposed algorithm (IBR-LMB smoother) is compared with OL-δ-GLMB smoother, FB-LMB smoother, and Backward-Interpolation LMB (BI-LMB) smoother [19] to verify the effectiveness.
For the four smoothers (FB-LMB, OL-δ-GLMB, BI-LMB, IBR-LMB), the reasons for the distortion points in Figure 10 stem from three aspects: outlier removal, short-lived track removal, and track continuity processing. First, to explaining these three aspects one by one: outlier removal is to remove outliers using backward smoothing under the control of backward smoothing step length; short-lived track removal is also to process short-lived tracks using backward smoothing processing combined with track start determination; track continuity processing is to use backward smoothing to reasonably recover track fractures. Among the four smoothers, except for the proposed IBR-LMB smoother, the other three methods only have partial capabilities.
FB-LMB smoother has an ability to remove outliers using backward smoothing, but there is a problem of erroneous removal due to missed detection, and it does not have the ability to process track continuity. Therefore, combined with the multi-target simulation scenario settings provided in Table 5, it can be seen that FB-LMB smoother can effectively remove outliers, so all distorted points are free of the interference of outliers and short-lived tracks. In the processing result of FB-LMB smoother given in Figure 10, points 6, 7, 8, 9, and 10 are erroneously removed due to missed detection of target T3 at time 11–12 under the influence of the smoothing step length, while points 11 and 12 are caused by missed detection of target T3 itself. Point 13 is due to the thresholding of the first point at the beginning of the track due to its low initial survival probability. Points 16, 17, 18, 19, and 20 are also erroneously removed due to missed detection of target T3 at time 21–24 under the influence of the smoothing step length, while points 21, 23, and 24 are caused by missed detection of target T3 itself. Point 30, 31, 32, 33, and 34 are also erroneously removed due to missed detection of target T1 at time 35–38 under the influence of the smoothing step length. Points 35–38 are affected by missed detection of target T3 itself and point 36 may also be affected by unstable determination due to ineffective processing of outliers. Points 37 and 38 are erroneously removed due to the algorithm’s assumption of missed detection of target T1 at 41, while point 39 is erroneously removed due to the thresholding of the first point at the beginning of the track due to its low initial survival probability, and target T1 is not measured at 41, which the algorithm assumes to be a missed detection. Point 40 is erroneously removed due to the algorithm’s assumption of missed detection of target T1 at 41.
BI-LMB smoother has an ability to remove outliers using backward smoothing and corrects the problem of erroneous removal caused by missed detections. However, it does not have the ability to process track continuity. Therefore, compared to FB-LMB smoother, BI-LMB smoother has distortion points only at targets T1 in time 11–12, targets T3 in time 21–24 and 35–38 due to missed detections, and at points 13, 25, and 39 due to the threshold removal of the first point at the start of the trajectory due to its low survival probability.
OL-δ-GLMB smoother only has an ability to remove outliers and incomplete short-lived tracks in one-step processing, but it still has the problem of one-step error removal due to missed detection. In addition, it does not have the ability to process track continuity. Here, we first analyze the removal results of short-lived tracks J1-J6 by OL-δ-GLMB smoother: Due to the one-step smoothing of OL-δ-GLMB smoother, it cannot effectively remove short-lived tracks like other smoothers. Due to its one-step smoothing step length, its ability to remove short-lived tracks is limited. In addition, due to the threshold removal effect of the first point in the track initiation, the result is that J1 is normally removed, but point 13 in J2 is not removed, and points 18 and 19 in J3 are not removed. Point 30 in J4 and J5 is not removed and point 40 in J6 is not removed. Therefore, further analysis is conducted based on the above results. Point 10 is due to one-step error removal caused by missed detection of target T3 in time 11–12. Points 11 and 12 are due to missed detection of target T3 itself in time 11–12. In addition, it should be noted that although point 13 appears to be undistorted, it is actually retained due to the one-step smoothing of OL-δ-GLMB smoother, which leads to the removal of short-lived track J1 at point 13. However, there is an impact of threshold removal due to the low survival probability of the first point in the track initiation, which makes point 13 appear undistorted but actually have a problem. Point 18 and 19 are due to the removal of short-lived track J3 at points 18 and 19. Point 20 is due to one-step error removal caused by missed detection of target T3 in time 21–24. Points 21–24 are due to missed detection of target T3 itself in 21–24. Point 34 is due to one-step error removal caused by missed detection of target T3 in points 35–38. Points 35–38 are due to missed detection of target T1 itself in 35–38. Point 39 is due to threshold removal due to the low survival probability of the first point in the track initiation.
As shown in Figure 8, it can be seen that the proposed IBR-LMB smoother output track is smoother and more complete compared to other algorithms. Figure 11 show the average OSPA distance and cardinality errors of four algorithms. Table 6 presents the total OSPA errors of four algorithms. From the above results, it can be seen that the proposed IBR-LMB smoother outperforms other algorithms in cardinality-estimation performance due to eliminating interferences and recovering track fractures. Eventually, it can be concluded that the proposed IBR-LMB smoother is superior to the other three smoothers, verifying its effectiveness.

4.3. Verification of Measured Data

In the end, the proposed algorithm is verified by the measured data. The actual scenario and parameter setting are provided in Table 6. Track start determination length is set to 3. Figure 12, Figure 13 and Figure 14 and Table 7 provide the experimental results. Here, the results of the four algorithms are also compared and analyzed.
The measured data contains two targets, and their true target state values are shown in Figure 12. Firstly, as shown in Figure 14, the proposed algorithm still has a better OSPA distance error compared to other smoothers, which can also be seen from the specific total OSPA distance error value given in Table 8. In addition, it should be noted that from the true target state values and measured values provided in Figure 12, the measured data used in this article is relatively smooth, which makes the tracking performance of the proposed algorithm not much different from other algorithms, which can be seen from Figure 13, but it is still the optimal algorithm (based on the results of Monte Carlo simulation, the simulation times is 100). Combined with multi-target scene simulation in Section 4.2, it can be seen that with the aggravation of interferences such as motion noise, measurement noise, clutter, etc., the proposed algorithm has more obvious advantages.

5. Conclusions

This article aims to improve the performance of state estimation and track extraction ability for multi-target tracking in radar. Based on LMB filtering, combining with backward smoothing, a sequential joint state estimation and track extraction processing algorithm based on label iterative processing is proposed. Numerical analysis results show that the proposed algorithm can effectively eliminate outliers and short-lived targets, improve the performance of target cardinality and state estimation to a certain extent, and effectively recover track fractures and improve the tracking performance at track fractures. During the research process, it was found that using label iterative processing helps Labeled RFS filters/smoothers to achieve sequential processing of tracks, which is of great significance for conventional algorithms that use batch processing and do not have track output to solve the problem of track initiation and continuity. Therefore, it is proposed to further combine the existing more mature Labeled RFS algorithms to explore how to improve the performance of maneuvering multi-target tracking performance through label iterative processing, and introduce mature fast processing methods from a theoretical level to reduce the computational burden of Labeled RFS filters/smoothers, so as to promote its application in practical engineering.

Author Contributions

J.Z., Z.Z. and K.L. designed the research. J.Z. processed the data and drafted the manuscript. R.Z., S.L. and L.B. helped organize the manuscript. J.Z. and R.Z. revised and finalized the article. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China (NSFC) under grant no. 62271491 and 62001486.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors would like to acknowledge their colleagues and teachers who participated in research activities and contributed to the development of some of the ideas and results presented in this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bar-Shalom, Y.; Willett, P.; Tian, X. Tracking and Data Fusion: A Handbook of Algorithms; YBS Publishing: Storrs, CT, USA, 2011. [Google Scholar]
  2. Blackman, S.; Popoli, R. Design and Analysis of Modern Tracking Systems; Artech House Publishers: Boston, MA, USA, 1999. [Google Scholar]
  3. Mahler, R.P.S.; Ebrary, I. Statistical Multisource-Multitarget Information Fusion; Artech House Publishers: Boston, MA, USA, 2007. [Google Scholar]
  4. Mahler, R.P.S. Multi-target Bayes Filtering via First-Order Multi-target Moments. IEEE Trans. Aerosp. Electron. Syst. 2003, 39, 1152–1178. [Google Scholar] [CrossRef]
  5. Mahler, R. PHD Filters of Higher Order in Target Number. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 1523–1543. [Google Scholar] [CrossRef]
  6. Vo, B.-T.; Vo, B.-N.; Cantoni, A. The Cardinality Balanced Multi-Tar-get Multi-Bernoulli Filter and Its Implementations. IEEE Trans. Signal Process. 2009, 57, 409–423. [Google Scholar]
  7. Vo, B.-T.; Vo, B.-N. Labeled Random Finite Sets and Multi-Object Conjugate Priors. IEEE Trans. Signal Process. 2013, 61, 3460–3475. [Google Scholar] [CrossRef]
  8. Reuter, S.; Vo, B.-N.; Dietmayer, K. The Labeled Multi-Bernoulli Filter. IEEE Trans. Signal Process. 2014, 62, 3246–3260. [Google Scholar]
  9. Beard, M.; Vo, B.-T.; Vo, B.-N. Generalized Labelled Multi-Bernoulli Forward-Backward Smoothing. In Proceedings of the 2016 19th International Conference on Information Fusion (FUSION), Heidelberg, Germany, 5–8 July 2016; pp. 688–694. [Google Scholar]
  10. Vo, B.-N.; Vo, B.-T. A Multi-Scan Labeled Random Finite Set Model for Multi-Object State Estimation. IEEE Trans. Signal Process. 2019, 67, 4948–4963. [Google Scholar] [CrossRef]
  11. Liang, G.; Li, Q.; Qi, B.; Qiu, L. Multi-target Tracking Using One Time Step Lagged Delta-Generalized Labeled Multi-Bernoulli Smoothing. IEEE Access 2020, 8, 28242–28256. [Google Scholar] [CrossRef]
  12. Liu, R.; Fan, H.Q.; Xiao, H.T. A Forward-Backward Labeled Multi-Bernoulli Smoother. In Proceedings of the 16th International Conference on Distributed Computing and Artificial Intelligence, Avila, Spain, 26–28 June 2019; pp. 244–252. [Google Scholar]
  13. Liu, R.; Fan, H.Q.; Li, T.C.; Xiao, H. A Computationally Efficient Labeled Multi-Bernoulli Smoother for Multi-Target Tracking. Sensors 2019, 19, 4226. [Google Scholar] [CrossRef] [PubMed]
  14. Liu, R. Research on Radar Target Tracking with Labeled Random Finite Sets. Ph.D. Thesis, National University of Defense Technology, Changsha, China, 2020. (In Chinese). [Google Scholar]
  15. Qi, L.; Wang, H.; Xiong, W.; Dong, K. Track Segment Association Algorithm Based on Multiple-Hypothesis Models with Prior Information. Syst. Eng. Electron. 2015, 37, 732–739. [Google Scholar]
  16. Zeng, X. Multi-Sensor Vessel Target Tracking and Fusion Algorithm. Master’s Thesis, Inner Mongolia University, Inner Mongolia, China, 2022. [Google Scholar]
  17. Zhou, S. Research on Target Track Segment Association Method Based Gaussian. Master’s Thesis, Hangzhou University of Electronic Science and Technology, Hangzhou, China, 2022. [Google Scholar]
  18. Liang, P.; Liu, R.; Chen, X.; Shang, Z.; Yi, T.; Lu, D. Radar Weak Target Tracking Based on LMB Smoothing. Aero Weapon 2021, 28, 80–85. [Google Scholar]
  19. Zhao, J.; Zhan, R.; Zhuang, Z.; Li, K.; Deng, B.; Peng, H. An Improved Backward Smoothing Method Based on Label Iterative Processing. Remote Sens. 2023, 15, 2438. [Google Scholar] [CrossRef]
  20. Zhao, H. A Study for Radar Multi-Target Tracking Algorithm Based on Random Finite Set. Master’s Thesis, Xi’an University of Electronic Science and Technology, Xi’an, China, 2020. [Google Scholar]
  21. Anil, K.J. Data clustering: 50 years beyond K-means. Pattern Recognit. Lett. 2010, 31, 651–666. [Google Scholar]
  22. Li, Q.-R.; Qi, B.; Liang, G.-L. Approximate Bayes Multi-Target Tracking Smoother. IET Radar Sonar Navigat. 2019, 13, 428–437. [Google Scholar] [CrossRef]
Figure 1. Algorithm flow of sequential joint state estimation and track extraction based on improved backward smoothing.
Figure 1. Algorithm flow of sequential joint state estimation and track extraction based on improved backward smoothing.
Remotesensing 15 05369 g001
Figure 2. Algorithm processing framework.
Figure 2. Algorithm processing framework.
Remotesensing 15 05369 g002
Figure 3. (a) Track start processing results under different backward smoothing step lengths; (b) processing result under different track start determination length.
Figure 3. (a) Track start processing results under different backward smoothing step lengths; (b) processing result under different track start determination length.
Remotesensing 15 05369 g003
Figure 4. Processing result under different track continuity processing length.
Figure 4. Processing result under different track continuity processing length.
Remotesensing 15 05369 g004
Figure 5. Real state value and measured value.
Figure 5. Real state value and measured value.
Remotesensing 15 05369 g005
Figure 6. Average OSPA distance error under different backward smoothing step lengths.
Figure 6. Average OSPA distance error under different backward smoothing step lengths.
Remotesensing 15 05369 g006
Figure 7. Total OSPA distance error and runtime under different backward smoothing step lengths.
Figure 7. Total OSPA distance error and runtime under different backward smoothing step lengths.
Remotesensing 15 05369 g007
Figure 8. Real value and measured value.
Figure 8. Real value and measured value.
Remotesensing 15 05369 g008
Figure 9. Multi-target simulation result of four algorithms.
Figure 9. Multi-target simulation result of four algorithms.
Remotesensing 15 05369 g009
Figure 10. Average cardinality-estimation result of four algorithms.
Figure 10. Average cardinality-estimation result of four algorithms.
Remotesensing 15 05369 g010
Figure 11. Average OSPA distance and cardinality error of four algorithms.
Figure 11. Average OSPA distance and cardinality error of four algorithms.
Remotesensing 15 05369 g011
Figure 12. Real state value and measure value of measured data.
Figure 12. Real state value and measure value of measured data.
Remotesensing 15 05369 g012
Figure 13. The processing result of four algorithms for measured data.
Figure 13. The processing result of four algorithms for measured data.
Remotesensing 15 05369 g013
Figure 14. Average OSPA distance and cardinality error of four algorithms in measured data.
Figure 14. Average OSPA distance and cardinality error of four algorithms in measured data.
Remotesensing 15 05369 g014
Table 1. Nomenclature table of all the symbols and notations.
Table 1. Nomenclature table of all the symbols and notations.
SymbolNomenclatureSymbolNomenclature
x Unlabeled state z Measurement
X Unlabeled state set Z k Measurement set
x Labeled state π Probability density function
X Labeled state set r Survival probability
Target label p Density function
L Label set ω Assumed association weight
X State space w Particle weight
L Label space P ε Probability of the survival target
L P Status-pending label set P d Detection probability
L p e r s i s t e n t Persistent label set P p Probability of the status-pending target
L m i s s e d Missed label set l b s Backward smoothing step length
  L d e a t h Vanishing label set l t s d Track start determination length
L r e v i v a l Duplicate label set l t c Track continuity processing length
Δ ( ) Indicator function of different labels d t Effective number
( ) Label mapping function n u m ( ) Total number of occurrence of labels
( ) Subset operation function O ( ) Computational cost function
r B , t Probability of the newborn target λ B Expected number of newborn targets
r B , max Preset maximum value of the newborn probability r U , t 1 ( z ) Association probability between measurement and hypothesis
θ Association hypothesis set Θ Association hypothesis space
f ( ) Multi-target transition density g ( | ) Multi-target likelihood function
u Stochastic process noise κ ( ) Density function of the clutter
N Particle number T Time interval
υ State noise σ w Process noise standard deviation
σ R Approximate variance of distance σ V Approximate variance of speed
p t Distance λ c Number of clutters
p ˙ t Radial velocity ε t Measurement noise
p ¨ t Radial acceleration Q ε Variance of the observation noise
F State transition matrix G Noise transformation matrix
R Measured distance V Measured speed
c Truncation distance e Sensitivity to outliers
Table 2. Scene setting.
Table 2. Scene setting.
TargetInitial State
(m; m/s)
Motion Description
(m/s)
T1 [ p 0 T 1 = 1000 ,   p ˙ 0 T 1 = 75 ] p ¨ 1 : 20 T 1 = 5 ; p ¨ 21 : 40 T 1 = 3 ; p ¨ 41 : 50 T 1 = 1 ;
J1 [ p 0 J 1 = 1020 ,   p ˙ 0 J 1 = 78 ] p ¨ 8 : 10 J 1 = 5
J2 [ p 0 J 2 = 990 ,   p ˙ 0 J 2 = 77 ] p ¨ 17 : 20 J 2 = 5
J3 [ p 0 J 3 = 920 ,   p ˙ 0 J 3 = 76 ] p ¨ 27 : 31 J 3 = 5
J4 [ p 0 J 4 = 930 ,   p ˙ 0 J 4 = 80 ] p ¨ 38 : 43 J 4 = 5
K = 50 z 25 : 29 T 1 = P d = 0.9
λ c = 0 σ w = 0 × [ 0.5 T 2 ;   T ;   1 ] σ R = 0   m ,   σ V = 0   m / s
Table 3. Scene setting.
Table 3. Scene setting.
TargetInitial State
(m; m/s)
Motion Description
(m/s)
T1 [ p 0 T 1 = 1000 ,   p ˙ 0 T 1 = 75 ] p ¨ 1 : 20 T 1 = 5 ; p ¨ 21 : 40 T 1 = 3 ; p ¨ 41 : 50 T 1 = 1 ;
K = 50 z 25 : 29 T 1 = P d = 0.76
λ c = 0 σ w = 1 × [ 0.5 T 2 ;   T ;   1 ] σ R = 1.875   m , σ V = 0.24   m / s
Table 4. Scene setting.
Table 4. Scene setting.
TargetInitial State
(m; m/s)
Motion Description
(m/s)
T1 [ p 0 T 1 = 1000 ,   p ˙ 0 T 1 = 75 ] p ¨ 1 : 20 T 1 = 5 ; p ¨ 21 : 40 T 1 = 3 ; p ¨ 41 : 50 T 1 = 1 ;
K = 50 z 25 : 27 T 1 = z 35 : 37 T 1 = P d = 0.9
λ c = 10 σ w = 1 × [ 0.5 T 2 ;   T ;   1 ] σ R = 1.875   m , σ V = 0.24   m / s
Table 5. Scene setting.
Table 5. Scene setting.
TargetInitial State
(m; m/s)
Motion Description
(m/s)
T1 [   p 0 T 1 = 1000 ,   p ˙ 0 T 1 = 75   ] p ¨ 1 : 20 T 1 = 5 ; p ¨ 21 : 40 T 1 = 3 ; p ¨ 41 : 50 T 1 = 1 ;
T2 [   p 0 T 2 = 1020 ,   p ˙ 0 T 2 = 70   ] p ¨ 1 : 25 T 2 = 5 ; p ¨ 26 : 50 T 2 = 3 ;
T3 [   p 0 T 3 = 980 ,   p ˙ 0 T 3 = 68   ] p ¨ 1 : 30 T 3 = 3 ; p ¨ 31 : 50 T 3 = 1 ;
J1 [ p 0 J 1 = 1000 ,   p ˙ 0 J 1 = 69.5 ] p ¨ 8 : 9 J 1 = 5
J2 [   p 0 J 2 = 990 ,   p ˙ 0 J 2 = 78   ] p ¨ 12 : 14 J 2 = 3
J3 [   p 0 J 3 = 920 ,   p ˙ 0 J 3 = 76   ] p ¨ 17 : 20 J 3 = 1
J4 [   p 0 J 4 = 930 ,   p ˙ 0 J 4 = 80.5 ] p ¨ 29 : 31 J 4 = 1
J5 [   p 0 J 5 = 940 ,   p ˙ 0 J 5 = 72   ] p ¨ 29 : 31 J 5 = 3
J6 [ p 0 J 6 = 920 ,   p ˙ 0 J 6 = 68.5 ] p ¨ 39 : 41 J 6 = 5
K = 50 z 35 : 38 T 1 = z 11 : 12 T 3 = z 21 : 24 T 3 = P d = 0.85
λ c = 5 σ w = 1 × [ 0.5 T 2 ;   T ;   1 ] σ R = 1.875   m , σ V = 0.24   m / s
l b s = 6 l t s d = 5 l t c = 6
Table 6. Total OSPA errors of four algorithms.
Table 6. Total OSPA errors of four algorithms.
SmootherOSPA DistOSPA CardOSPA Loc
OL-δ-GLMB120.582951.866768.7163
FB-LMB140.494993.333347.1616
BI-LMB96.664737.333359.3314
IBR-LMB44.93622.666742.2696
Table 7. Scene setting.
Table 7. Scene setting.
TargetT1T2
Initial State
(m; m/s)
[ p 0 T 1 = 1480.1 ,   p ˙ 0 T 1 = 29.89 ] [ p 0 T 2 = 1208.9 ,   p ˙ 0 T 2 = 71.13 ]
K = 40 λ c = 2 P d = 0.9
l b s = 3 σ w = 0.5 × [ 0.5 T 2 ;   T ;   1 ] σ R = 1.875   m , σ V = 0.24   m / s
Table 8. The total OSPA errors of four algorithms.
Table 8. The total OSPA errors of four algorithms.
SmootherOL-δ-GLMBFB-LMBBI-LMBIBR-LMB
OSPA Dist48.429347.688246.865646.2504
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhao, J.; Zhan, R.; Liu, S.; Bo, L.; Zhuang, Z.; Li, K. Sequential Joint State Estimation and Track Extraction Algorithm Based on Improved Backward Smoothing. Remote Sens. 2023, 15, 5369. https://doi.org/10.3390/rs15225369

AMA Style

Zhao J, Zhan R, Liu S, Bo L, Zhuang Z, Li K. Sequential Joint State Estimation and Track Extraction Algorithm Based on Improved Backward Smoothing. Remote Sensing. 2023; 15(22):5369. https://doi.org/10.3390/rs15225369

Chicago/Turabian Style

Zhao, Jiuchao, Ronghui Zhan, Shengqi Liu, Liankun Bo, Zhaowen Zhuang, and Kun Li. 2023. "Sequential Joint State Estimation and Track Extraction Algorithm Based on Improved Backward Smoothing" Remote Sensing 15, no. 22: 5369. https://doi.org/10.3390/rs15225369

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop