Next Article in Journal
Rate–Distortion–Perception Optimized Neural Speech Transmission System for High-Fidelity Semantic Communications
Previous Article in Journal
Advancements in Fatigue Detection: Integrating fNIRS and Non-Voluntary Attention Brain Function Experiments
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A GM-JMNS-CPHD Filter for Different-Fields-of-View Stochastic Outlier Selection for Nonlinear Motion Tracking

1
The Key Laboratory of Intelligent Rehabilitation and Barrier-Free for the Disabled, Changchun University, Ministry of Education, Changchun 130012, China
2
Jilin Provincial Key Laboratory of Human Health Status Identification & Function Enhancement, Changchun 130000, China
3
College of Computer Science and Technology, Changchun University, Changchun 130000, China
4
College of Electronic and Information Engineering, Changchun University, Changchun 130000, China
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(10), 3176; https://doi.org/10.3390/s24103176
Submission received: 22 April 2024 / Revised: 8 May 2024 / Accepted: 10 May 2024 / Published: 16 May 2024
(This article belongs to the Section Physical Sensors)

Abstract

:
Most multi-target movements are nonlinear in the process of movement. The common multi-target tracking filtering methods directly act on the multi-target tracking system of nonlinear targets, and the fusion effect is worse under the influence of different perspectives. Aiming to determine the influence of different perspectives on the fusion accuracy of multi-sensor tracking in the process of target tracking, this paper studies the multi-target tracking fusion strategy of a nonlinear system with different perspectives. A GM-JMNS-CPHD fusion technique is introduced for random outlier selection in multi-target tracking, leveraging sensors with limited views. By employing boundary segmentation from distinct perspectives, the posterior intensity function undergoes decomposition into multiple sub-intensities through SOS clustering. The distribution of target numbers within the respective regions is then characterized by the multi-Bernoulli reconstruction cardinal distribution. Simulation outcomes demonstrate the robustness and efficacy of this approach. In comparison to other algorithms, this method exhibits enhanced robustness even amidst a decreased detection probability and heightened clutter rates.

1. Introduction

Distributed fusion offers several advantages, including minimal bandwidth demands for communication links, the ability of nodes to handle data from nearby nodes, decreased system computing power requirements, and the flexibility to relocate or remove sensor nodes for simplified management. Consequently, distributed sensor networks find extensive applications across diverse research domains like military defense, smart industry, and industrial automation. Engaging in relevant technological investigations holds significant scientific importance. Multi-target tracking, employing random finite set (RFS) technology, circumvents intricate data-association procedures and has emerged as a focal point in multi-target tracking research [1,2,3,4,5]. The theory of RFS provides a unified and comprehensive theoretical framework for multi-target tracking problems in complex and variable monitoring environments and is widely applied in the distributed fusion of multiple sensors [6,7,8,9,10,11,12,13,14,15]. The Cardinalized Probability Hypothesis Density (CPHD) filter in random finite set theory is widely used due to its low computational cost and ability to avoid inconsistent label spaces [16,17,18,19,20].
In practical application scenarios, various sensor nodes in sensor networks have inconsistent and limited fields of view due to their different positions and angles, and different fields of view often correspond to different target state information. Directly using distributed fusion algorithms under different view conditions may not guarantee the good tracking performance of sensor networks. In other words, throughout the multi-sensor acquisition process, variations in perspectives among sensors may occur, including legitimate viewpoints and overlapping perspectives. There may be common information between these perspectives, which can lead to unknown correlations between multiple sensors and can affect fusion accuracy. At present, most research on distributed fusion algorithms assumes that the field of view between sensor nodes is consistent and can cover the entire monitoring area. It can be seen that the main research direction of current scholars is the impact of different perspectives on target tracking. Regarding the differences in perspective in sensors, Shen, et al. [21] introduced an innovative consensus-based labeled multi-Bernoulli (LMB) filter, which can effectively overcome the problem of label space mismatch in different sensor perspectives. Li, et al. [22,23] proposed a distributed fusion method for different sensor networks in different perspectives. The distributed fusion method proposed by Li, et al. [24] in his research is called local diffusion, which performs a neighbor communication iteration in either of two ways at each filtering step, realizing target tracking with perspective differences. Li, et al. [25] used labeled multi-Bernoulli (LMB) filters for multi-target tracking in different fields of view in his research. Yi, et al. [26] employed a series of dynamically calculated fusion weights in their research to conduct a weighted arithmetic average (WAA), enhancing robustness in the process, which is suitable for PHD filter-distributed multi-sensor fusion in different sensor fields of view. Da, et al. [27] proposed a novel GMP Jumping Markov CPHD (GMP-JMCPHD) filter implementation in his research to handle highly nonlinear/non-Gaussian models and target maneuvering. It is evident that the primary focus of current research is on optimizing fusion algorithms to address the challenges of multi-sensor and multi-target tracking from varying perspectives. However, the above methods are mainly applied to linear systems. In reality, multi-targets move nonlinearly during the motion process, and most of them move nonlinearly during the motion process, such as vehicle overspeed measurement and ship navigation. Nonlinear systems can more accurately describe the system’s motion state, while GM-PHD and GM-CPHD methods directly act on the multi-target tracking system of nonlinear targets, and the fusion effect is even worse under the influence of different perspectives.
Based on this, the focus of this study is to explore the multi-target tracking problem of distributed sensors in sensor networks with different FoVs. From the two aspects of moving-target state-space partitioning and fusion algorithms, the impact of different fields of view on nonlinear systems is verified. Suggesting a novel fusion strategy, the initial step involves decomposing the state space of fields of view (FoVs), followed by the utilization of the SOS clustering algorithm. This approach aims to enhance the performance of fusion criteria for tracking nonlinear motion targets observed from different perspectives.
The section arrangement of this article is as follows: Section 1, Introduction, introduces the research background of the article; Section 2, Research Background, introduces the impact of different fields of view on nonlinear systems and the GM-JMNS-CPHD filter and introduces the stochastic outlier selection algorithm; Section 3, Application of SOS-GM-JMNS-CPHD Algorithm to Nonlinear Systems, introduces the steps and processes of splitting, fusion, and merging; Section 4, Simulation Results, presents the application and analysis of SOS-GM-CPHD in nonlinear systems, a comparative analysis of SOS-GM-JMNS-CPHD and other algorithms, and algorithm complexity validation.

2. Research Background

2.1. Analysis of the Influence of Different Fields of View on Nonlinear Systems

Most multi-target movements are nonlinear in the process of movement. There is little existing research on non-uniform-field-of-view sensors, and there is even less research on multi-sensor tracking for non-uniform-field-of-view, nonlinear systems. In order to analyze the influence of non-uniform-field-of-view multi-sensors on nonlinear systems, the influence of different-diameter sensors in a nonlinear motion model on the multi-target tracking of nonlinear systems and the influence of different-angle sensors on the multi-target tracking of nonlinear systems is analyzed; as shown in Figure 1, the trajectory of a moving target in a nonlinear motion model and the birth time and death time of each trajectory are different.
Based on the motion trajectory of the above nonlinear motion model, sensors with different detection diameters and different detection angles are placed. Figure 2 and Figure 3 illustrate the influence of sensors with varying detection diameters and different detection perspectives on multi-target tracking in nonlinear systems. The effect of non-uniform fields of view on linear systems is comparable, as depicted in the figure. The trajectories of moving targets captured by sensors with different diameters and perspectives exhibit significant variations, thereby directly influencing the efficacy of moving-target acquisition.
As shown in Figure 4a, the FoV center angles are all 90°, and the sensor FoV is 60°. At this point, the sensors used to collect moving targets will be affected by their position and direction, resulting in differences in the acquisition perspective. Therefore, it is necessary to partition the state of nonlinear moving targets.
As shown in Figure 4b, the state-space division for nonlinear moving targets detected by multi-sensors also encounters challenges such as underestimating and overestimating the number of targets.

2.2. GM-JMNS-CPHD Filter

Regarding the CPHD (Cardinalized Probability Hypothesis Density) filter [28,29], the fusion method integrates the propagation intensity function and cardinality distribution, considering the clutter RFS (random finite set) as an Independent and Identically Distributed (IID) process. B.N. Vo, et al. [30] and R. Mahler, et al. [31,32] proposed the JM-CPHD filter in their study, which can be viewed as an extension of the state x integral in traditional CPHD filters to a double integral x ¨ = ( x , o ) of mode and state.
When a JMNS (Jumping Markov Nonlinear System) is applied to CPHD filters, the model lacks a target-generation model, and both the target-generation and clutter models must incorporate the probability distributions p ( k + 1 k ) B ( n ) and p ( k + 1 ) κ ( m ) for the number of new targets and clutter measurements, respectively. These distributions must adhere to the following requirements [33,34,35,36,37]:
m 0 n p ( k + 1 ) B ( n ) = o b ( k + 1 k ( x , o ) ) d x
m 0 m p ( k + 1 ) κ ( n ) = λ ( k + 1 )
For the probability distribution p ( n ) on a positive integer n, if n is negative, then p ( n ) = 0 . For the combination coefficient C n , i , if i > n , then C n , i = 0 . At this point, x ¨ can be used instead of x .
(1)
Prediction of JMNS-CPHD Filter
The prediction of the JMNS-CPHD filter can be expressed as follows:
D ( k + 1 k ) ( x ¨ ) = b ( k + 1 k ) ( x ¨ ) + p s ( x ¨ ) f ( k + 1 k ) ( x ¨ x ¨ ) D ( k + 1 k ) ( x ¨ ) d x ¨
Among them, b ( k + 1 k ) ( x ¨ ) is the intensity function during the appearance of the target, p s ( x ¨ ) is the probability of target survival, and f ( k + 1 k ) ( x ¨ x ¨ ) is the Jumping Markov transition density.
p ( k + 1 k ) ( n ) = n 0 p ( k + 1 k ) ( n n ) p ( k k ) ( n )
The Markov transition probability p ( k + 1 k ) ( n n ) is as follows:
p ( k + 1 k ) ( n n ) = l = j C j l p ( l ) p ( s , k ) , D j 1 p ( s , k ) , D j 1 , D l
This can be rewritten using Jumping Markov notation as follows:
D ( k + 1 k ) ( x , o ) = b ( k + 1 k ) ( x , o ) + o X ( o , o ) p s ( x , o ) f ( k + 1 k ) ( x x , o ) D ( k + 1 k ) ( x , o ) d x
(2)
Update of JMNS-CPHD filter
The update function of the PHD at time k, given the distribution of prediction cardinality p ( k + 1 k ) ( n ) and D ( k + 1 k ) ( x , o ) , can be expressed as follows:
p ( k k ) ( n ) = b k 0 D ( k + 1 k ) , Z k ( n ) p ( k + 1 k ) ( n ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k )
D ( k k ) ( x , o ) = ( 1 p ( k k ) ( x , o ) ) b k 1 D ( k + 1 k ) , Z k , p ( k + 1 k ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k ) D ( k + 1 k ) ( x , o ) + z Z k b k 1 D ( k + 1 k ) , Z k z , p ( k + 1 k ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k ) 1 , κ k g k ( z x , o ) p ( D , k ) ( x , o ) κ k ( z ) D ( k + 1 k ) ( x , o )
Among them,
b k u D , Z ( n ) = j = 0 min ( Z , n ) ( Z j ) ! p k κ ( Z j ) P j + u n × 1 p D , k , D n ( j + u ) 1 , D n e j D , φ k , z : z Z
e j ( Z ) represents an elementary symmetric function as follows:
e j ( Z ) = S Z , S = j i = S i i , e 0 ( Z ) = 1
(3)
Prediction of GM-JMNS-CPHD Filter
Da in reference [27] proposed a new Gaussian Mixture Particle (GMP) and implemented Jumping Markov CPHD filter in his research to handle highly nonlinear/non-Gaussian models and target maneuvering. The principle is that particles achieve local filtering propagation and updates, while Gaussian distribution achieves communication and fusion. Assuming independence between target-survival probability and sensor-detection probability with respect to the state, they can be segregated into two distinct phases: prediction and update. The Gaussian distribution form of b ( k + 1 k ) ( x , o ) and D ( k 1 k ) ( x , o ) for newly born goals is as follows:
b ( k + 1 k ) ( x , o ) = j = 1 J B , o b k j ( o ) N ( x ; m ( B , k ) j ( o ) , P ( B , k ) j ( o ) )
D ( k 1 k ) ( x , o ) = i = 1 J ( o , k 1 ) D ( k 1 k ) ( o ) N ( x ; m ( k 1 ) i ( o ) , P ( k 1 ) i ( o ) )
At this point, according to Formulas (31) and (32), it can be expressed as follows:
p ( k + 1 k ) ( n ) = n 0 p ( k + 1 k ) ( n n ) p ¯ ( k k ) ( n )
The Markov transition probability p ¯ ( k + 1 k ) ( n n ) is
p ¯ ( k + 1 k ) ( n n ) = l = j C j l p ( l ) Γ j p ( s , k ) , D Γ j 1 p ( s , k ) , D Γ l 1 , D
Among them,
Γ p ( s , k ) , D = o p s ( o ) i = 1 J o , k 1 D ( k 1 k ) i ( o )
This can be rewritten using Jumping Markov notation as follows:
D ( k + 1 k ) ( x , o ) = b ( k + 1 k ) ( x , o ) + o i = 1 J ( o , k 1 ) X o , o p s ( x , o ) D ( k 1 ) i ( x , o ) N ( x ; j = 1 M x + i , j M , j = 1 M m ( S , + ) i ( o ) x + i , j m ( S , + ) i ( o ) x + i , j T M )
At this time,
x + i , j f + ( x x ( k 1 ) i , j , o )
x ( k 1 ) i , j N ( x ; m ( k 1 ) i ( o ) , p ( k 1 ) i ( o ) )
(4)
Update of GM-JMNS-CPHD filter
The update of the GM-JMNS-CPHD filter can be expressed as follows:
Given the distribution of prediction cardinality p ( k + 1 k ) ( n ) and D ( k + 1 k ) ( x , o ) , the update function of PHD at time k can be expressed as follows:
p ( k k ) ( n ) = b k 0 D ( k + 1 k ) , Z k ( n ) p ( k + 1 k ) ( n ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k )
D ( k k ) ( x , o ) = ( 1 p ( k k ) ( x , o ) ) b k 1 D ( k + 1 k ) , Z k , p ( k + 1 k ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k ) D ( k + 1 k ) ( x , o ) + z Z k i = 1 J 0 , + A k i ( z , o ) B z ( o ) C z i ( x , o )
A k i ( z , o ) = 1 M j = 1 M g k ( z x k ( i , j ) , o ) N ( x k ( i , j ) ; m + i ( o ) , P + i ( o ) ) π k i ( x k ( i , j ) Z 1 : k 1 , z , o )
B z ( o ) = p ( k k ) ( x , o ) 1 , κ k b k 1 D ( k + 1 k ) , Z k , p ( k + 1 k ) κ k ( z ) b k 0 D ( k + 1 k ) , Z k , p ( k + 1 k )
C z i ( x , o ) = D ( k + 1 k ) i ( o ) N ( x ; m k i ( z , o ) , P k i ( z , o )
P K i ( z , o ) = j = 1 M g k ( z x k ( i , j ) , o ) N ( x k ( i , j ) ; m + i ( o ) , P + i ( o ) ) π k i ( x k i , j Z 1 : k 1 , z , o ) [ m k i ( z , o ) x k ( i , j ) ] [ m k i ( z , o ) x k ( i , j ) ] T j = 1 M g k ( z x k ( i , j ) , o ) N ( x k ( i , j ) ; m + i ( o ) , P + i ( o ) ) π k i ( x k ( i , j ) Z 1 : k 1 , z , o )
At this time, x k i , j π k i ( · Z 1 : k 1 , z , o ) .

2.3. Stochastic Outlier Selection

In the application field of data clustering and dimensionality reduction, data affinity is often used as a research tool. The essence of the SOS algorithm is to apply the concept of affinity to outlier selection to realize clustering [38,39,40].
The difference between the SOS algorithm and other methods is that this method is an unsupervised and unbounded outlier selection problem, which directly divides the data into “outlier” or “internal” values to realize the selection of outlier data [41,42,43]. The schematic diagram of the SOS algorithm is shown in Figure 5.
Illustrated in Figure 4, the process begins with inputting the matrix X containing the eigenvalues of data points. Initially, the dissimilarity matrix A is computed, representing the Euclidean distance between each feature point. Then, the affinity matrix B is independently calculated and combined with the probability matrix C to establish the joint distribution of various sequence row numbers. This amalgamation enables the estimation of the probability that a data point belongs to the outlier category. Subsequently, this probability serves as the outlier score within the SOS algorithm.

3. Application of SOS-GM-JMNS-CPHD Algorithm to Nonlinear Systems

Suppose the local strength of the sensor section is expressed as follows:
D ^ ( x ) i = i = 1 J i α p i N ( x ; m p i , P p i )
Among them, i represents the number of sensors, and α p i ( 0 , 1 ) and N ( x ; m , P ) represent Gaussian probability density functions (PDFs) with mean m and covariance p.
From the perspective of difference, different GCs may belong to different clusters C g , g 1 , 2 , , G , which can be divided into two clusters, i and j. When in a cluster,
D ¯ g i , j ( x , o ) = D ^ g i , j ( x , o )
The target number can be estimated according to the map standard. At this time, the cardinality distribution represented by g clusters is as follows:
p ¯ g i , j ( n ) = p ^ g i , j ( n ) = p = 1 M i , j ( 1 α ( g , p ) i , j ) σ M i , j , n ( α ( g , 1 ) i , j 1 α ( g , 1 ) i , j , , α ( g , M i , j ) i , j 1 α ( g , M i , j ) i , j )
The three steps of splitting, fusion, and merging are discussed below.

3.1. Splitting

3.1.1. Boundary Segmentation from Different Perspectives

Figure 6 shows the view scene division in two cases of sensor difference views and three cases of sensor difference views.
As shown in Figure 5, the SOS-GM-JMNS-CPHD algorithm can divide the GCS near the boundary in the difference perspective, avoiding the problems of missing detection and the repeated calculation of GCs.
Among them,
D g i ( x , o ) = 1 F L J ( x ) D g i ( , o ) = j = 1 : N D g j ( x , o ) = j = 1 : N 1 X L J ( x ) D g i ( x , o )
At this time, the number of targets and the density of spatial targets segmented according to the perspective are as follows:
M g ( i , j ) ( x ) = o x j D g i ( x ) d x
s g ( i , j ) ( x ) = D g i ( x ) M g ( i , j ) ( x )

3.1.2. SOS Clustering of GCs

G p i , G q j are GCs with different motion trajectories. According to the above SOS calculation process, it is determined that φ S O S ( G ( p , q ) ( i , j ) ) < β is divided into the same category. At this time, GCs are in the same cluster, and the node strength is as follows:
D ^ g ( i , j ) ( x ) = g = 1 G D ^ g ( i , j ) ( x )
M g ( i , j ) indicates the number of GCs. Once M g ( i , j ) > 0 , it needs to be classified. The corresponding sub strengths are as follows:
D ^ g ( i , j ) ( x ) = p = 1 M g ( i , j ) α ( g , p ) i N ( x ; m ( g , p ) i , P ( g , p ) i )
Under the joint action of the classification method and the SOS clustering algorithm, boundary segmentation is performed to generate the number of targets M g ( i , j ) ( x ) as follows:
M g ( i , j ) ( x ) = o x j D ^ g i ( x ) d x
The corresponding spatial target density and sub intensity can be expressed as follows:
s g ( i , j ) ( x ) = D ^ g i ( x ) M g ( i , j ) ( x )
D ^ g ( i , j ) ( x , o ) = p : ( i , p ) c g D ^ g ( i , j ) ( x , o ) = p : ( i , p ) c g α g , p i G ( x , m ( g , p ) i , P ( g , p ) i )
Under the joint action of F j and C , C , the following is generated:
( C g g = 1 G ) F s T ( F s T = M = 1 : N F L M )
C = ( C g g = 1 G )
The above target RFS corresponding to C is approximately Bernoulli, with a probability distribution of G p i ( x ) and a probability of existence of α p i [ 0 , 1 ] . The cardinality distribution formula for sensor i in F j is as follows:
p g ( i , j ) ( n ) = p ^ g ( i , j ) ( n ) = p = 1 M i , j ( 1 α ( g , p ) ( i , j ) ) σ M ( i , j ) , n ( α ( g , 1 ) ( i , j ) 1 α ( g , 1 ) ( i , j ) , , α ( g , M i , j ) ( i , j ) 1 α ( g , M i , j ) ( i , j ) )
At this point, σ ( M ( i , j ) , n ) ( ) is an N-th-order elementary symmetric function of M ( i , j ) , n .
According to the multi-Bernoulli MPD property, the cardinal number distribution of different regions is calculated as follows [44,45]:
n = 0 n p i j ( n ) = m = 1 M ( i , j ) α p i = M g ( i , j )
n 1 + n 2 + n N = n [ p i 1 ( n 1 ) p i N ( n N ) ] = p i ( n )

3.2. Fusion

The GA fusion strategy is used to fuse N sensor networks.
s g ( i . l + 1 ) ( X ) = j N i [ s g ( i . l + 1 ) ( X ) ] ω ( i , j ) j N i [ s g ( i . l + 1 ) ( X ) ] ω ( i , j ) d X
p g ( i , l + 1 ) ( n ) = j N i [ p g ( i , l ) ( n ) ] ω ( i , j ) ( j N i [ s g ( j , l ) ( X ) ] ω ( i , j ) d X ) n m = 0 j N i [ p g ( j , l ) ( m ) ] ω ( i , j ) ( j N i [ s g ( j , l ) ( X ) ] ω ( i , j ) d X ) m
For each area, the cardinal distribution given by different sensors p i j ( n ) D i j ( x , o ) is calculated, and the application of GA fusion strategy in CPHD is as follows:
D G A ( x , o ) = s G A ( x , o ) n = 0 n p G A ( n )
Among them,
s G A ( x , o ) = m = 0 i N j [ s i ( x , o ) ] ω i o X i N j [ s i ( x , o ) ] ω i d x
p G A ( n ) = i N j [ p i ( n ) ] ω i [ o X i N j [ s i ( x , o ) ] ω i d x ] n m = 0 i N j [ p i ( m ) ] ω i [ o X i N j [ s i ( x , o ) ] ω i d x ] m

3.3. Merging

The fusion algorithm process of SOS-GM-JMNS-CPHD in multi-sensor and multi-perspective situations is shown in Algorithm 1.
Algorithm 1: SOS-GM-JMNS-CPHD fusion algorithm for multi-sensor and multi-perspective situations.
  Input:  G 1 , k p p = 1 M g i , G 2 , k p p = 1 M g j , β , C 1 = ( 1 ,   p ) p = 1 M g i , C 2 = ( 1 ,   p ) p = 1 M g i , p i j ( n ) , F i
Implementing filtering using GM-JMNS-CPHD
for i N  do
for j = 1 : N  do
  for  M g i , j , k = 1 : g  do
    Locate   the   particles   situated   within   the   region   of   F j .
   for ( i , p ) C   and   ( i , p ) ( i , p )  do
     Calculate   C = C g g = 1 G by Algorithm 1
     Calculate ,   ( C g g = 1 G ) F s T ( F s T = M = 1 : N F L M ) N k , g = i : M g i , j > 0 N k , g C = ( C g g = 1 G )
    end for
  end for
   Calculate   D ^ g i , j ( x )   by   ( 35 ) ,   Calculate   p g i , j ( n ) by (38)
end for
end for
   Calculate   GA   fusion   strategy   by   43 45
   Calculate   cardinality   distribution   p ¯ i j ( n )   and   fusion   target   state   density   D ¯ g i , j ( x )
  after merging by 46–47
   Output:   p ¯ i j ( n ) ,   D ¯ g i , j ( x )
To obtain the multi-target probability density distribution of GCs across various sensors and diverse perspectives, it is crucial to integrate the multi-target probability density distributions from the segmented regions discussed earlier. This involves consolidating all combined sub-IID cluster processes into a unified IID cluster process. This consolidation is accomplished by aggregating all sub-strength functions and convolving the corresponding cardinality distributions; the merged cardinality distributions p ¯ i j ( n ) and GM-JMNS-CPHD D ¯ g i , j ( x ) are as follows:
D ¯ g i , j ( x ) = g = 1 G D ¯ g i , j ( x )
p ¯ i j ( n ) = ( p ¯ 1 p ¯ 2 p ¯ G ) ( n ) = n 1 + n 2 + + n G = n p ¯ 1 ( n 1 ) p ¯ 2 ( n 2 ) p ¯ G ( n G )

4. Simulation Results

Using the CV model for simulation verification, the following is obtained:
F k = I 2 Δ I 2 O 2 I 2
Q K = σ v 2 Δ 4 4 I 2 Δ 3 2 I 2 Δ 3 2 I 2 Δ 2 I 2
H k = [ I 2 O 2 ] ,   R k = σ ε 2 I 2
This section will employ a GM-JMNS-CPHD filter to evaluate the tracking performance of the SOS-GM-JMNS-CPHD algorithm proposed in the study and to validate its effectiveness. A nonlinear CT model will be used. The CT model assumes that the target undergoes a uniform turning motion in a two-dimensional plane, C T ( x ) = ( x k   y k   v x , k   v y , k ) It can be described as the following matrix form:
The target status is as follows:
X ( k + 1 ) = F ( k ) X ( k ) + Γ ( k ) w ( k )
Among them,
F = 1 0 sin ω T ω ( 1 cos ω T ω ) 0 1 1 cos ω T ω sin ω T ω 0 0 cos ω T sin ω T 0 0 sin ω T cos ω T , Γ ( k ) = 0.5 T 2 0 T 0 0 0.5 T 2 0 T , w ( k ) = w x w y

4.1. Application of SOS-GM-CPHD in Nonlinear System Result Analysis

To assess the algorithm’s performance, it was evaluated across various scenarios through simulation and comparative analysis. This study employed a GA fusion strategy to evaluate the tracking performance of the SOS-GM-JMNS-CPHD algorithm. Specifically, the algorithm was tested using 15 motion trajectories across two sensors to analyze the detection probabilities of different objects p D , along with the Poisson average velocity value λ c of uniform clutter, across different scenarios. The goal was to evaluate their respective impacts on the algorithm’s performance. λ c = 5 ,   10 ,   20 ,   30 and p D = 0 . 50 ,   0 . 65 ,   0 . 85 ,   0 . 95 were set, and 120 Monte Carlo runs were performed. The application of SOS-GM-JMNS-CPHD in the multi-target tracking of linear systems is shown in Figure 7.
Similarly, in order to test the application of the algorithm to tracking moving targets in nonlinear systems, we assess the impact of the SOS-GM-JMNS-CPHD algorithm’s performance across 20 motion tracks involving 16 sensors at λ c = 10 and p D = 0 . 50 ,   0 . 65 ,   0 . 85 ,   0 . 95 . The results are shown in Figure 8 and Figure 9. It can be seen from the figures that the algorithm has a certain degree of robustness.

4.2. Comparative Analysis of SOS-GM-JMNS-CPHD and Other Algorithms

To evaluate the performance of this algorithm against others, this study implements and compares the filtering performance across several scenarios. The effectiveness of SOS-GM-JMNS-CPHD and GM-JMNS-CPHD and EKF-GM-CPHD and UKF-GM-CPHD is compared in references. We set up 15 motion trajectories for p D = 0 . 95 , λ c = 10 , and two sensors for research and analysis. Different algorithms’ OSPA (Optimal Sub-Pattern Assignment) metrics over time and different algorithms’ cardinality estimates over time are shown in Figure 10. The comparison results between SOS-GM-JMNS-CPHD and different algorithms show that the SOS-GM-JMNS-CPHD algorithm proposed in this study is significantly better than other algorithms due to its effectiveness. The research results are similar to GMP-JMCPHD and are more effective compared to other methods.

4.3. Algorithm Complexity

In general, the computation of the cardinal distribution is model-independent [46,47], as the calculation demand remains unaffected by the increase in the number of targets in the scenario. However, the computational complexity of the CPHD and SOS-GM-JMNS-CPHD algorithms is a factor to consider. The CPHD algorithm can be seen as evaluating an elementary pair production function m + 1 times, with a complexity of O ( m 3 ) O Z 3 n max ) , where m is the number of evaluations and n max is the maximum number of targets. When n max > m , CPHD can be considered as ( m 3 + n max m 2 m 2 2 ) O ( n max m 2 ) . As mentioned earlier, the computational complexity of JMNS-CPHD increases linearly with the number of patterns, from O ( Z 3 n max ) to O ( Z 3 n max O ) , where n max is the maximum number of targets.
SOS-GM-JMNS-CPHD does not have any impact on the cardinality distribution of CPHD during use, but rather changes the maximum number of targets.
n max n ¯ max through clustering algorithms. Although clustering algorithms may increase algorithm difficulty, they also have an impact on the maximum number of targets. The complexity of the SOS-GM-JMNS-CPHD algorithm can be considered as O ( Z 3 n max O + O ) O ( Z 3 n max O ) , and the complexity of the algorithm will not occur linearly with the increase in the number of targets. Compared with CPHD, GM-JMNS-CPHD, and SOS-GM-JMNS-CPHD, the complexity of the three algorithms is O C P H D < O G M J M N S C P H D = O S O S G M J M N S C P H D .

5. Conclusions

This paper presents a novel approach for random anomaly selection in distributed multi-sensor fusion, tailored for nonlinear systems with varying view angles. The method combines the SOS clustering algorithm with the GM-JMNS-CPHD filtering technique. By delineating boundaries based on different perspectives, the approach divides them into disjoint segmentation regions. SOS is then employed to identify outliers, ensuring that the split cardinal distribution accurately reflects the target distribution in each corresponding region, while preserving the original cardinal distribution. The implementation of a distributed multi-sensor fusion method for nonlinear systems with diverse perspectives is realized. This method addresses issues such as repeated detection and local density loss due to fields of view (FOVs) in distributed fusion setups, which often lead to the overestimation or underestimation of target numbers. Consequently, it enhances the accuracy of local density acquisition within FOVs. The robustness and effectiveness of this approach are confirmed through simulation results, showcasing its superiority over alternative methods. Additionally, an analysis of algorithm complexity reveals that it does not increase linearly with the number of targets.
This paper proposes a distributed fusion random outlier selection method for sensor networks with different fields of view. The research and practice in this field is only a guide. There are many directions worthy of in-depth research in the future, such as technological breakthroughs in complex scenes; in the actual distributed fusion technology of sensor networks, there are many complex scenes, such as the sensor node acquisition clock not being synchronized, the sensor position being unknown, or the angle of view being unknown, and there are time and angle differences, as well as heterogeneous sensor configuration, and the sensor network itself is subject to strong interference and instability, and so on. In the follow-up study, we can break through the above practical and challenging technical problems one by one.

Author Contributions

Conceptualization, L.W.; methodology, L.W.; validation, J.Z. (Jian Zhao); data curation, L.S.; writing—original draft preparation, J.Z. (Jing Zhang); writing—review and editing, L.S.; visualization, Y.L.; project administration, J.Z. (Jian Zhao); funding acquisition, J.Z. (Jian Zhao). All authors have read and agreed to the published version of the manuscript.

Funding

This work was partially supported by the Jilin Provincial Department of Science and Technology (No. YDZJ202301ZYTS496, YDZJ202303CGZH010, 20210101477JC, 20200601004JC).

Institutional Review Board Statement

Studies not involving humans or animals.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are contained within the article.

Acknowledgments

The authors would like to thank all of the authors cited and the anonymous reviewers in this article for their helpful suggestions.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Marsh, B.; Sadka, A.H.; Bahai, H. A Critical Review of Deep Learning-Based Multi-Sensor Fusion Techniques. Sensors 2022, 22, 9364. [Google Scholar] [CrossRef]
  2. McAfee, M.; Kariminejad, M.; Weinert, A.; Huq, S.; Stigter, J.D.; Tormey, D. State Estimators in Soft Sensing and Sensor Fusion for Sustainable Manufacturing. Sustainability 2022, 14, 3635. [Google Scholar] [CrossRef]
  3. Jin, X.-B.; Yu, X.-H.; Su, T.-L.; Yang, D.-N.; Bai, Y.-T.; Kong, J.-L.; Wang, L. Distributed Deep Fusion Predictor for a Multi-Sensor System Based on Causality Entropy. Entropy 2021, 23, 219. [Google Scholar] [CrossRef]
  4. Fantacci, C.; Vo, B.N.; Vo, B.T. Robust Fusion for Multisensor Multiobject Tracking. IEEE Signal Process. Lett. 2018, 25, 640–644. [Google Scholar] [CrossRef]
  5. Wang, P.; Ji, H.; Liu, L. Consistent fusion method with uncertainty elimination for distributed multi-sensor systems. Inf. Sci. Int. J. 2022, 595, 378–394. [Google Scholar] [CrossRef]
  6. Sönmez, H.H.; Hocaoğlu, A.K. Hölder Divergence-Based Reward Function for Poisson RFSs and Application to Multitarget Sensor Management. IEEE Sens. J. 2023, 23, 9999–10008. [Google Scholar] [CrossRef]
  7. Bao, Z.; Jiang, Q.; Liu, F. A PHD-Based Particle Filter for Detecting and Tracking Multiple Weak Targets. IEEE Access 2019, 7, 145843–145850. [Google Scholar] [CrossRef]
  8. Wang, Y.F.; Li, Y.; Wang, J.Q. An optical flow estimation method based on multiscale anisotropic convolution. Appl. Intell. 2024, 54, 398–413. [Google Scholar] [CrossRef]
  9. Do, C.T.; Nguyen, T.T.D.; Van Nguyen, H. Robust multi-sensor generalized labeled multi-Bernoulli filter. Signal Process. 2022, 192, 108368. [Google Scholar] [CrossRef]
  10. Yu, B.; Li, T.; Ge S, Gu, H. Robust CPHD Fusion for Distributed Multitarget Tracking Using Asynchronous Sensors. IEEE Sens. J. 2022, 22, 1030–1040. [Google Scholar] [CrossRef]
  11. Zhou, Y.; Yan, L.; Li, H.; Xia, Y. Asynchronous Nonuniform Distributed Multitarget Tracking Filter Based on Asymmetric Alpha-Divergence Consensus. IEEE Trans. Aerosp. Electron. Syst. 2023, 59, 1854–1866. [Google Scholar] [CrossRef]
  12. Do, C.T.; Nguyen, T.; Moratuwage, D. Multi-object tracking with an adaptive generalize d lab ele d multi-Bernoulli filter. Signal Process. Off. Publ. Eur. Assoc. Signal Process. (EURASIP) 2022, 196, 108532. [Google Scholar] [CrossRef]
  13. García-Fernández Á, F.; Xia Y, Svensson, L. Poisson multi-Bernoulli mixture filter with general target-generated measurements and arbitrary clutter. IEEE Trans. Signal Process. 2023, 71, 1895–1906. [Google Scholar] [CrossRef]
  14. Xie, X.; Wang, Y.; Guo, J.; Zhou, R. The Multiple Model Poisson Multi-Bernoulli Mixture Filter for Extended Target Tracking. IEEE Sens. J. 2023, 23, 14304–14314. [Google Scholar] [CrossRef]
  15. Li, G.; Battistelli, G.; Chisci, L.; Gao, L.; Wei, P. Distributed Joint Detection, Tracking, and Classification via Labeled Multi-Bernoulli Filtering. IEEE Trans. Cybern. 2022, 54, 1429–1441. [Google Scholar] [CrossRef]
  16. Khalilipour, M.; Masnadi-Shirazi, A.; Abutalebi, H.R. Joint DOA tracking and spectral signature estimation of wideband sources using a multi-spectral TBD-CPHD filter. Signal Process. Off. Publ. Eur. Assoc. Signal Process. (EURASIP) 2023, 205, 108885. [Google Scholar] [CrossRef]
  17. Li, Y.; Wang, B. Multi-Extended Target Tracking Algorithm Based on VBEM-CPHD. Int. J. Pattern Recognit. Artif. Intell. 2022, 36, 22500264. [Google Scholar] [CrossRef]
  18. Wang, L.; Chen, G. An Efficient Implementation Method for Distributed Fusion in Sensor Networks Based on CPHD Filters. Sensors 2024, 24, 117. [Google Scholar] [CrossRef]
  19. Wang, Y.F.; Wang, W.; Li, Y. An attention mechanism module with spatial perception and channel information interaction. In Complex & Intelligent Systems; Springer: Berlin/Heidelberg, Germany, 2024. [Google Scholar]
  20. Wang, L.; Chen, G.; Chen, G. Gaussian Mixture Cardinalized Probability Hypothesis Density (GM-CPHD): A Distributed Filter Based on the Intersection of Parallel Inverse Covariances. Sensors 2023, 23, 2921. [Google Scholar] [CrossRef]
  21. Shen, K.; Dong, P.; Jing, Z.; Leung, H. Consensus-Based Labeled Multi-Bernoulli Filter for Multitarget Tracking in Distributed Sensor Network. IEEE Trans. Cybern. 2022, 52, 12722–12733. [Google Scholar] [CrossRef]
  22. Li, G.; Battistelli, G.; Chisci, L. Distributed multi-view multi-target tracking based on CPHD filtering. Signal Process. 2021, 188, 108210. [Google Scholar] [CrossRef]
  23. Li, G.; Battistelli, G.; Yi, W.; Kong, L. Distributed multi-sensor multi-view fusion based on generalized covariance intersection. Signal Process. 2020, 166, 107246. [Google Scholar] [CrossRef]
  24. Li, T.; Elvira, V.; Fan, H.; Corchado, J.M. Local-Diffusion-Based Distributed SMC-PHD Filtering Using Sensors with Limited Sensing Range. IEEE Sens. J. 2019, 19, 1580–1589. [Google Scholar] [CrossRef]
  25. Li, S.; Battistelli, G.; Chisci, L. Multi-Sensor Multi-Object Tracking with Different Fields-of-View Using the LMB Filter. In Proceedings of the 2018 21st International Conference on Information Fusion (FUSION), Cambridge, UK, 10–13 July 2018; pp. 1201–1208. [Google Scholar] [CrossRef]
  26. Yi, W.; Li, G.; Battistelli, G. Distributed Multi-Sensor Fusion of PHD Filters With Different Sensor Fields of View. IEEE Trans. Signal Process. A Publ. IEEE Signal Process. Soc. 2020, 68, 5204–5218. [Google Scholar] [CrossRef]
  27. Da, K.; Li, T.; Zhu, Y. Gaussian Mixture Particle Jump-Markov-CPHD Fusion for Multitarget Tracking using Sensors with Limited Views. IEEE Trans. Signal Inf. Process. Over Netw. 2020, 6, 605–616. [Google Scholar] [CrossRef]
  28. Vo, B.T.; Vo, B.N.; Cantoni, A. Analytic Implementations of the Cardinalized Probability Hypothesis Density Filter. IEEE Trans. Signal Process. 2007, 55, 3553–3567. [Google Scholar] [CrossRef]
  29. Vo, B.N.; Drovandi, C.C.; Pettitt, A.N. Quantifying uncertainty in parameter estimates for stochastic models of collective cell spreading using approximate Bayesian computation. Math. Biosci. 2015, 263, 133–142. [Google Scholar] [CrossRef] [PubMed]
  30. Vo, B.N.; Pasha, A.; Tuan, H.D. A Gaussian Mixture PHD Filter for Nonlinear Jump Markov Models. In Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, USA, 13–15 December 2006; pp. 3162–3167. [Google Scholar] [CrossRef]
  31. Mahler, R. On multitarget jump-Markov filters. In Proceedings of the 2012 15th International Conference on Information Fusion, Singapore, 9–12 July 2012; pp. 149–156. [Google Scholar]
  32. Mahler, R. PHD filters of higher order in target number. IEEE Trans. Aerosp. Electron. Syst. 2007, 43, 1523–1543. [Google Scholar] [CrossRef]
  33. Pasha, S.A.; Tuan, H.D.; Apkarian, P. The LFT based PHD filter for nonlinear jump Markov models in multi-target tracking. In Proceedings of the 48h IEEE Conference on Decision and Control (CDC) Held Jointly with 2009 28th Chinese Control Conference, Shanghai, China, 15–18 December 2009; pp. 5478–5483. [Google Scholar] [CrossRef]
  34. Li, W.; Jia, Y. Gaussian mixture PHD filter for jump Markov models based on best-fitting Gaussian approximation. Signal Process. Off. Publ. Eur. Assoc. Signal Process. (EURASIP) 2011, 4, 91–105. [Google Scholar] [CrossRef]
  35. Sun, Y.C.; Kim, D.; Hwang, I. Multiple-model Gaussian mixture probability hypothesis density filter based on jump Markov system with state-dependent probabilities. IET Radar Sonar Navig. 2022, 16, 1881–1894. [Google Scholar] [CrossRef]
  36. Lu, L.; Xia, M.; Qi, W. Adaptive event-triggered resilient stabilization for nonlinear semi-Markov jump systems subject to DoS attacks. Int. J. Robust Nonlinear Control. 2023, 33, 1914–1929. [Google Scholar] [CrossRef]
  37. Cheng, P.; He, S.; Dong, H.; Chen, W.; Zhang, W. Extended state observer-based finite-region control for 2-D Markov jump systems. Int. J. Robust Nonlinear Control 2023, 33, 1010–1026. [Google Scholar] [CrossRef]
  38. Janssens, J.; Postma, E. Stochastic Outlier Selection. Available online: http://www.uvt.nl/ticc (accessed on 3 February 2012).
  39. Wang, L.; Chen, G.; Zhang, L.; Wang, T. Stochastic Outlier Selection via GM-CPHD Fusion for Multitarget Tracking Using Sensors with Different Fields of View. IEEE Sens. J. 2024, 24, 9148–9161. [Google Scholar] [CrossRef]
  40. Wang, Y.; Li, Y.; Wang, J.; Lv, H.; Guo, J. Sparse Optical Flow Outliers Elimination Method Based on Borda Stochastic Neighborhood Graph. Mach. Learn. Sci. Technol. 2024, 5, 015022. [Google Scholar] [CrossRef]
  41. Jabbar, A.M. Local and Global Outlier Detection Algorithms in Unsupervised Approach: A Review. Iraqi J. Electr. Electron. Eng. 2021, 17, 76–87. [Google Scholar] [CrossRef]
  42. Fernández, N.; Bella, J.; Dorronsoro, J.R. Supervised outlier detection for classification and regression. Neurocomputing 2022, 486, 77–92. [Google Scholar] [CrossRef]
  43. Zhang, H.; An, T.; Yan, P.; Hu, K.; An, J.; Shi, L.; Zhao, J.; Wang, J. Exploring cooperative evolution with tunable payoff’s loners using reinforcement learning. Chaos. Solitons Fractals 2024, 178, 114358. [Google Scholar] [CrossRef]
  44. Luttrell, S.P. Cluster decomposition of probability density functions. Neural Netw. 1988, 1, 109. [Google Scholar] [CrossRef]
  45. Chaayra, T.; Ben-Azza, H.; Bouanani, F.E. A Closed-Form Approximation to the Distribution for the Sum of Independent Non-identically Generalized Gamma Variates and Applications. Math. Model. 2021, 8, 33–44. [Google Scholar] [CrossRef]
  46. Li, S.Q.; Yi, W.; Hoseinnezhad, R.; Battistelli, G.; Wang, B.L.; Kong, L.J. Robust distributed fusion with labeled random finite sets. IEEE Trans. Signal Process. 2018, 66, 278–293. [Google Scholar] [CrossRef]
  47. Melo FE, D.; Maskell, S. A CPHD Approximation Based on a Discrete-Gamma Cardinality Model. IEEE Trans. Signal Process. 2019, 67, 336–350. [Google Scholar] [CrossRef]
Figure 1. Generation time of moving object in nonlinear motion model.
Figure 1. Generation time of moving object in nonlinear motion model.
Sensors 24 03176 g001
Figure 2. Influence of sensors with different detection diameters on multi-target tracking in nonlinear systems.
Figure 2. Influence of sensors with different detection diameters on multi-target tracking in nonlinear systems.
Sensors 24 03176 g002
Figure 3. Influence of sensors with different detection angles on multi-target tracking in nonlinear systems.
Figure 3. Influence of sensors with different detection angles on multi-target tracking in nonlinear systems.
Sensors 24 03176 g003
Figure 4. Results of partitioning the state space for multi-view multi-sensor detection of nonlinear moving targets.
Figure 4. Results of partitioning the state space for multi-view multi-sensor detection of nonlinear moving targets.
Sensors 24 03176 g004
Figure 5. Schematic diagram of SOS algorithm.
Figure 5. Schematic diagram of SOS algorithm.
Sensors 24 03176 g005
Figure 6. Different perspective scene division with different numbers of sensors. (a) Two sensor differential perspectives; (b) three sensor differential perspectives.
Figure 6. Different perspective scene division with different numbers of sensors. (a) Two sensor differential perspectives; (b) three sensor differential perspectives.
Sensors 24 03176 g006
Figure 7. Application of SOS−GM−JMNS−CPHD in multi−target tracking of nonlinear systems.
Figure 7. Application of SOS−GM−JMNS−CPHD in multi−target tracking of nonlinear systems.
Sensors 24 03176 g007
Figure 8. Comparison results of different SOS-GM-JMNS-CPHD λ c .
Figure 8. Comparison results of different SOS-GM-JMNS-CPHD λ c .
Sensors 24 03176 g008
Figure 9. Comparison results of different SOS-GM-JMNS-CPHD p D .
Figure 9. Comparison results of different SOS-GM-JMNS-CPHD p D .
Sensors 24 03176 g009
Figure 10. Comparison results of SOS-GM-JMNS-CPHD and different algorithms. (a) Different algorithms’ OSPA metrics over time. (b) Different algorithms’ cardinality estimates over time.
Figure 10. Comparison results of SOS-GM-JMNS-CPHD and different algorithms. (a) Different algorithms’ OSPA metrics over time. (b) Different algorithms’ cardinality estimates over time.
Sensors 24 03176 g010
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, L.; Zhao, J.; Shi, L.; Liu, Y.; Zhang, J. A GM-JMNS-CPHD Filter for Different-Fields-of-View Stochastic Outlier Selection for Nonlinear Motion Tracking. Sensors 2024, 24, 3176. https://doi.org/10.3390/s24103176

AMA Style

Wang L, Zhao J, Shi L, Liu Y, Zhang J. A GM-JMNS-CPHD Filter for Different-Fields-of-View Stochastic Outlier Selection for Nonlinear Motion Tracking. Sensors. 2024; 24(10):3176. https://doi.org/10.3390/s24103176

Chicago/Turabian Style

Wang, Liu, Jian Zhao, Lijuan Shi, Yuan Liu, and Jing Zhang. 2024. "A GM-JMNS-CPHD Filter for Different-Fields-of-View Stochastic Outlier Selection for Nonlinear Motion Tracking" Sensors 24, no. 10: 3176. https://doi.org/10.3390/s24103176

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop