1. Introduction
Group targets [
1] can be considered as the formation of cooperative members whose locations obey special structures, such as unmanned aerial vehicle (UAV) formations, vehicle convoys, and flocks of birds, which are densely distributed and maintain certain patterns of movement. For tracking such targets, if a standard point target tracking method e.g., [
2] was adopted, performance degradation would occur. On the one hand, the high density of measurement may lead to complex computations by standard tracking methods. On the other hand, the interaction between the members within the group is ignored, which is not conducive for improving the tracking accuracy and stability. In general, there are mainly two methods for tracking group targets: The “holistic” tracking method based on the group shape and centroid [
3,
4,
5,
6], and the “internal” tracking method based on group structures [
7,
8,
9].
It is difficult to establish a stable trajectory for densely clustered targets with poor measurement resolution and severe echo crossing. A “holistic” tracking strategy [
3] has been proposed to handle such targets, which focuses on the group shape and centroid state instead of focusing on targets within the group. Similar to the extended target tracking method [
10,
11,
12,
13,
14], this strategy models the group shape, such as the elliptical model [
15], the random hypersurface model (RHM) [
16], and the star-convex model [
17].
Tracking members within the group is of great significance in certain cases. For instance, by estimating the members’ states, one can distinguish friendly objects from enemies or predict the intention of the groups. In a high-resolution sensor system, the measurements of different members within the group are located in different resolution units and maintain a special distribution structure. Modelling the group structure is the basis for tracking internal members. By combining the group structure with the member’s state, the integrity and stability of target tracking can be improved. Several models of group structures have been proposed and widely used, such as the virtual leader-follower model [
7], the Markov random field (MRF) model [
8], and the evolving network model [
9].
The filter based on random finite set (RFS) [
18] avoids the complicated data association process and introduces a complete theoretical framework for target tracking. In the single-sensor field, the probability hypothesis density (PHD) [
19], multi-target multi-Bernoulli (MeMBer) [
20], generalized labelled multi-Bernoulli (GLMB) filters [
21], and their variants [
22,
23,
24] for group target tracking have been proposed. Moreover, the multi-sensor PHD (MS-PHD) [
25], multi-sensor MeMBer (MS-MeMBer) [
26], and multi-sensor GLMB (MS-GLMB) filters [
27] have shown promising performance in handling multi-sensor measurements. Besides, several particle filters [
28,
29,
30] have been proposed to improve the accuracy of the target state estimation. However, very few “internal” tracking methods have been considered in the literature for multi-sensor RFS filtering.
The MS-MeMBer filter inherits the advantages of the multi-Bernoulli filters with straightforward particle implementations and state estimation [
20]. Although it cannot obtain target trajectories, it has a lower computational cost than that of the labelled versions [
27]. Inspired by the idea of [
23], we propose a group target tracking method using the virtual leader–follower model and the MS-MeMBer filter. Specifically, in the prediction step of the MS-MeMBer filter, we consider the group of individuals as an undirected random graph. Furthermore, the motion equation of targets within groups is introduced, combined with the virtual leader–follower model. Then, in the update step, the partition of multi-sensor measurements is transformed into a multi-dimensional assignment (MDA) problem. Using the MDA algorithm proposed in [
31], better measurement partitions can be achieved in conditions for tracking targets within groups.
The rest of this paper is organized as follows.
Section 2 briefly reviews the RFS and the original MS-MeMBer filter.
Section 3 describes the group target tracking method proposed in this paper. Simulation results are given in
Section 4. Finally, discussions are given in
Section 5.
3. The Group Target Tracking
Based on the MS-MeMBer filter, a new group target tracking method is proposed. First, the filter parameters and the group structure are initialized according to the initial state of members. Then, in the prediction step, the movement of the members within a group is constrained by the group structure. Furthermore, in the update step, the partition of multi-sensor measurements is transformed into a multi-dimensional assignment (MDA) problem. Compared with the original two-step greedy partitioning mechanism [
26], the MDA algorithm [
31] can obtain better measurement partitions in group target tracking scenarios. Finally, the group structure is estimated through the current state of internal members and is fed back to the prediction step at the next moment. Also, the current state of members and groups is output. The flowchart of the proposed method is shown in
Figure 3.
3.1. Graphical Representation of the Group
Graph theory [
22] provides a convenient tool for describing groups, in which the relations between members are reflected by the edges between the related graph vertices. In this section, we consider the group of members as an undirected graph.
Given an undirected graph,
of group
m at time
.
is the vertex set composed of
n individuals within group
m, and each vertex
contains the state and covariance of target
i. For two different vertices
and
, if the Mahalanobis distance
is less than the threshold
, it is determined that there is an edge connection between them. In other words, targets
i and
j are in the same group.
is the collection of all edges between vertices in
.
is a mapping function that points to other members in the same group with target
i.
represents a set of undirected graphs for each group.
Figure 4 is a graphical representation of group targets, which shows seven moving targets belonging to two groups.
3.2. The System Model of Group Movement
The virtual leader–follower model [
7] assumes that the state of any member is the translational offset of the group centroid. Consider a group with
members at time
. We represent the member state as
.
and
are the target positions.
and
represent the target velocities along respective axes. According to the leader–follower model, the motion equation of the
i-th member is given by
where
and
are the unit matrix and zero matrix of size
d, respectively. The process noise
is considered as the zero-mean white Gaussian noise with variance
. We can see from (17) that the movement of the members is not only related to its own state at the previous moment, but also restricted by other members in the same group. If
is an empty set, then (17) can be simplified to the standard motion equation [
2].
The observation equation of group members is given by
where
is the observation of
, and
is the measurement noise, which is usually assumed to be the zero-mean white Gaussian noise with variance
.
is the observation matrix at time
k.
3.3. Multi-Sensor Measurement Partition and MDA
In the two-step greedy partitioning algorithm, each Bernoulli RFS (target) is assumed to be independent. Then, the target measurement set
of each Bernoulli RFS can be obtained separately. Also, the clutter measurement set
is assumed to be independent of the target. Therefore, measurement partitions can be formed by combining each independent measurement set. As a divide-and-conquer strategy, this algorithm breaks the partitioning problem up into several independent sub-problems, which improves the efficiency of measurement partition. However, due to the dense distribution of individuals within groups, the association between measurements and targets is more complex. As can be seen from
Figure 5, the measurement of a member would fall within the correlation threshold of other members in the same group. In this case, it is hard to maintain independence between the sub-problems in the two-step greedy partitioning mechanism. If the divide-and-conquer strategy is still adopted in group target tracking scenarios, the quality of the measurement partitions would deteriorate.
In this section, by eliminating the constraint of the clutter measurement set, the multi-sensor measurement partition can be interpreted as a multi-dimensional allocation problem, which can be solved by the MDA algorithm [
27]. Compared with the two-step greedy partitioning mechanism, the MDA algorithm is implemented from the whole perspective, which improves the quality of multi-sensor measurement partitions. The derivation detail is given as follows.
From [
25], the
n-th derivative of function
obeys
where
is the clutter intensity of sensor
j.
Then the coefficient
in (15) can be written as
where
We employ as a ratio of the likelihood that is generated by target i to the likelihood that is the clutter set. As can be seen from (22), the constraint of the clutter set is eliminated. Therefore, we can obtain the partition by associating Bernoulli RFSs with the measurements of S sensors.
In order to get the best association between multi-sensor measurements and Bernoulli components, the maximum score of
is required:
The maximization problem shown in (25) is equivalent to the negative logarithmic minimization problem:
where
In (27), the decision variable
denotes that the measurement set
is associated with the
i-th Bernoulli RFS. The number of predicted Bernoulli RFSs is given by
and the number of measurements from sensor
j at time
k is
. The constraint condition can be expressed as
which guarantees that two different Bernoulli RFSs cannot share the same real measurement, and that a Bernoulli RFS can be associated with an empty set
.
The minimization problem shown in (26) can be solved by the MDA algorithm [
27]. Also, multiple high-scoring partitions are needed in the update step. Therefore, a list can be created that ranks feasible solutions in the order of cost factors.
3.4. Gaussian Mixture Implementation
It is very intractable to calculate multiple integrals in the prediction step and update step of the MS-MeMBer filter. Therefore, a Gaussian mixture (GM) implementation is adopted, in which the distribution function of each Bernoulli component is assumed to follow a GM form.
3.4.1. Prediction Step
Assume that at time
, the distribution function of each Bernoulli component has the following GM form:
where
is a Gaussian function with mean
and variance
.
is the number of the Gaussian components.
is the weight of the corresponding component.
Using (17), the transfer function
follows
Define the target survival probability as
, and the distribution function of newborn targets as a GM form with
.Then the distribution function of each survival Bernoulli component also has a GM form:
where
Furthermore, the probability
of each survival Bernoulli follows
3.4.2. Update Step
Assume that the distribution of each predicted Bernoulli component has the following GM form:
Given the measurement likelihood function of each sensor
, and the detection probability of each sensor
, the distribution function of each updated Bernoulli component also has a GM form:
where
and
The updated probability
satisfies
3.5. The State Extraction and Group Structure Estimation
The state extraction [
25] is adopted to calculate the movement of all the targets, where the mean value is obtained from the densities of the updated Bernoulli RFSs with the exiting probabilities exceeding a given threshold. Consider the multi-target movement
at time
k, where
and
are the kinematic state and covariance matrix of member
i, respectively.
Suppose that at time
k, the adjacency matrix is given by
where
The structure and number of groups can be obtained by the adjacency matrix [
23]. If the Mahalanobis distance between two targets is less than the threshold
, the two targets can be determined to be in the same group, and the corresponding value in the adjacency matrix is equal to one. For instance, the adjacency matrix of group 1 in
Figure 4 can be denoted by
Furthermore, the estimated group structure can be fed to the next step to update the state of members within the group.
4. Simulation Results
In this section, a two-dimensional area with size [−1500 m, 1500 m] × [0 m, 3000 m] is considered. Suppose that group targets that involve three subgroups moving in x-y plane. To verify the capability of the proposed method for tracking standard point targets, a single target in consistent velocity (CV) style is also considered. As shown in
Figure 6, 11 moving targets are simulated. Among them, target 1 moves independently; target 2, target 3, and target 4 constitute group 1; target 5, target 6, target 7, and target 8 constitute group 2. Besides, target 5 separates from group 2 at about 65 s; target 9 and target 10 constitute group 3, and target 11 merges with this group at about 40 s. The kinematic parameters of targets are shown in
Table 1.
The duration time is 100 s, and the sampling period
. There are three sensors in the observation area.
Figure 7 shows the measurements collected from sensor 1. The detection probability of each sensor is
, and the clutter intensity is
. The birth model is set according to the initial state of the targets. The target survival probability is set as
. The process noise covariance matrix
, and the observation noise covariance matrix
are respectively:
where
and
.
In the simulation, the number of the Bernoulli components is not more than
, the number of the Gaussian components per target is not more than
. The pruning threshold is set as
. There are at most four measurement partitioning hypotheses in the set
, and the number of the measurement subsets in each hypothesis
is up to
. In addition, the Mahalanobis distance threshold is
. The simulation is performed using algorithms implemented in MATLAB on computers with one Intel Core i7-6700 CPU and 16 GB RAM. The average result is obtained through 50 Monte Carlo runs. The filtering performance is measured by the optimal sub-pattern assignment (OSPA) distance [
34]. The OSPA distance accounts for both errors in estimation of target states and errors in estimation of target cardinality, where we set order
and the penalty factor
.
As can be seen from
Figure 8, in the group target tracking scenario, the OPSA error of the MS-MeMBer filter with group structure estimation is significantly smaller than that of the original MS-MeMBer filter. This means that the filtering accuracy is improved by using the group structure. In addition, compared with the above two methods, the proposed method with both the MDA algorithm and group structure estimation has the optimal filtering performance. Note that there is a peak of the OSPA error at about 80 s. This is because the filters mentioned above react slower to the death of the members.
Figure 9 shows the members’ cardinality estimation of the above methods. The black line is the true cardinality of the members, the red dot is the estimated cardinality at the corresponding time, and the blue line represents the standard deviation of the estimated cardinality. We can see that for group target tracking, a cardinality estimation bias occurs in the original MS-MeMBer filter, which can be eliminated by using the group structure. Moreover, the standard deviation of cardinality estimation is further reduced by the MDA algorithm.
Figure 10 shows the estimated group cardinality of the proposed method. It can be seen that the proposed method obtains smaller standard deviations of the estimated group cardinality. We can conclude that compared with the MS-MeMBer filter, which only contains the group structure estimation, the proposed method with both group structure estimation and MDA algorithm obtains better estimation of the group cardinality.
Table 2 shows the average running time of the MS-MeMBer filter and the proposed method in scenarios with different number of sensors. The number of the sensors is varied in the range {3, 4, 5}. By comparison, they have similar time consumptions when the number of the sensors is small. However, the computational complexity of the MDA algorithm increases exponentially with the increasing number of the sensors, leading to a significant increase in the time consumption of the proposed method.
The time-averaged OSPA errors (via 50 MC runs) of the above methods in scenarios with different sensor numbers are displayed in
Figure 11. It can be seen that as the number of the sensors increases, the time-average OSPA error of the two methods without MDA algorithm increases. The reason is that as
S increases, the association between the measurements and Bernoulli components is more complicated because of the densely clustered members within the group. On the contrary, as the number of the sensors increases, the proposed method combined with the MDA algorithm and group structure estimation together can obtain better filtering results.
Figure 12 shows the performance of the original MS-MeMBer filter, the MS-MeMBer filter with group structure estimation, and the proposed method under different clutter intensities. The clutter intensity is varied in the range {10, 100, 200}. It can be concluded that the performance of the first two methods decreases significantly with the increase of clutter intensity. However, by using the MDA algorithm, the proposed method can still obtain better filtering results in clutter-intensive scenes.
5. Discussion
In this paper, we proposed a group target tracking method based on the MS-MeMBer filter. We used the group structure to constrain the movement of members within the group. We also improved the multi-sensor measurement partition through the MDA algorithm. Finally, we established a simulation scenario with splitting and merging of groups. Simulation results showed that compared with the original MS-MeMBer filter, the proposed method has achieved better robustness and accuracy in group target tracking scenarios, at the cost of an acceptable increasing computational load.
However, the MS-MeMBer filter is not strictly a tracker, because it can only get the target state, not the target trajectory. To obtain multi-target trajectories, the filter based on the labeled RFS or additional track maintenance operation can be considered. Furthermore, the proposed method ignores the dynamic evolution of the group structure. Future work will explore the multi-sensor multi-target filter, which can accommodate the evolution of group structures and can estimate target trajectories.