1. Introduction
The ocean is considered the largest public space on Earth’s surface. Additionally, the ocean is the origin of numerous security threats. In modern naval warfare, passive bearing angle estimation of underwater non-cooperative targets is a pivotal field of study. Passive bearing angle estimation methods are classified into two categories: direction-of-arrival (DOA) estimation and DOA tracking [
1,
2,
3]. DOA estimation and tracking determine the real-time bearing of underwater targets, enabling real-time monitoring of specific maritime areas.
The DOA estimation method assumes that the target’s bearing angle remains unchanged or changes slightly during the observation time. This approach determines the target’s bearing by processing the information contained in array-received signals. However, DOA estimation methods neglect the motion information of the target [
4,
5,
6,
7], which results in poor bearing estimation in low signal-to-noise ratio (SNR) environments. In complex underwater environments, with non-stationary, highly non-cooperative targets and low SNR, traditional DOA estimation methods struggle to provide effective results. Consequently, continuous DOA tracking is required for the accurate estimation of moving underwater targets.
To overcome the drawbacks of the traditional DOA estimation methods, DOA tracking techniques not only utilize array-received signals but also incorporate the target’s motion characteristics to achieve more accurate and stable results than traditional DOA estimation methods. Researchers have extensively studied the DOA tracking field. Typically, DOA tracking methods use signals received by sonar arrays as input and develop motion and measurement models based on typical underwater target movements. Due to the significant nonlinearity between target bearing and original array signal measurements, these models are applied with nonlinear Bayesian filtering theory to recursively estimate the target’s bearing. Researchers have developed various tracking algorithms based on nonlinear Bayesian filtering for DOA tracking, a type of nonlinear parameter estimation problem. The extended Kalman filter (EKF) is the most representative of these. Kong [
8] used EKF to derive a target bearing tracking method using array-received signals, achieving effective target tracking. In real underwater target tracking scenarios, in addition to the target’s acoustic signals, uncertain noise from marine turbulence, distant ships, storms, and surface waves can significantly affect array measurements. Zhang [
9] used an improved Sage–Husa algorithm to estimate the covariance matrix of measurement noise in real-time, obtaining robust underwater target DOA tracking results against strong disturbances. Hou [
10] enhanced the extended Kalman filter with variational Bayesian methods and incorporated machine learning in the initial covariance matrix [
11], conducting extensive research on DOA tracking based on raw array measurements. These studies verify the feasibility of array-based DOA tracking, which can achieve continuous high-precision tracking of underwater moving targets. However, array-based observations have not been processed to focus on specific spatial directions, leading to potential signal drowning in noise under low SNR or strong interference conditions. Additionally, neglecting the spatial sparsity of target signals and the large number of array elements can result in reduced computational efficiency in DOA tracking.
Beamforming functions as a spatial filter, suppressing signals from non-target directions and enhancing those from target directions. To achieve spatial directivity and improve accuracy and computational efficiency of DOA tracking, beam-domain DOA tracking is required. This method employs beamforming to generate weight vectors, resulting in observations with spatial directivity. By focusing on specific spatial directions, this approach effectively increases the SNR of received signals. Conventional beamforming, exemplified by the 1965 Bartlett algorithm (conventional beamforming, CBF) [
12], is computationally simple but constrained by the “Rayleigh limit”, resulting in poor resolution, poor array gain, and the inability to adapt. Adaptive beamforming, such as the MVDR beamformer introduced by Capon in 1969 [
13], offers improved spatial resolution but fails to control the main lobe and sidelobes. In practice, received signals are often drowned in environmental noise and cluttered with interference from multiple directions. Thus, a beamforming method with low sidelobes is essential to effectively reduce interference within the sidelobe areas and enhance directional accuracy. Additionally, beam-domain tracking can introduce errors. Each observation should improve the SNR within the target angle range and suppress signals outside this range, necessitating the use of low-sidelobe beamforming techniques. In conventional beamforming, the most well-known method to reduce sidelobes is the Dolph–Chebyshev (DC) weighting [
4], which achieves the lowest sidelobe levels given a set main lobe width, but which is limited to ULA and lacks adaptability. In adaptive beamforming, Ma [
14] first introduced an optimization method for antenna patterns of sensors with any structural shape. This method, by placing virtual interferers of appropriate intensity in the sidelobe area, achieves desired low sidelobes. Following the same principle, Olen [
15] proposed a digital synthesis method for static beam patterns. This method control sidelobes through iterative virtual noise sources, which can reduce sidelobes to a predetermined level set by us. It also allows for the pre-calculation and storage of beamforming weights. However, Olen only used simple difference control to iterative virtual noise sources. Many researchers have improved this approach [
16,
17,
18], enhancing algorithm convergence and precision. However, these methods, primarily using single controls, like difference and proportional control, often face issues with oscillations, slow convergence, excessive iterations, and high computational demands.
Building on the above discussion, to address the limitations caused by traditional DOA estimation methods overlooking target motion characteristics and array-based DOA tracking algorithms neglecting real-time spatial information of targets, we propose a new tracking algorithm. Initially, to achieve observations with spatial directivity, we innovatively design and propose beam-based observation. Beamforming is applied after element domain observation, resulting in beam-based observations with specific spatial directivity. By performing beamforming in the element domain, the SNR in suspected target directions is enhanced, thereby improving DOA tracking accuracy. Next, to obtain the beam-domain observations, a new beamforming method and an adaptive dynamic beam window are innovatively designed and proposed. To suppress signals from non-target directions and enhance signals from the target direction for better SNR, the beamforming method needs to effectively reduce the sidelobe levels of the beam. To be applicable in various array scenarios, the beamforming method needs to be adaptable to different array configurations. To reduce real-time computation, the beamforming method should allow for the pre-calculation and storage of beamforming weight vectors. The new beamforming method, namely the proportional–integral–differential (PID)-optimized Olen–Campton beamforming method (PIDBF) can meet the above three conditions; at the same time, it can also achieve faster and more stable low-sidelobe control effects. The Olen–Campton beamforming method (OBF) and its improvements adopt single control strategies, such as difference control and proportional control during the error control process of these virtual noise sources. This approach results in slow sidelobe reduction, excessive iterations, and high computational demands. To overcome these issues, the PIDBF introduces PID control techniques on the basis of OBF and its improvements, achieving faster and more stable low-sidelobe control effects. To obtain the beam-domain observations, an adaptive dynamic beam window is also designed and proposed. The adaptive dynamic beam window uses the predicted angle as the beam center direction. The root mean square of the angular error determines the beam window width. This creates dynamic feedback for the beam window, allowing real-time adjustments to its position and size. This approach improves the capture of target directional characteristics and regulates the SNR of the received signals. Then, a DOA tracking algorithm based on a beam-domain observation model is proposed. This algorithm is framed within EKF and utilizes a PID-optimized Olen–Campton beamforming method, which is named PIDBF-EKF. Firstly, we obtain measurement information from a uniform linear array (ULA) regarding the target’s radiation noise and establish a typical kinematic model for underwater moving targets. Additionally, we design and propose PIDBF to achieve faster and more stable sidelobe control. We also design and propose an adaptive dynamic beam window to obtain better beam-based observations. Finally, we integrate PIDBF into the EKF tracking filter framework and propose the PIDBF-EKF for robust DOA tracking. The innovative contributions of this work are summarized as follows:
(1) To achieve observations with spatial directivity, beam-based observation is innovatively designed and proposed. Beamforming is applied after element domain observation, resulting in beam-based observations with specific spatial directivity. By performing beamforming in the element domain, the SNR in suspected target directions is enhanced, thereby improving DOA tracking accuracy.
(2) To obtain the beam-domain observations, the PIDBF is designed and proposed. By introducing the PID control technique, proportional control, integral control, and derivative control are used to iteratively adjust virtual noise sources, achieving faster and more stable sidelobe control so that the SNR of the interested target can be enhanced. The PIDBF is adaptable to different array configurations to be applicable in various array scenarios. The PIDBF also allows for pre-calculation and storage of beamforming weight vectors to reduce real-time computation. Simulation verification of the proposed beamforming algorithm under different SNR conditions shows that the PIDBF can achieve stable and rapid low sidelobe control. To obtain the beam-domain observations, an adaptive dynamic beam window is also designed and proposed. The adaptive dynamic beam window uses the predicted angle as the beam center direction. The root mean square of the angular error determines the beam window width. This creates dynamic feedback for the beam window, allowing real-time adjustments to its position and size.
(3) The PIDBF-EKF is designed and proposed. PIDBF-EKF is a real-time iterative updating beam-domain DOA tracking framework based on “beamforming + nonlinear filtering”, where EKF is incorporated based on beam-based observations. This framework overcomes the limitations of traditional DOA estimation and DOA tracking for underwater moving targets under low SNR conditions, enhancing the spatial directivity and computational efficiency of the tracking algorithm. Simulation verification of the proposed beam-domain DOA tracking algorithm under different SNR conditions and different numbers of beams demonstrates that beam-domain DOA tracking offers higher tracking accuracy than traditional DOA estimation and element-domain DOA tracking under low SNR conditions. PIDBF-EKF enhances computational efficiency while maintaining the same tracking accuracy as other beam-domain DOA tracking methods.
The remainder of this paper is organized as follows: In
Section 2, the problem of underwater DOA tracking is formulated. In
Section 3, the PIDBF is proposed. The beam-domain DOA tracking algorithm PIDBF-EKF is designed in
Section 4. In
Section 5, simulations with various conditions are conducted and the effectiveness of the proposed algorithms are verified.
3. Principle of the PIDBF
Array-based observations possess spatial omnidirectionality and cannot focus on specific spatial directions of interest. To achieve observations with spatial directivity, we innovatively design and propose beam-based observation. Beamforming is applied after element domain observation, resulting in beam-based observations with specific spatial directivity. We propose a new beamforming method that introduces PID control technology in the process of artificially adding virtual interference sources to control the sidelobe level in the Olen–Campton beamforming method (OBF) [
15]. This approach which is called the proportional–integral–differential (PID)-optimized Olen–Campton beamforming method (PIDBF) achieves a faster and more stable sidelobe reduction in the beamforming process. The following subsections will demonstrate the principle of the OBF and PIDBF, which is designed and proposed based on the OBF.
3.1. Olen–Campton Beamforming Method and Optimization
To enhance the spatial directivity and interference suppression capabilities of beamforming, it is essential to achieve lower sidelobe levels, which effectively suppress interference within the sidelobe area and reduce the system’s false alarm probability. The Olen–Campton beamforming method addresses this by generating a beam response map and artificially introducing virtual interference sources in the sidelobe region. This approach enables adaptive adjustment of the intensity of these interference sources, facilitating the reduction of sidelobes.
First,
virtual interference sources are artificially added in the sidelobe region.
and
represent the intensity and direction of the
-th interference source, respectively. The steady-state interference covariance matrix is obtained through matrix operations, as shown in the following Equation (13):
where the subscripts
and
in index
are abbreviations for the words interference and noise, respectively, indicating that
includes two components: the noise covariance matrix and the interference source covariance matrix.
is the array response vector corresponding to direction
,
is the power of the additive white noise of the element, and
is the identity matrix.
Under the current conditions of the interference source’s intensity and direction, the beamforming weight vector is given by the following:
where
is the beam pointing angle, and
is the array manifold of the base array. The interference sources can be uniformly distributed across the entire scanning bearing, with no interference sources located within the main lobe. Consequently, the intensity of the interference sources in the main lobe is set to zero, while the intensity of the interference sources in the sidelobe region is continuously and adaptively adjusted.
Suppose the main lobe region is
during the
-th adaptive adjustment. Then, for the next adjustment, the intensity of the interference sources
in the Olen–Campton beamforming method is set as follows:
The obtained beam pattern needs to be compared with the desired beam pattern. When the sidelobe level in a certain direction exceeds the desired value, the intensity of the interference source in that direction is increased. Conversely, if the sidelobe level is below the desired value, the interference source’s intensity is decreased. In Equation (16), is the normalized beam response in direction obtained after the -th adjustment, is the desired beam response in direction , and is the adaptive iterative gain, which affects the speed of iterative convergence. The initial value of the interference source intensity can be set to zero.
OBF and its optimization have three advantages. Firstly, the beam has lower sidelobe levels to effectively suppress interference within the sidelobe area and reduce the system’s false alarm probability. Secondly, they are adaptable to different array configurations to be applicable in various array scenarios. Thirdly, by using the method of artificially adding virtual interference sources, OBF and its optimization can iteratively obtain the beamforming weight vectors without obtaining array signals in advance. So, OBF and its optimization allow for the pre-calculation and storage of beamforming weight vectors to reduce real-time computation. However, there is a problem still to be solved.
The iterative steps of the Olen–Campton beamforming method utilize difference regulation, which can lead to slow iteration speeds and oscillation problems. Zhang and Yang have each optimized the interference source iterative steps of the Olen–Campton beamforming method [
14]. Zhang’s optimization, known as the Zhang–Olen–Campton beamforming method (ZOBF), transforms the nonlinear problem into a linear one through segmentation but still uses a single Differential control method to manage the error between the current sidelobe and the desired sidelobe. The choice of coefficients relies on empirical values, which may lack theoretical significance to some extent. Optimization of the Olen–Campton beamforming method proposed by Yang (YOBF) uses a proportional control method, which can increase the stability but still has room for improvement in speed of iterations.
3.2. Design of the PIDBF Method
In addressing the problem, we design and propose PIDBF, which introduces PID control in the interference source iteration steps of the Olen–Campton beamforming method for optimization and improvement. As a widely used error-regulating controller, the PID algorithm can effectively regulate the system’s desired output through end-to-end control. Its core principle involves computing the control output by weighting and summing the proportional, integral, and derivative elements of the control deviation (the gap between the set value and the actual value), thereby effectively correcting the deviation of the controlled object to achieve optimal control effect and ensuring the controlled object reaches a stable state. By introducing PID control into the process of artificially adding virtual interference sources for low-sidelobe management in beamforming, we enable rapid calibration to achieve the desired low-sidelobe beam under certain main lobe power conditions, thereby enhancing the SNR in regions where targets may exist in space. Initially, the sidelobe error between the current beam and the desired beam is calculated in real-time to obtain the PID control input. Then, using the characteristics of proportional control to increase the speed of sidelobe control, integral control is adopted to eliminate static sidelobe control errors, and derivative control is utilized to improve the dynamic performance of sidelobe control. Consequently, low-sidelobe beamforming in beam-domain specific spatial regions can be achieved, providing a measurement basis for subsequent DOA tracking.
The intensity of the interference source
in the beamforming method is set as follows:
where the initial value of
should be non-zero. Otherwise, the interference source intensity will be zero in each iteration.
Equation (18) is as follows:
where
is the desired sidelobe level, and
is the sidelobe level obtained in the current iteration. Equation (18) is used to obtain the proportional error term
in the
-th iteration.
The iterative gain factor of the
-th interference source after the
-th adjustment
is set as follows:
where
is the maximum allowable value of the iterative gain factor setting to prevent divergence in the adaptive process.
is the proportional error term in the
-th iteration. The three parameters
correspond to the three parameters of the PID controller.
is the proportional control parameter,
is the integral control parameter, and
is the derivative control parameter.
is the sum of the proportional error amounts over n iterations.
6. Conclusions
We explore robust DOA tracking technologies for underwater targets in complex environments. To enhance the target direction signal and effectively improve the SNR of the received signal, the PIDBF has been designed. This method accelerates the convergence of sidelobes to the desired height, achieving lower MSE and RMSE with fewer iterations. Furthermore, the method’s convergence process is stable, with minimal oscillations, and as the iterations increase, the final convergence results closely match the desired sidelobe heights.
To address the two issues of traditional DOA estimation—namely, the lack of consideration for the kinematic information of the tracking target and the direct use of raw array information as measurements without considering the spatial sparsity of target information, beam-domain DOA tracking based on “beamforming + nonlinear filtering” is proposed. Furthermore, PIDBF-EKF is designed and proposed.
The simulation results demonstrate that under conditions of low SNR, where traditional DOA estimation methods and E-EKF are ineffective or fail, the proposed beam-domain DOA tracking method still maintains an average estimation error below . PIDBF-EKF enhances computational efficiency while maintaining the same tracking accuracy as other beam-domain DOA tracking methods. This makes PID-EKF more adaptable for array applications. When the array changes (such as individual element failures or array configuration adjustments) and requires recalculating beamforming weights, PID-EKF shows a significant speed advantage. In the simulations, the extremely low error in the simulation algorithms is due to the ideal simulation conditions. The simulation algorithm exhibits an extremely low error due to the highly idealized conditions. The observation noise in the simulation is artificially defined as white noise that follows a Gaussian distribution. The motion model in the simulation is precise, and the beamforming accuracy is exceptionally high, achieving 0.01°. In real-world scenarios, the target is subject to unknown environmental interferences, leading to challenges, such as non-stationary and non-Gaussian observation noise, unknown target motion trajectories, and reduced beamforming accuracy. These factors collectively result in decreased estimation accuracy. Future research will aim to address these issues.