Next Article in Journal
Domain Knowledge-Based Evolutionary Reinforcement Learning for Sensor Placement
Previous Article in Journal
Printed Multilayer Piezoelectric Transducers on Paper for Haptic Feedback and Dual Touch-Sound Sensation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Three-Dimensional Imaging of Circular Array Synthetic Aperture Sonar for Unmanned Surface Vehicle

1
National Key Laboratory of Science and Technology on Underwater Acoustic Antagonizing, Shanghai 201108, China
2
Shanghai Marine Electronic Equipment Research Institute, Shanghai 201108, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(10), 3797; https://doi.org/10.3390/s22103797
Submission received: 7 April 2022 / Revised: 13 May 2022 / Accepted: 15 May 2022 / Published: 17 May 2022
(This article belongs to the Section Remote Sensors)

Abstract

:
Synthetic aperture sonar (SAS) and interferometric synthetic aperture sonar (InSAS) have a range layover phenomenon during underwater observation, the AUV-mounted circular synthetic aperture sonar (CSAS) system, that insonifies targets using multiple circular scans that vary in height and can eliminate the layover phenomenon. However, this observation method is time-consuming and difficult to compensate. To solve this problem, the circular array synthetic aperture sonar (CASAS) based on the equivalent phase center was established for unmanned surface vehicles. Corresponding to the echo signal model of circular array synthetic aperture sonar, a novel three-dimensional imaging algorithm was derived. Firstly, the echo datacube was processed by signal calibration with near-field to far-field transformation and grid interpolation. Then, the sparse recover method was adopted to achieve the scattering coefficient in the height direction by sparse Bayesian learning. Thirdly, the Fourier slice theorem was adopted to obtain the 2D image of the ground plane. After the reconstruction of all height slice cells was accomplished, the final 3D image was obtained. Numerical simulations and experiments using the USV-mounted CASAS system were performed. The imaging results verify the effectiveness of the 3D imaging algorithm for the proposed model and validate the feasibility of CASAS applied in underwater target imaging and detection.

1. Introduction

Synthetic aperture sonar (SAS) is a well-established powerful underwater remote-sensing technique [1,2,3,4]. SAS systems could transmit acoustic pulses while moving along a trajectory and coherently combine the backscattered echoes to yield high-resolution images of the objects [5,6]. However, due to the platform of SAS moving in a straight trajectory, multiple acoustic scatterers may map to the same pixel in a beamformed SAS image. The SAS and synthetic aperture radar (SAR) community describe this phenomenon as range layover [4]. SAS can only obtain the projection of the real 3D scene on the 2D slant plane, but not the 3D image of the observed scene.
In order to obtain the 3D information of the observed scene, the researchers proposed the interferometric synthetic aperture sonar (InSAS) technology [7]. The InSAS imaging technology can obtain two 2D complex images under different viewing angles by using an interferometric array sonar system and then acquires the height information of the target by performing interference processing on the 2D complex images. However, the InSAS sonar imaging technology is not a real three-dimensional imaging technology, because it can only obtain the height of the target but cannot achieve the resolution of the target along the height direction. In addition, since InSAS processing assumes that each two-dimensional resolution cell contains only one scatterer in the height direction, when there are multiple scatterers in the height direction, the InSAS technology can only obtain the average height of scatterers. In the other words, InSAS also has a range layover phenomenon.
One approach for addressing range layover phenomenon is circular synthetic aperture sonar (CSAS) technology [4,8,9,10,11,12,13,14]. CSAS can obtain echo data in all directions of the target by a circular measurement trajectory. Based on the principle of computed tomography [15,16,17], the backscattered echoes are coherently processed to obtain the target image. CSAS imaging resolution is better than SAS and has three-dimensional imaging capability. Although CSAS has the ability of three-dimensional imaging, the lack of the wavenumber space spectrum in the height direction leads to poor height resolution of the three-dimensional image and serious conical side lobes. The method for improving the 3D imaging quality of CSAS is to erect a multidimensional synthetic array by conducting repeat passes at multiple altitudes or ranges and coherently combining the backscattered signals [4]. Such an approach has been performed and reported previously in the Synthetic Aperture Radar (SAR) community, where it is commonly referred to as SAR tomography [18,19,20,21,22]. When the airborne and spaceborne SAR tomography demonstration system moves in a circular trajectory, it is also called circular SAR (CSAR) tomography. Theoretical and laboratory-based studies have been conducted regarding the feasibility of this approach in the SAS community [11,23]. Recently, autonomous underwater vehicle-based (AUV) experiments have been performed to verify the validity of the method. The AUV-mounted sonar system insonifies targets using circular scans varying in height or radius, then coherently combines the backscattered signals to obtain 3D imaging of the target [4].
However, the synthesized multipass array will be irregular in the AUV-mounted sonar system due to navigation errors caused by currents [24,25,26]. This problem can fail to coherently combine the backscattered signals, which leads to unsuccessful attempts to obtain 3D imaging of the target. On the other hand, the AUV-mounted sonar system would surface and frequently obtain a new GPS lock for correcting underwater navigation trajectory during multipass measurement [25]; this is time-consuming and errors in the GPS localization would often cause a discontinuity in the final multipass aperture. This paper proposes a novel method to overcome these difficulties using the Unman Surface Vehicle (USV)-mounted array in height direction sonar system, which insonifies targets using a single circular scan, then coherently combines the backscattered signals to obtain the 3D imaging of target. Similar to the definition of Circular Array SAR (CASAR) in the literature [27], the USV-mounted array in height direction can be defined as Circular Array synthetic aperture sonar (CASAS). The structure of this paper is organized as follows: in Section 2, the CASAS system configuration, parameters, signal model, and data acquisition are introduced. In Section 3, the signal calibration, scattering coefficient reconstruction along the height direction, 3D imaging reconstruction procedure, and point spread function of CASAS are presented. The corresponding simulation and experimental results are shown in Section 4. Section 5 concludes the paper.

2. CASAS System

2.1. CASAS Configuration

In the SAS community, there are two kinds of transmitting-receiving models for sonar sensor array: single-transmitter multiple-receiver and multiple-transmitter multiple-receiver models. Each sensor transmits a signal and receives an echo independently based on the equivalent phase center principle. The imaging geometry of CASAS is shown in Figure 1, where the sonar system consists of a vertical line array operating at a β angle to the Z-axis. The sensor array moves along a circular trajectory with a radius of R0. Assuming that there are a total of M equivalent sensors whose Z-axis coordinates are z m ,   m = 1 , , M , the distance of each equivalent sensor is d, the height of CASAS is H, and the circular trajectory of the first equivalent sensor is treated as the reference trajectory. When the CASAS sonar system moves to the azimuth angle θ, the instantaneous coordinate of the equivalent sensor m is ( R 0 m d · sin β · cos θ , R 0 m d · sin β · sin θ , z m ), where z m = m d · cos β + H . It is assumed that the target scattering is isotropic and the sensors can illuminate the region of interest during the entire sampling time.
Generally, the target in the imaging scene can be approximated as a sum of several independent and non-directional scattering centers in SAS imaging. Consequently, the echo of the target can be expressed as the superposition of echoes of all scattering centers. Considering a general scattering center P with coordinate ( x P , y P , z P ), which is shown in Figure 1. The instantaneous distance from the scattering center to the equivalent sensor m can be given as
R m ( θ ) = [ ( R 0 m d · sin β · cos θ ) x P ] 2 + [ ( R 0 m d · sin β · sin θ ) y P ] 2 + ( z m z P ) 2
Considering the target is in the far-field, the high-order terms can be neglected for the Taylor series expansion of the cosine term. The Equation (1) can be approximated as
R m ( θ ) 2 [ R 0 2 + z m 2 z m z P R 0 2 + z m 2 R 0 R 0 2 + z m 2 ( x P cos θ + y P sin θ ) ]

2.2. CASAS Parameters and Signal Model

The pulsed linear frequency modulated (LFM) is appropriate for CASAS imaging. The transmitted signal can be presented as
p ( τ ) = r e c t ( τ T ) exp ( j 2 π f 0 τ + j π γ τ 2 )
where τ is the fast time, T is the pulse duration, f0 is the center frequency, and γ is the frequency modulated rate. For scattering center P, the echo received by equivalent sensors m can be expressed as
s b ( τ , θ ; m ) = σ P · r e c t ( τ R m ( θ ) / c T ) exp [ j 2 π f 0 ( τ R m ( θ ) / c ) + j π γ ( τ R m ( θ ) / c ) 2 ]
where σ P is the scattering coefficient of target P and c is sound speed.
For broadband signal, the matched filtering (MF) method will need a high sampling rate to satisfy the Nyquist sampling criterion [28], which will increase the data size remarkably. The bandpass sampling technique is able to overcome this difficulty [29].

2.3. CASAS Data Acquisition

The CASAS transmission signal p(τ) is the LFM signal and the echo signal is s b ( τ , θ ; m ) . The fast-time sampling frequency of the CASAS determines the number of range bins, and the pulse repetition frequency (i.e., the slow-time sampling frequency) determines the angle bins. The CASAS system received signals that are forming a time series 1D signal after the analog to digital converter (ADC). The fast- and slow-time samples of each equivalent sensor accumulated at each angle θ1, θ2, …, and θN are reshaped by the number of range bins. Hence, the sampling sequence of fast-time, slow-time, and equivalent sensor data are organized as a 3D complex time domain data matrix. As can be seen in Figure 2, the datacube is organized as N θ × N R a n g e × N c h , where N R a n g e is the number of fast-time sampling points, N θ is the number of slow-time sampling data, and N c h is the number of receiver sensors.

3. CASAS Three-Dimensional Image Processing

3.1. Signal Calibration

In general, as in the two-dimensional case, the 3D datacube of circular array synthetic aperture sonar can be used to create 3D volumetric images simply by back-projection to voxels in the time–domain. However, this approach to beamforming is computationally burdensome and time-consuming. Two methods could be devised to reduce this burden. The first method beamforms data in the vertical dimension so that the Fourier slice theorem-based method can be applied to each horizontal slice [25]. Nevertheless, the Fourier slice theorem assumes that the data is acquired in the far-field of the object. For large objects or high-frequency synthetic aperture sonar systems, this can impose an experimentally unrealistic requirement on the radius of the synthetic aperture, forcing data to be acquired in the nearfield. Failure to meet the far-field criteria leads to distortions in the resulting image, angular spreading of narrow glints, and migration in an azimuthal angle of elastic features [4]. Referring to methods that have been suggested for SAR and ultrasonic imaging community, an algorithm can be proposed that allows 3D datacube measured in the near-field and then converted to the far-field, and such methods can be related to [29].
Θ F - F ( θ , t ) = F ( 2 ) [ F ( 2 ) [ Θ N F ( θ , t ) ] n · e i [ ( 4 n 2 1 ) / 2 ( 4 k R ( θ ) + ( 4 n 2 1 ) ( 4 n 2 25 ) / 6 ( 4 k R ( θ ) ) 3 + ( 4 n 2 1 ) ( 16 n 4 114 4 n 2 + 1073 ) / 5 ( 4 k R ( θ ) ) 5 ] ]
where Θ N F ( θ , t ) is the near-field backscattered acoustic data collect along a circular trajectory, Θ F - F ( θ , t ) is the far-field converted data, k is the wavenumber, R ( θ ) is the radial diameter at θ , n is the azimuthal Fourier component, H n ( 1 ) represents the nth-order Hankel function of the first type, and F ( 2 ) and F ( 2 ) represent the forward and inverse two-dimensional Fourier transforms. This transformation makes the signals from near-field to far-field successful.
The second signal calibration of CASAS signal process is grid interpolation, which can be referred to [4]. The CASAS data is interpolated onto a common ground-plane grid in cylindrical coordinates, which means slant-range to ground-range interpolation. The grid has a uniform height of h = 0, spans a predefined r radius, the angularly spans 0 to 2π. The transformation from slant-range time units to ground-plane radial units can be shown in
r = R ( θ ) ( t c / 2 ) 2 ( h C A S A S ( θ ) ) 2
where R(θ) and h C A S A S ( θ ) are the radius and height above the grid of the CASAS at θ. Following radial interpolation, the datacube is interpolated in the angular dimension to make the data regular in θ. The signal calibration can reduce the computational burden of CASAS 3D imaging [25].

3.2. Scattering Coefficient Reconstruction along the Height Direction

In order to increase the array size of CASAS, which is beneficial for the resolution in the height direction, the sparse hydrophone sensors array along the Z-axis is implemented. The density of the CASAS line array cannot satisfy the half-wavelength spacing condition, which cannot avoid the grating lobes. This makes the Fourier-based signal processing invalid [28]. Since there are limited dominated scattering centers in the height direction, the sparse reconstruction method can provide a solution to recover the scattering coefficient distribution [30,31]. It can extract the data corresponding to the same pixel cell of the multiple 2D complex images and rearrange them in a vector as the measurement data. For the pixel cell (u, v) of 3D imaging, the scattering distribution can be written as
I ( x u , y v , φ m ) = q = 1 Q σ q exp ( j 2 K z q sin φ m )
where φ m represents the pitch angle between the equivalent sensor and ground plane, Q is the number of grids divided along the height direction, the grids values are z = [ z 1 , z 2 , , z Q ] T , T denotes the transpose, K denotes signal wavenumber, and σ q represents the scattering coefficients of the target at grid q. Furthermore, the Equation (7) can be presented as the vector form I u , v ( φ m ) = G m σ q , where G m = exp ( j 2 K sin φ m z T ) and σ q = [ σ 1 , σ 2 , , σ Q ] . For the φm, I u , v ( φ m ) = G σ q , where I u , v ( φ m ) = [ I u , v ( φ 1 ) , I u , v ( φ 2 ) , , I u , v ( φ M ) ] T and G = [ G 1 , G 2 , , G M ] T . Considering that it will reconstruct the height scattering coefficient in the height direction pixel by pixel, the subscript u,v can be omitted in the following
I = G σ + N
where N is the additive white Gaussian noise, whose mean is zero and variance is Ψ. Since Q M , the solution of Equation (8) is underdetermined when assuming that the scattering center of the target behaves with spatial sparsity. Thus, assuming that δ is a proper bound, the Equation (8) can be transferred to an optimization problem as
min | σ | σ , s . t . I G σ δ
In the SAS community, the number of dominated scattering centers are generally unknown, so it is impracticable to solve the Equation (9) based on the sparsity of signal. The sparse Bayesian learning (SBL) is an effective approach for sparse recovery. Compared with other l1-norm minimization algorithms, the SBL-based algorithm adopts iteration during the procedure to avoid convergence to the local minimum and produces a full posterior distribution as the solution [32,33,34,35]. Assuming that there are hyperparameter ξ = [ ξ 1 , ξ 2 , , ξ Q ] governs σ , the prior probability of the distribution of scattering coefficient σ can be shown as
f ( σ | ξ ) = q = 1 Q 1 2 π ξ q exp ( σ q 2 2 ξ q )
If the scattering coefficients are given, the probability of the measurement vector is determined by noise distribution, which can be presented as [30]
f ( I | σ ; ψ ) = ( 1 2 π ξ q ) M exp ( 1 2 ψ I G σ 2 )
Considering the prior probability of σ and the conditional probability of I , the marginal probability of I can be written as
f ( I | ξ ; ψ ) = f ( I | σ ; ψ ) f ( σ | ξ ) d σ = 1 ξ J + G d i a g ( ξ ) G ( 1 2 π ) M exp ( 1 2 I T ( ξ J + G d i a g ( ξ ) G ) 1 I )
where J is the identity matrix. The posterior probability of σ can be written as follows based on Bayesian theorem
f ( σ | I ; ξ ) = f ( I | σ ; ψ ) f ( σ | ξ ) f ( I | ξ ; ψ ) = ( 1 2 π ) Q · 1 | [ ψ 1 G T G + ( d i a g ( ξ ) ) 1 ] 1 | exp [ 1 2 σ T ( ψ 1 G T G + ( d i a g ( ξ ) ) 1 d · J ) σ ]
where d = σ 1 [ ψ 1 G T G + ( d i a g ( ξ ) ) 1 ] 1 G T I . From Equation (12), it can be seen that the posterior probability is a Gaussian distribution with mean d . Furthermore, the variance is Ξ σ = [ ψ 1 G T G + ( d i a g ( ξ ) ) 1 ] 1 . From Equation (13), the mean value can be treated as the estimated scattering coefficient, which is relative to the noise of variance Ψ and hyperparameter ξ . Both Ψ and ξ can be estimated by expectation–maximization (EM) steps in the traditional SBL process, nevertheless, the noise variance Ψ is a nuisance parameter that cannot frequently estimate with accuracy [32]. However, Ψ can be integrated out by introducting a gamma distribution based on reference [33], which can be written as
f ( ψ | c , d ) = d c ψ c 1 Γ ( c ) exp ( c ψ )
where c and d are small values and deterministic. Γ ( c ) = 0 x c 1 exp ( x ) d x . The posterior distribution of σ is obtained in the form
f ( σ | I ; ξ ) = 0 f ( σ | I ; ξ , ψ ) f ( ψ | c , d ) d ψ
where f ( σ | I ; ξ , ψ ) is a multivariate complex Gaussian posterior distribution of σ , which can be shown as
f ( σ | I ; ξ , ψ ) = c N ( σ | μ , Σ )
where μ = ψ Σ I H I q , Σ = ( ψ I H I + d i a g ( ξ ) ) 1 . Substituting Equations (13) and (15) into (14), the posterior of σ can be shown as
f ( σ | I ; ξ ) = Γ ( c + Q ) [ 1 + ( σ d ¯ ) H Φ σ ¯ 1 ( σ d ¯ ) / d ] c + Q Γ ( c ) ( π d ) Q | Φ σ ¯ |
The posterior distribution given by Equation (17) is a multivariate complex Student’s t-distribution [32], for which the mean and covariance are written as
d ¯ = Φ σ ¯ G T I Φ σ ¯ = [ G T G + ( d i a g ( ξ ) ) 1 ] 1
From Equation (17), it can be seen that the estimate is merely a function of hyperparameter ξ rather than variance. Therefore, we have to estimate the hyperparameter ξ to obtain the scattering coefficient. Taking the EM approach of SBL into consideration, ξ can be obtained by maximizing the marginal probability of I [28]. The marginal likelihood function is obtained by integrating over the parameters σ and Ψ
f ( I | ξ ) = f ( I | σ ; ψ ) f ( σ | ξ ) f ( ψ | c , d ) d σ d ψ
Substituting Equations (10), (11) and (14) into (19) and evaluating this integral gives
f ( I | ξ ) = d c ( d + I H Ω 1 I ) ( M + c ) Γ ( M + c ) Γ ( c ) π M | Ω |
where Ω = J + G d i a g ( ξ ) G H and ( · ) H denotes the conjugate transpose operator.
Taking the logarithm of f ( I | ξ ) and keeping only the terms that are dependent on hyperparameter ξ , we obtain the cost function
F ( ξ ) = ( M + c ) ln ( I H Ω 1 I ) ln ( | Ω | )
Our goal is to maximize (21) with respect to the hyperparameter ξ . Differentiating F ( ξ ) with respect to ξ q , then setting the result to zero yields
ξ q = 1 ( M + c ) d q ¯ / ( d + I H Ω 1 I ) + Φ ¯ σ q , q
where d q ¯ is the qth component of d ¯ and Φ ¯ σ q , q is the qth diagonal of Φ σ ¯ . Note that the hyperparameter ξ is a function of mean d ¯ and covariance Φ σ ¯ . Meanwhile, Equation (18) indicates that mean d ¯ and covariance Φ σ ¯ are functions of ξ . Therefore, this optimization algorithm iterates between Equations (18)–(22) until convergence is achieved. Furthermore, it can obtain the scattering coefficient estimate by σ ^ = d ¯ . As mentioned above, the processing procedure of SBL can be shown in Algorithm 1.
Algorithm 1: Procedure of SBL to Reconstruction Imaging along the height direction
       Input:
                Matrix G , image vector in height direction;
                    Initial hyperparameter ξ , parameter c and d;
                    Convergence value ε;
       Output:
                 Mean d ¯ ; covariance Φ σ ¯ ;
           1: Begin
       2: Initialize input parameter, step j = 1;
           3: do
           4: computer d ¯ ( j ) and Φ σ ¯ ( j ) by Equation (18);
           5: Update d ¯ and Φ σ ¯ ;
           6: Calculate hyperparameter ξ q ( j ) by Equation (22), j = j + 1;
           7: if
           8: F ( ξ ) ( j + 1 ) F ( ξ ) ( j ) < ε
           9: end do
           10: return
           11: d ¯ , Φ σ ¯ .
       12: End

3.3. D Imaging Reconstruction Procedure

In order to reduce the computationally burdensome of 3D imaging and increase the resolution in the height direction, two methods are proposed to solve these problems. The first method beamforms data in the vertical dimension by SBL [35] followed by the application of the Fourier slice theorem-based method to each horizontal slice. Occasionally, the autofocus method can be used to improve the image quality of the horizontal slice 2D image [36,37,38,39], such as Shannon entropy metrics, generalized sharpness metrics, and contrast metrics. Finally, the 3D imaging of the data cube can be obtained by combining the 2D imaging along the height direction. The overall flowchart for 3D imaging is presented in Figure 3.

3.4. Point Spread Function of CASAS

The point spread function (PSF) defines the response of an imaging system to a point source [27]. For the CASAS imaging system, it is difficult to acquire the analyzed expression of CASAS PSF out of the image scene center. However, the PSF can be obtained by numerical calculation, which is shown in Figure 4. The main numerical calculation system parameters are listed in Table 1.
Figure 4a is the slice of CASAS 3D PSF in (0,0,0) and it can be seen that the target image focuses very well. Figure 4b is the slice of CASAS 3D PSF in (0,0,7), where the PSF is a circular lobe when it is out of the target. Figure 4c is the 3D PSF of CASAS which is shown in VAA3D software [40,41,42], and it can be seen that the PSF likes a “circular cone”. From Figure 4, it can be observed that the Peak Side Lobe Ratio (PSLR) is −7.96 dB and the Integral Side Lobe Ratio (ISLR) is −5.53 dB. Furthermore, the PSF has circular side lobes from the center.

4. Simulation and Experiment

4.1. Simulation Setup and Results

In this section, we present numerical simulations used to verify the effectiveness of the proposed 3D imaging model. The main simulation CASAS system parameters are listed in Table 2.
The simulated 3D target is shown in Figure 5. The 3D target consists of 116 scattering centers, for which the scatter coefficients are defined as 1. Figure 6 shows the simulated imaging scene, where the red cube is the 3D target, the black circular track is the trajectory of CASAS, the red pentagram defines the transmit sensor, and the blue points are receiver sensors.
The final 3D imaging simulation results using the 3D imaging reconstruction method are presented in Figure 7. Compared with Figure 5, it can be seen that the point scattering centers in the height z = −4 and the 3D target are reconstructed very well in the 3D space. Therefore, the simulation result demonstrates that the sparse recovery can reconstruct the height location of scattering centers, and the 3D imaging reconstruction method which is presented in this paper can reconstruct the 3D image of the target accurately.

4.2. Experiment Setup and Results

In December 2021, a series of CASAS experiments were conducted 20 m off the lakeside of Moganshan Lake, in Zhejiang Province, China. The utilized CASAS system has the operational frequency bands: the center frequency is 100 kHz and the band is 30 kHz. The length of the receiver array of CASAS is 1.2 m and the distance of each receiver is 2.5λ, where λ is the wavelength of center frequency. The main experimental CASAS system parameters are listed in Table 3.
The CASAS was mounted on the USV which was manufactured by Shanghai Marine Electronic Equipment Research Institute. The system can be shown in Figure 8a,b. The CASAS system can adjust the observation angle using the servo mechanism on the USV. The speed range of the USV is 0~3 kn. The Navigation devices on the USV include Real-Time Kinematic (RTK) Global Positioning System (GPS), Inertial Navigation System (INS), and Doppler Velocimeter (DVL). These navigation devices are beneficial for the platform motion calibration of CASAS. The transmit and receive array side of CASAS is perpendicular to the movement direction of USV during the trial. One of the main observation targets is shown in Figure 8c. It is a cube steel frame for which the size is 1.5 m × 1.5 m × 1.8 m, and there are several steel balls on each side of the steel cube which can be used to increase the target intensity.
The experimental results are shown in Figure 9, which contain the 2D slice imaging of the steel cube bottom, the reconstruction in the height direction at angle bin = 200, and the 3D imaging of steel cube. Comparing Figure 9a,b to Figure 8c, we can see that the 2D slice image has been reconstructed well, for the steel cube bottom, the steel cube side, and the ball can be seen clearly. Comparing Figure 9c to Figure 8c, we can see that the steel cube target has been reconstructed very well, and the 3D image is similar to a real steel cube. The bottom of the lake was also shown in Figure 9c. Therefore, the experimental results demonstrate the 3D imaging ability of the proposed imaging model and the sparse recovery algorithm.

5. Conclusions

Three-dimensional imaging is beneficial for verification and identification of underwater targets [43,44,45]. For the application of accurate 3D imaging for underwater targets, a novel 3D imaging process was proposed in this study. Due to the short wavelength of transmit waves, the sparse recovery method, which is based on sparse Bayesian learning, was applied to reconstruct scattering coefficients in the height direction with complex 2D images obtained by CSASA in each angle. After accomplishing the reconstructions of all angle bins, then, the high-resolution 2D imaging in horizontal slice was implemented by the Fourier slice theorem and the final 3D imaging was obtained by coherence stacking in the height direction. A numerical simulation was performed to verify the high-resolution imaging ability of the proposed imaging model and algorithm. Furthermore, the experiment had been conducted to verify the algorithm by a USV-mounted CASAS system in a lake. The experiment results verify the high-resolution imaging ability of the proposed imaging model and algorithm, which indicates that the USV-mounted CASAS system is suitable for 3D imaging of underwater targets.

Author Contributions

Conceptualization, S.Z.; methodology, S.Z. and W.F.; software, S.Z.; validation, S.Z., W.F. and X.D.; formal analysis, S.Z.; investigation, W.F.; resources, S.Z.; data curation, S.Z. and W.F.; writing—original draft preparation, S.Z.; writing—review and editing, S.Z.; visualization, X.D.; supervision, W.F.; project administration, W.F.; funding acquisition, W.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by national defense basic scientific research project, grant number JCKY2020206B034.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

Thanks to the reviewers for their comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hansen, R.E.; Callow, H.J.; Sæbø, T.O.; Synnes, S.A.V. Challenges in seafloor imaging and mapping with synthetic aperture sonar. IEEE Trans. Geosci. Remote Sens. 2011, 49, 3677–3687. [Google Scholar] [CrossRef]
  2. Hansen, R.E. Introduction to Synthetic Aperture Sonar, Sonar Systems; Kolev, N.Z., Ed.; Intech: Triangle Park, NC, USA, 2011; pp. 3–7. [Google Scholar]
  3. Hayes, M.P.; Gough, P.T. Synthetic Aperture Sonar: A Review of Current Status. IEEE J. Ocean. Eng. 2009, 34, 207–224. [Google Scholar] [CrossRef]
  4. Marston, T.M.; Kennedy, J.L. Volumetric Acoustic Imaging via Circular Multipass Aperture Synthesis. IEEE J. Ocean. Eng. 2016, 41, 852–867. [Google Scholar] [CrossRef]
  5. Hawkins, D.W. Synthetic Aperture Imaging Algorithms: With Application to Wideband Sonar. Ph.D. Thesis, University of Canterbury, Christchurch, New Zealand, 1996. [Google Scholar]
  6. Bülow, H.; Birk, A. Synthetic Aperture Sonar (SAS) without Navigation: Scan Registration as Basis for Near Field Synthetic Imaging in 2D. Sensors 2020, 20, 4440. [Google Scholar] [CrossRef] [PubMed]
  7. Griffiths, H.D.; Rafik, T.A.; Meng, Z.; Cowan, C.F.; Shafeeu, H.; Anthony, D.K. Interferometric synthetic aperture sonar for high-resolution 3D mapping of the seabed. Proc. Inst. Electr. Eng.—Radar Sonar Navig. 1997, 144, 96–103. [Google Scholar] [CrossRef] [Green Version]
  8. Sæbø, T.O.; Hansen, R.E.; Austeng, A. Synthetic aperture sonar tomography: A preliminary study. In Proceedings of the 10th European Conference on Synthetic Aperture Radar, Berlin, Germany, 3–5 June 2014. [Google Scholar]
  9. Jideani, J.; Wilkinson, W. Air-based synthetic aperture sonar tomography using compressive sensing. In Proceedings of the 2014 IEEE International Ultrasonics Symposium, Chicago, IL, USA, 3–6 September 2014. [Google Scholar] [CrossRef]
  10. Ferguson, B.G.; Wyber, R.J. Application of acoustic reflection tomography. J. Acoust. Soc. Am. 2005, 117, 2915–2928. [Google Scholar] [CrossRef]
  11. Ferguson, B.G.; Wyber, R.J. Generalized Framework for Real Aperture, Synthetic aperture, and Tomographic Sonar Imaging. IEEE J. Ocean. Eng. 2009, 34, 225–238. [Google Scholar] [CrossRef]
  12. Marston, T.; Kennedy, J.; Marston, P. Coherent and semi-coherent processing of limited-aperture circular synthetic aperture (CSAS) data. In Proceedings of the OCEANS’11 MTS/IEEE KONA, Waikoloa, HI, USA, 19–22 September 2011; pp. 1–6. [Google Scholar]
  13. Tran, H.; Nguyen, B.; Melino, R.; Wood, S. A Detailed Study of Sonar Tomographic Imaging. Maritime Operations Division Electronic Warfare and Radar Division: Research Report AR-015-647; 2013. Available online: http://dspace.dsto.defence.gov.au/dspace/bitstream/dsto/10336/1/DSTO-RR-0394%20PR.pdf (accessed on 6 April 2022).
  14. Callow, H.; Hansen, R.; Synnes, S.; Saebo, T. Circular synthetic aperture sonar without a beacon. In Proceedings of the 3rd International Conference & Exhibition on Underwater Acoustic Measurements, Nafplion, Greece, 21–26 June 2009. [Google Scholar]
  15. Fan, W.; Kong, H.; Zhang, X. Simulation of circular synthetic aperture sonar imaging using TriKirch scattering model and experimental validation. In Proceedings of the OCEANS 2017, Aberdeen, UK, 19–22 June 2017; pp. 128–131. [Google Scholar]
  16. Goldman Lee, W. Principles of CT: Multi-slice CT. J. Nucl. Med. Technol. 2008, 75, 57–68. [Google Scholar] [CrossRef] [Green Version]
  17. Javier, D.; Francisco, J.; Rodríguez, T. Exploring computed tomography in ichnological analysis of cores from modern marine sediments. Sci. Rep. 2020, 10, 47–69. [Google Scholar]
  18. Pan, Y.; Shi, D.; Wang, H.; Chen, T.; Cui, D.; Cheng, X.; Lu, Y. Automatic opportunistic osteoporosis screening using low-dose chest computed tomography scans obtained for lung cancer screening. Eur. Radiol. 2020, 30, 4107–4116. [Google Scholar] [CrossRef] [Green Version]
  19. Hui, L.; Peifeng, M.; Min, C.H. Basic principles, Key technique and applications of tomographic SAR imaging. J. Geomat. 2015, 40, 2–6. [Google Scholar]
  20. Liao, Z.; He, B.; Quan, X. Potential of texture from SAR tomographic images for forest aboveground biomass estimation. Int. J. Appl. Earth Obs. Geoinf. 2020, 88, 2–8. [Google Scholar] [CrossRef]
  21. Rambour, C.; Denis, L.; Tupin, F.; Oriot, H.; Huang, Y. Urban surface reconstruction in SAR tomography by graph-cuts. Comput. Vis. Image Underst. 2019, 188, 102791. [Google Scholar] [CrossRef]
  22. Matteo, N.; Michele, M.; Paola, R.; Pau, P. Coherence-based SAR tomography for spaceborne applications. Remote Sens. Environ. 2019, 225, 107–114. [Google Scholar]
  23. Bi, H.; Zhang, B.; Hong, W. Matrix completion-based distributed compressive sensing for polarimetric SAR tomography. Sci. China Inf. Sci. 2015, 58, 1–3. [Google Scholar] [CrossRef]
  24. Pailhas, Y.; Petillot, Y.; Mulgrew, B. Increasing circular synthetic aperture sonar resolution via adapted wave atoms deconvolution. J. Acoust. Soc. Am. 2017, 141, 2623–2632. [Google Scholar] [CrossRef] [Green Version]
  25. Jermaine, L.K.; Timothy, M.M. Multipass and Non-Concentric Target Circular Synthetic Aperture Sonar (CSAS). Final Report. SERDP Project Number: MR-2439. January 2018. Available online: https://apps.dtic.mil/sti/pdfs/AD1065501.pdf (accessed on 6 April 2022).
  26. Marston, T.; Kennedy, J. Spatially variant autofocus for circular synthetic aperture sonar. J. Acoust. Soc. Am. 2021, 149, 4078–4093. [Google Scholar] [CrossRef]
  27. Jing, M.; Xiaoling, Z.; Ling, P.; Jun, S. PSF analysis and ground test results of a novel circular array 3-D SAR system. J. Radars 2018, 7, 770–776. [Google Scholar]
  28. Zhang, R.; Cao, S. 3D Imaging Millimeter Wave Circular Synthetic Aperture Radar. Sensors 2017, 17, 1419. [Google Scholar] [CrossRef]
  29. Plotnick, D.S.; Marston, P.L.; Marston, T.M. Fast nearfield to farfield conversion algorithm for circular synthetic aperture sonar. J. Acoust. Soc. Am. Exp. Lett. 2014, 136, EL61–EL66. [Google Scholar] [CrossRef]
  30. Hao, J.; Li, J. Three-Dimensional Imaging of Terahertz Circular SAR with Sparse Linear Array. Sensors 2018, 18, 2477. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Xu, G.; Yang, L.; Bi, G.; Xing, M. Enhanced ISAR imaging and motion estimation with parametric and dynamic sparse bayesian learning. IEEE Trans. Comput. Imaging 2017, 3, 940–952. [Google Scholar] [CrossRef]
  32. Tang, V.H.; Bouzerdoum, A.; Phung, S.L.; Tivive, F.H.C. A sparse bayesian learning approach for through-wall radar imaging of stationary targets. IEEE Trans. Aerosp. Electron. Syst. 2017, 53, 2485–2501. [Google Scholar] [CrossRef]
  33. Zhang, Y. Theory of Compressive Sensing via l1-Minimization: A Non-RIP Analysis and Extensions. J. Oper. Res. Soc. China 2013, 1, 79–105. [Google Scholar] [CrossRef] [Green Version]
  34. Romberg, J. Imaging via compressive sampling [introduction to compressive sampling and recovery via convex programming]. IEEE Signal Proc. Mag. 2008, 25, 14–20. [Google Scholar] [CrossRef]
  35. Zhang, Z.; Rao, B.D. Sparse signal recovery with temporally correlated source vectors using sparse Bayesian learning. IEEE J. Sel. Top. Signal Process. 2011, 5, 912–926. [Google Scholar] [CrossRef] [Green Version]
  36. Fienup, J.R.; Miller, J.J. Abberation correction by maximizing generalized sharpness metrics. J. Opt. Soc. Am. A Opt. Image Sci. 2003, 20, 609–620. [Google Scholar] [CrossRef] [PubMed]
  37. Kolman, J. Image Reconstruction and Restoration Using Constrained Optimization Algorithms. Ph.D. Thesis, Purdue University, West Lafayette, IN, USA, August 1996. [Google Scholar]
  38. Fienup, J.R. Synthetic-aperture radar autofocus by maximizing sharpness. Opt. Lett. 2000, 25, 221–223. [Google Scholar] [CrossRef] [PubMed]
  39. Ash, J. An autofocus method for backprojection imagery in synthetic aperture radar. IEEE Geosci. Remote Sens. Lett. 2012, 9, 104–108. [Google Scholar] [CrossRef]
  40. Peng, H.; Ruan, Z.; Long, F.; Simpson, J.H.; Myers, E.W. V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets. Nat. Biotechnol. 2010, 28, 348–355. [Google Scholar] [CrossRef] [Green Version]
  41. Peng, H.; Bria, A.; Zhou, Z.; Iannello, G.; Long, F. Extensible visualization and analysis for multidimensional images using Vaa3D. Nat. Protocols. 2014, 9, 193–208. [Google Scholar] [CrossRef] [PubMed]
  42. Peng, H.; Tang, J.; Xiao, H.; Bria, A.; Zhou, J.; Butler, V.; Zhou, Z.; Gonzalez-Bellido, P.T.; Oh, S.W.; Chen, J.; et al. Virtual finger boosts three-dimensional imaging and microsurgery as well as terabyte volume image visualization and analysis. Nat. Commun. 2011, 5, 4342. [Google Scholar] [CrossRef] [PubMed]
  43. Murino, V.; Trucco, A. Three-dimensional image generation and processing in underwater acoustic vision. Proc. IEEE 2000, 88, 1903–1948. [Google Scholar] [CrossRef]
  44. Degel, C.; Fonfara, H.; Welsch, H.J.; Becker, F.J.; Hewener, H.; Fournelle, M.; Tretbar, S.H. 3D sonar system based on mills cross antenna configuration. In Proceedings of the IEEE/MTS Oceans, Sts. John’s, NL, Canada, 14–19 September 2014; pp. 1–6. [Google Scholar]
  45. Liu, X.; Zhou, F.; Zhou, H.; Tian, X.; Jiang, R.; Chen, Y. A low-complexity real-time 3-d sonar imaging system with a cross array. IEEE J. Ocean. Eng. 2016, 41, 262–273. [Google Scholar] [CrossRef]
Figure 1. The imaging geometry of circular array synthetic aperture sonar.
Figure 1. The imaging geometry of circular array synthetic aperture sonar.
Sensors 22 03797 g001
Figure 2. The datacube of circular array synthetic aperture sonar.
Figure 2. The datacube of circular array synthetic aperture sonar.
Sensors 22 03797 g002
Figure 3. The 3D imaging flowchart of circular array synthetic aperture sonar.
Figure 3. The 3D imaging flowchart of circular array synthetic aperture sonar.
Sensors 22 03797 g003
Figure 4. The 3D PSF of circular array synthetic aperture sonar. (a) Slice of CASAS 3D PSF in (0,0,0); (b) Slice of CASAS 3D PSF in (0,0,7); and (c) 3D PSF of CASAS.
Figure 4. The 3D PSF of circular array synthetic aperture sonar. (a) Slice of CASAS 3D PSF in (0,0,0); (b) Slice of CASAS 3D PSF in (0,0,7); and (c) 3D PSF of CASAS.
Sensors 22 03797 g004
Figure 5. The simulated 3D target of circular array synthetic aperture sonar.
Figure 5. The simulated 3D target of circular array synthetic aperture sonar.
Sensors 22 03797 g005
Figure 6. The image scene of circular array synthetic aperture sonar.
Figure 6. The image scene of circular array synthetic aperture sonar.
Sensors 22 03797 g006
Figure 7. The 3D imaging simulation results of circular array synthetic aperture sonar. (a) the reconstruction in the height direction at angle 15°; (b) the 2D imaging result of horizontal slice at height z = −4; and (c) the 3D imaging result of the simulated target.
Figure 7. The 3D imaging simulation results of circular array synthetic aperture sonar. (a) the reconstruction in the height direction at angle 15°; (b) the 2D imaging result of horizontal slice at height z = −4; and (c) the 3D imaging result of the simulated target.
Sensors 22 03797 g007
Figure 8. Experimental scenario and setup of circular array synthetic aperture sonar. (a) The schematic of CASAS installation in USV. It also shows the Navigation devices of USV, such as RTK GPS and INS. (b) The photo shows that the CASAS was installed in USV and the transmit and receive array side of CASAS perpendicular to the movement direction of USV during the trial. (c) The photo of the steel cube which was treated as experiment target. (d) The trajectory of USV in experiment which was recorded by GPS.
Figure 8. Experimental scenario and setup of circular array synthetic aperture sonar. (a) The schematic of CASAS installation in USV. It also shows the Navigation devices of USV, such as RTK GPS and INS. (b) The photo shows that the CASAS was installed in USV and the transmit and receive array side of CASAS perpendicular to the movement direction of USV during the trial. (c) The photo of the steel cube which was treated as experiment target. (d) The trajectory of USV in experiment which was recorded by GPS.
Sensors 22 03797 g008
Figure 9. The 3D imaging experimental results of CSAS for steel cube target. (a) The reconstruction in the height direction at angle bin = 200; (b) the 2D slice imaging result at steel cube bottom; and (c) the 3D imaging result of the steel cube. It also contains the bottom image of lake.
Figure 9. The 3D imaging experimental results of CSAS for steel cube target. (a) The reconstruction in the height direction at angle bin = 200; (b) the 2D slice imaging result at steel cube bottom; and (c) the 3D imaging result of the steel cube. It also contains the bottom image of lake.
Sensors 22 03797 g009
Table 1. CASAS system parameters for PSF.
Table 1. CASAS system parameters for PSF.
ParametersValues
Point coordinate(0,0,0)
Height of CASAS system8 m
CASAS system Radius20 m
Angle to Z-axis of CASAS10°
Equivalent sensors32
Center frequency100 kHz
Band30 kHz
SignalLFM
Pulse duration time40 ms
Pulse width2 ms
Table 2. CASAS system parameters for 3D imaging simulation.
Table 2. CASAS system parameters for 3D imaging simulation.
ParametersValues
3D target1 m × 1 m × 1 m (it consists of 116 scattering centers)
Z-axis coordinate of 3D target Bottom−4 m
Height of CASAS system4 m
CASAS system Radius20 m
Angle to Z-axis of CASAS10°
Equivalent sensors32
Center frequency100 kHz
Bandwidth30 kHz
SignalLFM
Pulse duration time40 ms
Pulse width2 ms
Angular sampling interval0.2°
Table 3. CASAS system parameters for experiment.
Table 3. CASAS system parameters for experiment.
ParametersValues
TargetSteel cube 1.5 m × 1.5 m × 1.8 m
Target layoutAt the bottom of lake
CASAS system Radius~25 m
Angle to Z-axis of CASAS10°
Equivalent sensors32
Center frequency100 kHz
Band30 kHz
Array length of CASAS1.2 m
Distance of receiver2.5λ
SignalLFM
Pulse duration time100 ms
Pulse width10 ms
Speed of USV<1.5 kn
Navigation devices of USVRTK GPS, INS, DVL
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zeng, S.; Fan, W.; Du, X. Three-Dimensional Imaging of Circular Array Synthetic Aperture Sonar for Unmanned Surface Vehicle. Sensors 2022, 22, 3797. https://doi.org/10.3390/s22103797

AMA Style

Zeng S, Fan W, Du X. Three-Dimensional Imaging of Circular Array Synthetic Aperture Sonar for Unmanned Surface Vehicle. Sensors. 2022; 22(10):3797. https://doi.org/10.3390/s22103797

Chicago/Turabian Style

Zeng, Sai, Wei Fan, and Xuanmin Du. 2022. "Three-Dimensional Imaging of Circular Array Synthetic Aperture Sonar for Unmanned Surface Vehicle" Sensors 22, no. 10: 3797. https://doi.org/10.3390/s22103797

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop