1. Introduction
Compared to other widely used sensors such as Lidar and camera, automotive radar—typically referring to millimeter wave (MMW) radar mounted on vehicles—offers significant advantages in terms of low cost price and robustness even in adverse weather conditions or on dim nights. However, the limited azimuth resolution of automotive radar remains a notable drawback that impacts its overall performance [
1]. To address the challenge of improving angular/azimuth resolution (AR) in side-looking automotive radar, synthetic aperture radar (SAR) technology has been increasingly explored and tested for automotive applications in recent years [
2,
3]. By mounting SAR on a moving vehicle platform, an equivalent long aperture of the radar array is achieved through coherent processing of signals collected during the vehicle’s motion. Automotive SAR images provide high resolution and visual clarity, making them particularly suitable for side-looking radar applications such as parking information perception [
4], lane boundary detection [
5], and automatic parking [
6]. Unlike traditional SAR systems, which often focus on specific types of targets, automotive SAR is designed to handle more complex scenarios and diverse targets, including those with radar cross section (RCS) distributed over a wide dynamic range [
7]. In addition to the fact that automotive SAR reconstruction exhibits higher dynamic range RCS, another particularity of automotive SAR compared to conventional airborne SAR is its significantly smaller grazing angle in the geometric configuration. This ultimately results in generally sparser images [
8].
Matched filter (MF) algorithms, such as the range migration algorithm (RMA), are commonly employed to synthesize SAR images in automotive applications [
9]. Automotive SAR images generated via MF often exhibit some limitations, including noisy backgrounds, sidelobe artifacts, and limited resolution. Regularization methods enable the integration of prior assumptions about radar signals into imaging models during radar signal processing. A common approach is
regularization, which minimizes signal energy by penalizing large values, leading to estimates with many small coefficients. However, this assumption is often unsuitable for radar imaging, where sparsity—a small number of large coefficients—is typically more appropriate [
10,
11]. Sparse regularization methods have shown promise in enhancing image quality by adding sparsity of signals as prior knowledge [
12,
13,
14]. A significant challenge in applying sparse signal processing techniques to automotive SAR imaging lies in the coupling of azimuth and range phase histories within the SAR geometry. Without decoupling these components, direct application of sparse methods is impractical [
13]. Although an azimuth-range decoupling method has been proposed for automotive SAR sparse imaging from echo data [
8], its computational complexity remains a limiting factor for its practical implementation.
To efficiently obtain sparse-enhanced SAR images, a sparse SAR imaging method based on complex images, modeled as unweighted
regularization, was introduced in [
15]. This method has been proven to effectively improve the quality of SAR images. However, when applied to scenarios with RCS distributed over a wide dynamic range, the conventional unweighted
regularization approach exhibits several limitations, including insufficient sidelobe suppression, amplitude distortion, and inconsistent super-resolution performance. These issues have been highlighted in existing literature, such as [
16]. Automotive SAR scenarios, characterized by diverse targets with varying RCS, are a prime example of such wide dynamic range cases [
7]. When employing the unweighted
regularization model for automotive SAR restoration, a critical limitation arises: the flexibility of
regularization is only confined to the selection of regularization parameters. However, selecting a single parameter suitable for the entire SAR image with a wide RCS dynamic range is difficult. Parameters chosen to preserve the energy of weak scatterers’ mainlobes are often too small to effectively suppress sidelobes for strong scatterers, while parameters optimized for strong scatterers tend to overlook weak scatterers. Even when a trade-off parameter—such as the so-called “optimal parameter” discussed in [
17,
18,
19]—is selected, weak scatterers may be missed, and strong scatterers may still exhibit residual sidelobe artifacts. In summary, the simple unweighted
regularization model is not applicable for automotive SAR applications.
A regularization penalty term with greater flexibility is essential to address the limitations of conventional methods. Existing penalty terms can be broadly categorized into two frameworks: reweighting frameworks and penalty modifying frameworks. Reweighting frameworks, as exemplified in [
20,
21,
22,
23], assign distinct weights to individual elements of the signal. The primary advantage of this approach lies in its ability to flexibly apply varying degrees of
constraints to different signal components, enabling tailored regularization based on the specific characteristics of each element. On the other hand, penalty modifying frameworks, as exemplified in [
24,
25,
26], replace the
constraint with alternative forms of regularization. The primary advantage of this framework is its potential to recover signals more accurately, particularly when the modified penalty term perfectly reflects the statistical properties of the signal. Both frameworks provide distinct advantages, and their applicability is determined by the specific requirements and characteristics of the signal under consideration. Both frameworks offer unique advantages, and the choice between them depends on the specific requirements of processing and characteristics of the signal being analyzed. The issue is that when facing highly dynamic RCS scenarios in automotive SAR, neither the reweighting framework nor the penalty modifying framework can individually achieve distortion-free and consistent enhancement results simultaneously.
In this paper, we propose a novel reweighted regularization method, termed multi-segment-reweighted (MSR) regularization, for automotive SAR image restoration. MSR constructs its penalty term by integrating penalty terms from both reweighting and penalty modifying frameworks [
20,
21,
24,
25,
26]. First, through an innovative weighting scheme, MSR localizes the global scattering point enhancement problem to the mainlobe scale, effectively mitigating the influence of sidelobes. The weighting scheme is inspired by methodologies in [
20,
22,
23] and assigns weights proportional to adaptive filtering outputs that suppress sidelobes [
27]. This localization ensures that MSR achieves consistent enhancement capability, independent on RCS variations. Then, MSR employs multi-segment regularization to constrain the amplitude within the mainlobes, preserving the characteristics of the original response. This approach leads to the introduction of a novel thresholding function, termed Thinner Response Undistorted THresholding (TRUTH), which is different from conventional thresholding functions in sparse signal processing [
25,
26,
28,
29,
30]. The multi-segment strategy underlying this approach can be traced back to foundational works in [
31,
32]. By integrating these strategies, MSR provides an innovative solution for automotive SAR image enhancement, effectively addressing critical challenges such as sidelobe suppression, undistorted amplitude preservation, and consistent super-resolution performance.
The main contributions of this paper are summarized as follows:
A sparse SAR image-enhancement method based on complex images is introduced for automotive applications. The limitations of the conventional unweighted regularization method are revealed, particularly in scenarios with radar RCS distributed over a wide dynamic range. The inconsistent resolution enhancement and amplitude bias of the conventional unweighted regularization method are quantitatively analyzed.
Existing frameworks for constructing more flexible penalty terms, reweighting and penalty modifying frameworks, are reviewed. A novel approach combining these two frameworks is proposed to leverage the advantages of both.
A novel image-enhancement method, termed MSR regularization, is proposed for automotive SAR. MSR constructs its penalty term by integrating penalty terms from both reweighting and penalty modifying frameworks. On one hand, a novel weighting scheme is introduced, which localizes the global scattering point enhancement problem to the mainlobe scale, effectively suppressing sidelobes. On the other hand, a multi-segment regularization strategy is employed to eliminate distortion of the enhanced results. Correspondingly, a new thresholding function, the TRUTH function, is introduced as a fast solver for multi-segment regularization problem.
An iterative algorithm for enhancing automotive SAR images using MSR is presented. Real data experiments are conducted to validate the feasibility and effectiveness of the proposed method.
The remainder of this paper is organized as follows.
Section 2 formulates the problem of automotive SAR image enhancement via regularization and introduces related works as a reference.
Section 3 presents the proposed MSR method and its iterative algorithm.
Section 4 showcases the results of real data experiments. Finally,
Section 5 concludes the paper.
2. Problem Formulation and Related Works
2.1. Problem Formulation and Regularization Method
The degradation model of the low-quality SAR image can be expressed as follows:
where
is the known low-quality SAR image generated via MF,
is the high-quality image to be restored with enhanced features, and
represents the difference between
and
. Here,
,
, and
all share the same pixel dimensions of
, where
and
denote the number of pixels in the azimuth and range directions, respectively.
The regularization-based method reconstructs high-quality signals by minimizing the sum of the signal adaptation error and the prior error. This can be formulated as follows:
where
denotes the Frobenius norm of the matrix,
denotes the regularization parameter, and
denotes the regularization term or penalty term, which is constructed based on prior knowledge of the signal characteristics. The first term ensures fidelity to the observed data
, while the second term incorporates prior information to regularize the solution and enhance desired features.
The sparsity of signals is a widely utilized prior knowledge in numerous signal processing applications. Assuming that
is spatially sparse,
can be reconstructed by solving the following
regularization optimization problem:
where
denotes the
-norm of
, which counts the number of non-zero elements in
(
).
However, the
regularization optimization problem is a nondeterministic polynomial-time hard (NP-hard) problem, which is almost impossible to be resolved. A relaxation strategy can be adopted, and the equivalent solution to the
regularization can be approximately estimated by solving the following
regularization optimization problem:
where
denotes the
-norm of
, its value equal to the sum of absolute values of all elements in
(
).
The
regularization optimization problem is also known as the basis pursuit denoising (BPDN) problem, which can be resolved by existing optimization algorithms, such as Soft thresholding. The Soft thresholding estimation for image pixel
can be expressed as follows:
where
denotes the positive part of a real number,
equals
x for
or 0 for
, and
denotes the sign function.
2.2. Limitations of Regularization Method for SAR Image Enhancement
In the case with wide dynamic RCS, the amplitudes of are assumed to span a large interval, such that .
It is difficult to select an appropriate parameter for whole SAR image. If a large parameter
is selected, let
denote the support set of
,
. Let
denote the complement set of
. Some weak scatterers located at
are removed in the reconstruction. If a small parameter
is selected to keep all scatterers maintained, however, small parameter
weakens constraints of sparse regularization term. As for most elements of
, their amplitude are far greater than
,
. Their reconstruction can be approximatively expressed as follows:
The approximation means that most elements of the SAR image are almost not restored, which is unacceptable as well.
In addition, the resolution of scatterers is enhanced inconsistently versus their amplitude. The point spread function (PSF) of ideal SAR images generated via the MF can be approximated as a bi-dimensional sinc function. Suppose there are a total of
K point targets in the scenario, and let the amplitude of the
k-th point target be denoted as
. The response of a scatterer with amplitude
after the
regularization estimator tends to be sharpened. By fitting the sinc function with a quadratic function
, the 3 dB mainlobe width of the estimated response can be simply calculated as follows:
where
represents the theoretical resolution of the system. The formula illustrates that weaker scatterers, characterized by smaller amplitudes, exhibit finer local responses when estimated via
regularization. As a result, the apparent resolution of weaker targets appears higher. However, this inconsistent sharpening also implies non-recoverable distortion and energy loss in the local response, which can compromise the accuracy and reliability of the reconstructed image.
The expectation of estimated amplitude can be separately expressed as follows:
where
denotes the expectation function.
This indicates that the amplitudes of the scatterers are systematically underestimated. Unfortunately, the amplitude bias is nonlinear with respect to the true amplitude, which reduces the quantization accuracy of the SAR image. The statistical characteristics of the target’s RCS may be altered, leading to potential distortion of responses.
In summary, when applied to scenarios with RCS distributed over a wide dynamic range, the unweighted regularization method results in SAR images with several limitations: insufficient sidelobe suppression, amplitude distortion, and inconsistent super-resolution performance.
2.3. Related Works About Reweighted Regularization
General linear observations can be described in matrix form as follows:
where
denotes the vector of observation data,
denotes the signal vector to be estimated, and
denotes the measurement matrix or observation matrix.
Conventional unweighted
regularization method for recovery of sparse signal can be achieved by solving the optimal solution of the penalized least square optimization problem as follows:
Using the
penalty function to approximate the
penalty function is not always the optimal choice. For example, a log-sum penalty function has been demonstrated to offer superior approximation capabilities. The
penalty function,
penalty function, and log-sum penalty function for a single variable
t can be respectively represented as follows:
where
denotes a small positive constant.
An abridged general view illustrating the difference between the
and the
penalty terms is shown in
Figure 1. The figure also demonstrates that the
penalty function is more accurately approximated by the log-sum penalty terms than by the
one [
20]. This highlights the superior ability of the log-sum penalty function for sparse signal recovery.
When the log-sum penalty function is used in the recovery of sparse signals, the corresponding optimization problem can be formulated as follows:
A strategy with weights inversely proportional to the true signal magnitude is proposed in [
20]. After applying the weighting, the problem in Equation (
12) can be equivalently solved by addressing the following
regularization optimization problem:
where
is a small positive constant, and
denotes the weight of
.
A similar log-sum family penalty function is adopted for SAR sidelobe suppression in [
33]. In order to facilitate the comparison, only its one-dimensional simplified form is represented here, as follows:
This log-sum penalty function excels in sidelobe suppression and mainlobe preservation. Similar to the equivalence between Equations (
12) and (
13), the problem in Equation (
14) can also be equivalently transformed into a reweighted
regularization (RL1) optimization problem:
Another framework for weighting schemes is introduced in the adaptive lasso technique [
34]. The adaptive lasso addresses the following reweighted
regularization problem:
where
is a positive constant.
The above-mentioned weighting schemes, their equivalent penalty problems, and their related adaptive lasso forms are summarized in
Table 1. This table also includes several other commonly used existing weighting schemes for reference.
The aforementioned weighting schemes are based on basic operations involving signal amplitude. In contrast, another category of methods incorporates image convolution operations. For instance, Zhang et al. [
22] propose a novel convolutional reweighted scheme, where weights are assigned inversely proportional to the outputs of a smooth filtering process.
where
is a small positive constant,
denotes a filter kernel smoothing the signal,
denotes the convolution operation between
and
.
The convolutional reweighted scheme is capable of simultaneously achieving sparse signal recovery and region enhancement. For ease of comparison with other weighting schemes in subsequent discussions, we designate this convolutional reweighted scheme as “Weighting Scheme 7 (WS7)”.
2.4. Related Works About Modified Penalty Term
By minimizing
norm of
, one can obtain the least squares error
. The least squares estimation
can be regarded equivalently as
. The penalized least square cost function can be expressed as follows:
where
denotes the transformed observation vector,
denotes the reconstructed signal of least square method, and
denotes the penalty functions, which are allowed to depend on parameters
.
The analytical form first introduced in [
21] provides a component-wise form for regularization. When the penalty functions for all coefficients are variable and depend on parameters
, the term
can be denoted by
. Then, the component-wise form regularization can be expressed as follows:
When the penalty term is determined, thresholding methods can be employed to reconstruct the signal. For example,
can be expressed in the form of a discontinuous penalty function, such as the following:
where
is a regularization parameter set containing only one element. The solution to the discontinuous penalty function in Equation (
20) takes the form of the Hard thresholding function [
28,
35]. The Hard thresholding function can be expressed as follows:
For another example,
in
norm regularization is presented as the product of regularization parameter and absolute value of signal:
Its solution takes the form of Soft thresholding function [
29,
36], expressed as follows:
The Hard and Soft thresholding functions are widely used in sparse signal processing. A visualization of these two functions is shown in
Figure 2. Each thresholding function has its own advantages and disadvantages: The Hard thresholding function preserves the amplitude of signal components above the threshold without bias, but it can introduce higher estimation error and is often highly sensitive to noise and threshold selection, leading to potential instability in sparse signal recovery. The Soft thresholding function provides a more stable and continuous estimation of the signal, and it generally performs better for overall signal estimation, but it introduces amplitude bias, which can distort the true amplitudes of the recovered signal.
If a constant exponential operation is applied to the amplitude in Equation (
22), the penalty function
becomes more generalized, corresponding to
regularization. This can be expressed as follows:
where
makes the penalty term still retain sparse constraint capability. Among all
cases, the
is especially noteworthy for its excellent and non-excessive sparse constraint performance [
24].
Xu et al. [
30] propose a fast thresholding solver, the Half thresholding function, for
norm optimization problem. The Half thresholding function can be expressed as follows:
The Half provides a smoother transition than the Hard while introducing less bias than the Soft, as illustrated in
Figure 3a.
Similar to the Half thresholding function, non-negative Garrote is another compromise solution [
37]. The non-negative Garrote, recorded as Garrote+, can be expressed as follows:
The Garrote+ thresholding function lacks a model foundation, so we will not discuss it here in further detail. One may naturally consider the composite scheme of Equations (
19) and (
22) by segmenting and piecing segments together:
Its solution takes the form of a mixture of the Hard and the Soft [
26], abbreviated as Mix thresholding function, shown in
Figure 3b. It can be expressed as follows:
The minimax-concave (MC) penalty is a transitional method upgraded on the basis of the simple composite scheme. The MC penalty term uses double regularization parameters, where
,
.
Its solution takes the form of mixture of the Hard thresholding function and the Soft one as well, but with a transitional slope as shown in
Figure 3c [
25]. The transition version mixture is named as the semi-Soft or the Firm, which can be expressed as follows:
Smoothly clipped absolute deviation (SCAD) penalty can be regarded as another transitional method. The SCAD penalty term uses double regularization parameters as well, and uses the build transitional penalty term even more delicately, as follows:
where
.
Unlike MC penalty, SCAD penalty has continuous derivatives [
21], expressed as follows:
Its solution also takes the form of mixture of the Hard thresholding function and the Soft one but with a more delicate transitional slope as shown in
Figure 3d. The thresholding function for the SCAD penalty can be expressed as follows:
2.5. Summary of Related Works
Existing penalty terms can be divided into two categories: reweighting framework and penalty modifying framework. There are connections and differences between these two.
Connections between these two frameworks reveal that some reweighting frameworks and penalty modifying frameworks are equivalent, as listed in
Table 1. The modified forms of penalty functions can inspire the development of new weighting schemes. For instance, even the most primitive weighting scheme was inspired by the log-sum penalty [
20].
Differences between these two frameworks lie in their approaches to modifying the model, their respective advantages, and their solving methods: The reweighting framework directly assigns different weights to each element of the signal. It flexibly applies varying degrees of constraints to different components of the signal, enabling adaptive regularization. And its solution process is similar to solving an unweighted regularization problem, except that weights are updated iteratively and multiplied by the signal components. The penalty modifying framework replaces the constraint with alternative forms of penalty terms. It tends to recover signals more accurately when the modified penalty term aligns well with the statistical characteristics of the signal. And its solution is typically expressed as a thresholding function that depends on the specific form of the penalty term.
These differences highlight the complementary advantages of the two frameworks. Reweighting frameworks excel in adaptability and flexibility, while penalty modifying frameworks offer improved accuracy when the penalty term is well-matched to the signal’s properties. Combining insights from both frameworks can lead to more robust and effective regularization techniques for sparse signal recovery.
3. Multi-Segment-Reweighted Regularization and Iteration Algorithm
3.1. A Combination Framework
In the previous section, the reweighting framework and penalty modifying framework were reviewed as approaches to constructing more flexible penalty terms. In this paper, we aim to develop a combined framework that integrates the advantages of both frameworks.
According to the reweighted
regularization model,
can be reconstructed in the reweighting framework by solving the following optimization problem:
where
denotes the weights matrix, and ⊙ denotes the Hadamard product of matrices.
According to the modified penalty term model,
can be reconstructed in the penalty modifying framework by solving the following optimization problem:
where
denotes the penalty term selected specially for SAR image enhancement applications.
Combining the above two equations, one can build a combination framework. Then,
can be reconstructed in the combined framework by solving the following optimization problem:
A novel image-enhancement method named MSR for automotive SAR is proposed. On the one hand, a novel weighting scheme used in MSR is indicated. The novel weighting scheme localizes the global scattering point enhancement problem to the mainlobe scale, effectively suppressing sidelobes. On the other hand, a multi-segment regularization strategy is adopted to remove distortion of enhanced results. Correspondingly, a novel thresholding function TRUTH is revealed. Details of the novel weighting scheme and the multi-segment regularization strategy are revealed in the next two subsections separately.
3.2. Weighting Scheme for Consistent Enhancement
In [
20], the weights were inversely proportional to the true signal magnitude, so that the parts of the signal with different amplitudes are normalized. This kind of weighting scheme is suitable for signal processing applications where the unit response is approximately an impulse function. As for accurate SAR applications, the unit response at the local scale cannot be regarded as an impulse function anymore. The mainlobe of the unit response is widened, and the sidelobes appear to leak the energy of the response. Therefore, we suggest an amplitude normalization weighting scheme such that the weight for image pixel
can be expressed as follows:
where
denotes the local peak amplitude of the lobe where the pixel
is located. Let the entire weight matrix be denoted as
.
Although the above weights can normalize mainlobes of responses, unfortunately, the sidelobes are also normalized simultaneously, which is revealed in
Figure 4b. Therefore, we suggest an extra weight to suppress sidelobes as follows:
where
denotes a bi-dimensional filter kernel suppressing sidelobes; the weighted result of
in Equation (
39) is revealed in
Figure 4c.
Basic
can take the values calculated in [
27]. In cases of high sampling rate and fine image grid,
exhibit pixel size of
, where
and
are integer part of resolution to grid ratio,
,
.
is with only a few nonzero coeffience which can be adaptively calculated pixel by pixel:
Comprehensively, we suggest a novel weighting scheme as follows:
where
is a small constant introduced to provide stability; the weighted result of
in Equation (
41) is revealed in
Figure 4d. Now, weights in Equation (
41) can normalize mainlobes of responses and suppress the sidelobes simultaneously.
3.3. Multi-Segment Regularization
Inspired by the penalty function with continuous derivatives in [
21], we propose a penalty function with approximately continuous derivatives:
where
is index of
P regularization parameters
, (
),
is a parameter adjusting the super-resolution factor of the result, whose value satisfies
, and
and
denote the response function of the mainlobe and its inverse function. In SAR application,
usually presents or approximates the form of a sinc function.
The solution of Equation (
42) also takes multi-segment form. Examples can be found in
Figure 5. Since the thresholding function is dedicated to enhancing lobes into thinner response without distortion, we name it as Thinner Response Undistorted THresholding (TRUTH). The TRUTH function can be expressed as follows:
If the interval between P points is fixed, such as are selected at equal intervals, then the threshold function can have a fixed form. The main parameters that affect the thresholding function are P and .
P determines the number of segments, and the larger the
P, the more refined the model becomes, resulting in a thresholding function that better fits the smooth solution. For example, in a fixed task, we fix
, such as
, and examine the variation of the thresholding function versus
P.
Figure 5 shows examples of
. It can be observed that as
P increases, the threshold function of the step sample becomes closer to a smooth thresholding function that is independent of the value of
P. This smooth thresholding function can be expressed as follows:
is a task dependent parameter, and the larger its value, the higher the super-resolution factor required to be improved. Naturally, the larger
value, the further the thresholding function deviates from the diagonal.
Figure 6 shows examples of
.
3.4. Iteration Algorithm
We propose an iterative algorithm that alternates between estimating penalized signal and updating the weights, which is similar to the iterative algorithm in [
20]. As for a general problem in Equation (
37), the main steps of the iterative algorithm are listed as follows:
Set the iteration count k to zero and initialize ;
Update the weights from according to the designed weighting scheme;
Solve the reweighted regularization minimization problem:
Terminate algorithm when update of converges or when k attains maximum number of iterations. Otherwise, k plus one and go to step 2.
As for the specific problem of our MSR regularization with weighting scheme in Equation (
41) and penalty satisfying Equation (
42), the main steps of the iterative algorithm are listed in Algorithm 1.
The details of Algorithm 1 are explained as follows: The TRUTH thresholding function is built in advance, so that the corresponding thresholding operation can be implemented in practice through a lookup table. The local peak amplitude of the lobe can be obtained by continuous detecting maximum value among neighborhoods element by element.
Algorithm 1 Iteration algorithm for enhancement of automotive SAR image via MSR. |
Input: RMA recovered SAR image . Initial: Model parameter , Update step size , Convergent tolerance , Iteration count , Maximum iterative steps , Thresholding function , Initial resorted image . while and do- 1:
Update iterative index: . - 2:
Calculate the difference: . - 3:
Update resorted image with the difference: . - 4:
Calculate the bi-dimensional filter kernel and update the weights: . - 5:
Threshold the temporary result element by element: . - 6:
Calculate normalized updated residuals:
end while Output: Restored SAR image . |
3.5. Discussion on the Proposed Algorithm
Firstly, the convergence of the proposed algorithm needs to be investigated. The impact of weighting on convergence is disregarded, as the primary focus lies in proving the convergence with respect to the TRUTH thresholding function. Qualitatively speaking, assuming the proposed algorithm possesses a convergent value, the magnitude of each pixel in the resulting image converging via the TRUTH thresholding function would be bounded between a Soft thresholding function and a Hard thresholding function. The result of a single threshold iteration satisfies the following constraint relationship:
The
-th iteration result satisfies the following recurrence relationship:
Given the convergence properties of both the Soft thresholding function and the Hard one, we can readily conclude that the results obtained by the proposed TRUTH thresholding function are bounded.
Consider that each iteration of the proposed thresholding algorithm can be regarded as monotonically decreasing the image amplitude:
Combining the two characteristics of boundedness and monotonic decrease, the convergence of the proposed iteration algorithm can thus be deduced.
Secondly, the computational complexity and memory cost of the proposed algorithm need to be investigated. Considering that SAR image-enhancement methods are post-processing steps based on MF imaging, the computational overhead of the coarse MF imaging must also be taken into account.
Sparse enhancement imaging with raw SAR echoes is computationally more intensive than sparse image enhancement directly based on SAR image [
15]. The RMA-based decouple method is an efficient approach for sparse imaging using SAR echo data [
8]. The computational complexity for the RMA-based decouple method can be expressed as follows:
where
and
denote range and azimuth sample numbers, respectively.
denotes the number of iterations required for algorithm convergence. Further,
denotes a constant associated with Stolt interpolation in the RMA.
In comparison, the sparse imaging approach that combines MF imaging with sparse image enhancement based on SAR image requires significantly lower computational complexity. If the matched filtering employs the RMA and the sparse image enhancement adopts the conventional unweighted
regularization, the overall computational complexity can be expressed as follows:
where
denotes a constant associated with thresholding operation.
If the matched filtering employs the RMA and the sparse image enhancement adopts the MSR regularization proposed in this paper, the overall computational complexity can be expressed as follows:
where
denotes a constant associated with SVA operation for each image pixel.
is slightly larger than
, while both
and
are significantly smaller than
, differing about two orders of magnitude.
As for memory cost, the MSR regularization proposed in this paper requires additional size to store the weighting coefficient matrix during each iteration compared to the unweighted regularization.
In summary, the proposed algorithm also adopts the computationally efficient framework of sparse image enhancement directly based on SAR image. Although it requires higher computational complexity and memory cost compared to conventional unweighted regularization, these additional overheads are considered justified to achieve undistorted and consistent enhancement.
5. Discussion and Future Trends
The motivation behind our proposed MSR regularization method is to harness the combined advantages of the two penalty frameworks. To achieve the solution via the MSR regularization model, an iteration algorithm was proposed, analyzed, and proven to be convergent. To validate the feasibility of our proposed MSR regularization method, we evaluated it and compared it with other algorithms. As we supposed, the MSR regularization method successfully achieved the combined advantages as its design. For practical automotive application and further enhanced performance, we speculate on future trends based on the proposed MSR regularization method.
Firstly, real-time processing in automotive applications needs to be further investigated. We believe that the proposed method still needs to be further simplified and accelerated. On the workstation, the execution time of the algorithm proposed in this paper, along with that of the two reference algorithms, is shown in
Table 5. The execution times validate the computational complexity analysis in
Section 3.5.
Potential algorithmic acceleration strategies we may consider in the future include, but are not limited to, variable step sizes and parallel computing. The sparse enhancement algorithm has currently been verified to be hardware-implementable, though only in low-speed automotive applications such as assisted parking. With future algorithmic acceleration, the sparse augmentation algorithm is expected to be deployed in more applications.
Secondly, The proposed algorithm shows potential for further development into a deep learning-based SAR image-enhancement method. As an interpretable sparse constraint, each iteration of the proposed algorithm can naturally serve as a stage in an unfolding network for SAR image enhancement. The resulting deep learning-based SAR image-enhancement method is expected to inherit the undistorted and consistent performance advantages from our proposed method.
Thirdly, further research is needed to determine if and how the proposed method requires adaptation for broader application scenarios. These application scenarios may include moving target imaging (MTI), squint imaging, and multi-channel imaging.
6. Conclusions
In this paper, a novel image-enhancement method, termed MSR regularization, is proposed for automotive SAR applications. The MSR method constructs its penalty term by combining the strengths of both reweighting and penalty modifying frameworks. On one hand, a novel weighting scheme is introduced, which localizes the global scattering point enhancement problem to the mainlobe scale, effectively suppressing sidelobes. On the other hand, a multi-segment regularization strategy is employed to eliminate distortion in the enhanced results. Correspondingly, a new thresholding function, Thinner Response Undistorted THresholding (TRUTH), is proposed. An iterative algorithm for enhancing automotive SAR images using MSR is also presented.
Real data experiments demonstrate the feasibility and effectiveness of the proposed method. The results show that MSR outperforms conventional unweighted regularization and existing reweighted regularization methods in simultaneously suppressing sidelobes and preserving weak contour points of the target. Furthermore, the proposed multi-segment regularization and its corresponding TRUTH function are proven to restore automotive SAR images with significantly less distortion compared to existing penalty terms and thresholding functions. Finally, the consistent enhancement capability of the MSR method is validated, highlighting its robustness and reliability in handling diverse automotive SAR scenarios.
Future trends in sparse imaging of automotive SAR are discussed as guidance for our future research directions.