Next Article in Journal
A Method for Efficient Quality Control and Enhancement of Mobile Laser Scanning Data
Previous Article in Journal
VO-LVV—A Novel Urban Regional Living Vegetation Volume Quantitative Estimation Model Based on the Voxel Measurement Method and an Octree Data Structure
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A No-Reference Edge-Preservation Assessment Index for SAR Image Filters under a Bayesian Framework Based on the Ratio Gradient

1
School of Resources and Environmental Engineering, Anhui University, Hefei 230601, China
2
Engineering Center for Geographic Information of Anhui Province, Anhui University, Hefei 230601, China
3
Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei 230601, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(4), 856; https://doi.org/10.3390/rs14040856
Submission received: 20 December 2021 / Revised: 29 January 2022 / Accepted: 8 February 2022 / Published: 11 February 2022
(This article belongs to the Section Remote Sensing Image Processing)

Abstract

:
Denoising is an essential preprocessing step for most applications using synthetic aperture radar (SAR) images at different processing levels. Besides suppressing the noise, a good filter should also effectively preserve the image edge information. To quantitatively assess the edge-preservation performance of SAR filters, a number of indices have been investigated in the literature; however, most of them do not fully employ the statistical traits of the SAR image. In this paper, we review some of the typical edge-preservation assessment indices. A new referenceless index is then proposed. The ratio gradient is utilized to characterize the difference between two non-overlapping neighborhoods on opposite sides of each pixel in both the speckled and despeckled images. Based on these gradients and the statistical traits of the speckle, the proposed indicator is derived under a Bayesian framework. A series of experiments conducted with both simulated and real SAR datasets reveal that the proposed index shows good performances, in both robustness and consistency. For reproducibility, the source codes of the index and the testing datasets are provided.

Graphical Abstract

1. Introduction

It is well known that, as with most of the active imaging systems, speckle noise is a serious image quality degradation factor for SAR data, which hinders the subsequent applications [1]. As reviewed by Foucher et al. [2] and Ma et al. [3], to deal with the despeckling issue many algorithms have been studied in the last few decades. The wavelet based filters [4,5], variational methods [6,7,8], nonlocal means based filters [9,10], and deep learning based filters [11,12,13] are hot topics in the area of SAR image despeckling. In addition to a good performance in reducing the speckle in the homogeneous areas, a good SAR filter should also effectively preserve the image information. Normally, for SAR data, the image information includes three main parts [14]: (1) the image edge information; (2) the polarimetric or radiometric information; and (3) the high returns from strong scatterers. It is necessary to objectively evaluate the image information preservation capability when developing a filter. To this end, a number of quantitative assessment indices have been developed in an attempt to reveal the performance of a filter in one or more of the three aforementioned aspects.
Retaining image edges or textures when applying an SAR filter is important for many applications. In this paper, we focus on the topic of evaluating the edge-preservation capability (EPC) of single-polarization SAR filters. Normally, when we talk about the “single-polarization SAR filter” we often refer to a filter that only handles the despeckling problem of SAR amplitude or intensity (the square of amplitude) data in the cases that the SAR images with only one polarization channel (HH, VV, HV or VH) are available. This also means that, for single look complex (SLC) single-polarization SAR data, the noise in the phase part is not concerned and suppressed by these filters, which, instead, is concerned by an interferometric SAR filter [15,16]. Generally speaking, SAR image EPC assessment indicators can be divided into two types: (1) full-reference indices; and (2) no-reference indices. Compared with the no-reference ones, the full-reference indices are much easier to obtain. The full-reference approaches assume that, if the noise-free image is known, the evaluation can be executed by directly comparing the structural information of the reference with that of the despeckled image. However, the problem is that no noise-free real-world SAR image exists. One solution is to average multitemporal SAR images of a same area, which, however, needs a large number of images and has to ensure that there are no major changes between different time sequences. A more common solution is to resort to a clean digital image and exert the speckle noise to generate a simulated SAR image. Then, some of the commonly used indicators in the digital image processing area, such as the peak signal-to-noise ratio (PSNR) [17] and the structural similarity (SSIM) index [18], can be directly applied to assess SAR filters. However, the shortcoming is apparent: the traits of the optical image simulated data are different from real-world SAR data in many aspects, making the evaluation results unreliable.
Recently, differing from the traditional full-reference approaches, Di Martino et al. [14] proposed a framework for the simulation of speckled and clean SAR images relevant to canonical scenes, based on a SAR raw signal simulator. The simulator employs complete physical models for the radar sensed targets by considering the scattering traits and the radar operational mode. As a result, the generated data are more in line with real SAR data. However, it needs to be pointed out that this simulation framework can only generate images with simple scenes. The real-world SAR images often have complicated scenes and high data dynamics. Therefore, the full-reference indices developed in the aforementioned simulation framework may lose their significance when evaluating the despeckling performance on complicated real-world SAR data.
All in all, a robust no-reference index needs to be developed to more objectively assess the EPC of SAR filters, which is the main goal of this paper. In this study, we developed a ratio gradient based EPC assessment index derived under a Bayesian framework. Specifically, the ratio gradient is first utilized to characterize the difference (i.e., the edge information) between two non-overlapping neighborhoods on opposite sides of each pixel in both the speckled and despeckled images. Then, based on the gradient values and the statistical traits of the speckle, the indicator is derived by employing Bayesian theory.
The rest of this paper is organized as follows. A brief review of the existing SAR EPC evaluation indices is provided and the proposal is introduced in Section 2. Then, in Section 3, the quantitative evaluation results obtained on several datasets are shown to reveal the good performance of the proposed index. Finally, our conclusions are drawn in Section 4.

2. Method

2.1. Review of the Classical SAR EPC Assessment Indices

In this section, we review some of the classical SAR EPC assessment indices, which are listed in Table 1. We categorize the indices into two classes, based on the type of image the indices operate on, namely, despeckled image based ones and ratio image (the point-to-point ratio between the speckled and the filtered image) based ones.

2.1.1. Despeckled Image Based Indices

The main idea of many despeckled image based indices is to compare the edges detected in the despeckled image with those in the original (clean or speckled) image, to evaluate the loss of edges. Two typical indices are the figure of merit (FOM) [19] and the edge correlation (EC) [20].
(1) FOM: The FOM [19] is formulated as:
FOM = 1 max ( n d , n r ) i = 1 n d 1 1 + γ l i 2
where n d and n r are, respectively, the number of edge pixels detected in the despeckled image and the reference; l i denotes the Euclidean distance between the ith edge pixel in the despeckled image and its nearest edge pixel in the reference; and γ is a constant value, which is usually fixed as 1/9 in practice. A higher FOM value indicates a better edge-preservation result.
(2) EC: the EC is also known as the β index [20]. It evaluates a filter by inspecting the gradient correlations between the noise-free image and the filtered image, which is defined as:
β = Ψ ( Δ u Δ u ¯ , Δ u ^ Δ u ^ ¯ ) Ψ ( Δ u Δ u ¯ , Δ u Δ u ¯ ) Ψ ( Δ u ^ Δ u ^ ¯ , Δ u ^ Δ u ^ ¯ )
with the correlation function
Ψ ( A , B ) = i = 1 N A ( i ) B ( i )
where Δ denotes the gradient image obtained by the Canny detector [21]; N is the total pixel number of the image; u and u ^ are, respectively, the reference image and the filtered image; and Δ u ¯ and Δ u ^ ¯ are the average values of images Δ u and Δ u ^ . The EC index ranges between 0 and 1, with unity for ideal edge preservation.
A key point of the indices, such as FOM and EC, is that an edge detector needs to be deployed. That is to say, the evaluation accuracy is highly dependent on the effectiveness of the edge detector. However, in many cases, distinguishing the fine edges from the noise is a challenging task. To cope with this issue, indices that do not require an edge detector have been proposed. Two representatives are the edge-preservation degree based on the ratio of average (EPD-ROA) [22] and the despeckling evaluation index (DEI) [23].
(3) EPD-ROA: The EPD-ROA [22] is one of the most widely used EPC assessment indices. It is a refined version of the edge-preservation index introduced in [24] that considers the multiplicative trait of the speckle, which is defined as:
EPD-ROA = i = 1 N | u ^ 1 ( i ) / u ^ 2 ( i ) | / | I 1 ( i ) / I 2 ( i ) |
where I1(i) and I2(i) are two adjacent pixel values of the speckled image along a certain direction. The better the filter retains the edges, the higher the EPD-ROA value is.
(4) DEI: The DEI [23] is defined as the ratio between the standard deviation over a small neighborhood and that over a larger neighborhood in the filtered image, which is defined as:
DEI = 1 N i , j min | p i | < s , | q j | < s ( std ( W p , q m ) ) std ( W i , j s ) , m < s
where W p , q m denotes the window centered at pixel (p, q) roaming in a neighborhood no greater than s × s , which has the size of m × m pixels. The assumption is that, for a homogeneous image patch without structures, the numerator and the denominator will be very close. In theory, the DEI lies between 0 and 1, and a high value indicates a serious over-smoothing problem.

2.1.2. Ratio Image Based Indices

The speckle model in SAR images can be described as:
I = u n
where n is the noise component. For a filter that perfectly retains the edges, the ratio image between the speckled and filtered image should be the noise component. Hence, it has the appearance of pure speckle without any profiles of edges. This is the main idea behind the ratio image based indices. The despeckling structure loss (DSL) [25] and the β ratio [26] are two representatives.
(1) DSL: By considering the local correlation (LC) between the noise-free image and the ratio image, the DSL [25] is defined as:
DSL = LC ( u , r ) LC ( u , r best ) LC ( u , r worst ) LC ( u , r best )
with
LC ( u , r ) = m e a n { ( u i u ¯ i ( r i r ¯ i ) } m e a n { ( u i u ¯ i 2 } m e a n { ( r i r ¯ i ) 2 }
where i denotes any edge pixel detected in the reference image u; r is the ratio image; r best is the best ratio image, i.e., the ratio image of an ideal filter; and r worst is the worst ratio image obtained by multiplying the speckled data with a constant value, indicating that all the structures are filtered out. The range of the DSL value is between 0 and 1. Clearly, for the worst case, the value will be close to 1.
(2)   β ratio : In [26], Gomez et al. proposed to refine the β index [20] by replacing the reference image with the speckled image, the despeckled image with the ratio image, and the Canny edge detector by the ratio edge detector [27]:
β ratio = Ψ ( Δ I Δ I ¯ , Δ r Δ r ¯ ) Ψ ( Δ I Δ I ¯ , Δ I Δ I ¯ ) Ψ ( Δ r Δ r ¯ , Δ r Δ r ¯ )
Clearly, differing from the β index, β ratio is a no-reference index that takes into account the multiplicative trait of the speckle. The more geometric content that appears in the ratio image, the higher the β ratio value is.

2.2. Ratio Gradient Preservation Index

2.2.1. Motivation

It is well known that SAR intensity data can be modeled by a gamma distribution. However, from the review in Section 2, it was shown that most of the existing EPC assessment indices do not fully exploit the statistical traits of SAR data, which can make the evaluation results not robust or objective enough. In the following, we summarize some of the other drawbacks of the existing indices.
(1) Full-reference based indices are not the optimal choice for the evaluation of SAR filters since optical image simulated data are quite different from real SAR data.
(2) The evaluation results obtained by the edge detector based indices (no matter the detection is undertaken on the speckled or despeckled image) are often not robust, since a detection threshold often needs to be determined, which is nontrivial in most cases.
(3) The ratio image based indices were developed using the multiplicative trait of speckle. However, they are also not objective enough. The reason is that, unlike the noise in the raw speckled image, the noise in the ratio image cannot be simply regarded as following a certain statistical distribution. In such a case, distinguishing the fine texture from the noise or precisely measuring the gradient information is a difficult task.
In this paper, based on the above analyses, we present a new SAR EPC assessment indicator named the ratio gradient preservation index (RGPI). The proposed indicator does not require a clean reference image or an edge detector and, more importantly, can fully employ the statistical traits of SAR data.

2.2.2. The Ratio Gradient Preservation Index (RGPI)

The main idea behind the RGPI is to evaluate the gradient retention in the filtered image, given the gradient information obtained from the speckled image. The most commonly used gradient descriptor is the difference gradient, which is defined as the arithmetic difference between the two pixels contiguous to a given pixel along a certain direction. In the proposed index, we use the ratio gradient rather than the traditional difference gradient. This is because, as pointed out in [27], the radiometric distortion problem caused by a filter can significantly influence the values of the difference gradient; moreover, the ratio gradient is more suitable for the multiplicative nature of speckle noise.
Given the gradient information obtained from the speckled image, evaluation of the gradient retention in the filtered image can be regarded as solving the following conditional probability problem:
RGPI = p ( K = q | Q ) , Q 0 , +
where Q and q are, respectively, the ratio gradient images obtained from the speckled and the filtered data. K is the unknown parameter, i.e., the ratio gradient for the unobserved clean data. A larger RGPI value indicates a better edge-preservation result. In a Bayesian framework, without prior knowledge of p (K = q) and p(Q), the probability p   ( K = q   | Q ) is proportional to p   ( Q | K = q ) . In addition, the event Q can be considered as being uniform in its definition domain. Therefore, the RGPI is deduced as:
RGPI p ( Q | K = q ) f ( Q | K = q )
where f ( ) denotes the conditional probability density function (PDF).
For an image with N pixels and under an independence assumption for each pixel, the RGPI can be decomposed into the following product:
RGPI = i = 1 N f ( Q ( i ) | K ( i ) = q ( i ) )
Naturally, taking the logarithm of (12) and considering the pixel number of the image, the RGPI is rewritten as:
RGPI = 1 N i = 1 N ln f ( Q ( i ) | K ( i ) = q ( i ) )
It can be seen from (13) that the only question for the RGPI is how to calculate f ( Q ( i ) | K ( i ) = q ( i ) ) . Thanks to the study by Touzi et al. [27], we know that, for SAR intensity data, the PDF of the ratio gradient between two pixels is given by:
f ( Q ( i ) | K ( i ) = q ( i ) ) = Γ ( 2 L ) Γ ( L ) 2 q ( i ) L ( Q ( i ) + q ( i ) ) 2 L Q ( i ) L 1
where Γ ( ) denotes the gamma function, and L is the nominal number of looks (NNL) of the speckled image. It should be pointed out that, in theory, for the above derivation, equivalent number of looks (ENL) may be a better choice than NNL, since the noise level in the speckled image varies from pixel to pixel to a little degree. However, it is still an open and challenging issue to precisely estimate ENL, although many methods have been studied [28]; besides, the computational speed of the proposed index could be significantly slowed down if we calculate the ENL values.

2.2.3. Refinement of the RGPI

There are three issues that need to be further considered when applying the RGPI in practice.
(1) The first issue is to calculate the ratio gradient using the mean values of two square patches contiguous to a given pixel, instead of using the values of two single pixels. As revealed in [27], as the size of the patch increases, the ratio gradient becomes less sensitive to the speckle noise. In contrast, the small patch or pixel based ratio gradient has the advantage of being able to detect micro-edges. To achieve a balance between weakening the influence of speckle and reducing the speckle correlations, we set the size of the patch as 3 × 3 in this study. Accordingly, as per the derivation in [27], the PDF in (14) becomes:
f ( Q ( i ) | K ( i ) = q ( i ) ) = Γ ( 2 M L ) Γ ( M L ) 2 q ( i ) M L ( Q ( i ) + q ( i ) ) 2 M L Q ( i ) M L 1
where M = 9 is the pixel number of a patch.
(2) The second issue is the direction when calculating the ratio gradient. To ensure the robustness of the proposed RGPI, the gradient information along several different directions should be considered. In this study, we chose the usual four directions (i.e., the vertical direction, the horizontal direction, and two different oblique directions (Figure 1)). The proposed index then becomes:
RGPI = 1 4 N i = 1 N j ln f Q j ( i ) | K j ( i ) = q j ( i )
where denotes the set of four directions. Since the index involves division operation, to avoid the infinity problem, we use a simple strategy: for a certain pixel, if any pixel with zero value is found in the two opposite patches along a certain direction, the corresponding ratio gradient will not be considered.
(3) Last but not least, taking into account the homogeneity of the local area is also necessary. The formulation in (16) uses all the pixels to assess the EPC of a filter. However, pixels from homogeneous areas often outnumber the ones located around edges, and tend to dominate this quantity. In particular, as reported in some studies [3], some SAR filters can introduce artifacts (i.e., “false edges”) in homogeneous areas, although most of the edges of the original image are effectively retained. In such a circumstance, the performance of the RGPI could be degraded. To solve this problem, we integrate a weight for each pixel into the RGPI, leading to:
RGPI = 1 4 N i = 1 N j W ( i ) ln f Q j ( i ) | K j ( i ) = q j ( i )
where the weight W ( i ) is calculated based on the homogeneity of the local area centered at pixel i. In the proposed index, we utilize the local homogeneity descriptor employed in the classical Lee filter [29]:
W ( i ) = var ( I s u b ( i ) ) I ¯ s u b ( i ) 2 / L ( 1 + 1 / L ) var ( I s u b ( i ) )
where var I s u b i and I ¯ s u b i are, respectively, the variance and mean of a local area in the speckled image. The weight is between 0 and 1, and the more homogeneous the local area is, the closer the value is to 0. W plays the role of weakening the impact of the pixels located in homogeneous areas. As shown in Figure 1, since the size of a patch in the ratio gradient operator is 3 × 3 , the size of the local area used to calculate W(i) is set as 7 × 7 .

2.2.4. Spatial Correlations of Speckle

An important issue should be pointed out here that the derivation of the proposed index is based on the assumption that the speckle component at each pixel of the SAR image is independently and identically distributed (IID assumption). However, during the SAR image formation, the raw data are usually oversampled and spectrally weighted to avoid Gibbs effects around point targets. In particular, during the SAR focusing operation, the matched filters are used. The above processes can introduce a spatial correlation of the noise, which may impact the validity of IID assumption [30]. Therefore, in theory, an initial decorrelation step is better to be taken on the speckled image, before applying the proposed IID assumption based index. Recently, Dalsasso et al. [31] reviewed the existing approaches that handle spatial correlations of speckle. These decorrelation approaches can be mainly divided into two categories, namely, the pre-processing approaches and post-processing approaches. The pre-processing approaches are performed by the data providers, which require the knowledge of sensor’s parameter and are sensor-specific. Clearly, the pre-processing approaches are often not feasible before using the proposed index. Instead, the post-processing approaches are better choices. Among them, the downsampling strategy and the method presented by Arienzo et al. [30] are two typical approaches. The downsampling strategy can directly reduce the spatial correlations of speckle by scarifying the resolution of SAR images. In [30], a blind decorrelation method is proposed, of which the main idea is to estimate and invert the point spread function by performing least square optimization. However, this blind decorrelation method can only handle the decorrelation issue of SLC SAR data, which limits its applicability before calculating the RGPI values
As aforementioned, to weaken the influence of speckle, the ratio gradient in the RGPI is calculated using the mean values of two square patches contiguous to a given pixel, instead of using the values of two single pixels. This strategy can be regarded as a downsampling or multi-look approach before calculating the ratio gradients, which is, therefore, a simple and fast means to reduce the speckle correlations before calculating the RGPI. To validate the robustness of RGPI in the case of correlated speckle, or to say, the reliability of the PDFs given by (14) and (15), we used the single-look simulated homogeneous image provided in [14], in which the speckle is spatial correlated (the link to get the image is provided in Appendix A). Then, we calculated the ratio gradients using single pixel values and mean values of 3 × 3 image patch, respectively, and obtained the corresponding empirical Cumulative Distribution Function (CDF). Besides, by (14) and (15), it is easy to derive the corresponding theoretical CDF when L = 1. Figure 2 displays the theoretical and empirical CDF. Apparently, in the case of pixel based ratio gradient, the two curves generally show good agreement. Moreover, in the case of patch based ratio gradient, the two curves become very close to each other, which means that taking the mean value of patch can help to compensate the inaccuracy of the proposed index to a large degree when the speckle is spatial correlated. The issue of spatial correlations of speckle is further discussed in the experiment section.

3. Result

In this section, to inspect the performance of the proposed index, we describe the quantitative experiments undertaken on both simulated and real SAR datasets. The EPD-ROA [22] and DEI [23] were chosen to be compared with the RGPI, since they are all no-reference indices and do not need an edge detector. For reproducibility, the link to obtain the source codes of the RGPI which were implemented by MATLAB and the testing datasets are provided in the Appendix A. The computational cost of RGPI consist of two main parts: the calculation of the ratio gradient PDFs (see [12]) and the calculation of weights (see [18]). For an image with N pixels, assuming the computational burden of one PDF calculation step to be O1(1) and one weight calculation step to be O2 (1), the total computational complexity of RGPI is O1(4N) + O2 (N). For a computer with an i7-6500U CPU and an 8 GB RAM, the processing time on an image with 500 × 500 pixels is about 23.5 s.

3.1. Experiments with Simulated SAR Data

In this part, to inspect the feasibility of RGPI on the evaluation of preserving the edge profiles, we use the simulated “building” image (Figure 3) provided by Di Martino et al. [14], with an isolated building placed on a homogeneous background. The results of three state-of-the-art filters, namely, the speckle reduction anisotropic diffusion (SRAD) filter [32], the probabilistic patch-based (PPB) filter [9] and the 3-D block matching-based SAR (SAR-BM3D) filter [10], were chosen to be evaluated by the indices (the links to get the simulated image and the source codes of the PPB and SAR-BM3D filter are provided in the Appendix A). From Figure 3, we can see that, compared with the SRAD filter, the PPB and SAR-BM3D filter perform much better in retaining the edges for the single-look speckled building images. To further inspect the EPC of the different filter, the range profile of the building of each filtered image compared with the clean reference is displayed in Figure 4, which clearly shows that the SAR-BM3D filter better retains the profile of the building than the PPB filter and the SRAD filter. The RGPI and DEI values listed in Table 2 are in agreement with Figure 3 and Figure 4. However, the EPD-ROA values disobey the observation that the SAR-BM3D filter performs better than the PPB filter; in addition, the values are very close to zero, due to the fact that the EPD-ROA is computed over all pixels and the pixels from homogeneous areas significantly outnumber the ones located around edges.
In theory, for a certain filter, the edges of an image can be better retained as the amount of noise decreases. In Table 2, we also list the assessment values when L = 2 and L = 4. We can see that the evaluation results obtained by the three indices all obey the above principle. However, as observed for the case of L = 1, the EPD-ROA values in the cases of L = 2 and L = 4 still do not precisely reflect the real state, which is that the SAR-BM3D filter better retains the edges than the PPB filter.
Since the RGPI is derived based on IID assumption, it is necessary to further inspect its validity on more images with correlated speckle. To this end, we used the clean “building” image provided in [14] and generated the speckle correlated single-look images by the approach presented in [30]. In this simulation process, the choice of parameter α which determines the degree of spectral smoothness is crucial. The lower the α is, the higher the level of spatial correlation that the SAR image has. For most commercial SAR sensors, the α value is between 0.6 and 0.7. The RGPI values for the filtered images with different α values are listed in Table 3; in addition, the pixel based and patch based RGPI values are also listed to investigate the necessity of using patch based ratio gradient. (1) In theory, since all of the three filters are developed based on IID assumption, the performances of these filters will be degraded when the image has a higher level of noise correlation. The RGPI values in Table 3 well reflect this trend. (2) In most cases, for a given α value, the RGPI values well reflect the facts that the SAR-BM3D filter better preserves the edges than the PPB filter and the PPB filter is better than the SRAD filter. The only exception is observed in the case of the highest correlation, i.e., α = 0.6, in which the pixel based RGPI value of SAR-BM3D is a little lower than that of PPB. The reason for this is that the performances of these two filters on this image are close and, meanwhile, the strong noise level and high noise correlation impact the judgment of pixel based RGPI. This group of experiments reveals that the RGPI are generally robust for correlated speckle, especially when the patch based ratio gradients are used.

3.2. Experiments with Real SAR Datasets

The quantitative assessment values of the EPD-ROA, DEI and RGPI indices on three real-world SAR datasets are reported in this part. The first data was acquired by the L-band ALOS system (Figure 5a), which is single-look HH polarization data. For an image quality measurement, the need for consistency is one of the most important requirements. The usual way to test the consistency is to compare the assessment values obtained for a given filter using different filtering parameters. In theory, for an over-smoothed result, the EPD-ROA and RGPI will provide low values and the DEI will provide a high value, if they follow the principle of consistency. When applying the PPB filter, the iteration times (T) is one of the key parameters. In Table 4, we list the EPC evaluation results for the images filtered by the PPB filter when T = 4, T = 3, and T = 2. To help the reader to better judge the EPC of PPB and SAR-BM3D, we display the corresponding ratio images. Clearly, from the filtered images and ratio images, we can see that the over-smoothing problem of the PPB filter is gradually relieved as the iteration times decrease. The values of the three indices are all consistent with this conclusion.
For the purpose of comparison, the evaluation values for the SRAD and SAR-BM3D filtered image are also listed. The profile of the river in the SRAD ratio image is quite notable, meaning that the SRAD filter performs poorly in preserving the edges of this image, and all the indices are in agreement with the observation. We can also see that the profile of the river is more distinguishable in the ratio image of the SAR-BM3D filtered data, indicating the better EPC of the PPB filter with T = 2 on this image. The values of the RGPI are in line with the above observation. Meanwhile, the EPD-ROA and DEI indices fail to reflect the real state.
The second real SAR image was acquired by the TerraSAR-X satellite in Ruhr, Germany (Figure 6a), which is single-look VV polarization data. The PPB filter and SAR-BM3D filter were both developed employing the idea of nonlocal means, and hence the size of the image patch (S) is an important parameter when applying these two filters. To confirm the consistency of the indices, we tuned the size of the patch in each filter to be 7 × 7 and 5 × 5 , respectively, and we list the quantitative assessment values for the four filtered images in Table 5.
As pointed out in some studies [33,34], for a certain nonlocal means based filter, the image edges will be better preserved if small patches are used. This conclusion can be easily drawn by comparing Figure 6b,d. The values obtained by the three indices also allow this conclusion. In the meantime, it can be also seen from Figure 6 that, given the size of the patch, the SAR-BM3D filter always outperforms the PPB filter on edge preservation. The values obtained by the three indices once again follow the above observation. Furthermore, if we inspect Figure 6c,d, we can draw the conclusion that the SAR-BM3D filter with S = 7 × 7 better retains the edges than the PPB filter with S = 5 × 5. However, the values of the EPD-ROA and DEI violate the real state. From the aforementioned observation, we can again confirm the robustness and consistency of the proposed index.
To further support the above conclusions, a line was taken across a lake of the image (marked out by a red line in Figure 6a), and the intensity values of this line after despeckling by the different filters are plotted in Figure 7. The signals returned from the outside areas of the lake, which are dominated by double scattering and volume scattering, are much higher than those from the water. This means that the pixels with high value in Figure 7 are generally from the outside areas of the lake. Especially, the edges and strong point targets are more likely in the location of those pixels with notable higher value than the nearby pixels. From Figure 7, we can observe that, in the locations of the pixels with very high value, the original values are closer to the despeckled results by the SAR-BM3D filter (no matter S = 7 × 7, or S = 5 × 5) than to the PPB filter in most cases, indicating the better EPC of the SAR-BM3D filter. The above conclusion has an agreement with the RGPI values listed in Table 5.
To more comprehensively evaluate the performance of RGPI, the assessment result on an AirSAR dataset acquired in Kyoto, Japan, are reported. This four-look dataset have two different polarization channels (HH and HV) and two different frequencies (C band and L band). From Figure 8, we can observe that the SAR-BM3D filter outperforms the SRAD and PPB filter in retaining image details (especially for the forest area) for all the cases. The RGPI values listed in Table 6 are again in good agreement with the visual inspection. In addition, we found an interesting phenomenon that, for a certain filter, the values of the four filtered images are generally close to each other, indicating the satisfactory robustness of RGPI.

4. Conclusions

The edges in SAR images should be effectively retained when applying a filter, which is important for the target detection task. To help the user to better judge the performance of the different SAR filters in edge preservation, developing a quantitative assessment index is a meaningful task. The common drawback of most existing EPC assessment indices is that they are often simply extended from the indices developed for digital images, and they do not fully exploit the statistical traits of SAR data. This brings in the problems that the results are often not robust and consistent enough, when the existing indices are used to assess filters on different images (i.e., images with simple or complicated scenes, images with different level of speckle).
In this paper, we have presented a no-reference edge-preservation assessment index for single-polarization SAR filters. In the proposed index, the ratio gradient of two patches contiguous to each pixel in the speckled and despeckled images is utilized to reflect the edge information. Then, considering the conditional probability density function of the ratio gradient and under a Bayesian framework, the edge retention in the filtered image is evaluated. The results obtained with both simulated and real SAR images support the conclusion that, the proposed index is robust and reliable for images acquired in different frequencies and different polarization states, and for images with simple scenes or complicated scenes. For reproducibility, the source codes of the index and the testing datasets are provided.
There are also two issues that should be noticed when applying the proposed index. First, the original derivation of RGPI is based on the IID assumption, while the speckle in the real SAR data is spatially correlated. Although the patched based ratio gradients are used and the experiments in this paper show its feasibility in addressing the correlation problem, it would be better to care for the assessment result if they use RGPI when the original image is highly spatially correlated and with a high level of noise. Second, due to the use of patch based gradient ratios, some very narrow structures may hard to detect. In most cases, the above problem can be neglected, since the final purpose of RGPI is to rank the filters’ general performances by inspecting the preservation of ratio gradient for all pixels in an image. That is to say, the general performance of RGPI will not be significantly degraded if a limited number of fine structures are not well detected by the ratio gradients. However, in the extreme case that too many very narrow structures exhibit in the original image, the situation might be worse.

Author Contributions

Conceptualization, X.M. and P.W.; methodology, X.M.; software, X.M. and H.H.; validation, X.M. and H.H.; formal analysis, X.M.; investigation, X.M. and P.W.; resources, P.W.; data curation, H.H.; writing—original draft preparation, X.M.; writing—review and editing, H.H. and P.W.; visualization, X.M.; supervision, X.M.; project administration, X.M.; funding acquisition, X.M. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China (No. 41701390), by the Open Research Fund Project of CMA·Henan Key Laboratory of Agrometeorological Support and Applied Technique (No. AMF202204) and by the Hefei Municipal Natural Science Foundation (No. 2021041).

Data Availability Statement

The authors confirm that the data supporting the findings of this study are cited within the article, and some codes are available in Table A1.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. The links to some source codes and testing datasets used in this paper.
Table A1. The links to some source codes and testing datasets used in this paper.
DescriptionLink
The source codes of the proposed indexhttps://github.com/ahuyzx/SAR_RGPI, accessed on 15 October 2021
The simulated SAR datasetshttp://www.grip.unina.it/web-download.html, accessed on 24 April 2016 (Reference [14])
The real SAR datasetshttps://github.com/ahuyzx/SAR_RGPI, accessed on 15 October 2021
The source codes of PPB filterhttps://www.charles-deledalle.fr/pages/software.php, accessed on 23 August 2019 (Reference [9])
The source codes of SAR-BM3D filterhttp://www.grip.unina.it/web-download.html, accessed on 9 March 2015 (Reference [10])

References

  1. Lee, J.S.; Pottier, E. Polarimetric Radar Imaging: From Basics to Applications; CRC Press: Boca Raton, FL, USA, 2009. [Google Scholar]
  2. Foucher, S.; López-Martínez, C. Analysis, evaluation, and comparison of polarimetric SAR speckle filtering techniques. IEEE Trans. Image Process. 2014, 23, 1751–1764. [Google Scholar] [CrossRef] [PubMed]
  3. Ma, X.; Wu, P.; Wu, Y.; Shen, H. A review on recent developments in fully polarimetric SAR image despeckling. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2018, 11, 743–758. [Google Scholar] [CrossRef]
  4. Achim, A.; Kuruoglu, E.E.; Zerubia, L. SAR image filtering based on the heavy-tailed Rayleigh model. IEEE Trans. Image Process. 2006, 15, 2686–2693. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Argenti, F.; Bianchi, T.; Alparone, L. Multiresolution MAP despeckling of SAR images based on locally adaptive generalized gaussian PDF modeling. IEEE Trans. Image Process. 2006, 15, 3385–3399. [Google Scholar] [CrossRef]
  6. Denis, L.; Tupin, F.; Darbon, J.; Sigelle, M. SAR image regularization with fast approximate discrete minimization. IEEE Trans. Image Process. 2009, 18, 1588–1600. [Google Scholar] [CrossRef] [Green Version]
  7. Yun, S.; Woo, H. A new multiplicative denoising variational model based on the root transformation. IEEE Trans. Image Process. 2012, 21, 2523–2533. [Google Scholar]
  8. Chierchia, G.; Pustelnik, N.; Popescu, B.P.; Pesquet, J. A nonlocal structure tensor-based approach for multicomponent image recovery problems. IEEE Trans. Image Process. 2014, 23, 5531–5544. [Google Scholar] [CrossRef] [Green Version]
  9. Deledalle, C.A.; Denis, L.; Tupin, F. Iterative weighted maximum likelihood denoising with probabilistic patch-based weights. IEEE Trans. Image Process. 2009, 18, 2661–2672. [Google Scholar] [CrossRef] [Green Version]
  10. Parrilli, S.; Poderico, M.; Angelino, C.V.; Verdoliva, L. A nonlocal SAR image denoising algorithm based on LLMMSE wavelet shrinkage. IEEE Trans. Geosci. Remote Sens. 2012, 50, 606–616. [Google Scholar] [CrossRef]
  11. Wang, P.; Zhang, H.; Patel, V.M. SAR image despeckling using a convolutional neural network. IEEE Signal Processing Lett. 2017, 24, 1763–1767. [Google Scholar] [CrossRef] [Green Version]
  12. Zhang, Q.; Yuan, Q.; Li, J.; Yang, Z.; Ma, X. Learning a dilated residual network for SAR image despeckling. Remote Sens. 2018, 10, 196. [Google Scholar] [CrossRef] [Green Version]
  13. Ma, X.; Wang, C.; Yin, Z.; Wu, P. SAR image despeckling by noisy reference-based deep learning method. IEEE Trans. Geosci. Remote Sens. 2020, 58, 8807–8818. [Google Scholar] [CrossRef]
  14. Martino, G.D.; Poderico, M.; Poggi, G.; Riccio, D.; Verdoliva, L. Benchmarking framework for SAR despeckling. IEEE Trans. Geosci. Remote Sens. 2014, 52, 1596–1615. [Google Scholar] [CrossRef]
  15. Deledalle, C.; Denis, L.; Tupin, F.; Reigber, A.; Jäger, M. NL-SAR: A unified Non-Local framework for resolution-preserving (Pol)(In)SAR denoising. IEEE Trans. Geosci. Remote Sens. 2015, 53, 2021–2038. [Google Scholar] [CrossRef] [Green Version]
  16. Sica, F.; Cozzolino, D.; Zhu, X.; Verdoliva, L.; Poggi, G. InSAR-BM3D: A Nonlocal Filter for SAR Interferometric Phase Restoration. IEEE Trans. Geosci. Remote Sens. 2018, 56, 3456–3467. [Google Scholar] [CrossRef] [Green Version]
  17. Zhao, W.; Deledalle, C.A.; Denis, L.; Maitre, H.; Nicolas, J.M.; Tupin, F. Ratio-based multi-temporal SAR images denoising: RABASAR. IEEE Trans. Geosci. Remote Sens. 2019, 57, 3552–3565. [Google Scholar] [CrossRef] [Green Version]
  18. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
  19. Pratt, W.K. Digital Image Processing; Interscience: New York, NY, USA, 1978. [Google Scholar]
  20. Sattar, F.; Floreby, L.; Salomonsson, G.; Lovstrom, B. Image enhancement based on a nonlinear multiscale method. IEEE Trans. Image Process. 1997, 6, 888–895. [Google Scholar] [CrossRef]
  21. Canny, J. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 1986, PAMI-8, 679–698. [Google Scholar] [CrossRef]
  22. Feng, H.; Hou, B.; Gong, M. SAR image despeckling based on local homogeneous-region segmentation by using pixel-relativity measurement. IEEE Trans. Geosci. Remote Sens. 2011, 49, 2724–2737. [Google Scholar] [CrossRef]
  23. Zhao, Y.; Liu, J.; Zhang, B.; Hong, W.; Wu, Y. Adaptive total variation regularization based SAR image despeckling and despeckling evaluation index. IEEE Trans. Geosci. Remote Sens. 2015, 53, 2765–2774. [Google Scholar] [CrossRef] [Green Version]
  24. Lee, J.S.; Jurkevich, I.; Dewaele, P.; Wambacq, P.; Oosterlinck, A. Speckle filtering of synthetic aperture radar images: A review. Remote Sens. Rev. 1994, 8, 313–340. [Google Scholar] [CrossRef]
  25. Yang, X.; Wu, K.; Tang, Y. A new metric for measuring structure-preserving capability of despeckling of SAR images. ISPRS J. Photogramm. Remote Sens. 2014, 94, 143–159. [Google Scholar] [CrossRef]
  26. Gomez, L.; Buemi, M.E.; Jacobo-Berlles, J.C.; Mejail, M.E. A new image quality index for objectively evaluating despeckling filtering in SAR images. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2016, 9, 1297–1307. [Google Scholar] [CrossRef]
  27. Touzi, R.; Lopes, A.; Bousquet, P. A statistical and geometrical edge detector for SAR images. IEEE Trans. Geosci. Remote Sens. 1988, 26, 764–773. [Google Scholar] [CrossRef]
  28. Anfinsen, S.N.; Doulgeris, A.P.; Eltoft, T. Estimation of the equivalent number of looks in polarimetric synthetic aperture radar imagery. IEEE Trans. Geosci. Remote Sens. 2009, 47, 3795–3809. [Google Scholar] [CrossRef]
  29. Lee, J.S. Refined filtering of image noise using local statistics. Comput. Graph. Image Process. 1981, 15, 380–389. [Google Scholar] [CrossRef]
  30. Arienzo, A.; Argenti, F.; Alparone, L.; Gherardelli, M. Accurate despeckling and estimation of polarimetric features by means of a spatial decorrelation of the noise in complex PolSAR data. Remote Sens. 2020, 12, 331. [Google Scholar] [CrossRef] [Green Version]
  31. Dalsasso, E.; Denis, L.; Tupin, F. How to handle spatial correlations in SAR despeckling? Resampling strategies and deep learning approaches. In Proceedings of the 13th European Conference on Synthetic Aperture Radar, Online, 29 March–1 April 2021. [Google Scholar]
  32. Yu, Y.; Acton, S.T. Speckle reducing anisotropic diffusion. IEEE Trans. Geosci. Remote Sens. 2002, 11, 1260–1270. [Google Scholar]
  33. Buades, A.; Coll, B.; Morel, J.M. A non-local algorithm for image denoising. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, 20–25 June 2005; Voloume 2; pp. 60–65. [Google Scholar]
  34. Ma, X.; Shen, H.; Zhao, X.; Zhang, L. SAR image despeckling by the use of variational methods with adaptive nonlocal functionals. IEEE Trans. Geosci. Remote Sens. 2016, 54, 3421–3434. [Google Scholar] [CrossRef]
Figure 1. The gradient directions used in the RGPI.
Figure 1. The gradient directions used in the RGPI.
Remotesensing 14 00856 g001
Figure 2. Theoretical and empirical CDF of the ratio gradient on single-look speckled homogeneous image. (a) The pixel based ratio gradient; (b) the patch based ratio gradient.
Figure 2. Theoretical and empirical CDF of the ratio gradient on single-look speckled homogeneous image. (a) The pixel based ratio gradient; (b) the patch based ratio gradient.
Remotesensing 14 00856 g002
Figure 3. Filtering results for the “building” image. (a) The clean image. (b) The single-look speckled image. (ce) are, respectively, the SRAD, PPB and SAR-BM3D filtered image.
Figure 3. Filtering results for the “building” image. (a) The clean image. (b) The single-look speckled image. (ce) are, respectively, the SRAD, PPB and SAR-BM3D filtered image.
Remotesensing 14 00856 g003
Figure 4. Range profiles of the building obtained by the three filters (red) compared with the clean reference (black). (a)The SRAD filter. (b) The PPB filter. (c) The SAR-BM3D filter.
Figure 4. Range profiles of the building obtained by the three filters (red) compared with the clean reference (black). (a)The SRAD filter. (b) The PPB filter. (c) The SAR-BM3D filter.
Remotesensing 14 00856 g004
Figure 5. Filtering results for the ALOS Image. (a) The speckled image. (b) The SRAD filtered image. (ce) are, respectively, the PPB filtered image when T = 4, T = 3, and T = 2. (f) The SAR-BM3D filtered image. (gk) are the corresponding ratio images of (bf).
Figure 5. Filtering results for the ALOS Image. (a) The speckled image. (b) The SRAD filtered image. (ce) are, respectively, the PPB filtered image when T = 4, T = 3, and T = 2. (f) The SAR-BM3D filtered image. (gk) are the corresponding ratio images of (bf).
Remotesensing 14 00856 g005
Figure 6. Filtering results for the TerraSAR-X Image. (a) The speckled image. (b,c) are, respectively, the PPB and SAR-BM3D filtered image with S = 7 × 7 . (d,e) are, respectively, the PPB and SAR-BM3D filtered image with S = 5 × 5 . (fi) are the corresponding ratio images of (be).
Figure 6. Filtering results for the TerraSAR-X Image. (a) The speckled image. (b,c) are, respectively, the PPB and SAR-BM3D filtered image with S = 7 × 7 . (d,e) are, respectively, the PPB and SAR-BM3D filtered image with S = 5 × 5 . (fi) are the corresponding ratio images of (be).
Remotesensing 14 00856 g006
Figure 7. The profiles of a line across the lake in the TerraSAR-X image after despeckling by the different filters.
Figure 7. The profiles of a line across the lake in the TerraSAR-X image after despeckling by the different filters.
Remotesensing 14 00856 g007
Figure 8. Filtering results for the AirSAR dataset (first row: speckled images; second row: SRAD filtered images; third row: PPB filtered images; fourth row: SAR-BM3D filtered images). (a) HH polarization of C band. (b) HV polarization of C band. (c) HH polarization of L band. (d) HV polarization of L band.
Figure 8. Filtering results for the AirSAR dataset (first row: speckled images; second row: SRAD filtered images; third row: PPB filtered images; fourth row: SAR-BM3D filtered images). (a) HH polarization of C band. (b) HV polarization of C band. (c) HH polarization of L band. (d) HV polarization of L band.
Remotesensing 14 00856 g008
Table 1. A list of some classical EDGE-preservation indices.
Table 1. A list of some classical EDGE-preservation indices.
Need
Ratio Image
Need
Reference
Need
Edge Detector
Range
of Values
FOMNOYESYES ( 0 , 1 ] ; 1 is best
ECNOYESYES [ 0 , 1 ] ; 1 is best
EPD-ROANONONO ( 0 , 1 ] ; 1 is best
DEINONONO ( 0 , 1 ] ; 0 is best
DSLYESYESYES [ 0 , 1 ] ; 0 is best
β r a t i o YESNOYES [ 0 , 1 ] ; 0 is best
Table 2. EPC assessment results for the simulated data.
Table 2. EPC assessment results for the simulated data.
L = 1L = 2L = 4
EPD-ROASRAD0.0210.0340.077
PPB0.0420.0750.159
SAR-BM3D0.0370.0530.144
DEISRAD0.7700.6950.543
PPB0.6720.5530.399
SAR-BM3D0.6110.5220.371
RGPISRAD−0.823−0.442−0.300
PPB−0.390−0.230−0.110
SAR-BM3D−0.308−0.218−0.102
Table 3. RGPI values for the simulated data with different degree of speckle correlation.
Table 3. RGPI values for the simulated data with different degree of speckle correlation.
Pixel Based RGPIPatch Based RGPI
α = 0.7 SRAD−3.166−0.711
PPB−2.212−0.339
SAR-BM3D−2.001−0.282
α = 0.65 SRAD−3.435−0.784
PPB−2.410−0.350
SAR-BM3D−2.300−0.332
α = 0.6 SRAD−3.568−0.801
PPB−2.566−0.423
SAR-BM3D−2.603−0.411
Table 4. EPC assessment results for the ALOS image.
Table 4. EPC assessment results for the ALOS image.
SRADPPB (T = 4)PPB (T = 3)PPB (T = 2)SAR-BM3D
EPD-ROA0.6760.8890.8900.8940.896
DEI0.7620.7250.6100.3030.287
RGPI−0.217−0.116−0.096−0.065−0.066
Table 5. EPC assessment results for the TerraSAR-X image.
Table 5. EPC assessment results for the TerraSAR-X image.
PPB
(S = 7 × 7)
SAR-BM3D
(S = 7 × 7)
PPB
(S = 5 × 5)
SAR-BM3D
(S = 5 × 5)
EPD-ROA0.6170.6790.6820.692
DEI0.7310.7000.6060.524
RGPI−0.532−0.276−0.417−0.267
Table 6. RGPI values for the AirSAR dataset.
Table 6. RGPI values for the AirSAR dataset.
SRADPPBSAR-BM3D
HH polarization (C band)−0.088−0.0550.270
HV polarization (C band)−0.078−0.0480.260
HH polarization (L band)−0.143−0.0170.307
HV polarization (L band)−0.1440.0290.303
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ma, X.; Hu, H.; Wu, P. A No-Reference Edge-Preservation Assessment Index for SAR Image Filters under a Bayesian Framework Based on the Ratio Gradient. Remote Sens. 2022, 14, 856. https://doi.org/10.3390/rs14040856

AMA Style

Ma X, Hu H, Wu P. A No-Reference Edge-Preservation Assessment Index for SAR Image Filters under a Bayesian Framework Based on the Ratio Gradient. Remote Sensing. 2022; 14(4):856. https://doi.org/10.3390/rs14040856

Chicago/Turabian Style

Ma, Xiaoshuang, Hongming Hu, and Penghai Wu. 2022. "A No-Reference Edge-Preservation Assessment Index for SAR Image Filters under a Bayesian Framework Based on the Ratio Gradient" Remote Sensing 14, no. 4: 856. https://doi.org/10.3390/rs14040856

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop