Next Article in Journal
High-Sensitivity Ultrasonic Guided Wave Monitoring of Pipe Defects Using Adaptive Principal Component Analysis
Previous Article in Journal
Discriminative Mobility Characteristics between Neurotypical Young, Middle-Aged, and Older Adults Using Wireless Inertial Sensors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

SAR Image Change Detection via Multiple-Window Processing with Structural Similarity

1
Division of Electrical, Electronic, and Control Engineering, Kongju National University, Cheonan 31080, Korea
2
Department of Mechanical Engineering, Gangneung-Wonju National University, Wonju 26403, Korea
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(19), 6645; https://doi.org/10.3390/s21196645
Submission received: 26 August 2021 / Revised: 30 September 2021 / Accepted: 4 October 2021 / Published: 6 October 2021
(This article belongs to the Section Sensing and Imaging)

Abstract

:
In this paper, a synthetic aperture radar (SAR) change detection approach is proposed based on a structural similarity index measure (SSIM) and multiple-window processing (MWP). The proposed scheme is performed in two steps: (1) generation of a coherence image based on MWP associated with SSIM and (2) gamma correction (GC) filtering. The proposed method is capable of providing a high-quality coherence image because the MWP operation based on SSIM has high sensitivity to the similarity measure for intensity between two SAR images. By finding an optimum value of order of GC, the proposed method can considerably reduce the effect of speckle noise on the coherence image, while retaining nearly all the information related to changed region involved in the change detection map. Several experimental results are presented to demonstrate the effectiveness of the proposed scheme.

1. Introduction

The change detection (CD) technique has been widely applied in the evaluation of monitoring and predicting trends in disasters that have occurred in the investigated area by using synthetic aperture radar (SAR), which can operate day and night and during almost any weather conditions [1,2,3,4]. The generation of a CD map (CDM), a kind of a binary change mask corresponding to difference between two SAR images, is aimed at providing the dynamic evolution of scene changes [5,6,7]. However, SAR images usually suffer from the presence of speckle noise, which leads to the degradation of detection performance of CD approach [8,9,10].
The SAR change detection methods can be divided into two groups: non-coherent (NC)-based CD (NCCD) and coherent-based CD (CCD) approaches. The NCCD techniques the subtraction and ratio operators (e.g., difference image (DI), log-ration difference (LRD), logarithmic mean-based thresholding (LMT) and neighborhood-based ratio approach (NRA)) have been successfully proposed. The DI [11] and LRD [12] are widely used for generation of CDM. The binary classification of changed region between two SAR images is presented in [13] using the LMT approach. The NRA is proposed in [14] considering the gray level and spatial information of neighbor pixels caused by DI. A novel SAR image CD method using saliency extraction and the shearlet transform (SEST) is proposed in [15]. In [16], the authors derive a statistical hypothesis approach based on bivariate gamma distribution (BGD) for wavelength-resolution NCCD. On the other hand, CCD techniques such as cross-correlation (CC) is successfully applied in handling the issue of SAR CD task. The coherence image is calculated by the CC using a small sliding window of pixels across the complex interferogram whose resulting phase information involves ground motion and surface change with unprecedented spatial detail [17]. Compared with the classic CC, the similarity measure operators such as Berger and universal quality index (UQI) [18] can decrease the influence of calibration and radiometric errors and is more suitable for the CD of SAR images. The speckle noise of SAR images is multiplicative noise and the similarity measure operation can not only transform multiplicative noise into additive noise but also compress the value range of pixels in an SAR image. However, lack of coherence caused by several decorrelation factors such as baseline, temporal, and rotational decorrelation has a strong influence on the performance of the accurate CD result.
The main contribution of this paper is to present a novel framework for CDM generation using the multiple-window processing (MWP) associated with the structural similarity index measure (SSIM) [19,20] and gamma correction (GC) [21,22,23]. The proposed method is capable of providing high-quality coherence image since the MWP operation based on SSIM has high sensitivity to the similarity measure for intensity between two SAR images, compared to classical similarity measures [24,25]. Meanwhile, the detection performance of the coherence image is dependent on the order p of GC [22]. The proposed method can obtain various degrees of performances of the speckle noise reduction with changes in the order p of GC. Thus, we analyzed the proposed method in terms of the image enhancement and the speckle noise reduction, taking the value of p into consideration. It achieves a superior quality of CDM by searching the value of p such as the global optimal solutions of the optimization problem with the GC technique. In experimental results, several detection quality metrics are employed to quantitatively evaluate the performance of CDM acquired by the proposed method.
The remainder of this paper is organized as follows. Section 2 presents some useful concepts regarding in the MWP associated with SSIM. In Section 3, the optimization task based on gamma correction is explained in detail. In Section 4, the computational complexity of the proposed algorithm is analyzed in mathematical expression. The results of several experiments are presented in Section 5 to testify to the performance of the proposed method. Section 6 discusses the results in perspective of previous studies, pointing out some future research directions. Finally, Section 7 presents our conclusions.

2. Analysis of MWP Associated with SSIM

Consider the case where we acquire two SAR images at different times but of the same geographical area on the Earth’s surface [25]. The CD can be performed using the complex CC between the master and the co-registered slave calculated locally over a small, namely 5 × 5 or 10 × 10 , pixel window in the SAR image pair [3]. However, the CC approach often fails to achieve excellent creation of the CDM due to the limitation of accuracy of similarity measure in presence of several decorrelation factors.
In this paper, we focus on the behavior of the MWP based on SSIM in SAR image, which is capable of outperforming CD ability more than CC in similarity measurement. Because each pixel intensity in image is closely related to neighborhood and represents dynamics of the scene being imaged, the proposed approach can exhibit a simple structure and powerful detection performance. Let a pair of two co-registered SAR images with a size of M × N , where M and N are the number of pixels in azimuth and slant-range domain, respectively, be I 1 = i 1 ( m , n ) 1 m M ,   1 n N and I 2 = i 2 ( m , n ) 1 m M ,   1 n N , respectively. The coherence image located at (y, x) is calculated by SSIM using a small sliding window of pixels across both absolute images ( i 1 ( m , n ) and i 2 ( m , n ) ) and can be expressed [19]:
γ s s i m ( y , x , M , N ) = ( 2 α ¯ β ¯ + c 1 ) ( 2 σ α β + c 2 ) ( α ¯ 2 + β ¯ 2 + c 1 ) ( σ α 2 + σ β 2 + c 2 )
where
σ α = 1 N M 1 n = 1 N m = 1 M ( i 1 ( m , n ) α ¯ ) 2 , σ β = 1 N M 1 n = 1 N m = 1 M ( i 2 ( m , n ) β ¯ ) 2 ,
σ α β = 1 N M 1 n = 1 N m = 1 M ( i 1 ( m , n ) α ¯ ) ( i 2 ( m , n ) β ¯ ) ,
α ¯ = 1 N M n = 1 N m = 1 M i 1 ( m , n ) , β ¯ = 1 N M n = 1 N m = 1 M i 2 ( m , n ) ,
c 1 = ( k 1 D ) 2 , c 2 = ( k 2 D ) 2 ,  
M and N are the y-directional and x-directional window widths, respectively. The size of the M × N image segment is usually much smaller than the size of the M × N image. Note that the local window with a size of M × N is typically chosen as square in this paper. D is the dynamic range of the pixel values. In addition, k i ( i = 1 , 2 ) is constant indicating scaling factor. According to numerous computer simulation results with an exhaustive search procedure for finding the best value of k 1 and k 2 , it is preferable to optimize the SSIM using the parameters k 1 = 0.01 and k 2 = 0.03 appropriate for providing the reliable performance within the framework of the proposed method. Structural information is the idea that the pixels have strong inter-dependencies especially when they are spatially close. These dependencies carry important information about the structure of the objects in the visual scene. Thus, it is more preferable to select the SSIM rather than conventional similarity measures such as CC and UQI [24] owing to its ability to measure information loss in terms of image similarity measurement. In the pursuit of similarity detail between two images, the SSIM converges to 1 if both images are identical. The SAR image pair, contaminated by a high frequency random speckle noise, has been filtered using a low-pass filter designed by the windowing of SSIM operation. The low-pass filter will pass the signal through it and suppress the high frequency speckle noises in SAR image. Thus, reliable reduction in the speckle noise can be ensured in the configuration of SSIM operation. Meanwhile, the resultant of SSIM associated with the multiple-window with different size of windows can be added cumulatively to preserve the detail information such as edge of the changed region. As shown in Figure 1, the MWP, obtained from the average of SSIM results for each different window, can be derived as
M W P ( y , x ) = 1 L i = 1 L γ s s i m int ( y , x , i , i ) ,
where γ s s i m int ( y , x , i , i ) = interp γ s s i m ( y , x , i , i ) ,   L ,   L , L is the number of windows at (y, x). A function of interp returns interpolated values of γ s s i m ( y , x , i , i ) at specific query points related to original image size of M × N using interpolation method. After the SSIM transformations were performed at each window size, the interpolation process is applied to one of the SSIM images so that all images are registered at the same pixel location. Then, after the interpolation is used to resample the SSIM image to provide the pixel-level registration, the MWP associated with SSIM is performed to reconstruct high-quality coherence images with the preservation of the detail information such as the edge of the changed region. However, it is inevitable that the SAR images usually suffer from the presence of the speckle noise [26,27]. The coherence image with the inclusion of undesired speckle noise may create challenges in providing reliable detection performance of CDM [28,29]; thus, there is a demand for a speckle noise reduction technique.

3. Optimization Task Based on Gamma Correction

Before applying the gamma correction (GC) to reduce the speckle noise, we applied the negative transformation (NT) in advance to reverse the intensity levels of an input image to produce the negative image. The negative image x can be expressed as [22]
k = 1 M W P ( y , x ) ,
where 0 k 1 . The NT is suitable for enhancing dark detail (low coherence) embedded in white regions (high coherence) of an image, especially when the white regions are dominant in whole image such as coherence image.
The power-law transformation, called GC, can be defined as follows [23]:
y = a k p ,
where k and y are the intensity levels of the pixels in the input and the output CDMs, respectively. p is an arbitrary real number. a is a positive constant and is selected as 1 in this paper. In GC filtering, the order p controls the slope of the transformation function. The higher the value of p is, the steeper the transformation curve becomes. The steeper the curve is, the more the corresponding intensities are spread, causing more increase in contrast. Figure 2a demonstrates a plot of y with respect to k using the order p which shows an increasing curve. Note that steeper the transformation curve will be obtained, which will cause large decrease in speckle noise, as expected. Because the intensity of the speckle noise in the CDM is usually smaller than that of the true changed region, the GC filtering leads to a significant reduction in the speckle noise, while retaining nearly all the information related to true changed region contained in the CDM, as shown in Figure 2a. The GC can provide various degrees of performances of both image enhancement and speckle noise reduction with changes in the value of p. Thus, the result obtained from the GC can be extremely close in appearance to the noise-free CDM if it is available for the proper selection of p. Because the performance of GC has a strong dependence on the value of p, the heuristic approach, which suboptimally selects the best solution by optimizing an average energy (AE) of CDM, is required to find a proper value of p. The GC uses different values of p for different images depending on the nature of the respective image according to the AE of CDM. Then, the AE can be defined as
A E ( p ) = 1 N M n = 1 N m = 1 M k p ( m , n ) .
The AE decomposes into two main contributions: A E r corresponding to the changed region and A E s corresponding to the speckle noise as follows:
A E ( p ) = A E r ( p ) + A E s ( p ) .
It is noteworthy that there inevitably exists a certain real number ν which leads to the result that A E s distributed in CDM starts to converge to 0 in the limit as p ν , that is,
lim p ν A E s ( p ) = 0 .
This is because the decreasing rate of A E s is generally larger than that of A E r with the value of p increasing as shown in Figure 2a. Thus, this approach results in the removal of the speckle noise in CDM due to k s v 1 , where k s denotes the NT corresponding to the speckle noise. Therefore, the AE has a tendency to converge to A E r ( v ) close to the noise-free CDM as shown in Figure 2b, and then the following relationship holds true:
lim p ν A E ( p ) = A E r ( ν ) .
Thus, the selection of the p parameter at the start of convergence of AE, namely p = ν , can reasonably lead to a global optimum in terms of both image enhancement and speckle noise reduction. Then, the reconstruction of desired CDM can be achieved by solving the following optimization problem:
P :   min   p   s u b j e c t   t o   d d p A E ( p ) σ ,
where σ is small negative threshold value. It is necessary to construct approach to a systematic process in setting for the adaptive threshold selection. According to numerous simulation results with an exhaustive search procedure of p parameter against threshold σ , the mathematical expression of the threshold σ = A E ( p ) p = 1 × log L 2 / 100 is heuristically derived to achieve the global optimum within the SAR NC-CD framework, regardless of the shape and size of changed region and the radar parameters. The initial differential coefficient A E ( p ) p = 1 is considered as the data-driven parameter to describe the proportion of the changed region in the original image. Finally, the CDM can be created where clusters of pixels with intensity above a specified threshold represent the scattering center locations on the changed region.
Additionally, we can consider a median filter with size of 3 × 3 in the post-processing step to accommodate the residual speckle noise reduction in the CDM. The overall flowchart of the proposed method is shown in Figure 3.

4. Analysis of Computational Complexity

The computational complexity of the SAR change detection for the proposed method is analyzed in detail. We establish the computational efficiency of the proposed method with regard to multiplications and divisions. Given N ( N 2 ) SAR images with a size of M × N , the total complexity of SSIM requires O L M N ( N 1 ) operations, where L is the number of windows in the MWP procedure. Meanwhile, the computational complexity of AE can be calculated as O M N . Therefore, the total complexity of the proposed method can be approximated as O L M N ( N 1 ) + M N .

5. Experimental Results

In this section, we evaluate the performance of the proposed method discussed in Section 2 for the reconstruction of CDM. We also compare the detection performance of the propose method with that of conventional CD methods.

5.1. Description of the Data Sets

To verify the detection performance of the CDM via the proposed method, we used three real SAR dataset (dataset 1, 2 and 3). Before applying the proposed method, it is assumed that the motion compensation algorithm [30] is perfectly performed in advance to generate well-focused SAR images whose phase coherence is well-preserved. Dataset1 consists of two SAR images with a size of 505 × 494 acquired by the ERS-2 satellite over the same region near the city of Bern, Switzerland, in April and May 1999 as shown in Figure 4a,b, respectively. Dataset2 is comprised of two SAR images with a size of 350 × 290 obtained from the RADARSAT sensor over the city of Ottawa, Canada, in May and August 1997 as shown in Figure 5a,b, respectively. In both Bern and Ottawa, the specific areas were submerged by floodwater between those two dates, respectively. Dataset3 is pair of two SAR images with a size of 3800 × 4200 acquired by RADARSAT-2 at the region of Yellow River Estuary in China in June 2008 and June 2009, as shown in Figure 6a,b, respectively. These two images include vegetation areas (paddy field) and are with different levels of strong noise and low coherence. The first image is with four looks and the second image is with a single look. In order to facilitate the quantitative evaluation of creation of CDM for detecting changed areas, reference maps (ground truth images), as shown in Figure 4c, Figure 5c and Figure 6c, were obtained by using manual analysis based on integration of prior information with photo interpretation.

5.2. Detection Quality Metrics

We made a direct comparison between each pixel in the result and the reference map to measure the detection quality metrics [13] such as false alarm (FA), detection rate (DR), and kappa index ( κ ).
True positive (TP) is the number of changed pixels detected correctly and its rate is p T P = T P / ( M N ) . True negative (TN) is the number of unchanged pixels detected correctly and its rate is p T N = T N / ( M N ) . False positive (FP) is the number of changed pixels detected incorrectly as unchanged, also known as misdetections and its rate is p F P = F P / ( M N ) . False negative (FN) is the number of unchanged pixels detected incorrectly as changed pixels and its rate is given as p F N = F N / ( M N ) . Furthermore, the kappa statistic index, which is a measure of agreement or accuracy based on the difference between the chance agreement and error matrix, was calculated to evaluate the validity and reliability of the CDM, defined as [13]
κ = A B 1 B ,
where A = 1 p F P p F N and B = ( p T P + p F P ) ( p T P + p F N ) + ( p T N + p F N ) ( p T N + p F P ) . The higher the value of kappa, the better is the detection performance. Furthermore, FA and DR are defined as ( F P + F N ) / ( M N ) and T P / C R , where CR is the number of pixels as changed region in the reference map, respectively. The final accuracy was evaluated by the proportion of correct detection (PCD), which can be calculated by (TP + TN)/(TP + FP + FN + TN).

5.3. Analysis of CDMs Generated by the Proposed Method

Under the aforementioned experimental setup, the CC [1], LMT [13], NRA [14], SEST [15], BGD [16], and the proposed method are carried out to compare the detection performance of each CDM. Note that the experiments were conducted to compare the performance of the six CD algorithms in two aspects: (1) before and (2) after post processing. We adopted the median filtering in the post-processing step, which is one of the most popular speckle noise reduction methods, to improve the performance of the CD technique.
The CC, LMT, NRA, SEST, and BGD images are obtained, followed by the application of constant false alarm rate (CFAR) detection to generate the CDMs. Meanwhile, the number of window for the MWP was chosen as L = 4 to exploit the preservation of the detail edge of the changed region. Each value of σ for solving the problem of optimization were chosen as 0.002 for dataset 1, 0.015 for dataset 2, and 0.023 for dataset 3, respectively. The main features of the changed regions, such as the flooded areas and the reclaimed paddy fields, are extracted in Figure 7, Figure 8 and Figure 9. It can be easily recognized that the CDM results obtained by the proposed method (depicted in Figure 7f, Figure 8f and Figure 9f) were nearly a match for the reference maps in terms of visual inspection. To provide a quantitative evaluation, the detection performance values of each algorithm are compared in Table 1, Table 2 and Table 3. The FA of the CDM obtained by the proposed method has the smallest value among the six approaches in each case (Table 1, Table 2 and Table 3). Furthermore, all the values of kappa and PCD measured for the proposed method were considerably greater than those of the other five methods. On the other hand, Figure 10, Figure 11 and Figure 12 show the final CD results obtained by the CC, LMT, NRA, SEST, BGD, and the proposed method, respectively, after the median filtering in the post-processing step. The background of the results obtained using the median filtering is clearer than those of the unfiltered CD results shown in Figure 7, Figure 8 and Figure 9. The detected changed portions in the CD image obtained using the proposed method show good agreement with those of the ground truth map (see Figure 4c, Figure 5c and Figure 6c), as shown in Figure 10f, Figure 11f and Figure 12f. The performances attained by all the methods after the median filtering were described in Table 4, Table 5 and Table 6. The FA of the CD image obtained by the proposed method has the smallest value in each dataset among the six algorithms. Furthermore, the DR and PCD measured by the proposed method are especially better than those of the CC, LMT, NRA, SEST, and BGD. The outstanding performance of the CD image obtained by the proposed algorithm exhibits a significant improvement over other five algorithms in terms of all metrics of detection quality after median filtering in the post processing step. Therefore, the quality of the CDM image obtained by the proposed method was the best in terms of quantitative detection quality measurements in this experiment. In summary, we can conclude that the undesired speckle noises involved in CDMs are successfully suppressed; thus, the CDM quality and detection performance is significantly improved using the proposed method.

6. Discussion

The main novelty of the proposed method is two-fold: (1) adoption of the MWP approach based on the SSIM of SAR image with no consideration for the well-preserved interferometric phase, and (2) application of GC in SAR CD framework in order to provide various degrees of performances of both image enhancement and speckle noise reduction with changes in the value of p. Because each pixel intensity in the image is closely related to the neighborhood and represents the dynamics of the scene being imaged, the proposed approach can exhibit a simple structure and powerful detection performance. Furthermore, another attractive attribute of the proposed method is that the GC filtering leads to a significant reduction in the speckle noise while retaining nearly all the information related to the true changed region contained in the CDM. In addition, the median filtering can be considered to improve the CD performance in the post processing step. The proposed method is capable of providing a high-quality coherence image since the SSIM operation has high sensitivity to the similarity measure for intensity between two SAR images. Meanwhile, the detection performance of the coherence image is dependent on the order p of GC. The proposed method can provide various degrees of performances of the speckle noise reduction with changes in the order p of GC. Thus, we analyzed the proposed method in terms of the image enhancement and the speckle noise reduction, taking the value of p into consideration. In experimental results, several detection quality metrics are employed to quantitatively evaluate the performance of CDM acquired by the proposed method. The most important issue in the paper is a superior quality of CDM reconstruction by searching the global optimal solutions of the optimization problem with a MWP associated with SSIM and GC, compared with state-of-the-art CD-based methods.

7. Conclusions

In this paper, a new framework for NC-CD is proposed for successful CD performance in multi-temporal SAR images. The processing sequence for generation of CDM is implemented as follows: the coherence image is obtained by the MWP associated with the SSIM, followed by optimization procedure of GC. The proposed scheme concentrates on the behavior of the SSIM to measure fine variation of intensity between two SAR images within multiple-windows in order to provide reliable generation of high-quality coherence images. The detection performance of the proposed method is dependent on the order p of the power-law function, called GC. The detailed explanation to select the optimum value p which plays the lead role in producing the noise-free CDM. The experimental results show that the proposed scheme provides excellent detection performance in terms of several detection quality metrics.

Author Contributions

Conceptualization, M.K.; methodology, M.K.; software, M.K.; validation, M.K.; formal analysis, M.K.; investigation, M.K.; resources, M.K.; data curation, M.K.; writing—original draft preparation, M.K.; writing—review and editing, M.K.; visualization, M.K.; supervision, J.B.; project administration, J.B.; funding acquisition, M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2021R1I1A3043152).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Curlander, J.C.; McDonough, R.N. Synthetic Aperture Radar Systems and Signal Processing; Wiley: New York, NY, USA, 2012. [Google Scholar]
  2. Kang, M.-S.; Kim, K.-T. Ground moving target imaging based on compressive sensing framework with single-channel SAR. IEEE Sens. J. 2020, 20, 1238–1250. [Google Scholar] [CrossRef]
  3. Cumming, I.G.; Wong, H.C. Digital Processing of Synthetic Aperture Radar Data: Algorithms and Implementation; Artech House: Norwood, MA, USA, 2005. [Google Scholar]
  4. Kang, M.S.; Lee, S.J.; Lee, S.H.; Kim, K.T. ISAR imaging of high-speed maneuvering target using gapped stepped-frequency waveform and compressive sensing. IEEE Trans. Image Process. 2017, 26, 5043–5056. [Google Scholar] [CrossRef] [PubMed]
  5. Kang, M.-S.; Kim, K.-T. Compressive sensing based SAR imaging and autofocus using improved Tikhonov regularization. IEEE Sens. J. 2019, 19, 5529–5540. [Google Scholar] [CrossRef]
  6. Schwartz, C.; Ramos, L.P.; Duarte, L.T.; Pinho, M.D.S.; Pettersson, M.I.; Vu, V.T.; Machado, R. Change Detection in UWB SAR images based on robust principal component analysis. Remote Sens. 2020, 12, 1916. [Google Scholar] [CrossRef]
  7. Kang, M.-S.; Bae, J.-H.; Kang, B.-S.; Kim, K.-T. ISAR Cross-range scaling using iterative processing via principal component analysis and bisection algorithm. IEEE Trans. Signal Process. 2016, 64, 3909–3918. [Google Scholar] [CrossRef]
  8. Lu, P.; Stumpf, A.; Kerle, N.; Casagli, N. Object-oriented change detection for landslide rapid mapping. IEEE Geosci. Remote Sens. Lett. 2011, 8, 701–705. [Google Scholar] [CrossRef]
  9. Wang, R.; Chen, J.-W.; Wang, Y.; Jiao, L.; Wang, M. SAR Image change detection via spatial metric learning with an improved mahalanobis distance. IEEE Geosci. Remote Sens. Lett. 2019, 17, 77–81. [Google Scholar] [CrossRef]
  10. Kang, M.-S.; Won, Y.-J.; Lim, B.-G.; Kim, K.-T. Efficient synthesis of antenna pattern using improved PSO for spaceborne SAR performance and imaging in presence of element failure. IEEE Sens. J. 2018, 18, 6576–6587. [Google Scholar] [CrossRef]
  11. Rignot, E.; Van Zyl, J. Change detection techniques for ERS-1 SAR data. IEEE Trans. Geosci. Remote Sens. 1993, 31, 896–906. [Google Scholar] [CrossRef] [Green Version]
  12. Song, Y.; Wang, J. Mapping winter wheat planting area and monitoring its phenology using sentinel-1 backscatter time series. Remote Sens. 2019, 11, 449. [Google Scholar] [CrossRef] [Green Version]
  13. Sunmaiya, M.N.; Shantha, R. Logarithm mean-based thresholding for sar image change detection. IEEE Geosci. Remote Sens. Lett. 2016, 13, 1726–1728. [Google Scholar] [CrossRef]
  14. Gong, M.; Cao, Y.; Wu, Q. A Neighborhood-based ratio approach for change detection in SAR images. IEEE Geosci. Remote Sens. Lett. 2012, 9, 307–311. [Google Scholar] [CrossRef]
  15. Zhang, Y.; Wang, S.; Wang, C.; Li, J.; Zhang, H. SAR image change detection using saliency extraction and shearlet transform. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 4701–4710. [Google Scholar] [CrossRef]
  16. Vu, V.T.; Gomes, N.R.; Pettersson, M.I.; Dammert, P.; Hellsten, H. Bivariate Gamma Distribution for Wavelength Resolution SAR Change Detection. IEEE Trans. Geosci. Remote Sens. 2019, 57, 473–481. [Google Scholar] [CrossRef]
  17. Kang, M.-S.; Kim, K.-T. Automatic SAR image registration via Tsallis entropy and iterative search process. IEEE Sens. J. 2020, 20, 7711–7720. [Google Scholar] [CrossRef]
  18. Kang, M.-S.; Bae, J.-H.; Lee, S.-H.; Kim, K.-T. Efficient ISAR autofocus via minimization of Tsallis Entropy. IEEE Trans. Aerosp. Electron. Syst. 2017, 52, 2950–2960. [Google Scholar] [CrossRef]
  19. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
  20. Brunet, D.; Vrscay, E.R.; Wang, Z. On the mathematical properties of the structural similarity index. IEEE Trans. Image Process. 2012, 21, 1488–1499. [Google Scholar] [CrossRef]
  21. Maini, R.; Aggarwal, H. A Comprehensive review of image enhancement techniques. J. Comput. 2010, 2, 8–13. [Google Scholar]
  22. Gonzalez, R.C.; Woods, R.E. Digital Image Processing, 2nd ed.; Pearson Education: New Delhi, India, 2005. [Google Scholar]
  23. Vimal, S.P.; Kandhai, T. Automated image enhancement using power law transformations. Sadhana 2013, 37, 739–745. [Google Scholar] [CrossRef]
  24. Wang, Z.; Bovik, A.C. A universal image quality index. IEEE Signal Process. Lett. 2002, 9, 81–84. [Google Scholar] [CrossRef]
  25. Cole-Rhodes, A.A.; Johnson, K.L.; Le Moigne, J.; Zavorin, I. Multiresolution registration of remote sensing imagery by optimization of mutual in-formation using a stochastic gradient. IEEE Trans. Image Process. 2003, 12, 1495–1511. [Google Scholar] [CrossRef]
  26. Bruzzone, L.; Prieto, D. Automatic analysis of the difference image for unsupervised change detection. IEEE Trans. Geosci. Remote Sens. 2000, 38, 1171–1182. [Google Scholar] [CrossRef] [Green Version]
  27. Gamba, P.; Dell’Acqua, F.; Lisini, G. Change detection of multitemporal SAR data in urban areas combining feature-based and pixel-based tech-niques. IEEE Trans. Geosci. Remote Sens. 2006, 44, 2820–2827. [Google Scholar] [CrossRef]
  28. Argenti, F.; Alparone, L. Speckle removal from SAR images in the undecimated wavelet domain. IEEE Trans. Geosci. Remote Sens. 2002, 40, 2363–2374. [Google Scholar] [CrossRef]
  29. Giustarini, L.; Hostache, R.; Matgen, P.; Schumann, G.; Bates, P.D.; Mason, D.C. A change detection approach to flood mapping in urban areas using TerraSAR-X. IEEE Trans. Geosci. Remote Sens. 2013, 51, 2417–2430. [Google Scholar] [CrossRef] [Green Version]
  30. Wei, P. Deep SAR imaging and motion compensation. IEEE Trans. Image. Process. 2021, 30, 2232–2247. [Google Scholar]
Figure 1. Schematic diagram of the SSIM and MWP procedure.
Figure 1. Schematic diagram of the SSIM and MWP procedure.
Sensors 21 06645 g001
Figure 2. (a) Illustration of the GC filtering, (b) AE versus value of p.
Figure 2. (a) Illustration of the GC filtering, (b) AE versus value of p.
Sensors 21 06645 g002
Figure 3. Detailed processing workflow that is proposed in this study.
Figure 3. Detailed processing workflow that is proposed in this study.
Sensors 21 06645 g003
Figure 4. Multi-temporal SAR images of the city of Bern. (a) SAR image acquired in April 1999 before the flooding. (b) SAR image acquired in May 1999 after flooding. (c) The reference map, called ground truth.
Figure 4. Multi-temporal SAR images of the city of Bern. (a) SAR image acquired in April 1999 before the flooding. (b) SAR image acquired in May 1999 after flooding. (c) The reference map, called ground truth.
Sensors 21 06645 g004
Figure 5. Multi-temporal SAR images of Ottawa. (a) SAR image acquired in July 1997 during the flooding. (b) SAR image acquired in August 1997 after flooding. (c) The reference map, called ground truth.
Figure 5. Multi-temporal SAR images of Ottawa. (a) SAR image acquired in July 1997 during the flooding. (b) SAR image acquired in August 1997 after flooding. (c) The reference map, called ground truth.
Sensors 21 06645 g005
Figure 6. Multi-temporal SAR images of Yellow River Estuary in China. (a) SAR image acquired in June 2008. (b) SAR image acquired in June 2009. (c) The reference map, called ground truth.
Figure 6. Multi-temporal SAR images of Yellow River Estuary in China. (a) SAR image acquired in June 2008. (b) SAR image acquired in June 2009. (c) The reference map, called ground truth.
Sensors 21 06645 g006
Figure 7. CDMs using dataset 1 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 7. CDMs using dataset 1 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g007
Figure 8. CDMs using dataset 2 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 8. CDMs using dataset 2 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g008aSensors 21 06645 g008b
Figure 9. CDMs using dataset 3 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 9. CDMs using dataset 3 obtained by six CD algorithms before median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g009
Figure 10. CDMs using dataset 1 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 10. CDMs using dataset 1 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g010aSensors 21 06645 g010b
Figure 11. CDMs using dataset 2 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 11. CDMs using dataset 2 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g011
Figure 12. CDMs using dataset 3 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Figure 12. CDMs using dataset 3 obtained by six CD algorithms after median filtering in the post processing step. (a) CDM reconstructed by the CC. (b) CDM reconstructed by the LMT. (c) CDM reconstructed by the NRA. (d) CDM reconstructed by the SEST. (e) CDM reconstructed by the BGD. (f) CDM reconstructed by the proposed method.
Sensors 21 06645 g012aSensors 21 06645 g012b
Table 1. Comparison of results from all the six methods using dataset 1 before median filtering.
Table 1. Comparison of results from all the six methods using dataset 1 before median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC60159184.82067.710.16492.21
LMT51556873.46368.220.18793.16
NRA58342102.96668.860.38594.45
SEST47937862.54469.450.53495.10
BGD43331152.23168.020.60194.85
Proposed37816431.22865.630.79495.32
Table 2. Comparison of results from all the six methods using dataset 2 before median filtering.
Table 2. Comparison of results from all the six methods using dataset 2 before median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC3263401518.3869.550.67789.23
LMT2977373714.6471.580.69890.10
NRA2645347511.2776.790.73491.44
SEST2712361512.2378.360.74991.78
BGD2885368812.7278.890.77692.21
Proposed210329859.66884.240.79693.43
Table 3. Comparison of results from all the six methods using dataset 3 before median filtering.
Table 3. Comparison of results from all the six methods using dataset 3 before median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC36229346232.698.6640.15569.74
LMT31098094224.6012.570.19775.97
NRA22797394717.5216.660.28884.83
SEST20616924616.4118.800.30185.45
BGD18946717515.4323.780.32586.31
Proposed16446362014.3027.440.35487.68
Table 4. Comparison of results from all the six methods using dataset 1 after median filtering.
Table 4. Comparison of results from all the six methods using dataset 1 after median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC56454913.37170.360.20495.46
LMT48050742.24471.150.22897.77
NRA54239871.83072.940.44898.12
SEST50334511.11473.540.63598.34
BGD42425420.93872.270.72398.86
Proposed31913590.67868.700.84899.32
Table 5. Comparison of results from all the six methods using dataset 2 after median filtering.
Table 5. Comparison of results from all the six methods using dataset 2 after median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC277135236.38974.860.73592.30
LMT258131025.67076.950.74894.43
NRA229428355.11980.100.77694.94
SEST201826214.80482.440.78295.12
BGD199423574.67684.020.80695.46
Proposed192021514.06287.670.82896.01
Table 6. Comparison of results from all the six methods using dataset 3 after median filtering.
Table 6. Comparison of results from all the six methods using dataset 3 after median filtering.
MethodFPFNFA (%)DR (%) κ PCD (%)
CC28448110223.2012.780.20576.41
LMT25217430218.0515.550.24380.96
NRA18976448211.4319.340.31888.57
SEST16756368011.2125.050.35688.89
BGD15636026810.9731.310.39289.64
Proposed13675848210.3239.530.42990.68
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kang, M.; Baek, J. SAR Image Change Detection via Multiple-Window Processing with Structural Similarity. Sensors 2021, 21, 6645. https://doi.org/10.3390/s21196645

AMA Style

Kang M, Baek J. SAR Image Change Detection via Multiple-Window Processing with Structural Similarity. Sensors. 2021; 21(19):6645. https://doi.org/10.3390/s21196645

Chicago/Turabian Style

Kang, Minseok, and Jaemin Baek. 2021. "SAR Image Change Detection via Multiple-Window Processing with Structural Similarity" Sensors 21, no. 19: 6645. https://doi.org/10.3390/s21196645

APA Style

Kang, M., & Baek, J. (2021). SAR Image Change Detection via Multiple-Window Processing with Structural Similarity. Sensors, 21(19), 6645. https://doi.org/10.3390/s21196645

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop