Next Article in Journal
A Flexible Algorithm for Detecting Challenging Moving Objects in Real-Time within IR Video Sequences
Previous Article in Journal
Performance of Three MODIS Fire Products (MCD45A1, MCD64A1, MCD14ML), and ESA Fire_CCI in a Mountainous Area of Northwest Yunnan, China, Characterized by Frequent Small Fires
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Method of Unsupervised Change Detection Using Multi-Temporal PolSAR Images

1
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China
2
Huffington Department of Earth Sciences, Southern Methodist University, Dallas, TX 75275, USA
*
Author to whom correspondence should be addressed.
Remote Sens. 2017, 9(11), 1135; https://doi.org/10.3390/rs9111135
Submission received: 11 September 2017 / Revised: 21 October 2017 / Accepted: 4 November 2017 / Published: 6 November 2017
(This article belongs to the Section Remote Sensing Image Processing)

Abstract

:
The existing unsupervised change detection methods using full-polarimetric synthetic aperture radar (PolSAR) do not use all the polarimetric information, and the results are subject to the influence of noise. In order to solve these problems, a novel automatic and unsupervised change detection approach based on multi-temporal full PolSAR images is presented in this paper. The proposed method integrates the advantages of the test statistic, generalized statistical region merging (GSRM), and generalized Gaussian mixture model (GMM) techniques. It involves three main steps: (1) the difference image (DI) is obtained by the likelihood-ratio parameter based on a test statistic; (2) the GSRM method is applied to the DI; and (3) the DI, after segmentation, is automatically analyzed by the generalized GMM to generate the change detection map. The generalized GMM is derived under a non-Gaussian assumption for modeling the distributions of the changed and unchanged classes, and automatically identifies the optimal number of components. The efficiency of the proposed method is demonstrated with multi-temporal PolSAR images acquired by Radarsat-2 over the city of Wuhan in China. The experimental results show that the overall accuracy of the change detection results is improved and the false alarm rate reduced, when compared with some of the traditional change detection methods.

Graphical Abstract

1. Introduction

In the field of remote sensing, change detection techniques are applied to recognize changes of the ground by analyzing remote sensing images taken at different times in the same geographical area [1,2]. Due to its all-time and all-weather mapping capability, which is independent of, for instance, cloud cover, night-time, and severe weather, the change detection of synthetic aperture radar (SAR) has played an important role in understanding the relationships and interactions between people and natural phenomena in recent years [3]. Change detection with SAR images has been used in applications such as disaster monitoring [4,5], ecological monitoring [6,7], regulatory policy development [8,9], and environmental impact assessment [10]. Meanwhile, full-polarimetric synthetic aperture radar (PolSAR) images contain both phase and amplitude information from radar returns transmitted in two different polarizations, and more scattering information can be obtained than with single-channel SAR images [11]. Therefore, many researchers have focused on change detection using multi-temporal PolSAR images [12,13,14,15].
Based on whether training data are accessed or not, change detection based on PolSAR images can be generally classified into two categories: unsupervised approaches and supervised approaches. Most of the supervised change detection approaches are dependent on the classification accuracy of the multi-temporal PolSAR images, and are liable to be affected by the significant cumulative error caused by the single remote sensing image classification during change detection [16,17]. Because of the impact of speckle noise, it is difficult to obtain high-precision classification results from multi-temporal PolSAR images, which limits the use of change detection based on PolSAR images. Unlike supervised change detection approaches, the unsupervised change detection methods implement change detection by directly comparing images acquired at different times, and these methods are widely used in change detection based on multi-temporal PolSAR images [18].
The traditional unsupervised methods based on PolSAR images usually take the pixel as the basic processing unit. The process of the state-of-the-art unsupervised change detection methods includes: (1) preprocessing; (2) generation of the difference image (DI); and (3) making a decision (thresholding algorithm or clustering algorithm) based on the analysis of the DI [19]. The preprocessing of multi-temporal PolSAR images mainly consists of radiometric calibration, speckle filtering, and image co-registration, which are all critical to the change detection. In particular, speckle filtering is usually carried out to suppress the speckle before the change detection of PolSAR images. Despite preprocessing, the result is still subject to the influence of noise and false alarms, which are caused by the pixel-based change detection method [20]. In generating the DI step, two preprocessed images of the same geographical area at different times are compared to generate the DI. There are many methods used to generate the DI using two co-registered images, including the ratio or log-ratio operator of SAR amplitudes or intensities [11,13,14], the hidden Markov chain model [16,17], and the Kullback–Leibler divergence method [18]. These methods are usually applied in multi-temporal single-channel SAR change detection. Unlike the above methods, test statistics can be applied not only to single-channel SAR data, but also to full PolSAR images [19]. Using multichannel PolSAR data (coherency C3 or covariance matrix T3) can obtain a more accurate DI [5]. In the step of change detection analysis, the change detection map can be obtained by a thresholding algorithm or a clustering algorithm. A number of different algorithms can be used to automatically make a decision, such as the k-means algorithm [21], the fuzzy c-means (FCM) algorithm [22], Otsu’s thresholding method [23], Kapur’s entropy algorithm [24], the Kittler and Illingworth (K&I) algorithm [25], and two-dimensional entropic segmentation (TDES) [26]. However, most of the methods of making a decision are based on the condition of a Gaussian assumption for the probability density function (PDF) of the DI for modeling the distributions of the changed and unchanged classes. Fortunately, the Gaussian mixture model (GMM) is capable of better fitting the arbitrarily conditional densities of the classes in the DI [27,28], but it is still difficult to select the optimal number of components for the GMM [29].
Above all, the existing pixel-based unsupervised change detection methods using full PolSAR images all show certain deficiencies, such as not taking advantage of the full-polarimetric information and being subject to the influence of noise and false alarms [17]. Meanwhile, the existing object-based unsupervised change detection methods using PolSAR images can suppress the influence of noise and improve the overall accuracy (OA) of the change detection results [30], but they have difficulty in capturing the global property of the image. The results are also sensitive to segmentation, and this is difficult to accomplish due to the degradation of spatial details and fine structures [31]. To solve the above problems, a novel method of unsupervised change detection is proposed in this paper, integrating the respective advantages of the test statistic, generalized statistical region merging (GSRM), and generalized GMM techniques. The use of a test statistic is a good strategy for obtaining the DI from multi-temporal PolSAR images. We use the GSRM algorithm to separate the same parts of the DI, which helps us to choose the threshold by generalized GMM.
This paper is organized into five sections. In Section 2, the proposed change detection framework is described, and the methods of test statistic, GSRM, and generalized GMM techniques are introduced. Section 3 details the results of the proposed approach on multi-temporal PolSAR images from the city of Wuhan, China. Section 4 discusses the results of the case study. Finally, the conclusions are drawn in Section 5.

2. Theories and Methods

2.1. Test Statistic

The full PolSAR system measures the amplitude and phase of each pixel’s four basic polarization scattering echoes in four combinations of linear receive and transmit polarizations: horizontal-horizontal ( h h ), horizontal–vertical ( h v ), vertical-horizontal ( v h ), and vertical-vertical ( v v ) [32]. Assuming that the target reciprocity condition is satisfied [33], the polarimetric information can be expressed by a complex vector:
Ω = [ S h h , 2 S h v , S v v ] T
where vector Ω follows a complex multivariate normal distribution. For multi-look processed PolSAR images, the covariance matrix follows a complex Wishart distribution, denoted as X W ( p , m , X ) . The covariance matrix C is defined as:
C = Ω Ω T = [ | S h h | 2 S h h S h v S h h S v v S h v S h h | S h v | 2 S h v S v v S v v S h h S v v S h v | S v v | 2 ]
The frequency function of the covariance matrix C is shown as follows:
f ( C ) = 1 Γ n ( p ) 1 | C | n | C | n p exp { t r [ C 1 C ] } Γ p ( n ) = π p ( p 1 ) / 2 j = 1 p Γ ( n j + 1 )
where t r ( ) is the trace operator, n is the number of looks, Γ p ( n ) is a normalization factor, and C = E [ Ω Ω T ] .
Let us consider two full PolSAR images ( X 1 , X 2 ), which are independent, and both follow a complex Wishart distribution:
X 1 W ( p , m , X 1 ) X 2 W ( p , n , X 2 )
where p represents the dimension of X 1 , X 2 ; and m , n represent the number of looks of X 1 , X 2 , respectively. X 1 and X 2 represent the dispersion matrix of X 1 , X 2 . Their sum then has the same distribution S W ( p , m + n , ) . The maximum likelihood estimation (MLE) of X 1 , X 2 , and X s is shown as follows:
X 1 M L E = 1 m X 1 , X 2 M L E = 1 n X 2   and   S M L E = 1 m + n ( X 1 + X 2 )
According to test statistic theory [5], we make the hypothesis that the null hypothesis H 0 : X 1 = X 2 means that the two matrices are equal and there is a strong possibility of no change, and the alternative hypothesis H 1 : X 1 X 2 means that the two matrices are different and there is a strong possibility of change [7].
Supposing that the test statistic based on MLE has a joint density f ( X 1 , X 2 , θ ) , where θ is the set of parameters of the probability function that has generated the data. H 0 then states that θ H 0 , and the likelihood ratio of the test statistic is shown as follows:
Q = max θ H 0 L ( θ ) max θ Ω L ( θ ) = L ( S ) L X 1 ( X 1 ) L X 2 ( X 2 )
where
L X 1 ( X 1 ) L X 2 ( X 2 ) = 1 Γ p ( n ) Γ p ( m ) . | X 1 | n | X 2 | m | X 1 | n p | X 2 | m p exp { t r [ X 1 1 X 1 + X 2 1 X 2 ] } L ( S ) = 1 Γ p ( n ) Γ p ( m ) . | | ( n + m ) | X 1 | n p | X 2 | m p exp { t r [ 1 ( X 1 + X 2 ) ] }
This leads to the desired likelihood-ratio test statistic:
Q = ( n + m ) p ( n + m ) n p n m p m | X 1 | n | Y 1 | m | X 2 | n | Y 2 | m | X 1 + Y 1 | n + m | X 2 + Y 2 | n + m = ( n + m ) p ( n + m ) n p n m p m | X | n | Y | m | X + Y | n + m
If m = n, Equation (7) is changed as follows:
I n Q = n ( 2 q I n 2 + I n | X | + I n | Y | I n | X + Y | )
where InQ describes the similarity of the corresponding features, and its range is (−∞, 0]. The closer InQ is to 0, the more similar the corresponding features, which means that change is less likely, and vice versa [30].

2.2. Generalized Statistical Region Merging (GSRM)

Speckle filtering is usually carried out to suppress the speckle before the change detection of PolSAR images. Despite the speckle filtering, the change detection result is still subject to the influence of noise and false alarms, which are caused by the pixel-based change detection method [20]. To solve the above problem, the GSRM algorithm [31] is applied to suppress the influence of noise.
The GSRM algorithm has been shown to perform well in solving significant noise corruption, and it does not depend on data distribution [31]. These advantages make GSRM suitable for the segmentation of the DI, which is characterized by speckle noise and different distributions of the various data types and spatial resolutions.
The GSRM algorithm belongs to the family of region growing and merging techniques. Accordingly, two essential components define a region merging algorithm: the merging predicate confirming whether adjacent regions are merged or not; and the order followed to test the merging of regions. Suppose I is the DI that contains |I| pixels, where | · | stands for the cardinal number. QR is a parameter that enables the quantification of the statistical complexity of I.

2.2.1. Merging Predicate

From the Nock and Nielsen model, the following merging predicate is derived for the DI [31]:
P ( R , R ) = { t r u e .   f a l s e . i f | R ¯ R ¯ | b 2 ( R ) + b 2 ( R ) o t h e r w i s e
where
b ( R ) = g 1 2 Q R | R | ln | R | R | | δ
where R ¯ is the observed average for the DI in region R; R is the adjacent region of region R; δ is the maximum probability when P(R, R) = false, which is usually set as a very small value; QR is a parameter which makes it possible to quantify the statistical complexity of the ideal segmentation, and also the statistical hardness of the task; |R| is the pixel number in region R; |·| stands for the cardinal number; and R n stands for the set of regions with n pixels.

2.2.2. Merging Order

For an observed image I, there are N < 2|I| pairs of adjacent pixels in 4-connectivity. SI is the set of these pairs, and f (p, p) is a real-valued function, with p and p’ a couple of adjacent pixels in I. Instead of stepwise optimization tactics, Nock and Nielsen proposed a pre-ordering strategy [32], [33]. With this strategy, the GSRM algorithm can be described as follows: firstly, sort the pairs of SI in increasing order of f (p, p); and then traverse this order only once. For any current pair of pixels (p, p’) ∈ SI, if R(p) = R(p’), where R(p) stands for the region to which p belongs. Make the test P(R(p), R’(p’)), and merge R and R’ if the result is true. The gradient function f is defined as follows:
f ( p , p ) = p - p p + p 1
Figure 1 shows the procedure of the GSRM algorithm.

2.3. The Generalized Gaussian Mixture Model (GMM) and Expectation Maximization (EM)

The GMM [28] is an unsupervised statistical learning approach that is widely used in statistical pattern recognition. This parametric model is chosen because it is capable of better fitting the arbitrarily conditional densities of the classes in the DI after segmentation and it is suitable to fit an unknown data distribution of the DI after segmentation. The finite GMM with k components can be written as:
f ( X | θ ) = m = 1 k α m p ( x | θ m )
where α m represent the mixing probabilities of the m-th component, which must be positive and sum to one; θ = { μ 1 , ... , μ m , σ 1 2 , ... , σ m 2 } ; μ k are the means; σ k 2 are the variances; and p ( x | θ m ) is a normalized Gaussian with specified mean and variance.
In general, the data distribution of DI p ( x d ) after segmentation can be modeled as a weighted sum of two distributions representing the “changed” class and “unchanged” class data distributions [34], i.e.,
p ( x d ) = p ( w u ) p ( x d | w u ) + p ( w c ) p ( x d | w c )
where p ( x d | w u ) and p ( x d | w c ) are the a posteriori PDFs, and p ( w c ) and p ( w u ) are the a priori probabilities of classes wu and wc, respectively. The data distribution p ( x d ) can also be modeled using the k-component GMM [35], i.e.,
p ( x d ) = k = 1 K p ( k ) p ( x d | k ) = θ u M u p ( θ u ) p ( x | θ u ) + θ c M c p ( θ c ) p ( x | θ c )
where p ( k ) is the prior probability of the data point having been generated from component n of the mixture, and p ( x d | k ) is the n-th component density modeled with a Gaussian density function. The data distribution modeled with Equation (15) can be separated into two distributions representing the data distributions of “changed” and “unchanged” classes.
In order to estimate θ , it is usual to introduce the log-likelihood function defined as shown in Equation (15):
log p ( x | θ ) = log i = 1 n p ( x ( i ) | θ ) = i = 1 n log m = 1 k α m p ( x ( i ) | θ m )
The MLE is:
θ ^ M L = arg max θ { log p ( x | θ ) }
However, x = { x ( 1 ) , ... , x ( n ) } are incomplete data, and Equation (16) cannot be solved using a derivative of 0. It is worth noting that the expectation maximization (EM) algorithm [36] is a special case of the GMM algorithm when the feature vector for each pixel constructed with no contextual information is used for the GMM representation [37].
The EM algorithm is an iterative method used to find the maximum likelihood or the maximum a posteriori estimates of the components in the GMM [36]. The EM iteration alternates between performing an expectation (E) step and a maximization (M) step. The E-step creates a function for the expectation of the log-likelihood evaluated using the current estimate for the parameters:
Q ( θ , θ ^ ( t ) ) E [ log p ( X , γ | θ ) | X , θ ^ ( t ) ] = log p ( X , γ ^ | θ )
where
γ ^ i m E [ γ i m | x , θ ^ ( t ) ] = α ^ m ( t ) p ( x i | θ ^ m ( t ) ) j = 1 k α ^ j ( t ) p ( x i | θ ^ j ( t ) )
The M-step computes the parameters maximizing the expected log-likelihood found in the E-step.
( Q ( θ , θ ^ ( t ) ) ) θ = 0
We update the parameter estimates according to Equation (20):
α i = i = 1 n γ ^ i m / n
μ i = i = 1 n γ ^ i m x i / i = 1 n γ ^ i m
σ i 2 = i = 1 n γ ^ i m ( x i μ i ) T ( x i μ i ) / d i = 1 n γ ^ i m
The EM algorithm of the criterion of convergence is defined as shown in Equation (23):
θ - θ ^ ( t ) < δ
For a certain class of traditional GMM algorithm, there is an important parameter commonly referred to as K that specifies the number of components to detect [27,28]. However, the correct choice of K is often ambiguous. Furthermore, it is essential to find the optimal number of components K, for which the elbow method [38] is introduced in this paper.
The elbow method is a method of interpretation and validation of the consistency within cluster analysis that is designed to help find the appropriate number of clusters in a dataset. It looks at the percentage of variance explained as a function of the number of clusters, i.e., one should choose a number of clusters so that adding another cluster does not give a much better modeling of the data. However, this “elbow” cannot always be unambiguously identified [38]. K is the cluster number, and it corresponds to 90% of the variance, explained as the ratio of the between-group variance to the total variance, which is also known as an F-test [39]. The elbow method is shown as follows:
F = b e t w e e n _ g r o u p var i a n c e ( F B ) t o t a l var i a n c e ( F T )
where
F B = i = 1 K n i ( Y i ¯ Y ¯ ) 2 / ( K 1 )
F T = i = 1 K j = 1 n i ( Y i j Y i ¯ ) 2 / ( N K )
where Y i ¯ denotes the sample mean in the i-th group, n i is the number of observations in the i-th group, Y ¯ denotes the overall mean of the data, and K denotes the number of groups. Y i j is the j-th observation in the i-th out of K groups, and N is the overall sample size.
Figure 2 shows the procedure of the GMM and EM algorithms.

2.4. The Proposed Method of TS_srm_GMM

The basic process flow of the proposed method consists of: (1) data preprocessing, which consists of speckle filtering and image co-registration; (2) generation of the DI using the test statistic; (3) segmentation of the DI by GSRM; and (4) obtaining the PDF of the changed and unchanged classes using generalized GMM and making a decision based on Equation (27):
C D ( i , j ) = { 1 , p ( w u ) p ( x | w u ) < p ( w c ) p ( x | w c ) 0 , o t h e r w i s e
where “1” represents changed classes and “0” represents unchanged classes. The process flow of the proposed method is shown in Figure 3.
Firstly, speckle noise is removed by a 7 × 7 refined Lee filter for the two registered full PolSAR images. The DI is obtained by the likelihood-ratio parameter, which is built using coherency matrix C3 or covariance matrix T3 of the full PolSAR images based on the test statistic. To suppress the influence of speckle noise in the DI, the GSRM algorithm is applied to segment the DI. The data distribution of the DI after segmentation computed from satellite images of the same scene acquired at different times is modeled using the generalized GMM. It also becomes possible to automatically extract change information based on Equation (27). Finally, the precision of the change detection result is evaluated.

2.5. Evaluation Criterion

Quantitative evaluation is important to determine the result of change detection. When the ground reference is available, quantitative evaluation can be performed [40,41]. In order to verify the performance of the proposed method, we calculated the false alarm (FA) rate, omission factor (OF) rate, overall accuracy (OA), and Kappa coefficient [42] of the experimental results. These indicators are calculated as follows:
{ F A = F P N u O F = F N N c O A = T P + T N N K a p p a = O A P e 1 P e P e = ( T P + F N ) ( T P + F P ) + ( F P + T N ) ( F N + T N ) N 2
where FP means the number of unchanged points incorrectly detected as changed; FN means the number of changed points incorrectly detected as unchanged; TP means the number of changed points correctly detected; TN means the number of unchanged points correctly detected; N u and N c are the number of unchanged points and changed points of the ground-truth change map; N is the sum of N u and N c , respectively.

3. Experiments and Results

3.1. Study Area and Data

The city of Wuhan is the capital of Hubei province in China. It is situated between latitude 29°58′–31°22′N and longitude 113°41′–115°05′E. Wuhan lies in the eastern part of the Jianghan Plain, and is located at the confluence of the Hanshui and Yangtze rivers, along the middle reaches of the latter. Most of the area is plain, with scattered hills and a great number of lakes and pools, as shown in Figure 4. The climate is humid subtropical, with abundant rainfall and four distinct seasons. In July 2016, 50-year return period rainfall occurred, and the rainfall was significantly higher than the average annual precipitation. According to reports, the city of Wuhan was badly affected by the continuous heavy rain, and some areas showed dramatic change, especially YanDong Lake and LiangZi Lake. Optical sensors are of limited use in such severe weather. In order to detect the flooded regions, multi-temporal PolSAR images were acquired, allowing a rapid emergency response [42].
In order to assess the effectiveness of the change detection algorithms for the analysis of the DI, multi-temporal Radarsat-2 data of the flood disaster in Wuhan in 2016 are considered in this paper. The two C-band quad-polarimetric Radarsat-2 images (single look complex) are composed of two images which are regions from two SAR images acquired by Radarsat-2 over an area near the city of Wuhan, China, on 25 June 2015 and 6 July 2016, respectively. The Pauli-RGB images ( | S h h S v v | for red, | S h v | for green, and | S h h + S v v | for blue) are shown in Figure 5 (YanDong Lake) and Figure 6 (LiangZi Lake). The ground reference of the changed areas was obtained by visual interpretation of the PolSAR data and corresponding optical images.
The multi-temporal PolSAR images of YanDong Lake shown in Figure 5a,b were acquired on 25 June 2015, and 6 July 2016, respectively. The image size is 400 × 400 pixels. The area of YanDong Lake includes some grassland, city, and water bodies. The main changes occurred in the water bodies, because of the heavy rain.
The multi-temporal PolSAR images of LiangZi Lake shown in Figure 6a,b were acquired on 25 June 2015, and 6 July 2016, respectively. The image size is 300 × 500 pixels. The ground reference of the changed areas was obtained by visual interpretation of the PolSAR data and corresponding optical images. The area of LiangZi Lake includes some grassland, city, and water bodies. The main changes again occurred in the water bodies.

3.2. Implementation of the Change Detection Algorithms

The DI for YanDong Lake based on the test statistic uses all the information of polarimetric SAR. The DI is shown in Figure 7a and the histogram of the DI is shown in Figure 7b.
In Figure 7a, the DI for YanDong Lake based on the test statistic can accurately detect the difference in information among the multi-temporal PolSAR images, but it still contains speckle noise. Figure 7b shows the histogram of the DI based on pixels, and we can see that the DI still contains many isolated outliers. Moreover, the probability distribution of the DI is far from a Gaussian distribution. To suppress the influence of noise, the GSRM algorithm was applied to the DI of YanDong Lake, and the result is shown in Figure 8.
The DI for YanDong Lake was segmented based on GSRM, which is shown in Figure 9a. It can be seen that the GSRM technique produces smooth results and suppresses the influence of noise in the DI. The histogram is shown in Figure 9b, where many isolated outliers can be picked out. Moreover, the probability distribution of the DI is under a non-Gaussian distribution.

3.3. Results

In order to assess the effectiveness of the proposed approach, contrast experiments were designed. The contrast experiments included unsupervised change detection based on pixels (test statistic and GMM, named TS_GMM_pixel), based on objects (test statistic and GMM, named TS_GMM_object) and the approach proposed in this paper, including Log_ratio and GMM (named Log_srm_GMM), test statistic and K&I (named TS_srm_KI), test statistic and TDES (named TS_srm_TDES), test statistic and k-means (named TS_srm_kmeans), test statistic and FCM (named TS_srm_FCM), and test statistic and GMM (named TS_srm_GMM). The results for the multi-temporal PolSAR images of YanDong Lake based on the eight methods are shown in Figure 10. The change detection map shows change (white) and no-change (black) information.
The change detection results of the different algorithms over YanDong Lake are shown in Figure 10. Figure 10a shows the change detection result using the test statistic and generalized GMM algorithm based on pixels, which can detect the spatial details and fine structures of the change, but it causes a noisy change detection map, with holes in connected regions and jagged boundaries. Figure 10b shows the change detection result using the test statistic and generalized GMM algorithm based on objects, which can suppress the speckle noise; however, this is accompanied with degradation of the spatial details and it is more time-consuming. Figure 10c shows the change detection result using the Log_ratio algorithm and generalized GMM algorithm based on the approach proposed in this paper, which can better suppress the speckle noise; however, it does have a higher OF. Figure 10d–g show the change detection results using the test statistic and the traditional algorithms (KI, TDES’s, k-means, FCM) based on the approach proposed in this paper, which can better suppress the speckle noise; however, they contain more fallout information. Figure 10h shows the change detection result using the test statistic and generalized GMM algorithm based on the approach proposed in this paper, which not only better suppresses the speckle noise, but also has a higher OA than the results of the traditional algorithms.
In order to compare each of the different results with ground reference over YanDong Lake, we overlaid each of the different results with ground reference which improved the readability of Figure 10 and are shown in Figure 11. Where the green represents the match of proposed result in comparison to the ground reference (overall accuracy), the red represents the underestimation of the proposed methodology in comparison with the ground reference (omission factor (OF) rate) and the blue represents the overestimation of the proposed methodology in comparison with the ground reference (false alarm (FA) rate).
Several conclusions can be obtained from Figure 11. The TS_srm_GMM approach shows a better performance than the other approaches and it obtains a lower FA than other approaches (such as TS_GMM_pixel, TS_GMM_object, Log_srm_GMM and TS_srm_KI). It also obtains a lower OF than other approaches (such as Log_srm_GMM, TS_srm_KI, TS_srm_kmeans and TS_srm_FCM) in qualitative comparisons over YanDong Lake.
The quantitative comparisons of the eight detection schemes shown in Table 1 indicate that the proposed approach shows a better performance than the other approaches. The proposed approach achieves the best results on two indicators (OA (94.47%) and Kappa (0.75)), and it obtains a lower FA (1.68%) than the pixel-based (2.95%) and object-based (3.63%) approaches. Moreover, the OA of the change detection results is improved (0.83%) and the false alarm rate reduced (1.27%) using the proposed method, compared with some of the traditional methods. Both the qualitative and quantitative analyses demonstrate that the proposed method is more effective and shows a significant improvement over the traditional methods.
In order to further assess the effectiveness and feasibility of the proposed approach, the multi-temporal PolSAR images from LiangZi Lake were used to test the proposed approach. The change detection results of the different algorithms over LiangZi Lake are shown in Figure 11.
Figure 12a shows the change detection result using the test statistic and generalized GMM algorithm based on pixels, which can detect the spatial details and fine structures of the change, but it causes a noisy change detection map, with holes in connected regions and jagged boundaries. Figure 12b shows the change detection result using the test statistic and generalized GMM algorithm based on objects, which can suppress the speckle noise; however, it is accompanied with degradation of the spatial details and it is more time-consuming. Figure 12c shows the change detection result using the Log_ratio algorithm and generalized GMM algorithm based on the approach proposed in this paper, which can also suppress the speckle noise; however, it does have a higher OF. Figure 12d–g show the change detection result using the test statistic and the traditional algorithms (KI, TDES’s, k-means, FCM) based on the approach proposed in this paper, which can better suppress the speckle noise; however, they contain more fallout information. Figure 12h shows the change detection result using the test statistic and generalized GMM algorithm based on the approach proposed in this paper, which not only better suppresses the speckle noise, but also has a higher OA than the traditional algorithms.
Analogously, Figure 13 shows that the qualitative comparisons change detection results of the different algorithms with ground reference over LiangZi Lake.
In the same way, several conclusions can be obtained from Figure 13. The TS_srm_GMM approach shows a better performance than the other approaches and it obtains a lower FA than other approaches (such as TS_GMM_pixel, TS_GMM_object, Log_srm_GMM and TS_srm_KI) and it also obtains a lower OF than other approaches (such as Log_srm_GMM, TS_GMM_pixel, TS_GMM_object and TS_srm_TDES) in qualitative comparisons over LiangZi Lake.
The quantitative comparison of the eight detection schemes shown in Table 2 indicates that the proposed approach shows a better performance than the other approaches. The proposed approach achieves the best results on two indicators (OA (96.22%) and Kappa (0.76)), and it obtains a lower FA (1.56%) than the pixel-based (2.07%) and object-based approaches. Moreover, the OA of the change detection results is improved (1.10%) and the false alarm rate reduced (1.95%) using the proposed method, compared with some of the traditional methods. Both the qualitative and quantitative analyses demonstrate that the proposed method is effective and shows a significant improvement over the other methods.

4. Discussion

The existing pixel-based unsupervised change detection methods using PolSAR images show certain deficiencies, such as not taking full advantage of the polarimetric information or being subject to the influence of noise and a high false alarm rate. Meanwhile, existing object-based unsupervised change detection methods using PolSAR images have difficulty in capturing the global property of the image, and the results are sensitive to segmentation. Furthermore, the results are often accompanied by degradation of the spatial details and fine structures. In this paper, to solve the problems of the existing unsupervised change detection methods using full PolSAR images, we have explored a novel approach to unsupervised change detection using multi-temporal Radarsat-2 images from the city of Wuhan.
The proposed approach integrates the respective advantages of the test statistic, GSRM, and generalized GMM techniques to develop a new approach, named TS_srm_GMM, which can make full use of the polarimetric information and suppress the speckle noise. In the first step, the two filtered multi-temporal images are compared to generate a DI based on a test statistic that can make full use of the polarimetric information. The second step is aimed at reducing the speckle noise in a controlled way in order to maximize the discriminative capability between changed and unchanged classes through a segmentation strategy. The third step produces the change detection map according to a statistical clustering model based on a reformulation of the GMM. The results showed that the proposed approach achieves the best results on two indicators (OA and Kappa) and it obtains a lower FA than the pixel-based and object-based approaches. Moreover, the OA of the change detection results is improved and the false alarm rate is reduced using the proposed method, compared with some of the traditional methods.
The results obtained in this study are in agreement with the results of previous studies, despite the fact that the studies cannot be compared directly because of the differences in the data used. For example, Conradsen et al. [5] showed that the test statistic based on PolSAR images is much more sensitive to the differences than the test statistics based only on the backscatter coefficients, and Yang et al. [30] reported that object-based change detection can suppress the speckle noise.
The generalized GMM is derived under a non-Gaussian assumption for modeling the distributions of changed and unchanged classes. This parametric model is chosen because it is capable of better fitting the arbitrarily conditional densities of the classes in the DI after segmentation. In order to obtain a better change detection map, we automatically identify the optimal number of components (k) for the GMM by the elbow method. This automatic change detection approach avoids the use of empirical methods for the selection of the number of components for the GMM. Both the qualitative and quantitative analyses of the results demonstrate that the efficiency of the proposed method is high, and that it shows a significant improvement over some of the traditional methods of change detection.

5. Conclusions

A novel method of automatic and unsupervised change detection using multi-temporal PolSAR images has been presented in this paper. The proposed approach is based on automatic generation of the DI using a test statistic and an object-based statistical clustering approach. Full PolSAR images contain both phase and amplitude information from the radar returns transmitted in two different polarizations, and more scattering information can be obtained than with single-channel SAR images. The test statistic is also a good strategy for obtaining the DI from multi-temporal PolSAR images. We use the GSRM algorithm to separate the same parts of the DI, which helps us to choose the threshold by generalized GMM. Two novel methodological contributions characterize this work, compared to the traditional unsupervised change detection techniques: (1) the influence of speckle noise in the DI is suppressed in the object-based statistical clustering approach; and (2) the optimal number of components for the GMM can be automatically selected. Regarding the first contribution, as a result of the speckle noise being suppressed, the proposed algorithm improves the OA of the change detection and reduces the false alarm rate, compared with some of the traditional methods of change detection. The second contribution of estimating the optimal number of components for the GMM results in the minimum time consumption and the highest change detection accuracy. The experimental results obtained on two different multi-temporal SAR images (YanDong Lake and LiangZi Lake near the city of Wuhan, China) confirm the effectiveness of the proposed approach. Although the results obtained are very encouraging, further experiments with additional scenes should be conducted and the method should be improved. For example, the EM algorithm in the generalized GMM based on the clustering technique is prone to falling into local optima, and it can be time-consuming to arrive at the convergence criterion.

Acknowledgments

The authors would like to thank the National Natural Science Foundation of China (No. 91438203, No. 61371199, No. 41501382, No. 41601355, No. 41771377), the Hubei Provincial Natural Science Foundation (No. 2015CFB328, No. 2016CFB246), the National Basic Technology Program of Surveying and Mapping (No. 2016KJ0103), and the Technology of Target Recognition Based on GF-3 Program (No. 03-Y20A10-9001-15/16).

Author Contributions

Wensong Liu defined the research problem, proposed the methods, undertook most of the programming using MATLAB, and wrote the paper. Jie Yang gave some key advice. Jinqi Zhao gave useful advice, contributed to the paper writing, collected the data, and processed the datasets by PolSARpro and NEST software. Le Yang provided the ground reference.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Singh, A. Review Article Digital change detection techniques using remotely-sensed data. Int. J. Remote Sens. 1989, 10, 989–1003. [Google Scholar] [CrossRef]
  2. Bruzzone, L.; Bovolo, F. A novel framework for the design of change-detection systems for very-high-resolution remote sensing images. Proc. IEEE 2013, 101, 609–630. [Google Scholar] [CrossRef]
  3. Hachicha, S.; Chaabane, F. On the SAR change detection review and optimal decision. Int. J. Remote Sens. 2014, 35, 1693–1714. [Google Scholar] [CrossRef]
  4. Giustarini, L.; Hostache, R.; Matgen, P.; Schumann, G.J.-P.; Bates, P.D.; Mason, D.C. A change detection approach to flood mapping in urban areas using TerraSAR-X. IEEE Trans. Geosci. Remote Sens. 2013, 51, 2417–2430. [Google Scholar] [CrossRef]
  5. Conradsen, K.; Nielsen, A.A.; Schou, J.; Skriver, H. A test statistic in the complex wishart distribution and its application to change detection in polarimetric SAR data. IEEE Trans. Geosci. Remote Sens. 2003, 41, 4–19. [Google Scholar] [CrossRef] [Green Version]
  6. Zhao, L.; Yang, J.; Li, P.; Zhang, L. Seasonal inundation monitoring and vegetation pattern mapping of the Erguna floodplain by means of a RADARSAT-2 fully polarimetric time series. Remote Sens. Environ. 2014, 152, 426–440. [Google Scholar] [CrossRef]
  7. Zhao, J.Q.; Yang, J.; Li, P.X.; Liu, M.Y.; Shi, Y.M. An Unsupervised Change Detection Based on Test Statistic and KI from Multi-temporal and Full Polarimetric SAR Images. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, XLI-B7, 611–615. [Google Scholar] [CrossRef]
  8. Sun, W.; Shi, L.; Yang, J.; Li, P. Building Collapse Assessment in Urban Areas Using Texture Information From Postevent SAR Data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2016, 9, 3792–3808. [Google Scholar] [CrossRef]
  9. Zhao, L.; Yang, J.; Li, P.; Zhang, L.; Shi, L.; Lang, F. Damage assessment in urban areas using post-earthquake airborne PolSAR imagery. Int. J. Remote Sens. 2013, 34, 8952–8966. [Google Scholar] [CrossRef]
  10. Zhao, L.; Yang, J.; Li, P.; Zhang, L. Characteristics Analysis and Classification of Crop Harvest Patterns by Exploiting High-Frequency MultiPolarization SAR Data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2014, 7, 3773–3783. [Google Scholar] [CrossRef]
  11. Rignot, E.J.; van Zyl, J.J. Change detection techniques for ERS-1 SAR data. IEEE Trans. Geosci. Remote Sens. 1993, 31, 896–906. [Google Scholar] [CrossRef]
  12. Bazi, Y.; Bruzzone, L.; Melgani, F. An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images. IEEE Trans. Geosci. Remote Sens. 2005, 43, 874–887. [Google Scholar] [CrossRef]
  13. Moser, G.; Serpico, S.B. Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery. IEEE Trans. Geosci. Remote Sens. 2006, 44, 2972–2982. [Google Scholar] [CrossRef]
  14. Sumaiya, M.; Kumari, R.S.S. Logarithmic Mean-Based Thresholding for SAR Image Change Detection. IEEE Geosci. Remote Sens. Lett. 2016, 13, 1726–1728. [Google Scholar] [CrossRef]
  15. Liu, M.; Zhang, H.; Wang, C.; Wu, F. Change detection of multilook polarimetric SAR images using heterogeneous clutter models. IEEE Trans. Geosci. Remote Sens. 2014, 52, 7483–7494. [Google Scholar]
  16. Carincotte, C.; Derrode, S.; Bourennane, S. Unsupervised change detection on SAR images using fuzzy hidden Markov chains. IEEE Trans. Geosci. Remote Sens. 2006, 44, 432–441. [Google Scholar] [CrossRef]
  17. Bouyahia, Z.; Benyoussef, L.; Derrode, S. Change detection in synthetic aperture Radar images with a sliding hidden Markov chain model. J. Appl. Remote Sens. 2008, 2, 513–526. [Google Scholar]
  18. Inglada, J.; Mercier, G. A new statistical similarity measure for change detection in multitemporal SAR images and its extension to multiscale change analysis. IEEE Trans. Geosci. Remote Sens. 2007, 45, 1432–1445. [Google Scholar] [CrossRef]
  19. Akbari, V.; Anfinsen, S.N.; Doulgeris, A.P.; Eltoft, T.; Moser, G.; Serpico, S.B. Polarimetric SAR Change Detection With the Complex Hotelling–Lawley Trace Statistic. IEEE Trans. Geosci. Remote Sens. 2016, 54, 3953–3966. [Google Scholar] [CrossRef] [Green Version]
  20. Yousif, O.; Ban, Y. Object-Based Change Detection in Urban Areas Using Multitemporal High Resolution SAR Images with Unsupervised Thresholding Algorithms; Multitemporal Remote Sensing; Springer: Berlin, Germany, 2016; pp. 89–105. [Google Scholar]
  21. Yetgin, Z. Unsupervised change detection of satellite images using local gradual descent. IEEE Trans. Geosci. Remote Sens. 2012, 50, 1919–1929. [Google Scholar] [CrossRef]
  22. Bunch, J.R.; Fierro, R.D. A constant-false-alarm-rate algorithm. Linear Algebra Appl. 1992, 172, 231–241. [Google Scholar] [CrossRef]
  23. Otsu, N. A threshold selection method from gray-level histograms. Automatica 1975, 11, 23–27. [Google Scholar] [CrossRef]
  24. Kapur, J.N.; Sahoo, P.K.; Wong, A.K.C. A new method for gray-level picture thresholding using the entropy of the histogram. Comput. Vis. Graph. Image Process. 1985, 29, 140. [Google Scholar] [CrossRef]
  25. Kittler, J.; Illingworth, J. Minimum error thresholding. Pattern Recognit. 1986, 19, 41–47. [Google Scholar] [CrossRef]
  26. Jansing, E.D.; Albert, T.A.; Chenoweth, D.L. Two-dimensional entropic segmentation. Pattern Recognit. Lett. 1999, 20, 329–336. [Google Scholar] [CrossRef]
  27. Qi, Z.; Yeh, A.G.-O.; Li, X.; Zhang, X. A three-component method for timely detection of land cover changes using polarimetric SAR images. ISPRS J. Photogramm. Remote Sens. 2015, 107, 3–21. [Google Scholar] [CrossRef]
  28. Rasmussen, C.E. The infinite Gaussian mixture model. Adv. Neural Inf. Proc. Syst. 2000, 10, 554–560. [Google Scholar]
  29. Greenspan, H.; Ruf, A.; Goldberger, J. Constrained Gaussian mixture model framework for automatic segmentation of MR brain images. IEEE Trans. Med. Imaging 2006, 25, 1233–1245. [Google Scholar] [CrossRef] [PubMed]
  30. Yang, W.; Yang, X.; Yan, T.; Song, H.; Xia, G. Region-Based Change Detection for Polarimetric SAR Images Using Wishart Mixture Models. IEEE Trans. Geosci. Remote Sens. 2016, 54, 6746–6756. [Google Scholar] [CrossRef]
  31. Lang, F.; Yang, J.; Li, D.; Zhao, L.; Shi, L. Polarimetric SAR image segmentation using statistical region merging. IEEE Geosci. Remote Sens. Lett. 2014, 11, 509–513. [Google Scholar] [CrossRef]
  32. Nock, R.; Nielsen, F. Statistical region merging. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26, 1452–1458. [Google Scholar] [CrossRef] [PubMed]
  33. Nock, R. Fast and reliable color region merging inspired by decision tree pruning. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 8–14 December 2001. [Google Scholar]
  34. Celik, T.; Ma, K.-K. Multitemporal Image Change Detection Using Undecimated Discrete Wavelet Transform and Active Contours. IEEE Trans. Geosci. Remote Sens. 2011, 49, 706–716. [Google Scholar] [CrossRef]
  35. Zivkovic, Z. Improved adaptive Gaussian Mixture Model for Background Subtraction. In Proceedings of the IEEE 17th International Conference on Pattern Recognition, Cambridge, UK, 26 August 2004. [Google Scholar]
  36. Dempster, A.P.; Laird, N.M.; Rubin, D.B. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B (Methodol.) 1977, 39, 1–38. [Google Scholar]
  37. Bruzzone, L.; Prieto, D.F. A minimum-cost thresholding technique for unsupervised change detection. Int. J. Remote Sens. 2000, 21, 3539–3544. [Google Scholar] [CrossRef]
  38. Ketchen, D.J., Jr.; Shook, C.L. The application of cluster analysis in strategic management research: An analysis and critique. Strateg. Manag. J. 1996, 17, 441–458. [Google Scholar] [CrossRef]
  39. Goutte, C.; Toft, P.; Rostrup, E.; Nielsen, F.; Hansen, L.K. On clustering fMRI time series. Neuroimage 1999, 9, 298–310. [Google Scholar] [CrossRef] [PubMed]
  40. Pham, M.-T.; Mercier, G.; Michel, J. Change Detection between SAR Images Using a Pointwise Approach and Graph Theory. IEEE Trans. Geosci. Remote Sens. 2016, 54, 2020–2032. [Google Scholar] [CrossRef]
  41. Stehman, S.V. Selecting and interpreting measures of thematic classification accuracy. Remote Sens. Environ. 1997, 62, 77–89. [Google Scholar] [CrossRef]
  42. Zhao, J.; Yang, J.; Lu, Z.; Li, P.; Liu, W.; Yang, L. A Novel Method of Change Detection in Bi-Temporal PolSAR Data Using a Joint-Classification Classifier Based on a Similarity Measure. Remote Sens. 2017, 9, 846. [Google Scholar] [CrossRef]
Figure 1. The procedure of the GSRM algorithm.
Figure 1. The procedure of the GSRM algorithm.
Remotesensing 09 01135 g001
Figure 2. The procedure of the GMM and EM algorithms.
Figure 2. The procedure of the GMM and EM algorithms.
Remotesensing 09 01135 g002
Figure 3. The process flow of the proposed method.
Figure 3. The process flow of the proposed method.
Remotesensing 09 01135 g003
Figure 4. Location of the study area.
Figure 4. Location of the study area.
Remotesensing 09 01135 g004
Figure 5. The Pauli-RGB images of YanDong Lake after preprocessing on (a) 25 June 2015, and (b) 6 July 2016. (c) Ground reference.
Figure 5. The Pauli-RGB images of YanDong Lake after preprocessing on (a) 25 June 2015, and (b) 6 July 2016. (c) Ground reference.
Remotesensing 09 01135 g005
Figure 6. The Pauli-RGB images of Liangzi Lake after preprocessing on (a) 25 June 2015, and (b) 6 July 2016. (c) Ground reference.
Figure 6. The Pauli-RGB images of Liangzi Lake after preprocessing on (a) 25 June 2015, and (b) 6 July 2016. (c) Ground reference.
Remotesensing 09 01135 g006
Figure 7. (a) The DI based on pixels; (b) Histogram of the DI based on pixels.
Figure 7. (a) The DI based on pixels; (b) Histogram of the DI based on pixels.
Remotesensing 09 01135 g007
Figure 8. (a) The DI based on pixels; (b) The result of GSRM.
Figure 8. (a) The DI based on pixels; (b) The result of GSRM.
Remotesensing 09 01135 g008
Figure 9. (a) The DI after GSRM; (b) Histogram of the DI after GSRM.
Figure 9. (a) The DI after GSRM; (b) Histogram of the DI after GSRM.
Remotesensing 09 01135 g009
Figure 10. Change detection results of the different algorithms over YanDong Lake.
Figure 10. Change detection results of the different algorithms over YanDong Lake.
Remotesensing 09 01135 g010aRemotesensing 09 01135 g010b
Figure 11. The qualitative comparisons change detection results of the different algorithms over YanDong Lake.
Figure 11. The qualitative comparisons change detection results of the different algorithms over YanDong Lake.
Remotesensing 09 01135 g011aRemotesensing 09 01135 g011b
Figure 12. Change detection results of the different algorithms over LiangZi Lake.
Figure 12. Change detection results of the different algorithms over LiangZi Lake.
Remotesensing 09 01135 g012aRemotesensing 09 01135 g012b
Figure 13. The qualitative comparisons change detection results of the different algorithms over LiangZi Lake.
Figure 13. The qualitative comparisons change detection results of the different algorithms over LiangZi Lake.
Remotesensing 09 01135 g013
Table 1. Performance evaluation of the change detection over YanDong Lake.
Table 1. Performance evaluation of the change detection over YanDong Lake.
MethodOAFAOFKappa
TS_GMM_pixel93.64%2.95%3.41%0.72
TS_GMM_object93.55%3.63%2.82%0.73
Log_srm_GMM92.80%2.13%5.07%0.68
TS_srm_KI93.39%2.47%4.13%0.70
TS_srm_TDES93.99%1.31%4.70%0.72
TS_srm_kmeans93.32%0.88%6.24%0.70
TS_srm_FCM93.92%0.75%5.31%0.69
TS_srm_GMM94.47%1.68%3.84%0.75
Table 2. Performance evaluation of the change detection over LiangZi Lake.
Table 2. Performance evaluation of the change detection over LiangZi Lake.
MethodOAFAOFKappa
TS_GMM_pixel95.12%2.07%2.97%0.70
TS_GMM_object95.41%1.90%2.74%0.73
Log_srm_GMM95.52%1.87%2.60%0.72
TS_srm_KI95.30%3.51%1.17%0.74
TS_srm_TDES95.49%2.12%2.38%0.74
TS_srm_kmeans94.29%4.58%1.12%0.71
TS_srm_FCM94.22%4.67%1.10%0.71
TS_srm_GMM96.22%1.56%2.20%0.76

Share and Cite

MDPI and ACS Style

Liu, W.; Yang, J.; Zhao, J.; Yang, L. A Novel Method of Unsupervised Change Detection Using Multi-Temporal PolSAR Images. Remote Sens. 2017, 9, 1135. https://doi.org/10.3390/rs9111135

AMA Style

Liu W, Yang J, Zhao J, Yang L. A Novel Method of Unsupervised Change Detection Using Multi-Temporal PolSAR Images. Remote Sensing. 2017; 9(11):1135. https://doi.org/10.3390/rs9111135

Chicago/Turabian Style

Liu, Wensong, Jie Yang, Jinqi Zhao, and Le Yang. 2017. "A Novel Method of Unsupervised Change Detection Using Multi-Temporal PolSAR Images" Remote Sensing 9, no. 11: 1135. https://doi.org/10.3390/rs9111135

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop