Next Article in Journal
Landslide Susceptibility Mapping along a Rapidly Uplifting River Valley of the Upper Jinsha River, Southeastern Tibetan Plateau, China
Next Article in Special Issue
On the Effects of the Incidence Angle on the L-Band Multi-Polarisation Scattering of a Small Ship
Previous Article in Journal
A Serverless-Based, On-the-Fly Computing Framework for Remote Sensing Image Collection
Previous Article in Special Issue
Assessment of Ocean Swell Height Observations from Sentinel-1A/B Wave Mode against Buoy In Situ and Modeling Hindcasts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Offshore Oil Platform Detection in Polarimetric SAR Images Using Level Set Segmentation of Limited Initial Region and Convolutional Neural Network

1
School of Software, Northwestern Polytechnical University, Xi’an 710072, China
2
Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
3
Starway Communication, No. 31, Kefeng Road, Guangzhou Science City, Guangzhou 510663, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(7), 1729; https://doi.org/10.3390/rs14071729
Submission received: 20 February 2022 / Revised: 1 April 2022 / Accepted: 1 April 2022 / Published: 3 April 2022
(This article belongs to the Special Issue Added-Value SAR Products for the Observation of Coastal Areas)

Abstract

:
Offshore oil platforms are difficult to detect due to the complex sea state, the sparseness of target distribution, and the similarity of targets with ships. In this paper, we propose an oil platform detection method in polarimetric synthetic aperture radar (PolSAR) images using level set segmentation of a limited initial region and a convolutional neural network (CNN). Firstly, to reduce the interference of sea clutter, the offshore strong scattering targets were initially detected by the generalized optimization of polarimetric contrast enhancement (GOPCE) detector. Secondly, to accurately locate the contour of targets and eliminate false alarms, the coarse results were refined using an improved level set segmentation method. An algorithm for splitting and merging the smallest enclosing circle (SMSEC) was proposed to cover the coarse results and obtain the initial level set function. Finally, the LeNet-5 CNN model was used to classify the oil platforms and ships. Experimental results using multiple sets of polarimetric SAR data acquired by RADARSAT-2 show that the performance of the proposed method, including the detection rate, the false alarm rate, and the Intersection over Union (IOU) index between the extracted ROI and the ground truth, is better than the performance of a method that combines a GOPCE detector and a support vector machine classifier.

Graphical Abstract

1. Introduction

The automatic detection and recognition of offshore targets is one of the most important problems in remote sensing image interpretation. It is widely used in applications such as navigation, marine monitoring, disaster prevention and reduction, maritime search and rescue, and safeguarding marine rights and interests [1]. The detection of offshore oil platforms is of great significance for the safe exploitation of offshore oil and gas and platform oil spill monitoring [2,3]. In PolSAR images, the scattering intensity of the offshore oil platform is high because of the double-bounce scattering components generated by the complex metal structure. Thus, the regions of interest (ROIs) of the offshore oil platform can be extracted by determining the high-intensity regions using the traditional constant false alarm rate (CFAR) method similarly as ship detection. However, it is difficult to detect the oil platform accurately due to the complex sea state, the sparse distribution characteristics of the target, and the similarity of targets with ships.
Since offshore oil platforms and ships are both metallic targets with similar superstructures, the scattering characteristics of oil platforms are almost the same as those of ships in SAR images. Therefore, various ship detection methods can also be used for the detection of offshore oil platforms. At present, there are mainly three kinds of ship detection methods: methods based on the CFAR detection of point targets, methods based on region segmentation, and methods based on deep neural networks.
The CFAR detection method includes four basic steps: scattering feature parameters extraction, sea clutter modeling, clutter sample censoring, and detection threshold determination. With respect to clutter modeling, the CFAR detection of polarimetric SAR images can be classified as a detector based on the hypothesis of a homogeneous region using the complex Wishart distribution [4], and as a detector based on the hypothesis of a heterogeneous region using the K distribution [5] and the G0 distribution [6]. From the perspective of clutter sample censoring, the CFAR detector has gone through development as the cell-averaging CFAR, the smallest-cell CFAR, and the order-statistics CFAR detector [7]. Cui et al. [8] and the authors in [9] proposed CFAR detection methods based on iterative sample censoring. Starting from the extraction of scattering parameters, the classic detectors in polarimetric SAR images include polarization whitening filter (PWF) [10], optimal polarimetric detector (OPD), polarimetric total power, and power maximum synthesis (PMS) detector [7]. Touzi et al. [11] proposed a ship detector using the parameters of polarization reflection symmetry, and validated the performance using Canadian airborne polarimetric SAR data under different incident angles and different polarization modes. Besides that, Chen et al. [12] proposed a ship detection method based on polarization cross-entropy. Yang et al. [13] proposed a ship detector based on the parameter of generalized optimization of polarimetric contrast enhancement (GOPCE). Touzi et al. [14] proposed a detector based on polarization degree. All the existing CFAR methods are pixel-based, with their performance depending on accurate clutter modeling and the construction of a detection window. In the case of rough sea states, there will be many false alarms and missing detections due to the interference of sea clutter and the weak scattering parts in the middle of the target. It is also difficult to extract the contour of the target because of the isolated strong scattering pixels and the broken detection region.
Different from the methods of pixel-based CFAR detection, the region-based segmentation methods segment the image into strong scattering and low scattering regions based on the scattering similarity of adjacent pixels. Lombardo et al. [15] and Renga et al. [16] pointed out that the false alarm rate of ship detection can be effectively reduced by segmentation. The region-based segmentation method mainly depends on two aspects: the model of the region’s statistical distribution and the model of the region’s boundary. With respect to the distribution model, the segmentation methods of polarimetric SAR images can be classified as models based on Wishart, G0, Kummer-U, and mixture Wishart distributions, and so on. With respect to the region boundary model, the segmentation models can be classified into region merged, Markov random field (MRF), and level set methods, and so on. On the assumption that the data obey a complex Wishart distribution, Yu et al. [17] proposed a region merged method based on the likelihood ratio distance of the coherent matrix. Rignot et al. [18] proposed an MRF segmentation method by building the spatial constraint of adjacent pixels. Ayed et al. [19] proposed a region-based level set segmentation by implicitly embedding the contour into a high-dimensional level set function. Liu et al. [20,21] proposed a hierarchical level set segmentation to segment the sea and land. Jin et al. [22] improved the level set model by assuming that the data obey the Kummer-U model. Since the models are region-based, an accurate contour of the targets can be obtained. However, those region-based segmentation methods are all sensitive to the initial segmentation. The segmentation is prone to converge to the local optimum in the case of random initialization.
Unlike the above pixel-based and region-based methods, which represent the data based on the statistical distribution of intensity or polarimetric parameters, deep neural networks build a full representation of tensor data by complex network structure. Lecun et al. [23] first proposed the convolutional neural network (CNN) model to recognize handwritten digits. Alex et al. [24] modified the pooling layer and activation function, and proposed a deep CNN model named AlexNet for large-scale image parallel operations. Subsequently, the CNN model has been continuously optimized—from VGG [25] and ResNet [26] to the recent SENet [27] model, the image classification performance has been continuously improved. As for the target detection method, from the earliest R-CNN [28] model to the later Fast/Faster R-CNN [29] and then the latest Yolo [30] and other models, the network structure has undergone changes from two stages to one stage, from a single-scale network to a feature pyramid network, and the performance of detection has been continuously improved. Ai et al. [31] proposed a ship detection method combining multi-scale rotation-invariant Haar-like features and CNN feature vectors. Jin et al. [32] used a deep CNN model based on patch-to-pixel for the detection of small ships. Zhao et al. [33] used the attention receptive pyramid network for ship detection in SAR images. However, when the deep neural network model was used in the detection of polarimetric SAR targets, it was difficult to collect sufficient training samples and extract the ROI under complex sea states in SAR images.
Although offshore oil platforms can be detected using ship detection methods, these methods cannot be directly used for offshore oil platform detection. In one respect, although the scattering characteristics of oil platforms and ships are almost the same, the oil platforms are usually sparsely distributed while ships are densely distributed. When extracting the ROI of oil platforms using the three kinds of ship detection methods mentioned before, the segmentation algorithm will be hard to converge. In another respect, the detected ROIs may include both ships and oil platforms. It is difficult to identify the oil platform targets from the extracted ROIs because the scattering characteristics and geometric structure of the targets are similar to those of ships. Thus, Chen et al. [34] proposed an oil platform detection method based on multi-temporal SAR images. Liu et al. [1] proposed an oil platform detection method based on multi-temporal Landsat-8 images. However, these multi-temporal methods cannot be used for single-phase images. Zhang et al. [35] proposed an oil platform detection method based on polarimetric parameters extracted from compact PolSAR data. Marino et al. [36] studied the multi-polarization characteristics of oil platforms using dual-polarization X-band SAR imagery. Migliaccio et al. [37] and Nunziata et al. [38] detected man-made metallic targets at sea using the reflection symmetry of quad-polarization data. However, the differences of these polarimetric parameters between oil platforms and ships are so small that it is difficult to extract oil platforms from the detected man-made metallic targets. Zhang and Wang et al. proposed using Hough transform [39] and neighborhood analysis [40] to eliminate the ship targets from the extracted ROIs. However, the classification accuracies of those geometric feature-based methods are insufficient since the differences in the geometric structure between the two kinds targets are small.
As a summary of the state of the art of offshore target detection with polarimetric SAR images, polarimetric parameters enhancing the contrast between the targets and the sea clutter need to be extracted first to reduce the interference of the sea clutter. The contour of the target can then be fixed by the region-based segmentation method. Finally, the oil platforms and ships can be classified using a deep neural network. Thus, a method of offshore oil platform detection in polarimetric SAR images based on the level set segmentation of a limited initial region and a CNN is proposed in this paper.
The main contribution of the work can be summarized as follows:
  • Unlike the traditional pixel-based CFAR detection method, the level set segmentation method based on the CFAR detector of the polarimetric parameter of GOPCE is proposed for detecting offshore oil platforms and locating the contour of targets.
  • Since the level set segmentation initialized by random circles is difficult to converge due to the sparse distribution characteristics of the target, an algorithm of splitting and merging the smallest enclosing circle (SMSEC) is proposed to initialize the level set function.
  • Based on the ROI extraction and the feature selection of input data, the classic LeNet-5 model is used for the classification of offshore oil platforms and ships.
The rest of this paper is organized as follows. In Section 2, the method basis, including the level set segmentation and GOPCE detector, is briefly introduced. In Section 3, the proposed method is introduced in detail. Experimental results are shown and discussed in Section 4. The discussion is given in Section 5. The conclusion is given in Section 6.

2. Method Basis

2.1. Level Set Segmentation

To extract the ROI of an oil platform, a two-region level set segmentation method was used. In the method, the objective of the segmentation is to search for the optimum value of a defined energy function related to the segmentation curve. For the segmentation of two regions, if the image plane is R , the given polarimetric SAR image is T , the segmentation boundary is represented as a curve Γ , and the two regions divided by the curve Γ are R 1 and R 2 . If the curve Γ is implicitly embedded in a level set function Φ x , y , t , in which the zero level set function corresponds to the segmentation curve Γ t = x ( t ) , y ( t ) | Φ x , y , t = 0 , then the objective energy function related to the level set function Φ can be defined as follows [41]:
E Φ = ν R H Φ d R R H Φ ln f T | R 1 + 1 H Φ ln f T | R 2 d R ,
where H Φ is the step function, and ∇ denotes the gradient. When Φ 0 , H Φ = 1 , and Φ < 0 , H Φ = 0 . R 1 corresponds to Φ 0 and R 2 corresponds to Φ < 0 . f T | R i i = 1 , 2 denotes the probability density function of region R i . The first item of E Φ denotes the internal energy which restricts the length of the segmentation curve, while the second item of E Φ denotes the external energy related to the zero level set function.
According to the Euler–Lagrange equation, to search the optimum value of the objective function, the energy function needs to change along the derivative of the level set function with respect to time [41]:
Φ t = Φ F T = Φ ν κ + ln f T | R 2 f T | R 1 ,
where the curvature of the curve κ = d i v Φ / Φ , d i v · is the divergence, ν is the regularization parameter of the curve, and F T is the speed of evolution.
The scattering matrix of each homogeneous region of the multi-look polarimetric SAR image obeys the complex Wishart distribution. If the average coherent matrix of the region is Σ and the number of looks is L, then its coherent matrix T W Σ , L , p
f T | Σ , L , p = L p L T L p exp L tr Σ 1 T K L , p Σ L ,
where p is the number of polarization channels, tr · is the trace of the matrix, K L , p = π p p 1 2 Γ L Γ L p + 1 , and Γ · is the Gamma function.
According to Equations (2) and (3), if the average coherent matrices of two regions after segmentation are Σ 1 and Σ 2 , respectively, then the level set evolution speed function is:
F T = ν κ + L ln Σ 1 + tr Σ 1 1 T L ln Σ 2 + tr Σ 2 1 T ,
where Σ 1 and Σ 2 are estimated in each iteration according to the inner and outer regions of the temporal zero level set function.
Σ i t + 1 = 1 N i t x , y R i t T x , y ,
where t denotes the t-th iteration, T x , y denotes the coherent matrix of point x , y , and N i denotes the number of pixels of region R i .
From Equations (4) and (5), we can see that F T is close to zero when the difference between Σ 1 and Σ 2 is small.
With a setting initial level set function Φ and parameter value ν , the segmentation of land and water can be carried out by iteratively evolving the level set function using Equations (4) and (5).

2.2. GOPCE Detector

To obtain an initial detection of the ROIs of an oil platform, a GOPCE detector was used. Let A denote the target and B the background. Suppose the average Kenaugh matrix of A is K A and that of B is K B ; furthermore, suppose that g = 1 , g 1 , g 2 , g 3 t and h = 1 , h 1 , h 2 , h 3 t are the two optimal polarization states, r = r 1 , r 2 , r 3 t are the three general parameters, r 1 denotes the similarity parameter between the target and a plane, r 2 denotes the similarity parameter between the target and a dihedral, and r 3 denotes the Cloude entropy [42]. The GOPCE detector can then be defined as follows [13]:
M a x i m i z e 1 M A i = 1 3 x i r i A 2 1 N B i = 1 3 x i r i B 2 × h t K A g h t K B g S u b j e c t t o g 1 2 + g 2 2 + g 3 2 = 1 h 1 2 + h 2 2 + h 3 2 = 1 x 1 2 + x 2 2 + x 3 2 = 1
where x = x 1 , x 2 , x 3 t are three coefficients of parameters r .

3. The Proposed Method

The algorithm flow of the proposed method is shown in Figure 1. In the ROI extraction step, a level set segmentation algorithm initialized by the GOPCE detector (GOPCE-LS) is proposed for extracting the ROIs from coarse to fine. Offshore strong scattering targets are coarsely detected using the GOPCE detector first. All the coarse detected targets are then covered with multiple circles using the smallest circle enclosing algorithm. The level set function is initialized by the circles. The ROIs of the offshore oil platform are finally extracted using the improved level set segmentation. In the ROI recognition step, oil platforms are recognized from the extracted ROIs using the classic LeNet-5 model.

3.1. Initialization of Level Set Segmentation

To accurately extract the ROIs of strong scattering targets on the sea using level set segmentation, an initial level set function needs to be defined. As shown in the mesh grid in Figure 2, we usually defined the initial level set function as a signed distance function (SDF), which takes the circle in the image center as the initial segmentation curve and takes the distance between the pixel and the circle center as the initial level set function. If x c , y c is the center of the image and the setting radius of the circle is r c , then the initial level set function can be represented as follows:
Φ 0 x , y = 2 A e x p D x x c 2 + y y c 2 A ,
where A and D are constants, and D = 1 r c 2 ln 2 is to keep Φ 0 equal to zero on the points of the boundary circle.
In Figure 2, the center x c , y c is 0 , 0 , r c 2 equals 8, and A is set to 5. The green plane is the zero plane. The intersection circle between the SDF and the zero plane denotes the zero level set function.
When the image-centered circle or a random circle is used for the initialization, the inner region of the circle denotes the region where the level set function is greater than zero, while the outside is smaller than zero, as shown in Figure 3a. In Figure 3, the rectangle denotes the image plane, the spots drawn in red denote targets, and the blue circle denotes the initial zero level set function. However, there may be some targets inside the circle and some targets outside the circle, as shown in Figure 3b. If the total area of the targets inside the circle is close to that of the outside region, the average coherent matrix of the inner region Σ 1 is almost equal to that of the outside region Σ 2 . The evolution speed of the level set segmentation (4) is so close to zero that the algorithm is difficult to converge.
To avoid the problem of slow convergence caused by the initialization with a single circle, a straightforward alternative plan is to compute the initial SDF using multiple circles rather than a single circle. As shown in Figure 3c, the image is divided into multiple square regions at equal intervals, in each of which a circle for initialization is extracted. If the coordinate of the center of one sub-region is x i , y i and the radius of the circular is p i , where i = 1 , , N p and N p is the number of sub-regions, then the initial level set function is:
Φ 0 x , y = 2 A e x p D l min i x x i 2 + y y i 2 A ,
where D i = 1 p i 2 ln 2 and l = argmin i x x i 2 + y y i 2 .
However, the slow convergence problem still exists in some cases. Supposing that there is a single small target, that half of the target is in a circle, and that the other half is outside the circle, as shown in Figure 3d, the evolution speed of the level set will also be close to zero since the average coherent matrix of the inner and outer regions of the initial segmentation curve is almost equal.
To further avoid the slow convergence problem, it is necessary to define a more reasonable initial segmentation curve. If we know the coarse position of the targets, we can initialize the level set function according to the boundary of the coarse result. However, the level set function cannot be initialized by a curve of any shape obtained by the boundary of the coarse result. Thus, we propose covering the coarsely detected targets using multiple circles based on the position distribution of the target regions. If the initial circles are close to the true boundary of the targets, the above half-coverage problem can be avoided.

3.2. Coarse Detection of Targets

To initialize the level set function using multiple circles, an initial detection of the suspicious targets is needed first. In an SAR image, the double-bounce scattering component between the tightly connected metal structure makes the oil platform constitute a strong scatterer. As shown in Figure 4, a Pauli pseudo-color image of oil platforms on the coast of Singapore is shown in Figure 4a. The corresponding ground truth is shown in Figure 4b, where the region marked by the red box is the oil platform. We can observe that the targets appear as a white light area with irregular contours. Thus, the initial detection can be fulfilled using the general CFAR detection method of strong scattering targets. However, accurate clutter modeling, sample censoring and detection window construction are needed in the case of a high sea state. Since only a coarse result is needed for the initial detection, the detection can be improved by extracting the polarimetric parameters of the targets. In polarimetric SAR images, the scattering component of the oil platform is complex due to the complex metal structure. Firstly, the similarity of the scattering matrix between the targets and a dihedral is high because of the double-bounce scattering component. Secondly, the polarimetric entropy and alpha angle is high according to the H / α classification plane [42] since the targets can be classified in the high-entropy double-bounce scattering region. Finally, the contrast of the double-bounce similarity and the polarimetric entropy between the targets and the background is high. The GOPCE detector can enhance the contrast of similarity parameters and polarimetric entropy between targets and background in a combination of the selection of an optimal polarization state. Since the contrast is greatly enhanced, the target pixels can be simply detected by a global thresholding of the GOPCE parameter. Therefore, the GOPCE detector (6) performing in a thresholding of a single pixel without sliding window construction was used for the detection of the oil platform.

3.3. Circle Calculation

When the coarse results of targets are detected, a circle covering all the detected targets needs to be computed to initialize the level set function using SDF. Since a smaller covered circle means a larger distance of the coherent matrix between the inner and outer segmentation regions, which is better for the convergence of segmentation, we need to find the smallest enclosing circle. As shown in Figure 5, the white region in the rectangle denotes the sea and the red spot denotes the detection targets. Three detected targets are covered by a single circle in Figure 5a, which is the smallest enclosing circle since the circle is just a coverage of the targets.
If the set of pixel coordinates of the initial detected targets is P i = x i , y i i = 1 N , where N is the total number of target pixels, then the problem can be described as “Given N points on a plane, cover all the points with a circle, and find the center and radius of the circle”. The problem can be solved by the incremental method [43]. The specific algorithm steps are as follows (Algorithm 1).
Algorithm 1 The smallest enclosing circle algorithm
(Circle C) = Smallest_circle(Points P i i = 1 N )
1:
Initialization: select two points P 1 , P 2 , consider P 2 as the current point, and obtain the initial circle C 2 with diameter P 1 P 2 (the circle determined by point P i is C i );
2:
i = 3 , then for each P i , if P i is inside C i 1 , then C i = C i 1 ; otherwise go to step 3;
3:
Construct a new circle containing P i . First determine C i 0 with diameter P 1 P i , if points P 1 P i 1 are all inside C i 0 , then C i = C i 0 ; otherwise go to step 4;
4:
If there is a point P j j < i which is not in C i 0 , obtain a new circle C i 1 with diameter P i P j . If points P 1 P j 1 are all inside C i 1 , then C i = C i 1 ; otherwise go to step 5;
5:
If there is a point P k k < j < i which is not in C i 1 , obtain a new circle C i 2 with three points P i , P j , P k , and finally C i = C i 2 ;
6:
Repeat Steps 2–5 until i = N . Return C N .
All target pixels can be covered by a circle using the smallest enclosing circle algorithm. However, the problem is that if the targets are scattered and distributed in the image, the calculated circle will be so large that the area of the sea in the covered circle is much larger than that of targets, as shown in Figure 5a. The distance of the coherent matrix between the inner and outer regions thus becomes smaller. Therefore, the scattered targets need to be classified into a group and covered with different circles, as shown in Figure 5b. To simplify the grouping process, a strategy of splitting and merging was taken, as shown in Figure 6. In the splitting step, the image plane is recursively split into small regions. Two splitting steps are shown in Figure 6. A region R is first equally divided into four phases R i ( i = 1 , 2 , 3 , 4 ) . Each sub-region R i is then equally divided into phases R i j ( j = 1 , 2 , 3 , 4 ) . In the merging step, the target pixels in a sub-region are covered by a circle using the smallest enclosing circle algorithm. The splitting and merging process continues until the size of sub-region is less than a constant value SC. Supposing R denotes the image plane and the size is X × Y , to ensure that the size of the sub-region is not too large, the region is to be split if the diameter of the smallest enclosing circle of the target pixels in the region is greater than m i n X , Y / 4 at the beginning of the algorithm. Then, for a given Z × Z region, if the diameter of the smallest enclosing circle of the region is greater than Z, the region will be split. Supposing the smallest size of the splitting region to be S C = 2 Q , the algorithm can be described as follows (Algorithm 2).
Algorithm 2 Split and merge circle coverage algorithm
Split_merge(region  R , xlabel u, ylabel v, size n)
1:
if  n = = S C   then
2:
   if  u 0 , v 0 s . t . R u 0 , v 0 = = 1  then
3:
      C r ( u + n / 2 , v + n / 2 , n / 2 )  
4:
      return
5:
   end if
6:
else
7:
   (center, radius) = Smallest_circle ( R , u, v, n)
8:
   if  2 r a d i u s 2 ( M k ) & & 2 r a d i u s m i n ( X , Y ) / 4  then
9:
      C r (center(1), center(2), radius)
10:
   else
11:
      Split_merge( R , u, v, n / 2 )
      Split_merge( R , u + n / 2 , v, n / 2 )
      Split_merge( R , u, v + n / 2 , n / 2 )
      Split_merge( R , u + n / 2 , v + n / 2 , n / 2 )
12:
   end if
13:
end if
In Algorithm 2, R denotes the segmented region, u and v are the coordinates of the left corner point of R , n denotes the size of R, and C r denotes the set of circles. At the beginning of the algorithm, the X × Y image plane R is padded into 2 M × 2 M with zero, where M is the minimum number such that 2 M is larger than X and Y. R is set to R , u and v are set to 0, n is set to 2 M , and C r is set to .
If the center of the circle C r j j = 1 , , N q computed by Algorithm 2 is x j , y j and the radius is q j , we can obtain the final initial level set function as follows.
Φ 0 x , y = 2 A e x p D l min j x x j 2 + y y j 2 A ,
where D j = 1 q j 2 ln 2 and l = argmin i x x i 2 + y y i 2 .

3.4. ROI Extraction

Based on the initial level set function defined by Equation (9), the regions of strong scattering and low scattering can be segmented by evolving the level set function using Equation (10) based on Equation (4).
Φ t + Δ t = Φ t Φ F T Δ t
When the evolution is terminated, the strong scattering and low scattering regions can be identified by comparing the average power of the two segmented regions. The ROIs of the targets on the sea can be extracted by determining all the connected strong scattering regions from the segmentation result.

3.5. ROI Recognition

Supposing the extracted ROIs to be R O I i , the final step of oil platform recognition is to classify R O I i into oil platforms and ships. Because the shape of oil platforms and ships is similar, it is difficult to accurately classify the two kinds of target using traditional geometric-based methods. Since deep network structure can fully represent data without geometric features extraction, CNN was taken as the classifier. Because the size of the ROI is small and the number of training samples was small, the lightweight CNN model LeNet-5 [23] was selected to perform the classification.
To use the CNN model, the input data and the network need to be constructed. Because the coherent matrix T is a 3 × 3 complex matrix, the nine elements need to be vectorized as the input. Since the difference of the scattering components between the oil platform and the ship is small and the main difference of the two targets is the contour shape, only the three diagonal elements T 11 , T 22 , T 33 of T in a combination of the GOPCE parameter were selected as the input data.
The LeNet-5 model requires the input image to have a fixed size J × J . However, the size of the extracted ROI varies. To avoid statistical distortion of the data caused by image zooming, we directly cropped a fixed J × J region in the center of the circumscribed rectangle of each ROI.
Since the dynamic range of the scattering power of the SAR image is large, the sigmoid activation function of the LeNet-5 model was replaced with the ReLU activation function, and the average pooling was replaced with maximum pooling in the polling layer. The network structure of the model is shown in Table 1. We also added a batch normalization layer after each convolutional layer and fully connected layer. The input was a 4-channel image of 32 × 32 . The output was a 3-dimensional vector representing three different categories of oil platform, ship, and background.

4. Experimental Results and Analysis

Seven single-look quad-polarization SAR datasets acquired by the RADARSAT-2 sensor over the coasts of Brunei, Ho Chi Minh City in Vietnam, El Nido in Philippines, and the Beibu Gulf of China were used to test the proposed method. The detailed parameters of the data are shown in Table 2. The range resolutions were all 4.73 m . The azimuth resolutions were varied from 4.78 m to 5.18 m . The size of the images was about 6000 × 4000 . To evaluate the performance of the proposed method, we drew the ground truth of the oil platforms by referring first to Google Earth and artificial judgment. Dataset 1 was then taken as an example to show the flow of the proposed method in Experiment A. The validation of the proposed method was divided into three parts. The first part validated the robustness of the proposed method by testing the method using data from different sites in Experiment B. The second part validated the performance of the ROI extraction. In Experiment C, the detection performance of the proposed GOPCE-LS method was first compared with that of different CFAR detection methods. The performance of the proposed GOPCE-LS method was then compared under different level set initialization methods and different algorithm parameters in Experiment D. The third part validated the performance of the ROI recognition. The recognition performance of the proposed method was compared with that of the support vector machine (SVM) classifier based on the ROI extraction result of GOPCE-LS in Experiment E.
The performance was evaluated using detection rate, false alarm rate, and two Intersection over Union (IOU) indexes. The macro-IOU computed the IOU between the detected result and the ground truth independently for each target and then computed the average, whereas the micro-IOU aggregated the contribution of all targets to compute the average IOU metric. If the detected result is D R = D R i i = 1 , , M and D R i denotes the ith candidate target, and if the ground truth is G T = G T j j = 1 , , N and G T j denotes the jth true target, then the macro-IOU and micro-IOU are defined as follows:
m a c r o - I O U = 1 N j = 1 N D R i G T j D R i G T j , m i c r o - I O U = D R G T D R G T ,
where D R G T denotes the union of the two sets, D R G T denotes the intersection of the two sets, and D R i G T j ( D R i G T j ) denotes the intersection (union) of the target G T j with the intersecting detected target D R i .
In the experiment, the image was processed by 5 × 5 multi-look processing to reduce the input size of the extracted ROI, where the size of the multi-look was determined by the average width and length of the oil platform and the input size of the CNN network model. In the coarse detection step, the probability of a false alarm (PFA) was set to 0.01. The strong scattering regions and the other regions in the ground truth were selected as the samples of target and background, respectively. When the splitting and merging algorithm was carried out, the minimum split size Q was set to 3, where Q can be set to 2–6. When performing the level set segmentation, the parameter A was set to 100, the curve parameter ν was set to 0.1 [20], and the maximum number of iterations was set to 200. Where the parameter PFA was set according to Experiment C, the parameters Q and ν were set according to Experiment D. For CNN classification, the input image size was set to 32 × 32 . When training the model, the batch size was set to 10, and the number of epochs was set to 20. In the experiment, parts of the seven datasets were randomly selected as training data, and the other datasets were used for testing. For performance analysis, we conducted the test using datasets 1–3 for training and datasets 4–7 for testing as examples. The testing platform used was Matlab v9.5 and CPU was Intel Xeon at 3.6 GHz with 16 GB RAM.

4.1. Results on Example Data

In the first experiment, Dataset 1 was taken as example data to show the detailed procedures of the proposed method. The Pauli pseudo-color image of the data is shown in Figure 7a. We can observe that several oil platforms surrounded by ships are sparsely distributed on the sea. It is difficult to distinguish oil platforms from ships because of their similar intensity and geometric structure. The coarse detected result of the ROI is shown in Figure 7b, where the white regions denote the detected targets and the gray regions denote the background. From the result we can find that almost all targets were correctly detected by the GOPCE detector. However, because H was calculated in a sliding window, there were some offsets between the extracted target contour and the actual contour. The circles obtained by the proposed split and merge smallest enclosing circle method are shown in Figure 7c, where the circles are drawn in red. The zooming result of Figure 7c near the island is shown in Figure 7d. We can find that all targets are correctly covered by multiple circles. The segmentation result is shown in Figure 7e, where the segmentation boundary is drawn in red. The zooming result of Figure 7e near the island is shown in Figure 7f. We can see that the segmentation boundary is accurately fixed in the actual boundary of the targets from Figure 7f. The result of the extracted ROIs is shown in Figure 7g, where the detected ROIs are marked in a red box. From Figure 7g, we can find that the sizes of the marked ROIs are varied. The final recognition result is shown in Figure 7h and the zooming result is shown in Figure 7i, where the detected oil platforms are drawn in green and the ships are drawn in red. We can observe that the oil platforms were correctly separated from ships by the CNN classifier. The detection accuracies, including detection rate, false alarm rate, and two IOU indexes, are listed in the second row of Table 3. All the six oil platforms in the data were correctly detected and the two IOU indexes were both higher than 99%.

4.2. Test under Different Sites

To validate the robustness of the method, the proposed method was tested using data from different sites. The result of Datasets 2–5 of Table 2 are shown in Figure 8, where the results of data i + 1 are shown in Figure 8(a1–e1). The Pauli pseudo-color images of the data are shown in Figure 8(a1–a4). We can see that the oil platforms are all sparsely distributed. The coarse detected results of the ROI are shown in Figure 8(b1–b4). The circle coverage results are shown in Figure 8(c1–c4). The final detection results are shown in Figure 8(d1–d4). The zooming result of Figure 8(d1–d4) are shown in Figure 8(e1–e4). We can see that the oil platforms were accurately detected and recognized from Figure 8(e1–e4). The performances including detection rate, false alarm rate, and two IOU indexes are listed in Table 3. The table shows that the detection rates were all 100%, the false alarm rates were all 0, and the two IOU indexes were all higher than 95% for each dataset. For the overall performance, the detection rate was also 100%, the false alarm rate was 0, and both the average macro-IOU and the average micro-IOU could achieve 98%.

4.3. Comparison of ROI Extraction

To evaluate the performance of the proposed GOPCE-LS method, we compared the proposed method with four different detection methods using Dataset 1 in this test. The four methods include H / α , PMS, PWF, and GOPCE detectors. In the H / α method, pixels with an entropy greater than 0.5 and an alpha angle greater than 45° were detected as targets. In the PMS, PWF, and GOPCE methods, the PFAs were all set to 0.01. The comparison results are shown in Figure 9. Because the targets were very small, a sub-region near the island in the image is shown to compare the detection results. The Pauli pseudo-color image of the data is shown in Figure 9(a1). The region marked in a red box in Figure 9(a1) is shown in Figure 9(a2). The ROI detection results of the H / α , PMS, PWF, and GOPCE methods are shown in Figure 9(b1,c1,d1,e1) ( i = 1 , 2 ), respectively. The ROI detection results of the proposed GOPCE-LS method are shown in Figure 9(f1,f2). The results of the full image are shown from Figure 9(b1–f1), and the results of the sub-region are shown from Figure 9(b2–f2). We can see that the offset of the proposed method between the detected result and the ground truth is smaller than that of other methods from the results. The detection performances of different ROI detection methods are listed in Table 4. All the 19 ROIs were detected by the proposed method, but there was one missing detection target for all the four comparison methods. The number of false alarms was 0 for the proposed method but 10 for the PMS method and 4 for the PWF method. The macro-IOU and micro-IOU indexes of the proposed method were both 0.9969, much higher than those of the four comparison methods.
Since the performance of the GOPCE method was the best among the four comparison ROI detection methods, the detailed ROI detection performance of the proposed GOPCE-LS method was compared with that of the GOPCE method using Datasets 1–4, where all the strong scattering targets on the sea were labeled as ROIs. The detection rate and false rate of the proposed method and the comparison method are shown in Table 5. The table shows that all the ROI targets were correctly extracted by the proposed method and only one false target was detected, in Dataset 3. The total detection rate was 100% and the false alarm rate was 1.9%. The average macro-IOU index was 0.9836, and the average micro-IOU index was 0.974. There was one missing target in Datasets 1, 2, and 3 for the comparison method. The total detection rate was 94%. However, the average macro-IOU index was 0.74, and the average micro-IOU index was 0.769. The missing and false targets are shown in Figure 10, where the results of data i are shown from Figure 10(a1–d1). The Pauli pseudo-color images are shown in Figure 10(a1–a3), where the wrong regions are marked in a red circle. The ROI extraction results of the GOPCE method are shown in Figure 10(b1–b3), where the missing targets of Dataset 1 and Dataset 2 are marked in a red circle. The ROI extraction results of the GOPCE-LS method are shown in Figure 10(c1–c3), where the false target of Dataset 3 is marked in a red circle. The zooming images of the wrong regions are shown in Figure 10(d1–d3). The reason for the missing targets was that the targets were too small, whereas the reason for the false alarm was that the region was an echo sidelobe of a strong scatterer.
The receiver operating characteristic (ROC) curves of the proposed method and the GOPCE method testing in Datasets 1–4 are shown in Figure 11. From the result, we can observe that the detection rates were larger than 0.94 when the PFA was larger than 0.01 for both the two methods. The detection rate of the proposed method was 1 even when the PFA was less than 0.01. The reason is that a target can be covered by the proposed method even if only a few points on the target are detected by the GOPCE detector under a small PFA. Even if some targets are missed by the GOPCE detector, the ROI can be correctly segmented by the level set segmentation method in a valid initialization of covering most of the targets using the proposed method.

4.4. Comparison of the GOPCE-LS Method Using Different Level Set Initialization Methods and Different Parameters

Since the purpose of the GOPCE-LS method is to avoid the slow convergence problem, the proposed method in which the level set function is initialized by the SMSEC method was compared with three other different methods, including the single-circle initialization, the equally divided multi-circle initialization, and the minimum single-circle initialization. As shown in Figure 12, the initialized zero level set function is drawn with red circles. In all the four methods, the parameter A was set to 100. All the initial results are shown in Figure 12. The result of single-circle initialization is shown in Figure 12a, where the parameter D was set to 10 X 2 + Y 2 in an image of size X × Y . The result of equally divided multi-circle initialization is shown in Figure 12b, where the number of sub-regions was set to 6 in the vertical direction. The result of the minimum single-circle coverage initialization is shown in Figure 12c. The result of the proposed SMSEC method is shown in Figure 12d. We can observe that almost all the targets were minimally covered in the result of the proposed method compared with those of other initialization methods. To evaluate the convergence performance, we compared the final number of convergence iterations of different initialization methods using Dataset 1–4 since the sites of those four datasets were different. The results are listed in Table 6. The maximum number of iterations was set to 500. From the result, we can find that only the proposed method was able to converge in 500 iterations. The numbers of convergence times of the proposed method were 70, 63, 185, and 195, which are all less than 200.
To evaluate the robustness of the proposed segmentation method, we tested the method under different parameters using Dataset 1. The main parameters of the proposed method include ν and Q according to Equation (4) and Algorithm 2. The regularization parameter ν was set to 0.05, 0.1, 0.2, 0.3, and 0.5. The splitting parameter Q was set to 2, 3, 4, 5, and 6. The results are listed in Table 7. The detection rates were all 100% and the false alarm rates were all 0 when ν was equal to 0.05, 0.1, and 0.2. Because some targets are too small, there will be a missing target when ν is set to a value larger than 0.3. There will be some false alarms when the ν is set to 0.5. The reason for this is that the regularization energy of some background regions is so much larger that they are segmented into targets. Because the contour of the segmented targets is smoother as ν increases, the macro-IOU and micro-IOU decrease as ν increases. The macro-IOU and micro-IOU are the highest when ν is set to 0.1. The number of detection targets, the number of false alarm targets, the macro-IOU index, and the micro-IOU index do not change when the value of Q changes. The reason is that the segmentation algorithm has a certain tolerance for the degree of target coverage in the initialization.

4.5. Comparison of the ROI Recognition

To evaluate the ROI recognition performance of offshore oil platforms by the proposed method, we compared the performance of the CNN classifier with the SVM classifier based on the ROI extraction result of the proposed GOPCE-LS method. For the SVM classifier, the radial basis function (RBF) kernel was used, and the three parameters of total power, area, and aspect ratio were extracted as the input feature vector. The recognition rate and false alarm rate of oil platforms by the two classifiers in both the training data and the testing data are shown in Table 8. We can find that the recognition rate of the proposed method was better than that of the SVM classifier. For the training data, all oil platforms and no false alarms were recognized for both methods. For the four testing datasets, all oil platforms and no false alarms were recognized for the proposed method. However, there were two false alarms in Dataset 6 and one false alarm in Dataset 5 and Dataset 7 for the SVM classifier. The recognition results of the testing datasets 5–7 are shown in Figure 13, where the results of data i + 4 are shown from Figure 13(a1–d1). The Pauli pseudo-color images are shown in Figure 13(a1–a3), where the false alarms are marked in a red circle. The recognition results of the SVM classifier are shown in Figure 13(b1–b3), where the missing targets of Dataset 1 and Dataset 2 are marked in a red circle. The recognition results of the proposed method are shown in Figure 13(c1–c3). The corresponding zooming images of the wrong regions are shown in Figure 13(d1–d3). The cause for the false alarms in the testing data was that the outline difference between the false alarms and the oil platform was too small. The recognition performance of the proposed method was better than that of the comparison method.

5. Discussions

With respect to the offshore oil platform detection problem, the proposed method introduces a novel solution by a combination of CFAR detection of the GOPCE parameter, ROI extraction by the region-based level set segmentation method, and ROI classification by CNN using a polarimetric SAR image. The obtained experimental results show that the proposed method can achieve not only high detection accuracies and low false alarm rates (the overall detection rates were 100% and the overall false alarm rates were zero) but also high location accuracies of target regions (the average of the two IOU indexes were both higher than 95%). In the step of initial target detection, the detection rate of the GOPCE detector was higher than 90% in multiple images. The GOPCE detector can obtain high performance since the characteristics of high polarimetric entropy and high scattering component of the dihedral corner of the targets are fully used. However, there were some fragments and missing detections in the results because the coarse detection was pixel-based. By the refined detection of the targets using the improved level set method, the target regions were segmented accurately enough for the fragments and missing detections to be largely reduced. The detection rate of the ROIs was increased to 100, and the accuracies of the location IOU indexes of target regions was increased to 98% from 75%. One of the difficulties of oil platform detection is that the differences in the geometric and scattering features between the targets and ships are small. It is difficult to extract trivially different features using the traditional feature-based classification method. The CNN model can achieve full representation of the data by a deep network structure so that the classification performance of the two kinds of targets can be improved. The experimental results show that the overall false alarm rate was decreased from 10% to 0 compared with the SVM classification method.
Due to the sparse distribution of oil platforms, the segmentation is difficult to converge since the evolution speed of the level set function is small. The cause for this is that the difference of the average coherent matrix between the inner and outer region of the zero level set function is small. By covering the coarsely detected targets using the SMSEC algorithm to obtain the initial level set function, the ratio of target pixels in the inner region of the zero level set plane increased so much that the evolution speed was greatly increased. The comparison results of different level set initialization methods show that the slow convergence problem is avoided by the proposed method since the algorithm can converge in 200 iterations.
Suppose that the size of the image is n × n ; then, the number of splits is log n when determining the initial segmentation. Since the complexity of the smallest enclosing circle algorithm for a single region is O n , the complexity of splitting and merging the smallest enclosing circle algorithm is O n log n . In the algorithm for initial target extraction, we used an explicit expression to calculate the eigenvalues of the 3 × 3 complex coherent matrix, which allowed us to simultaneously calculate the similarity and H parameters of the pixels of the entire image, so that the complexity of it was O 1 . Since the complexity of the level set segmentation algorithm is O k n 2 , where k is the number of iterations, the complexity of the target ROI extraction algorithm is O k n 2 . Therefore, the final time complexity of the proposed algorithm is O k n 2 . Since the actual number of iterations of the level set algorithm is largely reduced, the time complexity of the proposed algorithm is reduced.

6. Conclusions

The oil platform detection method in a polarimetric SAR image based on the level set segmentation of a limited initial region and CNN was proposed in this paper. To avoid the problem of the slow convergence of level set segmentation in the case of offshore targets that are sparsely distributed, the level set segmentation of a limited initial region was proposed to extract the ROIs. In the algorithm, the sparse offshore strong scattering targets are initially detected by GOPCE detector. Then, circles covering the coarsely detected targets are calculated using the splitting and merging smallest enclosing circle algorithm. Since the circles are the minimum coverage of the initially detected targets, the area of the sea inside the circle is so small that the difference of the average coherent matrix between the two initial segmented regions is large. As a result, the initial evolution speed of the level set function is so fast that the level set segmentation is convergent. By representing the multi-channel polarimetric data using the LeNet-5 CNN network, oil platforms can be effectively recognized from the extracted ROIs. The experimental results of seven polarimetric datasets over the coasts of Brunei, Ho Chi Minh City in Vietnam, El Nido in Philippines, and the Beibu Gulf of China acquired by RADARSAT-2 demonstrate the effectiveness of the proposed method. The experimental results show that the convergence speed of the proposed segmentation method is much faster than that of level set segmentation initialized by the random single-circle, equally divided multi-circle, or minimum-coverage single-circle methods. The micro-IOU and macro-IOU performance for ROI extraction by the proposed method is much better than that of the H / α , PMS, PWF, and GOPCE methods. The detection rate of ROI extraction by the proposed method is higher than that of the GOPCE detection method. The false alarm rate of oil platform recognition by the proposed method is lower than that of the SVM classifier.
Since no more than ten datasets could be acquired to test the proposed method, we adopted a two-step detection strategy to carry out the object detection. Because ROIs were accurately extracted first by the proposed GOPCE-LS method, only a small-scale neural network model training in a small-scale labeling dataset was needed for the ROI classification. The under-fitting problem is avoided if a large-scale neural network model is used in a small training dataset. In the future, if a large-scale and high-quality labeled dataset used for oil platform detection can be obtained, the detection method can be improved using the state of the art of one-step neural network object detection methods, but the fusion of polarization information is necessary.

Author Contributions

Conceptualization, C.L. and J.Y.; methodology, C.L.; software, C.L.; validation, C.L., J.O. and D.F.; formal analysis, J.Y.; investigation, J.O.; resources, J.Y.; data curation, D.F.; writing—original draft preparation, C.L.; writing—review and editing, J.Y.; visualization, C.L.; supervision, J.Y.; project administration, C.L.; funding acquisition, C.L. and J.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the National Natural Science Foundation of China (NSFC) (No. 62101456 and 62171023), and in part by the Fundamental Research Funds for the Central Universities (No. D5000210752).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Please contact Chun Liu ([email protected]) for access to the data.

Acknowledgments

The authors would like to thank the reviewers for their valuable comments and suggestions. The data were provided by the laboratory of polarimetric radar and remote sensing applications of Tsinghua University and the China National Satellite Ocean Application Service.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this paper.

References

  1. Liu, Y.; Sun, C.; Yang, Y.; Zhou, M.; Zhan, W.; Cheng, W. Automatic extraction of offshore platforms using time-series Landsat-8 Operational Land Imager data. Remote. Sens. Environ. 2016, 175, 73–91. [Google Scholar] [CrossRef]
  2. Casadio, S.; Arino, O.; Minchella, A. Use of ATSR and SAR measurements for the monitoring and characterisation of night-time gas flaring from off-shore platforms: The North Sea test case. Remote. Sens. Environ. 2012, 123, 175–186. [Google Scholar] [CrossRef]
  3. Casadio, S.; Arino, O.; Serpe, D. Gas flaring monitoring from space using the ATSR instrument series. Remote. Sens. Environ. 2012, 116, 239–249. [Google Scholar] [CrossRef]
  4. Novak, L.M.; Sechtin, M.B.; Cardullo, M.J. Studies of target detection algorithms that use polarimetric radar data. IEEE Trans. Aerosp. Electron. Syst. 1989, 25, 150–165. [Google Scholar] [CrossRef] [Green Version]
  5. Frery, A.C.; Muller, H.; Yanasse, C.C.F.; Sant’Anna, S.J.S. A model for extremely heterogeneous clutter. IEEE Trans. Geosci. Remote Sens. 1997, 35, 648–659. [Google Scholar] [CrossRef]
  6. Fan, W.; Zhou, F.; Tao, M.; Bai, X.; Shi, X.; Xu, H. An automatic ship detection method for PolSAR data based on K-Wishart distribution. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2017, 10, 2725–2737. [Google Scholar] [CrossRef]
  7. Novak, L.M.; Hesse, S.R. On the performance of order-statistics CFAR detectors. In Proceedings of the IEEE 25th Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA, 4–6 November 1991; pp. 835–840. [Google Scholar]
  8. Cui, Y.; Zhou, G.; Yang, J.; Yamaguchi, Y. On the iterative censoring for target detection in SAR images. IEEE Geosci. Remote Sens. Lett. 2011, 8, 641–645. [Google Scholar] [CrossRef]
  9. An, W.; Xie, C.; Yuan, X. An improved iterative censoring scheme for CFAR ship detection with SAR imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52, 4585–4595. [Google Scholar]
  10. Novak, L.M.; Burl, M.C.; Irving, W.W. Optimal polarimetric processing for enhanced target detection. IEEE Trans. Aerosp. Electron. Syst. 1993, 29, 234–244. [Google Scholar] [CrossRef]
  11. Touzi, R.; Charbonneau, F. Characterization of target symmetric scattering using polarimetric SARs. IEEE Trans. Geosci. Remote Sens. 2002, 123, 2507–2516. [Google Scholar] [CrossRef]
  12. Chen, J.; Chen, Y.; Yang, J. Ship detection using polarization Cross-Entropy. IEEE Geosci. Remote Sens. Lett. 2009, 6, 723–727. [Google Scholar] [CrossRef]
  13. Yang, J.; Zhang, H.; Yamaguchi, Y. GOPCE-Based approach to ship detection. IEEE Geosci. Remote Sens. Lett. 2012, 9, 1089–1093. [Google Scholar] [CrossRef]
  14. Touzi, R.; Hurley, J.; Vachon, P.W. Optimization of the degree of polarization for enhanced ship detection using polarimetric RADARSAT-2. IEEE Trans. Geosci. Remote Sens. 2015, 53, 5403–5424. [Google Scholar] [CrossRef]
  15. Lombardo, P.; Sciotti, M. Segmentation-based technique for ship detection in SAR images. IEEE Proc. Radar Sonar Navig. 2001, 148, 147–159. [Google Scholar] [CrossRef]
  16. Renga, A.; Graziano, M.D.; Moccia, A. Segmentation of marine SAR images by sublook analysis and application to sea traffic monitoring. IEEE Trans. Geosci. Remote Sens. 2019, 57, 1463–1477. [Google Scholar] [CrossRef]
  17. Yu, P.; Qin, A.K.; Clausi, D.A. Unsupervised polarimetric SAR image segmentation and classification using region growing with edge penalty. IEEE Trans. Geosci. Remote Sens. 2012, 50, 1302–1317. [Google Scholar] [CrossRef]
  18. Rignot, E.; Chellappa, R. Segmentation of polarimetric synthetic aperture radar data. IEEE Trans. Image Process. 1992, 1, 281–300. [Google Scholar] [CrossRef]
  19. Ayed, I.B.; Mitiche, A.; Belhadj, Z. Polarimetric image segmentation via maximum-likelihood approximation and efficient multiphase level-sets. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28, 1493–1500. [Google Scholar] [CrossRef]
  20. Liu, C.; Yang, J.; Yin, J.; An, W. Coastline detection in SAR images using a hierarchical level set segmentation. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2016, 9, 4908–4920. [Google Scholar] [CrossRef]
  21. Liu, C.; Xiao, Y.; Yang, J. A Coastline Detection Method in Polarimetric SAR Images Mixing the Region-Based and Edge-Based Active Contour Models. IEEE Trans. Geosci. Remote Sens. 2017, 55, 3735–3747. [Google Scholar] [CrossRef]
  22. Jin, R.; Yin, J.; Zhou, W.; Yang, J. Level Set Segmentation Algorithm for High-Resolution Polarimetric SAR Images Based on a Heterogeneous Clutter Model. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2017, 10, 4565–4579. [Google Scholar] [CrossRef]
  23. Lecun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 1998, 86, 2278–2324. [Google Scholar] [CrossRef] [Green Version]
  24. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. Commun. ACM 2017, 60, 84–90. [Google Scholar] [CrossRef]
  25. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
  26. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 770–778. [Google Scholar]
  27. Hu, J.; Shen, L.; Albanie, S.; Sun, G.; Wu, E. Squeeze-and-Excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 2011–2023. [Google Scholar] [CrossRef] [Green Version]
  28. Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, 23–28 June 2014; pp. 580–587. [Google Scholar]
  29. Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [CrossRef] [Green Version]
  30. Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 26 June–1 July 2016; pp. 779–788. [Google Scholar]
  31. Ai, J.; Tian, R.; Luo, Q.; Jin, J.; Tang, B. Multi-scale rotation-invariant haar-like feature integrated CNN-Based ship detection algorithm of multiple-target Environment in SAR Imagery. IEEE Trans. Geosci. Remote Sens. 2019, 57, 10070–10087. [Google Scholar] [CrossRef]
  32. Jin, K.; Chen, Y.; Xu, B.; Yin, J.; Wang, X.; Yang, J. A Patch-to-Pixel convolutional neural network for small ship detection with PolSAR images. IEEE Trans. Geosci. Remote Sens. 2020, 58, 6623–6638. [Google Scholar] [CrossRef]
  33. Zhao, Y.; Zhao, L.; Xiong, B.; Kuang, G. Attention receptive pyramid network for ship detection in SAR images. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2020, 13, 2738–2756. [Google Scholar] [CrossRef]
  34. Chen, P.; Wang, J.; Li, D. Oil platform investigation by multi-temporal SAR remote sensing image. In SPIE Remote Sensing International Society for Optics and Photonics; International Society for Optics and Photonics: Prague, Czech Republic, 2011; p. 28. [Google Scholar]
  35. Zhang, B.; Li, X.; Perrie, W.; Garcia-Pineda, O. Compact Polarimetric Synthetic Aperture Radar for Marine Oil Platform and Slick Detection. IEEE Trans. Geosci. Remote Sens. 2017, 55, 1407–1423. [Google Scholar] [CrossRef]
  36. Marino, A.; Velotto, D.; Nunziata, F. Offshore Metallic Platforms Observation Using Dual-Polarimetric TS-X/TD-X Satellite Imagery: A Case Study in the Gulf of Mexico. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2017, 10, 4376–4386. [Google Scholar] [CrossRef] [Green Version]
  37. Migliaccio, M.; Nunziata, F.; Montuori, A.; Li, X.; Pichel, W.G. A Multifrequency Polarimetric SAR Processing Chain to Observe Oil Fields in the Gulf of Mexico. IEEE Trans. Geosci. Remote Sens. 2011, 49, 4729–4737. [Google Scholar] [CrossRef]
  38. Nunziata, F.; Migliaccio, M.; Brown, C.E. Reflection Symmetry for Polarimetric Observation of Man-Made Metallic Targets at Sea. IEEE J. Ocean. Eng. 2012, 37, 384–394. [Google Scholar] [CrossRef]
  39. Zhang, J.; Wang, Q.; Su, F. Automatic extraction of offshore platforms in single SAR images based on a dual-step-modified model. Sensors 2019, 19, 231. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Wang, Q.; Zhang, J.; Su, F. Offshore Platform Extraction Using RadarSat-2 SAR Imagery: A Two-Parameter CFAR Method Based on Maximum Entropy. Entropy 2019, 21, 556. [Google Scholar] [CrossRef] [Green Version]
  41. Chan, T.F.; Vese, L.A. Active contours without edges. IEEE Trans. Image Processing. 2001, 10, 266–277. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Cloude, S.R.; Pottier, E. An entropy based classification scheme for land applications of polarimetric SAR. IEEE Trans. Geosci. Remote Sens. 1997, 35, 68–78. [Google Scholar] [CrossRef]
  43. Xu, S.; Freund, R.M.; Sun, J. Solution methodologies for the smallest enclosing circle problem. Comput. Optim. Appl. 2003, 25, 283–292. [Google Scholar] [CrossRef]
Figure 1. Diagram of the proposed offshore oil platform detection method.
Figure 1. Diagram of the proposed offshore oil platform detection method.
Remotesensing 14 01729 g001
Figure 2. Diagram of the signed distance function, where SDF denotes the signed distance function.
Figure 2. Diagram of the signed distance function, where SDF denotes the signed distance function.
Remotesensing 14 01729 g002
Figure 3. Diagram of the initialization of level set segmentation, where the rectangle denotes the image plane, the spots drawn in red denote targets, and the blue circle denotes the initial zero level set function. (a) Centered circle initialization. (b) The problem of centered circle initialization. (c) Multi-circle initialization. (d) The problem of multi-circle initialization.
Figure 3. Diagram of the initialization of level set segmentation, where the rectangle denotes the image plane, the spots drawn in red denote targets, and the blue circle denotes the initial zero level set function. (a) Centered circle initialization. (b) The problem of centered circle initialization. (c) Multi-circle initialization. (d) The problem of multi-circle initialization.
Remotesensing 14 01729 g003
Figure 4. Diagram of offshore oil platforms near the coast of Singapore, where the targets are marked in a red box. (a) Pauli pseudo-color map. (b) Ground truth.
Figure 4. Diagram of offshore oil platforms near the coast of Singapore, where the targets are marked in a red box. (a) Pauli pseudo-color map. (b) Ground truth.
Remotesensing 14 01729 g004
Figure 5. Diagram of smallest enclosing circle. (a) The minimum coverage using a single circle. (b) The minimum coverage using multiple circles.
Figure 5. Diagram of smallest enclosing circle. (a) The minimum coverage using a single circle. (b) The minimum coverage using multiple circles.
Remotesensing 14 01729 g005
Figure 6. Diagram of splitting and merging.
Figure 6. Diagram of splitting and merging.
Remotesensing 14 01729 g006
Figure 7. Results of the proposed method for offshore oil platform detection in Dataset 1. (a) The Pauli pseudo-color images. (b) Result of coarse detection, where the white regions denote the detected targets and the gray regions denote the background. (c) Result of multiple circles coverage, where the circles are drawn in red. (d) The zooming result of (c) near the island. (e) The results of level set segmentation, where the segmentation boundary is drawn in red. (f) The zooming result of (e) near the island. (g) The ROI extraction result, where the ROIs are marked with a red rectangle. (h) The ROI recognition result, where the red regions are all ROIs and the green regions are the final detected oil platforms. (i) The zooming result of (h).
Figure 7. Results of the proposed method for offshore oil platform detection in Dataset 1. (a) The Pauli pseudo-color images. (b) Result of coarse detection, where the white regions denote the detected targets and the gray regions denote the background. (c) Result of multiple circles coverage, where the circles are drawn in red. (d) The zooming result of (c) near the island. (e) The results of level set segmentation, where the segmentation boundary is drawn in red. (f) The zooming result of (e) near the island. (g) The ROI extraction result, where the ROIs are marked with a red rectangle. (h) The ROI recognition result, where the red regions are all ROIs and the green regions are the final detected oil platforms. (i) The zooming result of (h).
Remotesensing 14 01729 g007
Figure 8. Results of the proposed method for offshore oil platform detection in different scenes. (a1a4) The Pauli pseudo-color images. (b1b4) Result of coarse detection. (c1c4) Result of multiple circles coverage. (d1d4) The ROI recognition results. (e1e4) The zooming results. (a1e1) Results of data i + 1.
Figure 8. Results of the proposed method for offshore oil platform detection in different scenes. (a1a4) The Pauli pseudo-color images. (b1b4) Result of coarse detection. (c1c4) Result of multiple circles coverage. (d1d4) The ROI recognition results. (e1e4) The zooming results. (a1e1) Results of data i + 1.
Remotesensing 14 01729 g008
Figure 9. Comparison of the proposed method with four different CFAR detection methods, where the green region denotes the ground truth and the red region denotes the detection result. (a1,a2) The Pauli pseudo-color images of Dataset 1, where (a2) is the sub-region of (a1) marked in a red box. (b1,b2) Results of the H / α detector. (c1,c2) Results of the PMS detector. (d1,d2) Results of the PWF detector. (e1,e2) Results of the GOPCE detector. (f1,f2) Results of the proposed GOPCE-LS detector.
Figure 9. Comparison of the proposed method with four different CFAR detection methods, where the green region denotes the ground truth and the red region denotes the detection result. (a1,a2) The Pauli pseudo-color images of Dataset 1, where (a2) is the sub-region of (a1) marked in a red box. (b1,b2) Results of the H / α detector. (c1,c2) Results of the PMS detector. (d1,d2) Results of the PWF detector. (e1,e2) Results of the GOPCE detector. (f1,f2) Results of the proposed GOPCE-LS detector.
Remotesensing 14 01729 g009
Figure 10. Comparison of the ROI extraction results of the proposed method with the GOPCE method. (a1a3) The Pauli pseudo-color images of Datasets 1, 2, and 3 in Table 2, respectively, where the wrong regions are marked in a red circle. (b1b3) The ROI extraction results of the GOPCE method, where the missing targets of Dataset 1 and Dataset 2 are marked in a red circle. (c1c3) The ROI extraction results of the proposed method, where the false target of Dataset 3 is marked in a red circle. (d1d3) Zooming images of the wrong regions.
Figure 10. Comparison of the ROI extraction results of the proposed method with the GOPCE method. (a1a3) The Pauli pseudo-color images of Datasets 1, 2, and 3 in Table 2, respectively, where the wrong regions are marked in a red circle. (b1b3) The ROI extraction results of the GOPCE method, where the missing targets of Dataset 1 and Dataset 2 are marked in a red circle. (c1c3) The ROI extraction results of the proposed method, where the false target of Dataset 3 is marked in a red circle. (d1d3) Zooming images of the wrong regions.
Remotesensing 14 01729 g010
Figure 11. ROC curves of the GOPCE method and the proposed GOPCE-LS method under logarithmic coordinates.
Figure 11. ROC curves of the GOPCE method and the proposed GOPCE-LS method under logarithmic coordinates.
Remotesensing 14 01729 g011
Figure 12. Comparison of the level set segmentation method initialized by the proposed method with different initialization methods. (a) Result of the single-circle initialization method. (b) Result of the equally divided multi-circle initialization method. (c) Result of minimum single-circle coverage initialization. (d) Result of the proposed method.
Figure 12. Comparison of the level set segmentation method initialized by the proposed method with different initialization methods. (a) Result of the single-circle initialization method. (b) Result of the equally divided multi-circle initialization method. (c) Result of minimum single-circle coverage initialization. (d) Result of the proposed method.
Remotesensing 14 01729 g012
Figure 13. Comparison of the recognition performance of the proposed method with that of the SVM classifier, where the green regions are the recognized oil platforms and the red regions are other ROIs on the sea surface. (a1a3) The Pauli pseudo-color images of Datasets 5–7 in Table 2, respectively, where the regions marked by red circles are the false alarms recognized by the SVM classifier. (b1b3) Recognition results of the SVM classifier. (c1c3) Recognition results of the proposed method. (d1d3) Zooming images of the wrong regions. (a1d1) Results of data i + 4.
Figure 13. Comparison of the recognition performance of the proposed method with that of the SVM classifier, where the green regions are the recognized oil platforms and the red regions are other ROIs on the sea surface. (a1a3) The Pauli pseudo-color images of Datasets 5–7 in Table 2, respectively, where the regions marked by red circles are the false alarms recognized by the SVM classifier. (b1b3) Recognition results of the SVM classifier. (c1c3) Recognition results of the proposed method. (d1d3) Zooming images of the wrong regions. (a1d1) Results of data i + 4.
Remotesensing 14 01729 g013
Table 1. The LeNet-5 network structure, where W denotes the weights of the unit and b denotes the bais of the unit.
Table 1. The LeNet-5 network structure, where W denotes the weights of the unit and b denotes the bais of the unit.
LayerPatch/StrideTypeOutputParameters
1 5 × 5 / 1 Convolution 28 × 28 × 6 W  5 × 5 × 3 × 6
b  1 × 1 × 6
2 2 × 2 / 2 Max Pooling 14 × 14 × 6 -
3 5 × 5 / 1 Convolution 10 × 10 × 16 W  5 × 5 × 6 × 16
b  1 × 1 × 16
4 2 × 2 / 2 Max Pooling 5 × 5 × 16 -
5 5 × 5 / 1 Convolution 1 × 1 × 64 W  5 × 5 × 16 × 64
b  1 × 1 × 64
6-Fully Connected 1 × 1 × 32 W  32 × 64
b  32 × 1
7-Fully Connected 1 × 1 × 3 W  3 × 32
b  3 × 1
Table 2. Experimental dataset details, where UTC stands for the international standard time, AOI stands for the angle of incident of the center point of the image, and m × m stands for meter times meter.
Table 2. Experimental dataset details, where UTC stands for the international standard time, AOI stands for the angle of incident of the center point of the image, and m × m stands for meter times meter.
DatasetSceneSizeResolution
m × m
UTCAOI °
1Brunei 5553 × 3789 4.73 × 5.14 06/04/2012
22:03:48
40.91
2Ho Chi Minh City 5714 × 2888 4.73 × 5.18 06/08/2012
10:56:07
30.01
3EI Nido 6173 × 4256 4.73 × 4.78 06/08/2012
21:45:25
47.42
4Beibu Gulf 5733 × 4316 4.73 × 5.07 06/20/2012
22:33:46
48.16
5Brunei 5723 × 4100 4.73 × 5.15 06/09/2012
22:58:01
45.09
6Ho Chi Minh City 6159 × 4208 4.73 × 4.73 06/11/2012
11:08:26
46.62
7Beibu Gulf 5670 × 3716 4.73 × 4.84 06/13/2012
22:37:17
40.01
Table 3. Performances of the proposed method under different sites, where Num denotes the number of targets, Pd denotes the detection rate, Pf denotes the false alarm rate, Nd denotes the number of correctly detected targets, Nf denotes the number of false alarms, Macro denotes the macro-IOU index, Micro denotes the micro-IOU index, and Σ denotes the overall performance.
Table 3. Performances of the proposed method under different sites, where Num denotes the number of targets, Pd denotes the detection rate, Pf denotes the false alarm rate, Nd denotes the number of correctly detected targets, Nf denotes the number of false alarms, Macro denotes the macro-IOU index, Micro denotes the micro-IOU index, and Σ denotes the overall performance.
DataNumNdPdNfPfMacroMicro
166100000.99250.9927
266100000.99550.9954
322100000.97030.9593
455100000.97580.9785
555100000.99200.9917
655100000.99360.9927
777100000.98420.9662
Σ 3636100000.98630.9824
Table 4. Performance comparison of the proposed GOPCE-LS method with different detection methods, including the H / α , PMS, PWF, and GOPCE methods.
Table 4. Performance comparison of the proposed GOPCE-LS method with different detection methods, including the H / α , PMS, PWF, and GOPCE methods.
Index H / α PMSPWFGOPCEGOPCE-LS
Nd1818181819
Nf010400
Macro0.4130.4740.5060.7080.997
Micro0.5020.4800.4710.7560.997
Table 5. Comparison of the ROI extraction of the proposed method with the GOPCE method.
Table 5. Comparison of the ROI extraction of the proposed method with the GOPCE method.
DataNumGOPCEGOPCE-LS
NdPd
(%)
NfPf
(%)
MacroMicroNdPd
(%)
NfPf
(%)
MacroMicro
1191894.7000.7080.75619100000.99690.9969
2161593.7000.75970.819816100000.97290.9877
38787.5000.73120.73318100111.10.98690.9736
477100000.76410.76807100000.97770.9379
Σ 504794000.740.7695010011.90.98360.974
Table 6. Number of iterations of level set segmentation of different initialization methods, where Initial 1 denotes the single-circle initialization method, Initial 2 denotes the equally divided multi-circle initialization method, Initial 3 denotes the minimum single-circle coverage initialization method, and Initial 4 denotes the proposed method. >500 means that the number of iterations is larger than 500.
Table 6. Number of iterations of level set segmentation of different initialization methods, where Initial 1 denotes the single-circle initialization method, Initial 2 denotes the equally divided multi-circle initialization method, Initial 3 denotes the minimum single-circle coverage initialization method, and Initial 4 denotes the proposed method. >500 means that the number of iterations is larger than 500.
DataInitial 1Initial 2Initial 3Initial 4
1>500>500>50070
2>500>500>50063
3>500>500>500185
4>500>500>500195
Table 7. Performance comparison of the proposed method under different curve regularization parameters ν and splitting parameters Q.
Table 7. Performance comparison of the proposed method under different curve regularization parameters ν and splitting parameters Q.
Index ν
0.050.10.20.30.5
Nd1919191818
Nf00007
Macro0.99070.99690.94060.86050.7682
Micro0.99690.99690.96880.93790.4567
IndexQ
23456
Nd1919191919
Nf00000
Macro0.99690.99690.99690.99690.9969
Micro0.99690.99690.99690.99690.9969
Table 8. Comparison of ROI recognition results of the proposed method with those of the SVM classifier.
Table 8. Comparison of ROI recognition results of the proposed method with those of the SVM classifier.
DataNumSVMThe Proposed Method
NdPd
(%)
NfPf
(%)
NdPd
(%)
NfPf
(%)
16610000610000
26610000610000
32210000210000
45510000510000
555100116.7510000
655100228.5510000
777100112.5710000
Σ 36361004103610000
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Liu, C.; Yang, J.; Ou, J.; Fan, D. Offshore Oil Platform Detection in Polarimetric SAR Images Using Level Set Segmentation of Limited Initial Region and Convolutional Neural Network. Remote Sens. 2022, 14, 1729. https://doi.org/10.3390/rs14071729

AMA Style

Liu C, Yang J, Ou J, Fan D. Offshore Oil Platform Detection in Polarimetric SAR Images Using Level Set Segmentation of Limited Initial Region and Convolutional Neural Network. Remote Sensing. 2022; 14(7):1729. https://doi.org/10.3390/rs14071729

Chicago/Turabian Style

Liu, Chun, Jian Yang, Jianghong Ou, and Dahua Fan. 2022. "Offshore Oil Platform Detection in Polarimetric SAR Images Using Level Set Segmentation of Limited Initial Region and Convolutional Neural Network" Remote Sensing 14, no. 7: 1729. https://doi.org/10.3390/rs14071729

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop