Next Article in Journal
Identification of Fishing Vessel Types and Analysis of Seasonal Activities in the Northern South China Sea Based on AIS Data: A Case Study of 2018
Previous Article in Journal
An Efficient Approach to Automatic Construction of 3D Watertight Geometry of Buildings Using Point Clouds
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Improving the Image Quality of Moving Ships for GF-3NG Based on Simultaneous AIS Information

1
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
2
Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China
3
Key Laboratory of Technology in Geo-Spatial Information Processing and Application Systems, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China
4
Key Laboratory of Space Ocean Remote Sensing and Application, Ministry of Nature Resource of the People’s Republic of China, Beijing 100081, China
5
National Key Laboratory of Microwave Imaging Technology, Chinese Academy of Sciences, Beijing 100190, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2021, 13(10), 1951; https://doi.org/10.3390/rs13101951
Submission received: 5 April 2021 / Revised: 14 May 2021 / Accepted: 14 May 2021 / Published: 17 May 2021

Abstract

:
The synthetic aperture radar (SAR) is an important means of ship surveillance, but the motion of the ship leads to azimuth position offset, false targets, and azimuth defocusing for the spaceborne high-resolution and wide-swath (HRWS) SAR system, causing the degradation of imaging quality. The automatic identification system (AIS) can provide real-time information of the ships, which is an important auxiliary method for ship surveillance. Up to now, the traditional fusion of SAR and AIS mainly has focused on location matching and auxiliary recognition, and the next generation of GaoFen-3 (GF-3NG) satellite is equipped with both a SAR sensor and an AIS sensor to obtain the SAR images and simultaneous AIS information of ships. Consequently, this paper proposes a novel scheme to improve the imaging quality of moving ships for GF-3NG using AIS information. In this paper, through introducing the virtual stationary target, the slant range derivation (SRD) algorithm is proposed to estimate the radial velocity (RV) and the radial acceleration (RA) between the ship and the SAR platform relative to the stationary scene. According to the calculated RV, the azimuth position offset can be estimated and the ship can be repositioned on the image. After that, the traditional method is conducted to suppress the false targets. Finally, the method of using the RA to refocus ship slices is proposed. Additionally, the experiment results based on real data illustrate the effectiveness of the proposed methods.

1. Introduction

With the continuous improvement of the resolution and surveying width of the spaceborne synthetic aperture radar (SAR), the spaceborne SAR has gradually become an important means of ship surveillance [1,2,3,4]. However, due to the characteristics of SAR itself, there are still some deficiencies in ship monitoring. First, the Doppler effect between the SAR and target is the key to achieve high azimuth resolution, but the motion of the ship on the sea surface introduces an extra Doppler frequency shift, which results in the azimuth position offset and azimuth defocus of the ship after imaging [5,6,7]. Besides, there are false targets along the azimuth in multichannel mode. All of these damage the quality of the SAR image, which is not conducive to ship surveillance. Hence, scholars have proposed a large number of algorithms to estimate the motion of the ship in order to improve the SAR image quality, which can be mainly divided into two categories [8]: motion parameters estimation based on the wake [9,10,11] and the Doppler parameters estimation algorithm. However, the wakes of many ships are invisible on the SAR images and at larger incidence angles, the wakes are less visible [12]. Additionally, most of the existing time-frequency analysis algorithms, such as the Wigner Ville distribution method [13] and fractional Fourier transform (FrFT) method [14,15], are based on single-channel SAR, and there are few time-frequency analysis algorithms for high-resolution and wide-swath (HRWS) SAR. Consequently, other supplementary information is necessary for making up for the defects of the SAR. The automatic identification system (AIS) is a new type of auxiliary navigation system based on very high-frequency (VHF) technology with a global positioning system (GPS). It can obtain static information such as the ship name, maritime mobile service identify (MMSI), and ship type and length, as well as dynamic information such as the course, speed, latitude, and longitude [16]. According to AIS, we can analyze and predict the motion of the ship. Additionally, with the ability to work all day and in all weather conditions, AIS has also become an important technical means for marine monitoring [17,18]. However, AIS data are not always reliable because there is inevitably some uncertainty when sending signals [19].
The fusion of AIS and SAR images can make up for the deficiencies caused by a single monitoring means. Therefore, many SAR satellites that have been launched or is launched are equipped with both SAR payload and AIS payload, in order to obtain the SAR image and AIS information of the ship simultaneously. GaoFen-3 (GF-3) is a SAR satellite launched by China in August 2016 with the most abundant imaging modes in the world [20]. Additionally, the next generation of GF-3 (GF-3NG) that China plans to launch in the future will also carry AIS payloads to achieve the simultaneous monitoring of the ship by AIS and SAR.
At present, the traditional fusion of SAR and AIS mainly focuses on position matching. A general method of matching the SAR-detected vessels to their AIS messages is described and optimized with tailored weights for each vessel class in [21]. After the target is matched, the AIS information is applied to improve the recognition ability of SAR image ships as auxiliary information, for example, literature [22] improves ship classification in SAR images by transferring AIS knowledge and [17] uses large datasets of medium-resolution SAR images and AIS data as ground truths to evaluate the efficiency of different ship detectors based on adaptive threshold algorithms. There are also studies using AIS information to estimate the radial velocity (RV) of the ship on the SAR image. For instance, literature [23] projects the speed provided by the AIS data to get the relative RV. According to the heading and speed information reported by AIS, the speed can be projected to the line of sight (LOS) of the radar beam, and the RV can be estimated. However, this method turns the velocity of the ship to the two-dimensional velocity in the Mercator coordinate system, ignoring the velocity of the ship in the height direction, and it cannot estimate the azimuth velocity. Up to now, using AIS data to improve the SAR image quality has not been studied or published. In this paper, we further study how to use simultaneous AIS information to improve the imaging quality of moving ships on the basis of position matching.
Based on the imaging mode of GF-3NG, a novel scheme to improve the imaging quality of moving ships is proposed. This article innovatively proposes the slant range derivation (SRD) method to estimate RV and radial acceleration (RA) based on AIS data by introducing a virtual target, and proposes the method of using AIS data to improve the imaging quality of moving ships for the first time. According to the trajectory of the SAR platform reported by GPS and the trajectory of the ship reported by the AIS, the slant range between the ship and the SAR platform can be obtained. Then, the position of the ship at the moment of the shortest slant range is regarded as that of the virtual stationary target. Moreover, the relative RV and RA can be estimated by the SRD algorithm. Additionally, on the basis of the calculated RV, the azimuth position offset is estimated, and the ship is repositioned on the SAR image. Furthermore, the compensation method in [24] is used to suppress the false targets according to the RV. Finally, the method of using the RA to refocus ship slices is proposed. The GF-3 SAR image and the simultaneous AIS data offered by the commercial website [25] are adopted for experimental verification.
The remaining of the paper is organized as follows. In Section 2, the imaging geometry model of GF-3 is described, and the signal echo model of the moving ship is analyzed. Then, the methods of AIS data preprocessing, the RV and RA estimation, and the azimuth refocusing are explained in Section 3. Additionally, experimental results based on GF-3 real data are presented in Section 4. Moreover, Section 5 makes the discussion of the experiments and analyzes the algorithm performance. Finally, Section 6 makes the conclusions and points out the future directions of research.

2. Geometry Model and Signal Mode

A detailed analysis of the moving target signal model in GF-3 dual-channel mode is given in [24], and this article conducts further research on the basis of it. GF-3NG, like GF-3, includes azimuth dual-channel receive (DRC) mode and single-channel receive mode. For the single-channel mode, the motion of the target causes azimuth position offset and azimuth defocusing, whereas for the DRC mode, in addition to the above problems, there are also false targets in the azimuth resulting from under-sampling [26]. Without loss of generality, the DRC mode is taken as an example for modeling and analysis in this article.
The geometry of the GF-3 DRC model is depicted in Figure 1. The x-axis points to the direction of the SAR platform velocity V s , and the z-axis points away from the earth’s center; the three axes satisfy the orthogonal right-hand rule, and η   represents the azimuth time.
The full area of the antenna   Tx is used to transmit the chirp signal, where the solid red circle represents the phase center of the Tx . It is divided into two channels in the azimuth receiving echoes simultaneously, denoted as Rx 1 and Rx 2 , respectively. The white circle represents the effective phase center (EPC), and the distance between the two phase centers is d .
There is a moving target modeled as an ideal point target in the scene where the shortest slant range is R 0 and the incidence is θ , and its speed over ground (SOG) V t is projected into two directions, respectively: cross-track velocity V r g and along-track velocity V a . The radial velocity V r is the projection of   V r g on the slant range direction. Additionally, η 0 represents the radar observation time duration. When η = 0 , the position of the target is denoted as A , and when η = η 0 , it moves uniformly in a straight line to the position marked as A .
Based on the geometry model described above, the slant range between the n-th EPC and the moving target denoted as R n ( η ) can be written as:
R n ( η ) = ( R 0 + V r η ) 2 + ( ( V s V a ) η + x n _ e ) 2 R 0 + V r η + ( ( V s V a ) η + x n _ e ) 2 2 R 0 ,
where x n _ e represents the displacement length from the n-th EPC to the array center in the along-track direction and can be written as:
x n _ e = ( n N + 1 2 ) d 2 ,   n = 1 ,   2 ,
where n represents the number of receivers in the azimuth direction, and in the model of this article, N = 2 . Then, the ideal received echo of the n-th channel can be expressed as Equation (4), where the r e c t { }   stands for the unit rectangular function, the τ is the range time, and T p and K r are the pulse width and chirp rate of the transmitted signal, respectively. Additionally, T s is synthetic aperture time, R n ( η η c ) is the instantaneous slant range of the moving target at azimuth position X 0 , and η c is defined as follows.
η c = X 0 V s V a ,
S n ( τ , h ) = A 0 r e c t { τ     2 R n ( η η c ) c T p } r e c t ( η η c T s ) e x p { j π K r ( τ 2 R n ( η η c ) c ) 2 } e x p { j 4 π R n ( η η c ) λ } .
With reference to Equation (4), the azimuth Doppler frequency can be calculated as:
f η = 2 λ R n ( η ) η .
Additionally, the Doppler rate can be obtained by deriving the Doppler frequency as follows:
K a = f η η = 2 λ 2 R n ( η ) η 2 ,
Substituting Equation (1) into Equation (5), the azimuth Doppler frequency of the moving target can be expressed as:
f ^ n = ( 2 V r λ + 2 ( V s V a ) x n _ e λ R 0 ) 2 ( V s V a ) 2 λ R 0 η .
Let η = 0 , and the Doppler centroid of the n-th channel is
f ^ n _ d c = ( 2 V r λ + 2 ( V s V a ) x n _ e λ R 0 ) .
Based on Equation (6), the Doppler rate of the moving target can be written as:
K ^ a = 2 ( V s V a ) 2 λ R 0 ,
where, for a stationary target, V r and V a are both equal to 0, then the azimuth Doppler frequency can be expressed as:
f η = 2 V s x n _ e λ R 0 2 V s 2 λ R 0 η .
Additionally, the Doppler centroid of the n-th channel and the Doppler rate can be written as Equations (11) and (12), respectively:
f n _ d c = 2 V s x n _ e λ R 0 ,
K a = 2 V s 2 λ R 0 .
According to Equations (8) and (11), the Doppler centroid shift introduced by the moving target can be written as:
Δ f d c = f ^ n _ d c f n _ d c = 2 V r λ + 2 V a x n _ e λ R 0 .
In the case of spaceborne SAR, the azimuth velocity V a is relatively small, so its impact on the center can be ignored; thus, Equation (13) can be rewritten as:
Δ f dc 2 V r λ .
As analyzed above, the existence of the RV results in an offset of the Doppler frequency. Besides, the echo spliced by each channel of HSWR SAR is nonuniformly sampled in azimuth, so it is necessary to reconstruct it to recover the uniformly sampled signal. Additionally, the traditional method is to reconstruct the signal spectrum with the reconstruction filter bank [26,27,28]. While reconstructing the spectrum of the moving target with the filter bank for the stationary target, there is a step phase that leads to the false targets in pairs in azimuth after imaging. The azimuth position of false targets can be written as:
X n = ( 2 V r λ n f p ) V s K a , n = N N ,
where f p is the pulse repetition frequency for each channel, and only when n = 0 corresponds to the real target, and the others correspond to the false targets. According to Equations (14) and (15), the azimuth offset of the moving target relative to the static scene can be expressed as:
Δ X n = 2 V r λ V s K a = V r R 0 V s .
As suggested by Equations (9) and (12), the azimuth velocity V a introduced by the moving target causes the azimuth Doppler rate of the moving target echo to be inconsistent with that of stationary scene echo. Then in practice, the matching filter suitable for the stationary target is used to process the echo of the moving target. Therefore, for the moving target, the residual Doppler rate is not compensated, which leads to the azimuth defocusing, and the residual Doppler rate error is shown in Equation (17).
Δ K a = K ^ a K a = 4 V s V a 2 V a 2 λ R 0 .
According to the analysis above, in GF-3 DRC mode, the existence of the target motion results in the azimuth position offset, defocusing, and false targets on the SAR image.

3. Processing Method

In this section, we describe a scheme of using AIS to improve the imaging quality of the moving ships. Additionally, the main processing flow is shown in Figure 2. First, we introduced the preprocessing of data. Then, the SRD algorithm for calculating the relative RV is presented and how to use the RV to calculate the azimuth offset is deduced. Finally, the calculation of the relative RA and the method of compensating the residual Doppler rate error to achieve refocusing are proposed.

3.1. The Preprocessing of Data

The AIS data record the voyage message of the ship, including dynamic information such as speed, heading, and position, as well as static information such as MMSI and ship length and width, is of great help to ship monitoring. However, the AIS data are not always reliable. The final file of the AIS data may contain duplicated data of the same ship at a certain moment. Besides, AIS information may be missing at some moments. Additionally, the latitude and longitude reported by AIS may deviate from its true value. Due to these anomalies, we have to preprocess AIS data before using it to improve ship imaging quality.
The preprocessing consists of three steps. First, according to the imaging area and time of the SAR image, the AIS data of the ships corresponding to the SAR image are extracted. Since the AIS data are discrete, and we expect to obtain the continuous motion function of the ship with respect to time, the data after preprocessing need to be fitted at the end. The specific fitting method is introduced later. Generally, the movement of a ship in a short time is relatively stable, so for the accuracy of the final fitting, only the data within 30 min around the imaging time are selected for the next step. Then, the selected AIS data need to be deduplicated. According to the time stamp, the data of the same ship at the same time is removed. If the position of several consecutive data does not change, but the speed of the ship is not zero, it is considered that these data are abnormal, and only the first data in this group are retained, and the rest of the data are eliminated. Finally, the data processed after the first two steps are fitted to overcome the sparsity of AIS data. After several tests, it is found that the accuracy of fitting with a third-order polynomial is sufficient. We use the time-stamp as an independent variable, and latitude and longitude as dependent variables for fitting to obtain the ship’s motion curve.
The positions of the SAR satellite are expressed in the WGS-84 coordinate system, whereas the positions in the AIS data are represented by latitude (lat) and longitude (lon). Thus, the lat and lon in the AIS data need to be converted to the WGS-84 coordinate system, so as to unify the coordinate system. The method to convert the position represented by [ l o n , l a t ] to the WGS-84 coordinate system is as follows:
{ x = ( R + H ) c o s ( l a t ) c o s ( l o n ) y = ( R + H ) c o s ( l a t ) s i n ( l o n ) z = ( R + H ) s i n ( l a t ) ,
where   R is the approximate radius of the earth, R 6371.393   km , and H is the altitude of the target. In practice, the altitude of the ship on the sea is generally considered to be zero; thus, H = 0 . As suggested by Equation (18), the coordinates of the ship in the WGS-84 coordinates system, denoted as ( x s h i p ( t ) ,   y s h i p ( t ) ,   z s h i p ( t ) ) , can be known.
The spatial position of the SAR platform in the WGS-84 coordinates system can be obtained from the GPS. Similarly, only the data within 30 min around the imaging time are selected, and the three-dimensional coordinates are respectively fitted with the third-order polynomial to functions of time. Thus, the spatial position of the SAR platform can be expressed as ( x sar ( t ) ,   y sar ( t ) ,   z sar ( t ) ) .

3.2. Relative RV Calculation

When the coordinates of the SAR platform and ship are determined, the slant range between them can be calculated as:
{ Δ X m ( t ) = x sar ( t ) x s h i p ( t ) Δ Y m ( t ) = y sar ( t ) y s h i p ( t ) Δ Z m ( t ) = z sar ( t ) z s h i p ( t ) ,
R m ( t ) = Δ X m ( t ) 2 + Δ Y m ( t ) 2 + Δ Z m ( t ) 2 .
Additionally, by deriving R m ( t ) , the RV of the moving ship relative to the satellite can be obtained.
V rm ( t ) = dR m ( t ) dt .
Generally, the imaging scene of SAR is considered to be stationary relative to the earth. Therefore, the parameters of azimuth-matched filter, such as Doppler centroid and Doppler rate, are designed for stationary scenes. Additionally, according to the analysis of the signal model in Section 2, it is not the movement of the moving ship relative to the SAR platform, but the movement of the moving ship relative to the stationary scene, that causes the azimuth offset, the false targets, and the azimuth defocus. However, the velocity calculated according to Equation (21) is the RV of the moving ship relative to the SAR platform, rather than the RV relative to the ground stationary scene, and it cannot be used directly for azimuth offset correction and azimuth refocusing. If the RV of the stationary scene relative to the SAR platform is also known, the difference between the two velocities can be regarded as the RV of the moving ship relative to the stationary scene. As analyzed in Section 2, the Doppler centroid frequency reflects the RV of the target relative to the satellite platform, and the Doppler rate demonstrates the acceleration of the target relative to the satellite platform. However, even if they reflect the relative motion between the satellite platform and the target, the Doppler parameters used in imaging are calculated based on the satellite attitude and orbit parameters. Additionally, the measurement errors of both the attitude and orbit are inevitable, resulting in azimuth target location error. The measurement errors of the yaw angle, pitch angle, and roll angle cause the measured beam center pointing to be inconsistent with its real pointing, which is shown in Figure 3, leading to the calculation error of the Doppler centroid. Therefore, the Doppler parameters used in imaging cannot be directly regarded as the real Doppler parameters of the stationary scene relative to the satellite platform. Below, we introduce our method of solving the Doppler parameters of the stationary scene relative to the SAR platform.
According to the AIS data and the SAR platform’s GPS information, the slant range between the moving target and the SAR platform R m ( t ) can be obtained. The moment when   R m ( t ) reaches the minimum value is regarded as the target imaging center moment, denoted as t c . Assuming that there is a stationary target at the ship position corresponding to t c , with reference to Equations (19) and (20), the slant range between the stationary target and the satellite platform can be obtained by the same method. The slant range between this virtual stationary target and the SAR platform can be expressed as:
{ Δ X s ( t ) = x sar ( t ) x s h i p ( t c ) Δ Y s ( t ) = y sar ( t ) y s h i p ( t c ) Δ Z s ( t ) = z sar ( t ) z s h i p ( t c ) ,
R s ( t ) = Δ X s ( t ) 2 + Δ Y s ( t ) 2 + Δ Z s ( t ) 2 .
Taking the derivative of R s ( t ) as Equation (24), the RV of this stationary point relative to the SAR platform can be obtained.
V rs ( t ) = dR s ( t ) dt .
Additionally, the relative RV between the moving target and the SAR platform introduced in the stationary scene can be calculated as:
V r = V rm ( t c ) V rs ( t c ) .
According to Equations (25) and (16), the azimuth offset of the moving target after imaging can be calculated.
In summary, the calculation of RV can be achieved by the SRD algorithm, and the azimuth offset of the moving ship on the SAR image can also be obtained. The methods of azimuth position offset correction and multichannel false target suppression of the moving target are introduced in detail in [24]. This article does not repeat it, but does give a detailed method of azimuth defocusing compensation.

3.3. Calculation of RA and Compensation

The Doppler centroid shift of the moving ship relative to the stationary scene can be obtained by deriving the slant range R s ( t ) and R m ( t ) , and by the same method, the relative RA introduced by the moving ship can also be known, and it can be used to calculate the residual Doppler rate error. Additionally, the relative RA of the moving target and the virtual stationary target can be calculated as below:
A m ( t ) = dV rm ( t ) dt ,
A s ( t ) = dV rs ( t ) dt .
According to Equation (6), the Doppler rate error caused by ship motion can be written as:
Δ K a = 2 ( A m ( t c ) A s ( t c ) ) λ .
Generally speaking, the azimuth defocusing of moving target mainly results from the mismatch between the parameters of the filter and the actual echo. Taking the RD imaging algorithm as an example, the azimuth matched filter can be written as:
H a = exp ( j π f a 2 K a ) ,
where K a   is the Doppler rate used in the imaging process. However, the real Doppler rate of the moving target is
K at = K a + Δ K a .
To compensate for the Doppler rate error to achieve refocusing, firstly, the ship slice needs to be transformed into the range-Doppler domain by the azimuth fast Fourier transform (FFT) method, and then multiplied with the compensation function in Equation (31).
H a = exp ( j π · K at K a K at · K a f a 2 ) =   exp ( j π · Δ K a K at · K a f a 2 ) .
After compensating H a in the range-Doppler domain, and conducting the azimuth inverse fast Fourier transform (IFFT) method, the well-focused moving ship slice can be obtained.

4. Experimental Results

In this section, we verify the above methods with real data. The SAR images near Kyushu Island in Japan acquired by GF-3 in DRC mode were adopted for experiments. The location and acquisition time of the SAR image are shown in Table 1. The SAR image area is depicted in Figure 4a, and Figure 4b shows the SAR image. Additionally Figure 4c is the slice of the real target in Figure 4b, where the ship’s trajectory obtained from AIS data is marked with yellow dots, and the actual photo of the ship is also attached. Additionally, the AIS data for the experiment are provided by the commercial company [25]. The message type and some description of the AIS data are listed in Table 2.
First, the relative RV and RA were calculated. The relative RV obtained by SRD was compared with the results of other algorithms, and the error was analyzed. Then, the RV was used to suppress false targets. The results after suppression were compared with those before suppression. At last, according to the obtained RA, the azimuth phase compensation was carried out to achieve the refocusing of ship slices. At the same time, the conventional autofocus method was also conducted to process the slices, and the results of the two methods were compared and analyzed.

4.1. Relative RV and RA Estimation

Firstly, the spatial position of the GF-3 SAR platform in the WGS-84 coordinate around the imaging time can be obtained from the metafile of the SAR image product. Additionally, the AIS data corresponding to the ship on the SAR image were processed by the method mentioned in Section 3.1 to obtain the ship’s position information. Then, the lat and the lon of the ship were respectively fitted with a third-order polynomial, as shown in Figure 5, where the moment T = 0 represents the starting moment of imaging, and T < 0 represents the moment before imaging. Additionally, the goodness of fit is shown in Table 3. From the fitting results, the sum of squares due to error (SSE) and root-mean-squared error (RMSE) were very close to 0, and the coefficient of determination (R-square) was approximately equal to 1, meaning that the accuracy of fit is extremely high.
After fitting, the positions of the ship were converted to the WGS-84 coordinate system as suggested by Equation (18). The spatial positions of the GF-3 SAR platform and the ship in the WGS-84 coordinate system are shown in Figure 6a. Since the speed of the satellite is much higher than the speed of the ship, the ship is approximately stationary relative to the satellite in a short time. Thus, it is difficult to see the specific trajectory of the ship in Figure 6a. Additionally Figure 6b is an enlarged view of the ship trajectory in Figure 6a, where the blue point represents the position of the ship at the imaging center moment, that is, the position of the virtual stationary target.
Based on the methods mentioned in Section 3.2 and Section 3.3, the relative RV and relative RA at the imaging center moment were calculated, and the results were −6.39 m/s and 0.0496 m/s2, respectively (the direction along the slant range direction was positive). Figure 7 shows the slant range, RV, and RA of the moving target and the virtual stationary target relative to the SAR platform, respectively.
The conventional method of estimating the RV based on AIS data is velocity projection (VP), which projects the SOG V t provided by the AIS data to the direction of the LOS to estimate the RV. Additionally, the relative RV can be calculated as:
V r = χ V t c o s ϕ s i n θ .
where ϕ = π 2 χ ( COG proj LH ) , COG proj indicates the angle between the course over ground (COG) of the ship and the SAR azimuth, LH is the angle between the center of the beam and the zero Doppler line, and the θ represents the incidence of the radar beam. The χ is the indication coefficient. If the satellite is in orbit descending operation, χ = 1 , otherwise, χ = 1 .
In Reference [24], the time-domain correlation (TDC) algorithm and maximum likelihood (ML)-based algorithm are compared in estimating the RV from dual-channel echoes. In this paper, we use SRD, VP, TDC, and ML-based algorithms to estimate the RV. The results and their corresponding relocation coordinates calculated by Equation (16) are shown in Table 4. It can be seen that the difference of RV between SRD and VP, which were calculated based on AIS data, was only 0.08 m/s. Additionally, the two results of TDC and ML-based algorithms, which were calculated from SAR raw data echo, were also very close, and the difference between them was only 0.04 m/s. However, there was a velocity error of about 0.5 m/s between the two different methods, which resulted in an error of about 36 pixels in azimuth. The relocation positions in Table 4 are depicted in Figure 8.
The position of the ship regarded as a stationary target at the imaging center moment on the SAR image was (10,048, 9092), that is, the position of the blue point in Figure 8. As suggested by the annotation of Figure 8, the position results of SRD and VP were closer to the ship than that of TDC and ML-based, which means that the RV estimation results of SRD and VP are more accurate. However, the VP algorithm only uses the AIS data of the ship at the imaging time, without considering the radial component of the flight velocity of the SAR platform, and it does not have the ability to calculate the RA either.
In terms of accuracy and stability, the SRD method is a better choice for estimating the relative RV.

4.2. False Target Suppression

The RV obtained by the SRD algorithm in Table 4 is used to compensate for the original echo, and the compensation method refers to [24]. The compensated echo is imaged again, and the results of false target suppression are shown in Figure 9.
Generally, compared with the main target, the false target can be ignored when its intensity is lower than −40 dB [29]. Before the suppression, the ship target in the image has a pair of obvious false targets, as shown in Figure 9a. Perform statistical analysis on the image area marked by the red rectangle: take the maximum value of each row along the azimuth direction of the slice, and normalized. The image before compensation is shown in Figure 9b. It can be seen that there are two obvious side peaks caused by false targets. After compensation, as shown in Figure 9c, the false targets are invisible, and the real target is corrected to the actual azimuth position corresponding to the wake. Additionally the red rectangle in Figure 9c is analyzed in the same way, and the result is shown in Figure 9d. After compensation, the false targets are successfully suppressed at the same level as sea clutter and are much lower than −40 dB.
By compensating the echo according to the RV, the false targets are successfully suppressed, and the real target is also corrected to the true azimuth position. The results of false target suppression and azimuth offset correction also prove that the estimate of the RV is accurate, thus proving the reliability of the SRD algorithm.

4.3. RA Estimation and Azimuth Refocusing

As the RA of the moving target and the stationary target are obtained, respectively, the Doppler rate error can be estimated according to Equation (28), and then the compensating Doppler rate error (CDRE) as suggested by Equation (31) can achieve refocusing. In addition to the ship mentioned above, named Target 1, there are two other ships in another UFS mode image with the same orbit number, named Target 2 and Target 3, respectively, also used for azimuth refocusing. The original slices, the results of CDRE, and the conventional autofocus method in [24] are compared in Figure 10.
Entropy is an essential criterion for measuring the quality of image focus, and the peak signal-to-noise ratio (PSNR) is the most common objective measurement to evaluate image quality. Here, the entropy and the PSNR of the slice are regarded as evaluation indicators to compare the focusing effects of the two methods. If the defocused image is focused, the entropy decreases, and the PSNR increases. The results of CDRE are compared with the autofocus method in Table 5. According to the experimental results, it can be seen that the method in this article can achieve the same or better effect compared with the autofocus method. Besides, the computational complexity of the CDRE method is far lower than the autofocus method. The central processing unit (CPU) used in this experiment is Intel(R) Core (TM) i5-9300H and the software used is MATLAB. With the RA known, it only takes 0.080503 s to refocus target 1 with the CDRE method, whereas the autofocus method takes 0.339980 s under the premise of setting the required parameters. Moreover, the CDRE method is more robust. The autofocus method may decrease the overall image amplitude value causing the image to darken, as shown in Figure 10, but the CDRE method does not have such a problem.
In summary, the compensation method in this paper can indeed achieve refocusing, and in the case of uncomplicated sea conditions, both the method proposed in this paper and the traditional autofocus method can achieve good results, but our method is more efficient.

5. Discussion

In Section 4, a comprehensive experiment is conducted to illustrate the effectiveness of the proposed SRD algorithm. In the RV estimation, the difference between the results of the SRD algorithm and the other three methods was within 0.61 m/s, and from the relocation results of Figure 8, the SRD algorithm and VP algorithm were more accurate than the ML-based and TDC algorithm with lower computational complexity. Besides, the SRD algorithm uses the AIS position information for a long period, whereas the VP algorithm only uses the velocity and heading information at the imaging center moment, and the VP algorithm only considers the motion of the ship without considering the radial component of the flight velocity of the SAR platform. Thus, the SRD algorithm is more robust than the VP algorithm.
From the experimental results in Figure 9, it can be seen that according to the RV calculated by the SRD algorithm, the false targets were suppressed to the clutter level and were invisible on the image after compensating the echo. This also confirms the accuracy of the SRD algorithm and the feasibility of using AIS information to suppress false targets.
In Section 4.3, the RA can be obtained by the SRD algorithm, and then the residual phase errors are calculated. The traditional autofocus method and CDRE algorithm were conducted to refocus the three ship slices, respectively. As suggested by Figure 10, the method in this article can achieve the same or better effect compared with the traditional autofocus method. Moreover, the CDRE algorithm does not change the image amplitude, and the computational complexity is much lower than that of the traditional method.
In terms of effectiveness and computational complexity, the methods proposed in this article are superior to the traditional methods, and if the ship is not obvious on the SAR image due to its size beingtoo small, it can be detected by positioning with AIS data, and the image quality of it can be improved with the scheme in the article, which is also an advantage over the traditional ship detection method. However, the scheme proposed in this paper is not suitable for the ship’s shaking caused by strong wind and sea waves, and the stability of AIS data has a great influence on the experiment. Even if the AIS data are preprocessed, only individual abnormal data can be eliminated. Only when most of the AIS data are stable can the reliability of the results be guaranteed. In the case of a dense ship, such as a port, the AIS data between ships may collide or interfere. In this situation, further processing of the AIS data is needed, but the AIS data processing is not the focus of this article, and it is not discussed too much here. The scheme proposed in this paper can not only improve the imaging quality of moving ships, but also improve the matching accuracy of the ship and AIS data, which can be used to make data sets for ship detection and identification. Further research will be conducted in the future.

6. Conclusions

A novel scheme is proposed in this paper to improve the imaging quality of the moving ship based on simultaneous AIS information for the first time. The main impact of the moving ship is to cause Doppler spectrum different from that of the static target, leading to the azimuth position offset, false targets, and defocus. This article innovatively proposes the SRD algorithm in Section 3 to calculate the RV and RA of the moving ship by introducing the virtual stationary target. The RV can be used to correct the azimuth position offset and suppress the false targets. In the same way, the RA between the ship and the stationary target is calculated and the residual error of the azimuth Doppler rate can also be obtained, and the CDRE algorithm is proposed to solve azimuth defocusing resulting from the target motion in Section 3.3. The real data are adopted to illustrate the effectiveness of the proposed methods in Section 4. Compared with the classical methods, the proposed scheme can achieve better image quality improvement with lower computational complexity.

Author Contributions

Conceptualization, Y.L. and L.Z.; Funding acquisition, X.Q.; Investigation, Y.L.; Methodology, Y.L., L.Z., X.Q. and J.Y.; Resources, L.Z. and X.Y.; Software, Y.L. and J.Y.; Supervision, C.D.; Writing—original draft, Y.L.; Writing—review and editing, L.Z., X.Q., Y.H. and C.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Science Foundation of China under Grant No. 41976174, No. 61991421 and No. 61725105.

Acknowledgments

The authors wish to acknowledge the support of the GF-3 mission, especially the China Centre for Resources Satellite Data and Application, who provides the products of GF-3.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ramona, P.; Nicolas, L.; Mercier, G.; Guillaume, H.; Garello, R. Ship detection in SAR medium resolution imagery for maritime surveillance: Algorithm validation using AIS data. In Proceedings of the 2014 IEEE Geoscience and Remote Sensing Symposium, Quebeck, QC, Canada, 13–18 July 2014; pp. 3690–3693. [Google Scholar]
  2. Chiu, S.; Livingstone, C.; Sikaneta, I.; Gierull, C.; Beaulne, P. Radarsat-2 moving object detection experiment (MODEX). In Proceedings of the IGARSS 2008–2008 IEEE International Geoscience and Remote Sensing Symposium, Boston, MA, USA, 7–11 July 2008; pp. I-13–I-16. [Google Scholar]
  3. Estable, S.; Teufel, F.; Petersen, L.; Knabe, S.; Saur, G.; Ullmann, T. Detection and classification of offshore artificial objects in TerraSAR-X images: First outcomes of the DeMarine-DEKO project. In Proceedings of the OCEANS 2009-EUROPE, Bremen, Germany, 11–14 May 2009; pp. 1–8. [Google Scholar]
  4. Hou, X.; Ao, W.; Xu, F. End-to-end automatic ship detection and recognition in high-resolution gaofen-3 spaceborne SAR images. In Proceedings of the IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 28 July–2 August 2019; pp. 9486–9489. [Google Scholar]
  5. Jin, T.; Qiu, X.; Hu, D.; Ding, C. An ML-based radial velocity estimation algorithm for moving targets in spaceborne high-resolution and wide-swath SAR systems. Remote Sens. 2017, 9, 404. [Google Scholar] [CrossRef] [Green Version]
  6. Yang, T.; Wang, Y.; Li, W. A moving target imaging algorithm for HRWS SAR/GMTI systems. IEEE Trans. Aerosp. Electron. Syst. 2017, 53, 1147–1157. [Google Scholar] [CrossRef]
  7. Sparr, T.; Krane, B. Micro-doppler analysis of vibrating targets in SAR. IEE Proc. Radar Sonar Navig. 2003, 150. [Google Scholar] [CrossRef] [Green Version]
  8. Ouyang, K. Study on Moving Ship Detection and Velocity Estimation based on Interferometric Synthetic Aperture Radar; National University of Defense Technology: Changsha, China, 2016. [Google Scholar]
  9. Kang, K.; Kim, D. Ship velocity estimation from ship wakes detected using convolutional neural networks. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2019, 12, 4379–4388. [Google Scholar] [CrossRef]
  10. Soloviev, A.; Gilman, M.; Young, K.; Brusch, S.; Lehner, S. Sonar measurements in ship wakes simultaneous with TerraSAR-X overpasses. IEEE Trans. Geosci. Remote Sens. 2010, 48, 841–851. [Google Scholar] [CrossRef]
  11. Tunaley, J.K.E. The estimation of ship velocity from SAR imagery. In Proceedings of the IEEE 2003 International Geoscience and Remote Sensing Symposium, Toulouse, France, 21–25 July 2003; Volume 191, pp. 191–193. [Google Scholar]
  12. Eldhuset, K. An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions. IEEE Trans. Geosci. Remote Sens. 1996, 34, 1010–1019. [Google Scholar] [CrossRef]
  13. Park, J.-W.; Won, J.-S. An efficient method of doppler parameter estimation in the time–frequency domain for a moving object from TerraSAR-X data. IEEE Trans. Geosci. Remote Sens. 2011, 49, 4771–4787. [Google Scholar] [CrossRef]
  14. Pelich, R.; Longépé, N.; Mercier, G.; Hajduch, G.; Garello, R. Vessel refocusing and velocity estimation on SAR imagery using the fractional fourier transform. IEEE Trans. Geosci. Remote Sens. 2016, 54, 1670–1684. [Google Scholar] [CrossRef]
  15. Sun, H.; Liu, G.; Gu, H.; Su, W. Application of the fractional fourier transform to moving target detection in airborne SAR. IEEE Trans. Aerosp. Electron. Syst. 2002, 38, 1416–1424. [Google Scholar]
  16. Shimizu, S.; Ishizawa, J.; Sakamoto, H.; Nakamura, K. Ship monitoring in japan using Sar, Ais and earth observation satellites. In Proceedings of the IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 28 July–2 August 2019; pp. 4731–4733. [Google Scholar]
  17. Pelich, R.; Longépé, N.; Mercier, G.; Hajduch, G.; Garello, R. AIS-based evaluation of target detectors and SAR sensors characteristics for maritime surveillance. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2015, 8, 3892–3901. [Google Scholar] [CrossRef] [Green Version]
  18. Chaturvedi, S.K.; Yang, C.-S.; Shanmuagm, P.; Song, J.-H.; Ouchi, K. Preliminary technique to integrate SAR and AIS for ship detection and identification. In Proceedings of the 2011 3rd International Asia-Pacific Conference on Synthetic Aperture Radar (APSAR), Seoul, Korea, 26–30 September 2011; pp. 1–4. [Google Scholar]
  19. Achiri, L.; Guida, R.; Iervolino, P. SAR and AIS fusion for maritime surveillance. In Proceedings of the 2018 IEEE 4th International Forum on Research and Technology for Society and Industry (RTSI), Palermo, Italy, 10–13 September 2018; pp. 1–4. [Google Scholar]
  20. Zhang, F.; Yao, X.; Tang, H.; Yin, Q.; Hu, Y.; Lei, B. Multiple mode SAR raw data simulation and parallel acceleration for Gaofen-3 mission. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2018, 11, 2115–2126. [Google Scholar] [CrossRef]
  21. Meyer, R.G.V.; Schwegmann, C.P.; Kleynhans, W. The best of a BAD situation: Optimising an algorithm to match course resolution SAR vessel detections to sparse AIS data. In Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA, 23–28 July 2017; pp. 2385–2388. [Google Scholar]
  22. Lang, H.; Wu, S.; Xu, Y. Ship classification in SAR images improved by AIS knowledge transfer. IEEE Geosci. Remote Sens. Lett. 2018, 15, 439–443. [Google Scholar] [CrossRef]
  23. Zhao, Z. Research on the Key Technologies for Ship Surveillance by Integration of Space-borne SAR and AIS. Master’s Thesis, National University of Defense Technology, Changsha, China, 2013. [Google Scholar]
  24. Yang, J.; Qiu, X.; Zhong, L.; Shang, M.; Ding, C. A Simultaneous imaging scheme of stationary clutter and moving targets for maritime scenarios with the first chinese dual-channel spaceborne SAR sensor. Remote Sens. 2019, 11, 2275. [Google Scholar] [CrossRef] [Green Version]
  25. Chuanxun Website. Available online: http://www.shipxy.com/ (accessed on 20 May 2019).
  26. Jin, T. Unambiguous Imaging Techniques for Spaceborne Multichannel SAR in Azimuth. Ph.D. Thesis, University of Chinese Academy of Sciences Institute of Electronics, Chinese Academy of Sciences, Beijing, China, 2018. [Google Scholar]
  27. Krieger, G.; Gebert, N.; Moreira, A. SAR signal reconstruction from non-uniform displaced phase centre sampling. In Proceedings of the IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium, Anchorage, AK, USA, 20–24 September 2004; Volume 1763, pp. 1763–1766. [Google Scholar]
  28. Krieger, G.; Gebert, N.; Moreira, A. Unambiguous SAR signal reconstruction from nonuniform displaced phase center sampling. IEEE Geosci. Remote Sens. Lett. 2004, 1, 260–264. [Google Scholar] [CrossRef] [Green Version]
  29. Shang, M.; Qiu, X.; Han, B.; Ding, C.; Hu, Y. Channel imbalances and along-track baseline estimation for the GF-3 azimuth multichannel mode. Remote Sens. 2019, 11, 1297. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Imaging geometry model of the moving target in dual-channel receiving mode.
Figure 1. Imaging geometry model of the moving target in dual-channel receiving mode.
Remotesensing 13 01951 g001
Figure 2. The processing flow for simultaneous high-quality imaging scheme.
Figure 2. The processing flow for simultaneous high-quality imaging scheme.
Remotesensing 13 01951 g002
Figure 3. Illustration of measurement error.
Figure 3. Illustration of measurement error.
Remotesensing 13 01951 g003
Figure 4. The SAR image used in the experiment: (a) the position and area of SAR image, (b) the SAR image, and (c) the ship in the SAR image and its photo.
Figure 4. The SAR image used in the experiment: (a) the position and area of SAR image, (b) the SAR image, and (c) the ship in the SAR image and its photo.
Remotesensing 13 01951 g004
Figure 5. Fit results: (a) the fit of lat vs. T and (b) the fit of lon vs. T.
Figure 5. Fit results: (a) the fit of lat vs. T and (b) the fit of lon vs. T.
Remotesensing 13 01951 g005
Figure 6. The trajectory of the SAR and the ship: (a) the trajectory of the two in the same coordinate system and (b) the trajectory of the ship.
Figure 6. The trajectory of the SAR and the ship: (a) the trajectory of the two in the same coordinate system and (b) the trajectory of the ship.
Remotesensing 13 01951 g006
Figure 7. The results of moving target and stationary target: (a) the slant range, (b) the RV, and (c) the RA.
Figure 7. The results of moving target and stationary target: (a) the slant range, (b) the RV, and (c) the RA.
Remotesensing 13 01951 g007
Figure 8. The relocation results of different methods.
Figure 8. The relocation results of different methods.
Remotesensing 13 01951 g008
Figure 9. Comparison of the ambiguous image and the compensated image: (a) the imaging result before compensation, (b) the azimuth profile of the imaging result before compensation, (c) the imaging result after compensation, and (d) the azimuth profile of the imaging result after compensation.
Figure 9. Comparison of the ambiguous image and the compensated image: (a) the imaging result before compensation, (b) the azimuth profile of the imaging result before compensation, (c) the imaging result after compensation, and (d) the azimuth profile of the imaging result after compensation.
Remotesensing 13 01951 g009
Figure 10. Comparison of the original slices, refocused images, and autofocused images: (ac) are original slices, (df) are autofocused images, and (gi) are refocused images.
Figure 10. Comparison of the original slices, refocused images, and autofocused images: (ac) are original slices, (df) are autofocused images, and (gi) are refocused images.
Remotesensing 13 01951 g010
Table 1. SAR image information.
Table 1. SAR image information.
SatelliteOrbit IDImaging ModeCenter (Longitude/Latitude)Scene Date (UTC)
GF-311725UFS129.127942/33.4559592018-11-01 17:27:41
Table 2. The description of AIS data.
Table 2. The description of AIS data.
Message TypeDescription
Static informationMaritime Mobile Service Identify (MMSI) number, Ship type, International Maritime Organization (IMO) number, Ship name, Ship length, Ship width, Draught, etc.
Dynamic informationTurn rate, Latitude, Longitude, Speed, Course, True heading of ship, Position accuracy, Time-stamp, etc.
Navigation informationDestination, Cargo type, etc.
Table 3. Goodness of fit results.
Table 3. Goodness of fit results.
DataFit TypeSSER-SquareRMSE
Lat vs. TPolynomial 3 1.12101   ×   10 5 0.999865121 2.15227   ×   10 4
Lon vs. TPolynomial 3 1.72693   ×   10 5 0.999960823 2.67135   ×   10 4
Table 4. Results of RV estimation and relocation.
Table 4. Results of RV estimation and relocation.
AlgorithmRV (m/s)Position (x, y)
SRD−6.39(10,048, 9559)
VP−6.31(10,048, 9553)
TDC−5.78(10,048, 9515)
ML-based−5.82(10,048, 9517)
Table 5. The analysis of the Figure 10.
Table 5. The analysis of the Figure 10.
TargetNumberPSNR(dB)Entropy
Target 1(a)57.29580.31602
(d)59.14190.24085
(g)58.85880.25446
Target 2(b)51.97020.78291
(e)51.29880.73133
(h)52.09510.71665
Target 3(c)38.23932.2692
(f)39.55542.0946
(i)39.95112.0912
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lv, Y.; Zhong, L.; Qiu, X.; Yuan, X.; Yang, J.; Hu, Y.; Ding, C. Improving the Image Quality of Moving Ships for GF-3NG Based on Simultaneous AIS Information. Remote Sens. 2021, 13, 1951. https://doi.org/10.3390/rs13101951

AMA Style

Lv Y, Zhong L, Qiu X, Yuan X, Yang J, Hu Y, Ding C. Improving the Image Quality of Moving Ships for GF-3NG Based on Simultaneous AIS Information. Remote Sensing. 2021; 13(10):1951. https://doi.org/10.3390/rs13101951

Chicago/Turabian Style

Lv, Yini, Lihua Zhong, Xiaolan Qiu, Xinzhe Yuan, Junying Yang, Yuxin Hu, and Chibiao Ding. 2021. "Improving the Image Quality of Moving Ships for GF-3NG Based on Simultaneous AIS Information" Remote Sensing 13, no. 10: 1951. https://doi.org/10.3390/rs13101951

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop