Next Article in Journal
Spatial Transferability of Random Forest Models for Crop Type Classification Using Sentinel-1 and Sentinel-2
Previous Article in Journal
Automated Parts-Based Model for Recognizing Human–Object Interactions from Aerial Imagery with Fully Convolutional Network
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Rigorous Feature Extraction Algorithm for Spherical Target Identification in Terrestrial Laser Scanning

1
School of Civil Engineering, Chongqing University, Chongqing 400045, China
2
State Key Laboratory of Coal Mine Disaster Dynamics and Controls, Chongqing University, Chongqing 400044, China
3
College of Architecture and Civil Engineering, Beijing University of Technology, Beijing 100124, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2022, 14(6), 1491; https://doi.org/10.3390/rs14061491
Submission received: 13 February 2022 / Revised: 8 March 2022 / Accepted: 17 March 2022 / Published: 19 March 2022

Abstract

:
Precise and rapid extraction of spherical target features from laser point clouds is critical for achieving high-precision registration of multiple point clouds. Existing methods often use linear models to represent spherical target characteristics, which have several drawbacks. This paper proposes a rigorous estimation algorithm for spherical target features based on least squares configurations, in which the point-cloud data error is used as a random parameter, while the spherical center coordinates and radius are used as nonrandom parameters, emphasizing correlation between spherical parameters. The implementation details of this algorithm are illustrated by deriving calculation formulas for three variance–covariance matrices: variance–covariance matrices of the new observations, variance–covariance matrices of the new observation noise, and variance–covariance matrices of random parameters and the new observation noise. Experiments show that the estimation accuracy of sphere centers using our method is improved by at least 5.7% compared to classical algorithms, such as least squares, total least squares, and robust weighted total least squares.

1. Introduction

With a dramatic reduction in the cost of LiDAR technology, terrestrial laser scanning (TLS) technology has been widely applied in mobile mapping, 3D reconstruction, unmanned driving, forestry estimation, disaster monitoring, and many other fields [1,2,3,4]. These applications often involve point-cloud registration between different survey stations, and one of the most common methods is target-based point cloud registration. The accuracy of this method depends mainly on the extraction accuracy of the target. However, with the exception of spherical targets, the extraction accuracy of other shapes of targets will be affected by the scanning incidence angle [5,6,7,8].
The isotropic property of spherical targets ensures that the hemispherical point cloud (the unobscured part of the point cloud from a spherical target, which does not describe the shape of the whole point cloud) of the same target can be obtained from different measuring stations [9,10]; thus, spherical targets are the first choice for target point cloud registration, and it is of great practical value to study the feature extraction of spherical targets. For example, Yuriy [11] proposed a method to determine the optimal diameter of spherical objects based on a least squares (LS) adjustment model, and a value of 14 cm has been obtained as the optimal diameter. Liu [6] proposed a new method by integrating the adaptive dynamic random sample consensus algorithm (AD-RANSAC) and nonlinear least squares (NLS), and the resulting accuracy of sphere center coordinate estimation was less than 2 cm. The authors of [12] adopted the method of centering rod center to eliminate the influence of error caused by non-centering of the bubble, and the fitting accuracy within a short distance could reach about 4 mm.
Spherical target feature extraction algorithms can be mainly divided into linear and nonlinear categories [13]. Nonlinear algorithms are generally time-consuming and cannot use the law of error propagation to derive the extraction accuracy of geometric features [14,15]. Therefore, manufacturers and researchers mainly use linear extraction algorithms in real applications, where a fast speed of processing and extraction accuracy are demanded. Brazeal [16] studied the LS solutions for determining the parameters of a spherical TLS target, in which the coordinates of the spherical center and the radius were regarded as independent. Lu [17] proposed a total least squares (TLS) method for laser scanning target ball positioning, while Chen [9] proposed a weighted total least squares (WTLS) fitting method, which introduced a weight matrix according to the laser reflection intensity of the point cloud and partial correction of the vector in column A of the coefficient matrix. The authors of [10] determined the cofactor of each point according to the distance and the a priori incident angle, and then used a robust weighted total least squares (RWTLS) method to locate the target ball.
However, when the radius of spherical target is unknown, all algorithms assume that the sphere center coordinate parameter and sphere radius parameter are independent of each other. The negligence of their correlation would cause non-robust performance of the algorithms. Through considering the correlation between radius of the sphere and the coordinates of the sphere center, this paper proposes a high-precision estimation algorithm for spherical target sphere centers based on least squares configuration (LSC). Corresponding formulas and algorithm procedure steps for feature parameter estimation are derived in Section 2. Through simulation experiments and actual scanning experiments, Section 3 demonstrates the advantages of our proposed algorithm with respect to traditional algorithms, including LS, TLS, and RWTLS.

2. Materials and Methods

The LSC is a method to simultaneously determine random and nonrandom parameter estimations from observation data. It has been applied in conversion of the base level [18,19], determination of the geoid [20], and other fields. By treating the point-cloud data error as a random parameter and the spherical center coordinates and radius as nonrandom parameters, this section first constructs the LSC observation model of spherical target features and gives its parameter estimation model. Secondly, the rigorous calculation formulas of three variance–covariance matrices in the parameter estimation model are derived. Lastly, the realization of the algorithm steps is presented.

2.1. LSC Observation Model

Suppose the spherical point cloud contains n points. The true value, observation value, and observation error of the coordinates of the arbitrary point are ( x ˜ i , y ˜ i , z ˜ i ) , ( x i , y i , z i ) , and ( ε x i , ε y i , ε z i ) , respectively, with i = 1 , 2 , , n . The true value, approximate value, and approximate error of the sphere center coordinates are ( a ˜ , b ˜ , c ˜ ) , ( a 0 , b 0 , c 0 ) , and ( ε a , ε b , ε c ) , while those for the sphere radius are r ˜ , r 0 , and ε r , respectively. Then, the observation model for the point cloud at point i of the sphere is
r ˜ 2 = ( x ˜ i a ˜ ) 2 + ( y ˜ i b ˜ ) 2 + ( z ˜ i c ˜ ) 2 , i = 1 , 2 , , n ,
where r ˜ = r 0 + ε r , a ˜ = a 0 + ε a , b ˜ = b 0 + ε b , c ˜ = c 0 + ε c , x ˜ i = x i + ε x i , y ˜ i = y i + ε y i , and z ˜ i = z i + ε z i .
According to Equation (1), the observation equation of the i-th observation value can be expressed as follows:
1 2 [ r 0 2 ( x i a 0 ) 2 ( y i b 0 ) 2 ( z i c 0 ) 2 ] = [ x i a 0   y i b 0   z i c 0 ] [ ε x i ε y i ε z i ] [ x i a 0   y i b 0   z i c 0   r 0 ] [ ε a ε b ε c ε r ] + 1 2 [ ( ε x i ε a ) 2 + ( ε y i ε b ) 2 + ( ε z i ε c ) 2 ε r 2 ] .
The observation model of LSC can then be obtained as follows:
L = B X + G Y + Δ ,
where L represents a new observation, X denotes random variables, Y denotes nonrandom variables, and Δ illustrates the noise of new observations.
L = [ l 1 l 2 l n ] , l i = 1 2 [ r 0 2 ( x i a 0 ) 2 ( y i b 0 ) 2 ( z i c 0 ) 2 ] , i = 1 , 2 , , n .
B = [ x 1 a 0 y 1 b 0 z 1 c 0 x 2 a 0 y 2 b 0 z 2 c 0 x n a 0 y n b 0 z n c 0 ] .
G = [ x 1 a 0 y 1 b 0 z 1 c 0 r 0 x 2 a 0 y 2 b 0 z 2 c 0 r 0 x n a 0 y n b 0 z n c 0 r 0 ] .
X = [ ε 1 ε 2 ε n ] ,   ε i = [ ε x i ε y i ε z i ] ,   i = 1 , 2 , , n ,   Y = [ ε a ε b ε c ε r ] .
Δ = [ Δ 1 Δ 2 Δ n ] ,   Δ i = 1 2 [ ( ε x i ε a ) 2 + ( ε y i ε b ) 2 + ( ε z i ε c ) 2 ε r 2 ] ,   i = 1 , 2 , , n .
Assume that the error parameters ε a , ε b , ε c , ε x i , ε y i , ε z i , ε x j , ε y j , ε z j ( i j ) are independent of each other, the observation error parameter satisfies ε x i ~ N ( 0 , σ 2 ) , ε y i ~ N ( 0 , σ 2 ) , and ε z i ~ N ( 0 , σ 2 ) . From the least squares collocation theory of Equation (3), we can get
Y ^ = ( G T H 1 G ) 1 G T H 1 L ,
X ^ = ( D X B T + D X Δ ) H 1 ( L G Y ^ ) ,
D Y ^ = ( G T H 1 G ) 1 G T H 1 D L H 1 G ( G T H 1 G ) 1 ,
D X ^ = D X ( D X B T + D X Δ ) H 1 ( I n G D Y ^ G T H 1 ) ( B D X + D Δ X ) ,
H = B D X B T + D Δ + B D X Δ + D Δ X B T ,
where D X = I 3 n σ 2 , I 3 n is the unit matrix of 3 n × 3 n , D L denotes the variance–covariance matrix of new observations L , D X Δ is the variance–covariance matrix of parameter X and the new observation noise Δ , and D Δ illustrates the variance–covariance matrix of new observation noise.

2.2. Variance–Covariance

2.2.1. Variance–Covariance of the New Observations

From Equations (A2), (A3) and (4), we can get
l i = 1 2 ( r 0 2 a 0 2 b 0 2 c 0 2 x i 2 y i 2 z i 2 + 2 a 0 x i + 2 b 0 y i + 2 c 0 z i ) ,
u l i = 1 2 [ r 0 2 ( μ x i a 0 ) 2 ( μ y i b 0 ) 2 ( μ z i c 0 ) 2 3 σ 2 ] ,
l i u l i = 1 2 [ ( x i 2 + y i 2 + z i 2 ) E ( x i 2 + y i 2 + z i 2 ) + 2 a 0 ε x i + 2 b 0 ε y i + 2 c 0 ε z i ] ,
where i = 1 , 2 , , n .
Suppose the variance of the new observation l i is cov ( l i , l i ) , while the covariance of l i and l j is cov ( l i , l j ) , then, from Equations (A2), (A3) and (16), we have
E [ ( l i u l i ) 2 ] = 1 4 D ( x i 2 + y i 2 + z i 2 ) + E ( a 0 2 ε x i 2 + b 0 2 ε y i 2 + c 0 2 ε z i 2 ) + E ( a 0 x i 2 ε x i + b 0 y i 2 ε y i + c 0 z i 2 ε z i ) ,
cov ( l i , l j ) = E [ ( l i u l i ) ( l j u l j ) ] = 0 ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .
Substituting Equations (A3), (A5) and (A8) into Equation (17), we can get
cov ( l i , l i ) = E [ ( l i u l i ) 2 ] = 3 2 σ 4 + σ 2 [ ( μ x i a 0 ) 2 + ( μ y i b 0 ) 2 + ( μ z i c 0 ) 2 ] ,
where i = 1 , 2 , , n .
Assuming that ( μ x i a 0 ) 2 + ( μ y i b 0 ) 2 + ( μ z i c 0 ) 2 r 0 2 , Equation (19) can be simplified as
cov ( l i , l i ) = 3 2 σ 4 + σ 2 r 0 2 .
Then,
D L = [ 3 2 σ 4 + σ 2 r 0 2 ] I n ,
where i = 1 , 2 , , n , and I n is the unit matrix of n × n .

2.2.2. Variance–Covariance of the New Observation Noise

Suppose the expectation of new observation noise Δ i is μ Δ i , the variance of the new observation noise Δ i is cov ( Δ i , Δ i ) , and the covariance of Δ i and Δ j is cov ( Δ i , Δ j ) . From Equations (6) and (A2)–(A5), we can get
{ u Δ i = E ( ε x i 2 + ε y i 2 + ε z i 2 ) 2 + 1 2 ( ε a 2 + ε b 2 + ε c 2 ε r 2 ) u Δ j = E ( ε x j 2 + ε y j 2 + ε z j 2 ) 2 + 1 2 ( ε a 2 + ε b 2 + ε c 2 ε r 2 ) ,
{ Δ i u Δ i = ε x i 2 + ε y i 2 + ε z i 2 E ( ε x i 2 + ε y i 2 + ε z i 2 ) 2 ( ε a ε x i + ε b ε y i + ε c ε z i ) Δ j u Δ j = ε x j 2 + ε y j 2 + ε z j 2 E ( ε x j 2 + ε y j 2 + ε z j 2 ) 2 ( ε a ε x j + ε b ε y j + ε c ε z j ) ,
cov ( Δ i , Δ i ) = E [ ( Δ i μ Δ i ) 2 ] = D ( ε x i 2 + ε y i 2 + ε z i 2 ) 4 + ( ε a 2 + ε b 2 + ε c 2 ) σ 2 ,
cov ( Δ i , Δ j ) = E [ ( Δ i μ Δ i ) ( Δ j μ Δ j ) ] = 0 ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .
Substituting Equation (A7) into Equation (24), we have
cov ( Δ i , Δ i ) = 3 2 σ 4 + ( ε a 2 + ε b 2 + ε c 2 ) σ 2 ,
and
D Δ = [ 3 2 σ 4 + ( ε a 2 + ε b 2 + ε c 2 ) σ 2 ] I n ,
where i = 1 , 2 , , n , and I n is the unit matrix of n × n .

2.2.3. Variance–Covariance of the Random Parameter and New Observation Noise

From Equation (6), we know
Δ i ε x i = 1 2 ( ε x i 2 + ε y i 2 + ε z i 2 + ε a 2 + ε b 2 + ε c 2 ε r 2 ) ε x i ( ε x i ε a + ε y i ε b + ε z i ε c ) ε x i ,
Δ i ε x j = 1 2 ( ε x i 2 + ε y i 2 + ε z i 2 + ε a 2 + ε b 2 + ε c 2 ε r 2 ) ε x j ( ε x i ε a + ε y i ε b + ε z i ε c ) ε x j ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .
Considering that ε a , ε b , ε c are nonrandom parameters, from Equations (A2)–(A4), (28) and (29), we can get
E ( Δ i ε x i ) = ε a σ 2 , E ( Δ i ε x j ) = 0 ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .
The same derivation of Equation (30) yields
E ( Δ i ε y i ) = ε b σ 2 , E ( Δ i ε y j ) = 0 ,
E ( Δ i ε z i ) = ε c σ 2 , E ( Δ i ε z j ) = 0 ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .
Assuming that covariances between new observation noise Δ i and the observation error ε i = ( ε x i , ε y i , ε z i ) and ε j = ( ε x j , ε y j , ε z j ) are cov ( Δ i , ε i ) and cov ( Δ i , ε j ) , respectively, then, using Equations (30)–(32), we can get
cov ( Δ i , ε i ) = [ ε a σ 2 ε b σ 2 ε c σ 2 ] ,
cov ( Δ i , ε j ) = [ 0 0 0 ] .
Then,
D X Δ = [ ε a ε b ε c ε a ε b ε c ε a ε b ε c ] σ 2 ,
where i = 1 , 2 , , n , j = 1 , 2 , , n , and i j .

2.3. LSC Calculation Steps

The above observation model and parameter estimation assume that the initial values are known. However, spherical center coordinates and the approximate value of the spherical radius are usually unknown; thus, an iterative algorithm is required to complete LSC estimation of the spherical target characteristic parameters, which specific calculation steps are described as follows:
(1)
Read observation values of point clouds on surface of the ball target D a t a = { p i } , p i = ( x i , y i , z i ) , i = 1 , 2 , , n ;
(2)
Use conventional LS algorithm to calculate spherical coordinates and approximate spherical radius a 0 , b 0 , c 0 , r 0 ;
(3)
Assume the variance–covariance matrix of random parameters as D X = I 3 n σ 2 , with the initial nonrandom parameter value Y 1 = [ 0 0 0 0 ] T ;
(4)
Calculate the matrix of new observations L and coefficient matrices B and G using Equations (4), (5) and (6), respectively;
(5)
Assume ε a = Y 1 ( 1 , 1 ) , ε b = Y 1 ( 2 , 1 ) , and ε c = Y 1 ( 3 , 1 ) . Calculate random parameter X and the variance–covariance matrix D X Δ of new observed noise Δ using Equation (35) and the covariance matrix D Δ of new observed noise Δ using Equation (27);
(6)
Calculate matrix H using Equation (13);
(7)
Calculate Y ^ of the nonrandom parameters Y using Equation (9);
(8)
If ( Y ^ Y 1 ) T ( Y ^ Y 1 ) is less than the iteration stop threshold (the value can be 0.000001), then continue; if not, update the initial value of nonrandom parameters Y 1 = Y ^ , and go back to Step 5;
(9)
If Y ^ T Y ^ is less than iteration stop threshold (the value can be 0.000001), then continue; otherwise, update the approximate values of sphere center coordinates and sphere radius as a 0 = a 0 + Y ^ ( 1 , 1 ) , b 0 = b 0 + Y ^ ( 2 , 1 ) , c 0 = c 0 + Y ^ ( 3 , 1 ) , r 0 = r 0 + Y ^ ( 4 , 1 ) , and Y 1 = [ 0 0 0 0 ] T , and go back to Step 4;
(10)
Calculate the variance–covariance matrix D L of new observations L using Equation (21);
(11)
Calculate the variance–covariance matrix D Y ^ of Y ^ using Equation (11);
(12)
End.

3. Experimental Verification

In order to verify the effectiveness of the spherical target LSC algorithm, both simulations and actual scanning experiments are designed in this paper. In this section, we first introduce the evaluation indicators used in the experiments, then introduce experimental data and scenarios, and finally analyze experimental results through comparing the estimation accuracy of spherical parameters obtained from our method with LS, TLS, and RWTLS algorithms.

3.1. Evaluation Index

We used the root-mean-square error (RMSE) of sphere center coordinate parameter estimation ( R M S E a b c ) and sphere radius parameter estimation ( R M S E r ) as the evaluation metrics to compare differences among LS, TLS, and the RWTLS algorithms. The two evaluation metrics are expressed as follows:
R M S E a b c = 1 h j = 1 h ( a ^ j a ˜ ) 2 + ( b ^ j b ˜ ) 2 + ( c ^ j c ˜ ) 2 ,
R M S E r = 1 h j = 1 h ( r ^ j r ˜ ) 2 ,
where h represents the number of trials, and a ^ j , b ^ j , c ^ j , and r ^ j are estimations of the sphere center coordinate parameter and sphere radius parameter calculated for different algorithms.

3.2. Simulation Experiment

In order to compare the sphere center extraction accuracy of our methods, we imitate the laser scanning process and use random simulation to generate observations of spherical point clouds with different radii under different noise levels.

3.2.1. Simulation Experiment I

It is assumed that the center coordinate of the scanner is (0 m,0 m,0 m), true values of sphere center coordinates are ( a ˜ , b ˜ , c ˜ ) = (10 m,10 m,10 m), the true value of the sphere radius is r ˜ ∈ {2 cm,3 cm,…,11 cm}, and the observed noise variance is σ ∈ {1 mm,2 mm,…,10 mm}. We randomly simulated 1000 sets of spherical point cloud observations under different noises { D σ 1 , i , j , D σ 2 , i , j , , D σ 10 , i , j } i = 2 , , 11 ; j = 1 , 2 , , 1000 . For the above simulated point cloud observation data, LS, TLS, RWTLS, and the LSC algorithm proposed in this paper were used to estimate the spherical center coordinates and spherical radius of the target. At the same time, Equation (36) was used to calculate the estimation accuracy of the spherical center coordinate parameters under different noise variances (see Figure 1), and Equation (37) was used to calculate the estimation accuracy of spherical radius parameters under different noise variances (see Figure 2 and Table 1).

3.2.2. Simulation Experiment II

The sphere radius was set to r ˜ ∈ {2 cm,3 cm,…,11 cm}. The coordinates of the scanner center were still (0 m,0 m,0 m), true values of sphere center coordinates ( a ˜ , b ˜ , c ˜ ) were (10 m,10 m,10 m), and the observed noise variance was σ ∈ {1 mm,2 mm,…,10 mm}. We randomly simulated 1000 sets of spherical point cloud observations under different radii { D r 1 , i , j , D r 2 , i , j , , D r 10 , i , j } i = 1 , 2 , , 10 ; j = 1 , 2 , , 1000 . For the above simulated point cloud observation data, LS, TLS, RWTLS, and the LSC algorithm proposed in this paper were used to estimate spherical center coordinates and spherical radius of the target. At the same time, Equation (36) was used to calculate the estimation accuracy of spherical center coordinate parameters under different radii (see Figure 3), and Equation (37) was used to calculate the estimated accuracy of spherical radius parameters under different radii (see Figure 4 and Table 2).

3.3. Actual Experiment

To further verify the practicability of fitting the spherical center of the spherical target based on our LSC model, this study also designed a scan experiment (see Figure 5) taking into account the effects of observation noise and target radius. We used a MS60 three-dimensional laser scanner to scan spherical targets with radii of 2.02 cm, 2.14 cm, 2.76 cm, 3.44 cm, and 4.19 cm for 10 ( h = 10 ) repetitions to obtain spherical point cloud observation data. The LS, TLS, and RWTLS algorithms and the calculation steps in Section 2.3 were applied to process the point cloud data separately. Equations (36) and (37) were used to calculate the root-mean-square error of parameters under the three traditional algorithms and the algorithm of this paper. The processing results are shown in Figure 6. In addition, we also calculated the computation time of each algorithm, and the results are shown in Table 3.

3.4. Result Analysis

It can be seen from Figure 1 that, when the observation error was small, the estimation results of spherical center coordinate parameters from the four algorithms had little difference. The RMSE of spherical center coordinate parameters from RWTLS could reach a maximum of 12 mm, indicating that the observation error had a great influence on the accuracy of RWTLS algorithm. Table 1 shows that LSC spherical center coordinates had the highest fitting accuracy as noise increased, while the accuracy of ball parameter extraction with different radii gradually decreased. In terms of ball parameter extraction accuracy, the LSC algorithm extraction accuracy decreased more slowly than that of LS, TLS, and WRTL. Most of the differences between maximum and minimum RMSEs for LSC were smaller than for the other three methods, indicating that the LSC algorithm was more robust than other methods.
The comparison results of Figure 3 and Table 2 show that, as the radius of sphere increased, the extraction accuracy of sphere parameters under the influence of different noises gradually increased, among which the LSC algorithm’s extraction accuracy still changed more smoothly than that of LS, TLS, and RWTLS. In other words, the differences between the maximum and values of the RMSE were mostly the smallest in LSC, indicating that the LSC algorithm was less affected by the radius of the ball than the other three methods.
Figure 2 and Figure 4 show that the ball parameter extraction accuracy of LS-LSC, TLS-LS, WRTLS-TLS was greater than zero in all cases, and the results imply that the ball parameter extraction accuracy of LSC was the highest, followed by LS, TLS, and WRTLS. At the same time, it can be seen from Figure 2 that the differences in extraction accuracy of the spherical center coordinate parameters for different algorithms were mostly about 1 mm, with a maximum of 4.5 mm, while those for the sphere radius parameter were mostly below 0.5 mm, with a maximum of 2.6 mm. This shows that the extraction accuracy of the sphere radius parameter was more affected by the algorithm than the extraction of the sphere center coordinate parameter.
In addition, as can be seen from Table 1 and Table 2, compared with other algorithms, the LSC algorithm could improve the extraction accuracy of parameters in all cases, and the ball parameters could be increased by a minimum of 0.4% and maximum of 78.4%.
Figure 6 proves that, when our proposed algorithm was adapted to the point-cloud scanning data of a real scene, its accuracy remained the highest. With increasing radius of the ball target, the calculation accuracy of the four algorithms was improved. The spherical center fitting errors of the four radii from the LSC algorithm were 4–6 mm, 2–4 mm, and 2–4 mm lower than those of LS, TLS, and RWTLS, respectively, while the radius parameter estimation errors were 5–7 mm, 4–7 mm, and 2–5 mm lower than those of LS, TLS, and RWTLS, respectively. It can also be seen from Table 3 that, with increasing radius, the computation time of all algorithms increased, among which LS exhibited the lowest computation time, while the computation time of TLS, RWTLS, and the LSC algorithm proposed in this paper was about the same.

4. Conclusions

When the sphere radius is unknown, the correlation between the sphere center coordinate and the sphere radius is not considered in all existing estimation algorithms, which leads to inaccurate estimation of the sphere center coordinate. This paper constructed the LSC model of spherical point clouds and derived rigorous variance–covariance matrix estimation formulas for the new observations, new observation noise, and random parameters and the new observation noise. Then, a high-precision spherical target sphere center estimation algorithm together with implementation steps based on LSC was proposed.
Through comparison with the traditional LS, TLS and WRTLS algorithms, it was found that the proposed method was less affected by noise and sphere radius. The ball parameter extraction accuracy from the proposed LSC method was the highest, followed by LS, WRTL, and TLS. Under the influence of different noise variances, the LSC algorithm sphere center coordinate parameter extraction accuracy was improved by more than 5.7%, 12.1%, and 8.7% compared with the LS, RWTLS, and TLS algorithms, respectively. In terms of extraction accuracy of the sphere radius parameter, the LSC algorithm was also superior to LS, WRTL, and TLS, with improvements of 13.7%, 13.6%, and 10.1%, respectively, on average.
With respect to the influence of different sphere radii, the sphere center coordinate parameter extraction accuracy obtained by our proposed rigorous LSC algorithm was improved by 16.4%, 24.1%, and 9.7%, respectively, on average as compared with the LS, WRTL, and TLS algorithms. The LSC algorithm could also improve the extraction accuracy of the sphere radius parameter by an average of more than 9.7%, 10.6%, and 9.6%, respectively, as compared with the other three methods. In particular, in the absence of gross errors, the accuracy of the RWTLS algorithm was not optimal. In addition, although the TLS algorithm takes into account the influence of the coefficient matrix error, there was no substantial improvement in the accuracy of ball parameter estimation.

Author Contributions

Conceptualization, R.Y., X.M. and Y.Y.; methodology, R.Y., J.L. and Y.Y.; software, J.L.; validation, R.Y. and J.L.; formal analysis, R.Y. and X.M.; investigation, J.L.; resources, R.Y. and X.M.; data curation, J.L.; writing—original draft preparation, J.L.; writing—review and editing, R.Y. and X.M.; visualization, J.L.; supervision, R.Y., X.M. and Y.Y.; project administration, R.Y. and X.M.; funding acquisition, R.Y. All authors read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (grant number 41304001), the 111 Projects (grant number B18062), the Chongqing Natural Science Foundation (grant number cstc2019jcyj-msxmX0153), and the Fundamental Research Funds for the Central Universities (No.02180052020026).

Data Availability Statement

The datasets and source codes used in this study is available from the corresponding author on a reasonable request.

Acknowledgments

The authors would like to thank all anonymous reviewers for their valuable, constructive, and prompt comments and suggestions. And we appreciate Zhao Li for helping to revise the paper and improving the English language, Degui Teng, Chao Li, and Changzheng Yuan of Chongqing Survey Institute for their inspiration and useful suggestions, Long Li from Chongqing University for providing experimental equipment, Decheng Zhu and Chang Deng for their help in translation.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Suppose the expected values of coordinate observations ( x i , y i , z i ) and new observations l i are μ x i , μ y i , μ z i , μ l i , respectively, and the variances of coordinate observation ( x i , y i , z i ) and observation error ( ε x i , ε y i , ε z i ) are D x i , D y i , D z i , D ε x i , D ε y i , D ε z i , respectively. Suppose ε x i , ε y i , ε z i are independent of each other, and ε x i ~ N ( 0 , σ 2 ) , ε y i ~ N ( 0 , σ 2 ) , ε z i ~ N ( 0 , σ 2 ) . Then, we can get
{ x i ~ N ( μ x i , σ 2 ) y i ~ N ( μ y i , σ 2 ) z i ~ N ( μ z i , σ 2 ) ,   { x i σ ~ N ( μ x i σ , 1 ) y i σ ~ N ( μ y i σ , 1 ) z i σ ~ N ( μ z i σ , 1 ) ,   { ε x i σ ~ N ( 0 , 1 ) ε y i σ ~ N ( 0 , 1 ) ε z i σ ~ N ( 0 , 1 ) ,
{ μ x i = x ˜ i = E ( x i ) μ y i = y ˜ i = E ( y i ) μ z i = z ˜ i = E ( z i ) D x i = D y i = D z i = σ 2 ,   { E ( ε x i ) = E ( ε y i ) = E ( ε z i ) = 0 D ε x i = D ε y i = D ε z i = σ 2 .
With the properties of the expectation and variance [19], we can get
{ E ( x i 2 ) = D ( x i ) + [ E ( x i ) ] 2 = σ 2 + μ x i 2 E ( y i 2 ) = σ 2 + μ y i 2 E ( z i 2 ) = σ 2 + μ z i 2 ,   { E ( ε x i 2 ) = D ( ε x i ) + [ E ( ε x i ) ] 2 = σ 2 E ( ε y i 2 ) = σ 2 E ( ε z i 2 ) = σ 2 ,
{ E ( x i 3 ) = E [ ( μ x i ε x i ) 3 ] = μ x i 3 + 3 μ x i σ 2 E ( y i 3 ) = μ y i 3 + 3 μ y i σ 2 E ( z i 3 ) = μ z i 3 + 3 μ z i σ 2 ,   E ( ε x i 3 ) = E ( ε y i 3 ) = E ( ε z i 3 ) = 0 ,
{ E ( x i 2 ε x i ) = E [ ( μ x i ε x i ) 2 ε x i ] = 2 μ x i σ 2 E ( y i 2 ε y i ) = 2 μ y i σ 2 E ( z i 2 ε z i ) = 2 μ z i σ 2 ,
where E ( ) represents the calculation of expectation, and i = 1 , 2 , , n .
With Equation (A1) and the relationship between the chi-square distribution and the normal distribution, we can get
{ x i 2 σ 2 ~ χ ( 1 , λ 1 ) 2   and   λ 1 = μ x i 2 σ 2 y i 2 σ 2 ~ χ ( 1 , λ 2 ) 2   and   λ 2 = μ y i 2 σ 2 z i 2 σ 2 ~ χ ( 1 , λ 3 ) 2   and   λ 3 = μ z i 2 σ 2 ,   { ε x i 2 σ 2 ~ χ ( 1 , 0 ) 2 ε y i 2 σ 2 ~ χ ( 1 , 0 ) 2 ε z i 2 σ 2 ~ χ ( 1 , 0 ) 2 ,   { ε x i 2 σ 2 + ε y i 2 σ 2 + ε z i 2 σ 2 ~ χ ( 3 , 0 ) 2 x i 2 σ 2 + y i 2 σ 2 + z i 2 σ 2 ~ χ ( 3 , λ ) 2 λ = μ x i 2 + μ y i 2 + μ z i 2 σ 2 ,
where i = 1 , 2 , , n .
As the variance of the noncentral distribution χ 2 ( m , λ ) is D ( χ ( m , λ ) 2 ) = 2 m + 4 λ , with the above equation, we can get
D ( ε x i 2 ) = D ( ε y i 2 ) = D ( ε z i 2 ) = 2 σ 4 ,   D ( ε x i 2 + ε y i 2 + ε z i 2 ) = 6 σ 4 ,
{ D ( x i 2 ) = 2 σ 4 + 4 σ 2 μ x i 2 D ( y i 2 ) = 2 σ 4 + 4 σ 2 μ y i 2 D ( z i 2 ) = 2 σ 4 + 4 σ 2 μ z i 2 ,   D ( x i 2 + y i 2 + z i 2 ) = 6 σ 4 + 4 σ 2 ( μ x i 2 + μ y i 2 + μ z i 2 ) ,
where i = 1 , 2 , , n .

References

  1. Williams, R.D.; Lamy, M.; Maniatis, G.; Stott, E. Three-dimensional reconstruction of fluvial surface sedimentology and topography using personal mobile laser scanning. Earth Surf. Process. Landf. 2019, 45, 251–261. [Google Scholar] [CrossRef]
  2. Liu, H.; Shen, X.; Cao, L.; Yun, T.; Zhang, Z.; Fu, X.; Chen, X.; Liu, F. Deep Learning in Forest Structural Parameter Estimation Using Airborne LiDAR Data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 14, 1603–1618. [Google Scholar] [CrossRef]
  3. Li, L.; Cao, X.; He, Q.; Sun, J.; Jia, B.; Dong, X. A new 3D laser-scanning and GPS combined measurement system. C. R. Geosci. 2019, 351, 508–516. [Google Scholar] [CrossRef]
  4. Tian, H.; Ni, J.; Hu, J. Autonomous Driving System Design for Formula Student Driverless Racecar. In Proceedings of the 2018 IEEE Intelligent Vehicles Symposium, Suzhou, China, 26–30 June 2018; pp. 1–6. [Google Scholar]
  5. Jia, D.F.; Cheng, X.J.; Liu, Y.P. Application Analysis of Spherical Target in Point Cloud Data Registration. Geotech. Investig. Surv. 2011, 9, 64–68. [Google Scholar]
  6. Liu, W. Novel method for sphere target detection and center estimation from mobile terrestrial laser scanner data. Measurement 2019, 137, 617–623. [Google Scholar] [CrossRef]
  7. Prem, R.; Bala, M.; Daniel, S. Metrological evaluation of contrast target center algorithm for terrestrial laser scanners. Measurement 2018, 134, 15–24. [Google Scholar]
  8. Rachakonda, P.; Muralikrishnan, B.; Cournoyer, L. Software to Determine Sphere Center from Terrestrial Laser Scanner Data per ASTM Standard E3125-17. J. Res. Natl. Inst. Stand. Technol. 2018, 123, 1–4. [Google Scholar] [CrossRef] [PubMed]
  9. Chen, W.X.; Chen, Y.; Yuan, Q. Application of Weighted Total Least Squares in Fitting of 3D Laser Target. J. Geod. Geodyn. 2010, 30, 90–96. [Google Scholar]
  10. Wang, L.Y. Using Robust WTLS Method for 3D Laser Scanning Target Ball Positioning. J. Geod. Geodyn. 2016, 36, 746–749. [Google Scholar]
  11. Reshetyuk, Y.; Horemuž, M.; Sjöberg, L.E. Determination of the optimal diameter for spherical targets used in 3D laser scanning. Surv. Rev. 2005, 38, 243–253. [Google Scholar] [CrossRef]
  12. Schaffrin, B.; Wieser, A. On weighted total least-Squares adjustment for linear regression. J. Geod. 2008, 82, 415–421. [Google Scholar] [CrossRef]
  13. Rachakonda, P.; Muralikrishnan, B.; Cournoyer, L. Methods and considerations to determine sphere center from terrestrial laser scanner point cloud data. Meas. Sci. Technol. 2017, 28, 105001. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Lin, G.; Tang, Y.; Zou, X. Three-dimensional reconstruction of guava fruits and branches using instance segmentation and geometry analysis. Comput. Electron. Agric. 2021, 184, 106107. [Google Scholar] [CrossRef]
  15. Yue, D.; Xie, S.; Guo, P. Determination of spherical target center from TLS data based on a method of nonlinear least squares. In Proceedings of the International Symposium on Lidar and Radar Mapping, Nanjing, China, 26–29 May 2011. [Google Scholar] [CrossRef]
  16. Brazeal, R. GEOMETRIC FORM FITTING OF POINT CLOUD DATA REPRESENTING SPHERICAL REGISTRATION/GEOREFERENCING TARGETS. 2013. Available online: https://www.researchgate.net/publication/265014489_GEOMETRIC_FORM_FITTING_OF_POINT_CLOUD_DATA_REPRESENTING_SPHERICAL_REGISTRATIONGEOREFERENCING_TARGETS (accessed on 12 February 2022).
  17. Lu, T.D.; Zhou, S.J.; Zhang, L.T. Method for Positioning Target Ball Based on Global Least Squares by Laser Scanning on the Ground. J. Geod. Geodyn. 2009, 29, 102–105. [Google Scholar]
  18. Moritz, H. Least-squares collocation. Rev. Geophys. 1978, 16, 421–430. [Google Scholar] [CrossRef]
  19. You, R.J.; Hwang, H.W. Coordinate Transformation between Two Geodetic Datums of Taiwan by Least-Squares Collocation. J. Surv. Eng. 2006, 132, 64–70. [Google Scholar] [CrossRef]
  20. Ramouz, S.; Afrasteh, Y.; Reguzzoni, M. IRG2018: A regional geoid model in Iran using Least Squares Collocation. Studia Geophys. Geod. 2019, 63, 191–214. [Google Scholar] [CrossRef]
Figure 1. Estimation accuracy of spherical parameters under different noise variances. The y-axes of each graph in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each graph represents the magnitude of the noise variance. The unit of the x-axis is mm, while the unit of the y-axis is mm.
Figure 1. Estimation accuracy of spherical parameters under different noise variances. The y-axes of each graph in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each graph represents the magnitude of the noise variance. The unit of the x-axis is mm, while the unit of the y-axis is mm.
Remotesensing 14 01491 g001
Figure 2. Comparison of sphere parameter estimation accuracy of different algorithms under different noise variances. The y-axes of each graph in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each graph represents the magnitude of the noise variance. The unit of the x-axis is mm, while the unit of the y-axis is mm.
Figure 2. Comparison of sphere parameter estimation accuracy of different algorithms under different noise variances. The y-axes of each graph in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each graph represents the magnitude of the noise variance. The unit of the x-axis is mm, while the unit of the y-axis is mm.
Remotesensing 14 01491 g002
Figure 3. The estimation accuracy of spherical parameters under different radii. The y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each figure represents the initial value of the sphere radius. The unit of the x-axis is cm, while the unit of the y-axis is mm.
Figure 3. The estimation accuracy of spherical parameters under different radii. The y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each figure represents the initial value of the sphere radius. The unit of the x-axis is cm, while the unit of the y-axis is mm.
Remotesensing 14 01491 g003
Figure 4. Comparison of sphere parameter estimation accuracy of different algorithms under different radii. The y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each figure represents the initial value of the sphere radius. The unit of the x-axis is cm, while the unit of the y-axis is mm.
Figure 4. Comparison of sphere parameter estimation accuracy of different algorithms under different radii. The y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. The x-axis of each figure represents the initial value of the sphere radius. The unit of the x-axis is cm, while the unit of the y-axis is mm.
Remotesensing 14 01491 g004
Figure 5. Experimental scanning setup.
Figure 5. Experimental scanning setup.
Remotesensing 14 01491 g005
Figure 6. Sphere center coordinate error (left) and sphere radius error (right). Different colors represent different parameter estimation algorithms; the x-axis value represents the experiment number; the y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. (a) Ball target with a radius of 2.02 cm; (b) ball target with a radius of 2.16 cm; (c) ball target with a radius of 2.76 cm; (d) ball target with a radius of 3.44 cm; (e) ball target with a radius of 4.19 cm.
Figure 6. Sphere center coordinate error (left) and sphere radius error (right). Different colors represent different parameter estimation algorithms; the x-axis value represents the experiment number; the y-axes in the left and right columns represent the RMSE of spherical center coordinate parameter estimation and spherical radius parameter estimation, respectively. (a) Ball target with a radius of 2.02 cm; (b) ball target with a radius of 2.16 cm; (c) ball target with a radius of 2.76 cm; (d) ball target with a radius of 3.44 cm; (e) ball target with a radius of 4.19 cm.
Remotesensing 14 01491 g006aRemotesensing 14 01491 g006b
Table 1. Comparison of different algorithms under different radii (unit: %).
Table 1. Comparison of different algorithms under different radii (unit: %).
(LS − LSC)/LS(TLS − LSC)/TLS(RWTLS − LSC)/RWTLS
R MinMaxAverMinMaxAverMinMaxAver
R M S E a b c r 1 2.79.85.70.734.18.724.731.628.6
r 2 6.621.911.5325.611.727.136.532.4
r 3 1.628.69.81.521.69.519.638.131.9
r 4 3.516.87.42.622.610.716.140.532.4
r 5 3.331.619.22.712.17.214.951.336.5
r 6 11.731.223.42.220.911.62.749.134.2
r 7 2.436.421.75.43014.70.526.512.1
r 8 10.354.526.8034.816.511.539.523.7
r 9 1360.73810.955.334.20.350.731.8
r 10 13.550.531.811.855.733.46.950.628.5
R M S E r r 1 1.629.413.71.729.410.41.438.317.7
r 2 15.229.614.43.216.710.10.626.113.6
r 3 4.369.6220.423.811.35.422.714.4
r 4 2.932.123.52.371.811.30.980.625.6
r 5 3.868.328.70.656.8160.671.722.6
r 6 1.252.220.62.458.6180.164.621.2
r 7 1.440.229.16.446.423.311.562.231.9
r 8 1.342.529.81.826.313.94.680.637.5
r 9 3.110.633.85.524.41318.275.617.2
r 10 0.430.234.12.127219.341.250.6
Table 2. Comparison of different algorithms under different noises (unit: %).
Table 2. Comparison of different algorithms under different noises (unit: %).
(LS − LSC)/LS(TLS − LSC)/TLS(RWTLS − LSC)/RWTLS
σ MinMaxAverMinMaxAverMinMaxAver
R M S E a b c σ 1 4.954.521.4019.69.72.739.724.6
σ 2 3.141.319.65.734.118.60.544.226.7
σ 3 442.919.95.636.319.69.252.428.8
σ 4 1.636.417.81.525.610.90.347.524.1
σ 5 3.528.316.41.13013.812.345.130.6
σ 6 3.535.520.12.843.317.518.851.331.8
σ 7 4.739.319.22.142.416.419.947.235.8
σ 8 9.849.222.11.942.817.725.743.334.1
σ 9 3.356.519.43.645.615.22.350.728.6
σ 10 2.460.719.5255.7196.350.225.7
R M S E r σ 1 1.778.431.7677.639.11.880.642.5
σ 2 0.449.6330.735.413.8138.310.6
σ 3 1.430.99.91.321.911.26.232.920.8
σ 4 1.332.160.24.126.610.313.146.224.9
σ 5 3.127.111.67.754.528.50.646.825.5
σ 6 0.747.722.116.758.434.54.647.321.9
σ 7 1.738.818.57.243.7189.580.625.2
σ 8 3.334.217.34.632.8171.441.233.2
σ 9 5.326.914.83.117.59.60.956.233
σ 10 5.815.29.71.921.69.70.169.721.4
Table 3. Computation time of different algorithms.
Table 3. Computation time of different algorithms.
Time (s)
Radius (cm)LSTLSRWTLSLSC
2.020.0780.9370.9060.890
2.160.0930.9530.9530.953
2.760.1401.0620.9840.984
3.440.1561.0781.0931.015
4.190.1871.1561.0621.187
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yang, R.; Li, J.; Meng, X.; You, Y. A Rigorous Feature Extraction Algorithm for Spherical Target Identification in Terrestrial Laser Scanning. Remote Sens. 2022, 14, 1491. https://doi.org/10.3390/rs14061491

AMA Style

Yang R, Li J, Meng X, You Y. A Rigorous Feature Extraction Algorithm for Spherical Target Identification in Terrestrial Laser Scanning. Remote Sensing. 2022; 14(6):1491. https://doi.org/10.3390/rs14061491

Chicago/Turabian Style

Yang, Ronghua, Jing Li, Xiaolin Meng, and Yangsheng You. 2022. "A Rigorous Feature Extraction Algorithm for Spherical Target Identification in Terrestrial Laser Scanning" Remote Sensing 14, no. 6: 1491. https://doi.org/10.3390/rs14061491

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop