1. Introduction
Terrestrial Light Detection and Ranging (LiDAR) intensity data correction has been increasingly studied in recent years to obtain additional insight into the scanned environments that is not available from the geometric information alone. This additional intensity information has the possibility of aiding automated processing techniques [
1,
2,
3,
4,
5,
6,
7]. In essence, it provides a value that has some dependence on the material properties of the surface, which reflected the laser light. The raw intensity data provided by Terrestrial Laser Scanners (TLSs) is a Digital Number (DN) that is assumed to be proportional to the received power. However, each different scanner and scanner manufacturer reports intensity differently so direct comparisons of intensity values between manufacturers and devices are not trivial. The aim of radiometric correction, in our case, is to provide a number between zero and one, calibrated to known diffuse reflectance standards. The advantages of having a consistent corrected value is that it can be compared across scanners and across different environments. This allows manual and automatic algorithms to be developed that can be seamlessly applied across different instruments and manufacturers.
It is commonly accepted that the intensity value is dependent upon four factors: instrument and environmental factors, surface properties of the target and measurement geometry [
8]. In most previous work, correcting for measurement geometry was the main focus. This mainly involved applying a distance correction [
9,
10], an angle correction [
11,
12] or both an angle and distance correction [
8,
13,
14,
15,
16,
17,
18,
19,
20]. Some of the previous work has assumed a diffuse surface so that the corrected intensity becomes the diffuse reflectance [
13,
14,
18] or pseudoreflectance [
17]. However, since many materials, especially manmade materials, produce specular reflections or have varying surface roughness, more complex reflectance models have been used [
8,
11,
15,
19,
20]. There are two main drawbacks to using a more complex reflectance model: (1) the model requires an additional parameter related to the roughness of the surface being scanned; and (2) the estimated values can no longer be easily calibrated completely with a diffuse reflectance target. This second reason is very important when verifying the model. Without calibrating the model to a known standard, it is difficult to appropriately verify the model in different environments and conditions. Much of the literature has failed to do verification on their models and, in fact, their reported results are often the modelling errors and not the actual errors one would expect to see on a new data set [
13,
14,
17]. In addition, many studies do not correct to a known diffuse reflectance standard value and instead use a normalized, or corrected intensity [
9,
15,
19].
The genesis of this research came out of verifying the model presented in [
18]. During verification of the model for the Faro Focus
X 330 (Lake Mary, FL, USA) [
21], it was discovered that the model performed very poorly on new data sets. A number of possible causes for the poor performance were investigated. This work led to the ambient temperature being the problem. A temperature calibration method for the Faro Focus
X 330 laser scanner was developed and is presented in this paper. It is also shown how such a temperature compensation is not necessary for the Riegl VZ-400 (Horn, Austria) [
22] through three verification experiments. In both cases, the radiometric calibration method is based on the work by Errington et al. [
18]. To the best of the authors’ knowledge, this is the first time that a temperature compensation has been applied to intensity correction for terrestrial laser scanners. Another important contribution of this work is the verification of the radiometric correction and temperature compensation in different environments.
The following section highlights some of the most relevant and recent work in the area of intensity correction and
Section 3 presents the reflectance estimation model used in this research. The temperature compensation method is presented in
Section 4 and the experiments showing its applicability are described in
Section 5. Results and Discussions are presented in
Section 6 and
Section 7, respectively, and finally, in
Section 8, conclusions and a summary are presented.
2. Related Work
This section provides a brief overview of the most recent and relevant literature related to terrestrial LiDAR intensity correction. Fang et al. [
15] proposed an angle and distance correction for the Z+F Imager5006i (Wangen im Allgäu, Germany), which estimates parameters of a customized laser transmission function for the specific scanner. They performed the calibration of the model with paper targets at angles between 0 and 80 degrees and distances between 0 and 50 m. Similar to previous research, they focused on minimizing the variation of corrected intensities and not calibrating their model to known reflectances.
Tan and Cheng [
17] modelled the received intensity as a multiplicative function of three polynomials of reflectance
, cosine of the angle,
, and distance,
R. In their case, they calibrated this model with diffuse reflectance targets (20%, 40%, 60% and 80%) for the Faro Focus
X 330 and Faro Focus
120. The only verification of their model was done by comparing the variability of the corrected intensity using real world data. Similarily, in Tan et al. [
9], they investigate just a distance correction, through a polynomial series, and apply the model to the two Faro scanners, as in [
17].
Zhu et al. use intensity measured by a Riegl VZ-400 to estimate plant leaf water content [
11]. Their correction is not generally applicable because it was performed at a single distance. However, they did propose modelling the received intensity as a combination of diffuse and specular components. This was necessary due to the highly specular nature of many of the leaf species being scanned.
Carrea et al. [
19] proposed using the Oren–Nayar reflectance model [
23], which incorporates a more realistic model of diffuse surfaces than the typical Lambertian model, in order to correct for both distance and angle. They apply their correction to lithological differentiation. A drawback of their approach, and other reflectance models that take into account surface roughness, is the additional parameters required for the surface types scanned.
Tan et al. [
20] also propose a method using the Oren–Nayar reflectance model. They apply their method to the Faro Focus
.
3. Model Description and Fitting Approach
The method used here to correct the returned intensity was first presented in [
18]. It was inspired by the work of Pfeifer et al. [
14]. Although this method is not central to the contributions in this paper, it is presented for completeness.
In general, it is desired to model the returned intensity,
I, as a function of the angle of incidence,
, the reflectance of the surface,
, and the distance from the scanner to the point of interest,
r. Mathematically this dependence is,
where
and
is a set of parameters that depend upon
r. The specific model used here that provides excellent performance and yet is relatively straight forward is
where the dependence of the parameters
and
on the distance
r has been made explicit. This model was determined empirically from a number of different forms. The natural logarithm dependence performed the best out of all the other model forms tested. Equation (
2) can then be solved for the reflectance
, which yields
where the hat above the
implies that it is an estimate of the true reflectance,
.
To calibrate this model for a specific laser scanner, it is necessary to collect data points
, with corresponding known reflectance
, where
T represents the transpose and the
ith data point is composed of an incidence angle
, distance
, and a returned intensity
. A typical objective function to be minimized is the squared residuals between the true and estimated reflectance which has the following form,
where it is assumed that there are
N data points. For the form of the model presented here, this approach is not practical, since the parameters
and
are a function of distance. Instead, the experiments are designed so that multiple incidence angles are collected at each distance. In this way, each distance
r is held fixed while the parameters, which minimize Equation (
4), are found.
Once the optimization at each value of
r has been completed, it results in a matrix
that provides
and
at different values of
r:
Note that the superscripts indicate the value of r the parameters depend upon.
Once matrix
is obtained, the reflectance of a point obtained at the sampled distances can be estimated. However, it is necessary to use interpolation of the parameters,
and
when the distance of the point is not at a sampled distance. It was found that if the distances are well sampled, then a cubic spline interpolation provides the most accurate results. The definition of well sampled will depend upon a number of factors, including: the distance and angular dependency of the laser scanner under study and the eventual application of the radiometrically corrected intensity data. The specifics of how the distances and angles are sampled for the work presented in this paper are shown in
Section 5.
4. Temperature Compensation
The reflectance calibration procedure, described in
Section 3 and first proposed in [
18], when applied to the Faro Focus
X 330 produced poor results in comparison to the Riegl VZ–400. The model fit well, but when trying to verify the model on a separate data set that was taken at a different time and location, the error became very large. It was hypothesized that differences in environmental temperature of each of the three data sets adversely affected the results. For this reason, an experiment was conducted to assess how the intensity values reported by the Faro instrument depended upon environmental temperature.
The Faro scanner and two diffuse reflectance targets, 40% and 60%, were placed in a temperature controlled chamber. The values of 40% and 60% were used since, in the area of interest in underground potash mines, the majority of returned reflectance values fall in the range . The targets were approximately 2.3 m away from the scanner and the ambient air temperature was varied between 5 C and 35 C in 5 C steps. The temperature in the chamber was changed via either a heater or an air conditioning unit that was controlled via a Programmable Logic Controller (PLC). At each temperature step, the temperature was held for at least 10 min for the instrument to adjust to the ambient temperature in the room. During the course of the scans at a given temperature, the temperature did not vary more than C around the set point. The humidity was not controlled and varied between 28.6% and 18.1% throughout the course of the experiment. Multiple scans were taken at each temperature. The Faro scanner has an internal temperature sensor and the mean, minimum and maximum sensed value is saved for each individual scan. These values can be read from the Scan Parameters file and exported. The mean internal temperature of the Faro Focus X 330 was used instead of the ambient temperature because it was available without any extra sensing instruments. Another reason for using the internal temperature of the unit is that during the experiment, at each ambient temperature step, multiple scans were taken, which caused the internal temperature to increase.
Figure 1 shows how the intensity changes with respect to the mean internal temperature of the Faro scanner. The intensity value obtained from the scanner has been referenced to the minimum intensity recorded for each target. This allows the change in intensity over temperature, of both the 40% and 60% target, to be compared to one another, irrespective of which target the data point was obtained from. From
Figure 1, it is clear that the intensity of each target changes with a change in the internal temperature of the scanner, following a consistent relationship. A temperature correction was determined by fitting a seventh order polynomial to the data shown in
Figure 1. A series of polynomials from the linear to 11th order were tested by applying them to data collected in
Section 5.2. A 7th order polynomial was found to produce the best results and was selected.
The correction determined corrects the intensity to the intensity that would be received if the internal temperature were 40
C. The intensity correction can then be determined as
where
is the intensity correction added to the received intensity,
is the fitted seventh order polynomial and
is the mean temperature during the scan. In this research, the reflectance estimation method of Errington et al. [
18] is used, but the temperature compensation can easily be applied to other methods, as it operates as an offset to the raw intensity value. It should be noted that, although this method can be easily applied with other radiometric correction methods, if other TLSs require temperature compensation, they too will have to be tested to determine their specific relationship between intensity and temperature.
5. Experiments
Three experiments for each instrument were conducted, both to determine the model parameters and to validate the generated models. In order to characterize the model, it is necessary to sample the intensity at various angles, positions and reflectances, as explained in
Section 3.
Figure 2 shows a photograph from one of the field tests where both the Riegl and Faro instrument were used simultaneously to collect data. Six Spectralon [
24] calibrated diffuse reflectance targets were used in each experiment. Their nominal reflectances were 5%, 20%, 40%, 60%, 80% and 99%. The reflectance targets have slightly different reflectance values as compared to their nominal value. The reflectances at 1550 nm, the assumed wavelength for both scanners, are shown in
Table 1.
5.1. Riegl VZ-400
The Riegl VZ–400 is a pulse-based TLS which operates a laser of wavelength 1550 nm. It is a rugged device with passive cooling through its anodized aluminum housing. There were three experiments conducted using the VZ-400. The first two were conducted in a grass playing field (Field Test 1 and Field Test 2) during daylight and the third was conducted in a potash mine, which is approximately one kilometre underground (Allan mine), with no lighting present. The reasons for selecting these locations was twofold: (1) to see if different environmental conditions affect the resulting intensity, and (2) to provide multiple data sets to validate the model in different environments. This allows the model to be generated with a variety of data sets from different environments, in order to see how well it performs modelling alternative data sets. Note that the ambient air temperature of the field data sets was approximately 5 C and the underground mine data set was approximately 29 C.
The sampling grid of the 5% reflectance target from the mine data set is shown in
Figure 3. This figure illustrates at what distances and angles the 5% target was scanned. For example, at 30 m, the 5% target was scanned at approximately 5
, 23
, 37
, 49
and 61
. This data was produced by placing the target at eight different distances from 5 m to 89 m. At each of these distances, the target was rotated to give incident angles between 0 to 72 degrees. The goal was to obtain consistent angular steps at each distance, and this was not always possible. For instance, at the distance of 89 m, for the 5% reflectance target, the lowest incidence angle achieved was 10
. This procedure was repeated for each of the reflectance targets. The average intensity over the whole target was used to obtain the data points shown in
Figure 3. So, even though thousands of points land on the target, only the average value of those points is used in the model parametrization and verification. This same approach was used for the Faro instrument. It is important to note that the sampling grid shown in
Figure 3 will be unique for each target and for each of the three experiments. In particular, Field Test 1 and the Allan Mine experiments were sampled at similar distance steps. However, Field Test 2 was sampled at distances
m. The reason for differing spacing is to test the applicability of the radiometric correction in scenarios actually encountered.
5.2. Faro Focus X 330
The Faro Focus
X 330 is an Amplitude Modulated Continuous Wave (AMCW) phase–based scanner which operates at the same wavelength, 1550 nm, as the Riegl scanner. It is a fairly lightweight device with an integrated battery and utilizes active cooling through a recessed fan. Three data sets were collected for the Faro Focus
X 330. Two data sets were collected in a grass playing field (Field Test 1 and Field Test 2) and one was collected in an industrial plant environment (Pilot Plant). The sampling grid for all three was quite similar and is shown in
Figure 4. The ambient air temperature for the field data sets were approximately 5
C and the pilot plant data set was approximately 22
C.
Note, in
Figure 4, that the angular sampling is never above 60 degrees. This was limited because, in the application of interest, the angle of incidence is kept well below this value. Similar to the Riegl tests, not all experiments were sampled at the same distances so that a true predictive error estimate could be obtained. For instance, Field Test 1 was sampled at distances of
.
5.3. Parameter Determination
As was discussed in
Section 3, determining the model parameters is a two step process. The first step is to use Equation (
4) at each of the distances sampled to estimate the parameters
and
at those distances. The results can be written in matrix form as in Equation (
5). The second step fits a model, in this case a cubic spline, to each of the first and second columns of Equation (
5). It is expected that this cubic spline model will perform well at, and between, the data points but not outside of the extents.
7. Discussion
Table 4 shows a summary of the results that can be used to compare the performance of the instruments and the reflectance estimation procedure. Displayed in the table are Root Mean Square (RMS) averages of the error metrics of the verification data sets, since these values are more representative of what one would expect to see in the acquired data. It is very clear from
Table 4 that temperature compensation greatly improves the results for the Faro Focus
X 330 instrument. The RMS of the mean error (displayed in the table as RMS Mean) improves by a factor of 2.6 while the RMS of the standard deviation of the error improves by a factor of 1.4. Importantly, without verification data sets to test the efficacy of the modeling procedure, it would not be possible to tell that this temperature correction was needed.
Although the temperature compensation of the Faro data reduces the error metrics, they are still larger than that for the Riegl instrument, which clearly does not require temperature compensation. It is unclear exactly why the Faro Focus
X 330 requires compensation for temperature. However, it is clear, both from the experiments performed and the datasheets of the Spectralon reflectance targets [
24], that the object’s reflectance is not changing. If this were the case, we would also see a discrepancy in the Riegl data. Additionally, in the temperature experiment, the intensity varied according to the scanner’s internal temperature and not directly with the ambient temperature. This points to internal instrument components being dependent upon temperature, such as the receiver amplifier stage. Without detailed proprietary information from the manufacturer, it is difficult to definitively show which components exhibit the temperature dependence. It may also be that the components used in the Riegl scanner do not have such a strong temperature dependence. It is also important to note that the scanners are fundamentally different in how they calculate range. The Riegl is a pulse-based scanner, whereas the Faro is a phase-based AMCW instrument.
A comparison to previous work is not trivial, but some of the most recent and applicable work is by Tan and Cheng [
17] and Tan et al. [
9]. In Refs. [
9,
17], the model for a Faro Focus
X 330 was calibrated with diffuse reflectance targets and errors were presented. In fact, they provide a value of 0.0258 as the mean absolute error. If the same calculation is performed for the fit of the Pilot Plant data set (for both model and verification), a value of 0.0249 is obtained. However, this paper has limited the angle to be less than 60 degrees, whereas, in [
17], it goes up to 80 degrees. However, the data set in this paper includes variation of the angle at each distance step, whereas, in [
17], only a single angle series was considered. Furthermore, no verification of the reflectance targets was presented in [
17], so it is not possible to tell whether their model ‘over fit’ the data. If a verification had been completed, without temperature compensation, poorer results would have been obtained, as was shown here.
From the work presented here, it should be clear that adequate verification data sets, in the varying environmental conditions in which they will be used, are necessary in determining expected prediction error as well as whether temperature compensation is necessary for a given TLS.
8. Conclusions
A method for modelling the reflectance of a diffuse surface using returned intensity, angle of incidence and range obtained from TLSs was verified. The reflectance modelling method was applied to two different TLS instruments: a Faro Focus X 330 and Riegl VZ-400. Overall, the VZ-400 produced better results with the RMS standard deviation of error being 0.053 and RMS of the mean error of 0.032. In the case of the Faro Focus X 330, it was found that the temperature of the instrument played an important role in the accuracy of the results. For this reason, a temperature compensation method was proposed that improved the RMS standard deviation of the error by 1.4 times and the RMS of the mean error by 2.4 times compared to the uncompensated results. This is the first time, to the best of the authors’ knowledge, that temperature compensation applied to intensity correction has appeared in the literature.
The results presented here also provide a verification of the model and the modelling process showing the model to be robust to environmental changes. However, as was shown for the Faro Focus X 330, some scanners may need additional corrections applied. The only way to determine the necessity of such corrections is to verify the models in disparate environments and conditions, as was performed in this paper.