1. Introduction
At a time of great technological growth, accelerating computers, and automation, the replacement of human labour with newer instruments and processes is becoming more and more common in surveying. The level of current technologies allows the collection of big data in a very short time and moving most of the surveying work to the office. It is possible mainly due to digital photogrammetry [
1,
2] and laser scanning [
3,
4]. Combining these methods is commonly used in modern systems called mobile mapping systems [
5,
6,
7,
8]. Whether they are handheld systems [
9] or systems placed on various carriers (cars, aeroplanes) the main part of these systems is INS (inertial navigation system), which is used to determine the relative position of the device, and very often they are equipped with GNSS (Global Navigation Satellite System) equipment for absolute positioning. The main output of mobile mapping is a point cloud.
The first mobile scanners appeared in the 1980s. These systems were developed for rapid GIS (Geographic Information System) data collection; they recorded spatial data using analogue cameras and determined the position of the vehicle by georeferencing the ground points and using gyroscopes, accelerometers, and odometers [
10]. Development progressed, and so, as early as 1988, the Canadian MHIS (mobile highway inventory system) came along, using differential GPS (Global Positioning System) measurements combined with an inertial system to determine the position of the vehicle. Thus, the accuracy of vehicle positioning was in the tens of centimetres [
11]. The next device, VISAT (Video cameras, an Inertial system, and Satellite GPS receivers), was designed to achieve a positioning accuracy of 0.3 m and a relative accuracy of 0.1 m at a speed of 60 km/h. This system already used several colour CCD (charge-coupled device) cameras to record image data [
10]. The major milestone that brought mobile mapping to humanity’s awareness was the creation of Street View primarily by Google in Google Maps. This type of spatial data viewing still enjoys great popularity. Since the new millennium, LiDAR (Light Detection and Ranging) technology has been added not only to terrestrial mobile mapping systems, but also to airborne scanners, and the systems are becoming more and more advanced [
12].
This article focuses on the determination of the characteristics of the mobile laser scanner RIEGL VMX-2HA’s [
13] measurements in the urban build-up area. The environment in these districts is very variable. However, these are often parts of the city where there is dense residential development, tall buildings, and street trees. Other survey methods such as GNSS RTK or total station surveying are difficult and time-consuming. The first problem is the actuality of the data. Typically, these methods require a lot of field measurement time, and a large area such as a city would require months of measurements. Another problem is the complexity of the environment. For example, GNSS RTK measurements are problematic because the environment obscures the view of the sky, interferes with the GNSS signal, or cannot be used to measure points on private land without the owner’s consent.
The motivation for this project is the possibility of replacing the surveying of objects by the traditional geodesy methods with the more effective method of mobile mapping. The best-known mobile mapping systems include devices from GEOSLAM, Leica, Trimble, Faro, or GreenValley [
9,
14,
15,
16,
17]. These are generally handheld devices, but most of the newer models can be mounted on various carriers. Mobile mapping devices cost from tens of thousands to hundreds of thousands of euros. Currently, short training of a non-professionally educated person is usually required to operate these systems, or it can be placed on autonomic carriers [
18]. This leads to cost savings and the extension of this method to new branches [
19,
20]. Furthermore, the amount and type of data collected allow for more complex data analysis and visualisation, for example, in a virtual BIM environment [
21,
22,
23].
As mentioned above, mobile mapping systems are used in many areas, not only in surveying. Handheld mobile scanners are suitable for measuring the dimensions of buildings, especially in old or complex buildings where manual measurement takes a significant amount of time. Mobile scanners are very useful in tight and poorly lit spaces, sewers, and mines, where data on the entire object can be obtained quickly. The data obtained in this way may not only be used for drawing 2D plans but they are suitable for 3D object modelling. Mobile mapping systems, where a carrier is a car, are used for mapping horizontal and vertical road signs, as sources for making Digital Technical Maps whose accuracy corresponds in Czechia to class 3 (the mean coordinate error is 14 cm), or they are used for linear structures surveying. A big issue in mobile mapping is accuracy. In particular, the dependence of accuracy on the frequency and distribution of control points [
24,
25].
As this is a relativity new technology that is constantly rapidly developing, it is necessary to test this method and the behaviour of the devices in real conditions. With each instrument and new software, the accuracy and reliability parameters of the output change. A large amount of the literature has been written on mobile scanning, but only a small part of it has dealt with mobile mapping systems of the type Riegl VMX-2HA. The work [
26] compares mobile scanners in a point field that is 1.7 km long with a ground control point density of 1 point per 200 m. The determined accuracy is calculated from the differences between the measured MMS point cloud and the point cloud measured by the terrestrial static scanner and is around 2 cm. The papers [
24,
27] deal mainly with comparisons between an MMS cloud and another cloud obtained by scanning with another device, dealing with point densities and relative accuracies. The calculated standard deviations are in the range of millimetres.
The article [
28] already deals with the accuracy against points measured by GNSS RTK (the spatial accuracy of a point is 7.4 cm), and a test area included up to 200 control points. The resulting mean standard deviations in this project ranged from 1.2 cm to 5.9 cm, with a maximum of 26 cm. It is important to mention that both checkpoints and MMS measurements are dependent on the GNSS method and the accuracy is of the same precision. Thus, the GNSS error is also reflected in the MMS accuracy result. Absolute accuracy is the focus of the paper [
25]. In this paper, only a small area is surveyed, but the point field is dense and well-signalled, and the coordinates are accurately measured by an independent method. The standard deviation determined in this article is 1.7 cm. However, such conditions and precise points are impossible to achieve in practical use.
This project aims to simulate commercial measurements (point field accuracy and signalling) as much as possible, and it is necessary to determine the accuracy of the final point cloud depending on the measurement conditions, location, and computational parameters. Multiple parameters enter the final quality and accuracy. The most influential are the accuracy of GNSS/INS and the accuracy and spacing of the control points. The goal of the project should be to determine the overall accuracy of the mobile mapping system, the problem spots in the measured locations, and the appropriate spacing of the control points.
This article consists of several important parts. The first describes a detailed description of the testing, the devices used and their properties, the test field, the accuracy of the determination of the ground control points and checkpoints, and the expected accuracy of the MMS. Next, the chapter deals with how MMS data are processed and the approaches to their evaluation. The other section is devoted to the results, showing the calculated deviations and comparison of the measured clouds. This is then followed by a
Section 4, where the determined point clouds’ properties and the ground control point strategy are verbally evaluated.
2. Materials and Methods
This chapter is dedicated to information about the testing device, test field, and the work that led to the creation of the resulting clouds. The first part focuses on the characteristics and accuracies specified by the manufacturer of the RIEGL VMX-2HA mobile mapping device with which the entire measurement was carried out. Especially from this information, an estimate of the resulting expected accuracy was made. In the next part, we describe the test point field and point stabilisation, a method of determining the coordinates and resulting accuracies of the point field. The last chapter is devoted to the work with the measured data. Specifically, the conditions and parameters of the measurements, the processing of MLS data, and a description of the evaluation method.
2.1. Mobile Mapping System RIEGL VMX-2HA
The VMX-2HA [
13] (
Figure 1) mapping system from Riegl is based on two VUX-1HA [
29] laser heads with different rotation axes, capable of measuring up to 475 m, and an INS/GNSS unit [
30] supplemented by an odometer (DMI). The system can be equipped with up to nine position cameras, which can be set in the required directions (depending on the object of interest), and a Ladybug 5 + panoramic camera [
31], suitable for point cloud colouring. The entire system is on a carrier attached to the car.
In the product datasheet [
13], the manufacturer lists several important parameters of the device.
Table 1 shows the cloud densities for a specified distance at various speeds, which may be suitable for many applications but not for this work. As mentioned in the “MLS Data Acquisition”
Section 2.5, the carrier speed was lower in this test. In the first instance, the speed was 20 km/h, which was chosen for its sufficient accuracy for testing and smoothness of data collection; the same speed is used in [
25], where the final accuracy is high. A simple calculation shows that the density of points at 10 m should be 10,250 points/m
2. In the second case, the speed was about 35 km/h, which is the average speed that could be reached in such a densely built-up environment. The calculated point density value is 5860 points/m
2.
Table 2 lists the accuracy of each sensor from the manufacturer’s product datasheet. Accuracies are given for ideal conditions: an uncovered view of the sky, a maximum measured distance with a laser head to a distance up to 30 m, and the system must use a DMI (odometer).
2.2. Test Field Specification
The object of interest is to test the system in an urban area where the GNSS signal is jammed by surrounding trees and buildings. For this purpose, an extensive test field has been created to satisfy this condition [
25,
28]. The network is made up of control points, which are used to precisely align the point cloud, and of checkpoints.
Other important factors in selecting the location of the test field were a low-traffic site and a close location to the GEOREAL surveying company, which owns the device being tested.
Two sets of coordinates were created for all points in the test field. The first set is the coordinates determined by the dual GNSS RTK measurements and the arithmetic average (GNSS points). This method of determining points is used in real data collection. The second set of coordinates was calculated by adjustment of the tied grid from the total station measurements (TS points). The more accurate (TS) coordinates were created to be an order of magnitude more accurate than the expected accuracy of the method; see the chapter “Expected Accuracy”.
2.2.1. Test Field Parameters (Figure 2)
Location: Plzeň—Jižní Předměstí, Na Hvězdě;
Length of section: 1.5 km;
Number of control points: 27;
Number of checkpoints: approximately 90.
2.2.2. Control Points
A point field with a point spacing of approximately 50 m was created at the locality. The control points were stabilised with a metal nail and signalled with a 15 × 15 cm chequerboard target (
Figure 3), or they were marked as corners of horizontal road markers.
2.2.3. Checkpoints
Permanently stabilised spatial points were selected as checkpoints. These are mainly the corners of the kerbs (
Figure 3), sewer shafts, and traffic signs. These types of points are often the object of interest in geodetic mapping. A checkpoint coordinate set measured by a total station was used to evaluate the accuracy of the clouds. The coordinate set determined by the GNSS method is used to compare the accuracy of the GNSS RTK method with the mobile mapping method.
2.2.4. Coordinates Determined by GNSS
The points were measured independently twice with a Leica GS18. The average standard deviations of the GNSS point determinations were calculated from the dual measurements. Standard deviations from the dual measurements of the GNSS coordinates of the points are presented in
Table 3.
2.2.5. Coordinates Determined by Adjustment
The control points were measured using the polygon method with a Leica TS1200 (Leica Geosystems, Heerbrugg, Switzerland) and the measurements were adjusted in the EasyNET software (Version 3.5) using the tied network method. Points 1, 5, and 25 were chosen as fixed points because they are in a position with a good view of the sky. This is crucial because it ensures clear reception of satellite signals used to determine point positions and increases the number of satellites used to calculate the position. As a result, their deviations from the GNSS measurements were minimal and the resulting coordinates are more reliable. At these points, the number of satellites was between 30 and 34. The output values of the adjustment are shown in
Table 4. Since the network has been measured repeatedly and many redundant measurements are available, the number of excluded measurements can be considered insignificant.
The checkpoints were surveyed twice using the polar method from the points of the adjusted grid. The maximum difference between the two coordinates is 5 mm.
2.3. Point Identification Precision from the Point Cloud
The chapter describes how accurately points can be identified from point clouds. The points were again divided into control points and checkpoints. The control points are signalised, and there should be no significant problem in identifying them. However, identification is, in many cases, more difficult for checkpoints. The corners of the features are sometimes determined from the potential intersection of the object’s edges, or they are rounded due to time. For both types, five points were selected, and these were identified ten times with time intervals in the RiPROCESS software (Version 1.9.3., Riegl, Horn, Austria).
Table 5 shows the average standard deviations of the identification of the points.
2.4. Expected Accuracy
This chapter is dedicated to accuracy, which, according to the available material, can be expected. The manufacturer provides (
Table 2), for ideal conditions, a laser head accuracy of 5 mm and GNSS of 20 mm in the horizontal direction and 30 mm in the vertical direction. However, these are not the only variables that affect the resulting accuracy. Others such as the INS and DMI system, the spacing of the insertion points, the type of alignment, the speed, and, above all, the fact that the measurement is not carried out under ideal conditions enter the calculation.
Compared to the paper [
25], which reports a 3D standard deviation of 1.7 cm, a worse accuracy can be expected. The authors used a significantly denser point field of control points with high accuracy, and the checkpoints were very well signalised and marked with a chequerboard target. It follows from this article that the accuracy of MLS under very good conditions using precisely defined points may be better than that claimed by the manufacturer.
The option of a small spacing of the control points is not economical in real mapping in built-up areas, and the checkpoints in this project are chosen as objects of interest for mapping. Spatial points may be less easy to identify.
Also, the testing conditions in this article are not ideal according to the manufacturer’s datasheet, the view of the sky is often obscured, and we can expect worse GNSS accuracy. As the work evaluates several types of control point configurations, the resulting expected 3D standard deviation of the mobile scan can be assumed to be between 2 and 5 cm. In the cases where TS control points are used, an accuracy of around 2 cm can be expected. Using GNSS control points and for point clouds with larger control point spacing, worse accuracies can be expected.
2.5. MLS Data Acquisition
As already mentioned in the chapter “Introduction”, the Riegl VMX-2HA was used for the measurements, which was mounted on a car adapted for this purpose. The collection of data in this field was performed twice, forward (Record_1) and backward (Record_2).
Table 6 lists the main measurement parameters, including weather conditions and data collection speeds.
2.6. MLS Processing
The collected data are processed in software recommended by Riegl, also used in [
24,
25]. First, the initial trajectory is calculated, followed by the calculation of the initial cloud and its alignment. Since a panoramic camera was not used in this project, the processing ends here, and the cloud is exported or point coordinates are taken from it.
2.6.1. Initial Trajectory Calculation from GNSS/INS Data
The trajectory calculation from the measured data was performed in the Applanix POSPac software [
32]. The input to this software is GNSS/INS data including DMI, precise satellite ephemerides, and observation data from a permanent GNSS station network.
2.6.2. Point Cloud Computing
The calculations were performed in RiPROCESS, a software developed by Riegl to process kinematic LiDAR data. It is used for data management, processing, analysis, and visualisation.
2.6.3. Basic Processing Setup
The processing programme enters the calculated trajectory from the POSPac software (
https://www.applanix.com/products/pospac-mms.htm, Applanix, Richmond Hill, ON, Canada) and the data set from the Riegl VMX-2HA measurements, the most important part of which are the scanned data and possibly panoramic photographs. It is important to note that the trajectories are associated with the scanner data and photographs based on time stamps.
The first main parameters to be set are:
Coordinate system;
Range gate—cropping of points depending on the distance from the centre of measurement;
Deviation gate—filtering of points depending on the trustworthiness of the point;
Reflectance gate—filtering of points depending on the reflectivity of the point.
For this project, the individual values are shown in
Table 7. These values were chosen according to the manufacturer’s recommendation to satisfy the claimed laser measurement accuracy of 5 mm [
26]. This step is followed by processing the point cloud depending on the trajectory, i.e., without using control points.
2.6.4. Adjustment Based on Control Points
One of the important results is to determine how the density and quality of the control points affect accuracy. For this purpose, several clouds have been computed that differ in these parameters; see
Table 8.
After marking the control points in individual clouds, the adjustment is followed by the RiPRECISION tool, whose possible inputs are described in
Figure 4. The software allows three different alignments: non-rigid with translation (global shift with local alignment), non-rigid (local alignment), and rigid (global shift). In this project, a non-rigid with translation alignment was chosen. The tool takes all the input data, uses them to adjust and recalculate the initial trajectory, and as a final step, computes new point clouds based on the new trajectory. In the case of multiple data on a single path, it can merge the data into a single point cloud [
33].
2.7. MLS Accuracy Evaluation
The accuracy evaluation was performed using two separate approaches. The first approach evaluates the accuracy of the points taken from the computed point clouds to the check points targeted by the total station from the adjusted point network [
25,
28]. In the second part, the computed point clouds are compared against each other [
24,
26,
34].
2.7.1. Comparison with Checkpoints
Custom software was developed to compare point clouds and measured checkpoints with higher accuracy, calculate deviations, and visualise them. It allows working in the European Terrestrial Reference System 89 (ETRS89) and in the System of the Unified Trigonometrical Cadastral Network (S-JTSK) together with the heights given in the Bpv system (Baltic Vertical after Adjustment). Since the measurements were carried out on the territory of the Czech Republic, S-JTSK and Bpv were chosen as the main coordinate systems of the results.
The developed software allows the calculation of coordinate differences, coordinate standard deviations (Equation (2)), root mean square deviations (Equation (1)), visualisation of these values in bar charts, and visualisation of deviations depending on the distance of the control points.
where
,
are the coordinates of the check point,
are the coordinates of the point obtained from the point cloud.
where
,
are the coordinators differences between the check points and the points obtained from the cloud,
is their average.
2.7.2. Comparison of Computed Clouds
To further analyse the behaviour of the clouds depending on the number and location of the control points, the computed clouds were compared with each other in CloudCompare software (
https://www.danielgm.net/cc/).
As distinct from the previous case, the deviations are not related to the checkpoints but are calculated from the differences of all points from point clouds.
In the first phase, the point clouds were compared with the MLS_1 cloud, which was expected to be the most accurate. In the next phases, point clouds of different settings, which were expected to show interesting results, were compared. The outputs of this comparison are the average deviations of the compared clouds, a histogram of the cloud differences in the Z-axis direction, and a map showing the cloud differences and the control points in the map.
5. Conclusions
Mobile mapping, a method used in surveying, faces various factors that can influence its accuracy and efficiency.
The first presumed negative influence is the speed of data collection. In this work, two data collections were made with different speeds of 20 and 35 km/h. The analysis shows that higher speed, and therefore lower point cloud density, does not have a degrading effect on the accuracy of the resulting point cloud. Data collection at higher speed results in an average 2 mm better StDev XYZ.
The second expected factor that affected the accuracy of the result is the configuration and quality of the control/tie points. The influence of control point spacing on the overall cloud accuracy was confirmed from only one comparison, that between a cloud with TS points spaced 50 m apart and a cloud with TS points spaced 1000 m apart. The StDev XYZ for a cloud with a point spacing of 50 m is 24 mm and 29 mm for a point spacing of 1000 m. However, for clouds from the first data collection tied to GNSS points, StDev XYZ is around 30 mm, independent of the spacing of the control points. From the maps, locations where local cloud deformations occur were identified; these are sharp turns when leaving a location with a poorer view of the sky and larger distances from the control points. This deviation can be minimised in most cases by the appropriate location of the control point.
However, the influence of the quality of the points plays an important role. MLS_3 point clouds tied using a GNSS point with 50 m spacing show worse deviations than point clouds with larger spacing. This was due to the less accurate determination of the control points at locations with an obscured sky view and therefore a degradation of the quality of the GNSS RTK measurements. The results suggest that it is appropriate to select spots where the positioning of the control point will not be affected by negative influences, even at the cost of larger point spacings.
The overall quality of the result can also be influenced by the ability to identify the point. Points signalled by chequerboard targets or street lines can be identified with a repeatability of 4 mm and spatial features with a repeatability of 9 mm. This error is particularly visible in the last part of the tested section, where checkpoints were harder to identify.
This project has demonstrated that the highest measurement accuracy in urban areas can be achieved by using high-precision control points spaced at 50 m. Here, points with an average XYZ standard deviation of 2.2 mm were used. In this case, an average point cloud standard deviation of 22 mm was achieved. However, the making of such an accurate network is very time- and cost-consuming and in real terms inefficient and uneconomical.
Using GNSS grid points, the point cloud accuracy, independent of the spacing of the grid points, was around 30 mm.
In conclusion, even in the less ideal conditions in this project, the accuracy achieved in urban areas was better than or equal to the manufacturer’s stated GNSS/INS positioning accuracy for ideal conditions. From the comparison of the calculated GNSS RTK checkpoint deviations and the MLS checkpoint deviations, it can be said that the mobile laser scanning method in urban areas is more accurate than the GNSS RTK method. For the above reasons, the mobile mapping method using the RIEGL VMX-2HA system can replace GNSS measurements in urban areas to a large extent. This will speed up the measurements, save costs since a trained surveyor will not be needed to collect the data, ensure the measured data will be more detailed and wider, and ensure more information can be obtained not only about the objects of interest but also their surroundings.
Despite the insights gained from this study, certain limitations must be acknowledged. This study focused on the accuracy of one type of mobile mapping device used for mapping urban build-up areas. Data collection was carried out under specific weather conditions, which can affect the results.
Further research in different environments, under different weather conditions, could provide more comprehensive insights for data collection by mobile mapping systems. The method of mobile scanning by vehicle could become one of the main methods of modern mapping in the near future. In combination with aerial scanning, drone scanning, and handheld mobile scanning, detailed measurements of even large areas could be made in a relatively short time. It would also find great use in more demanding methods such as road condition inspection or surveying and checking road layers and slopes during construction. This is not yet possible with the VMX-2HA in the configurations shown; further research could be focused on technological solutions to this issue.