Next Article in Journal
Cu(I) Coordination Complex Precursor for Randomized CuOx Microarray Loaded on Carbon Nanofiber with Excellent Electrocatalytic Performance for Electrochemical Glucose Detection
Next Article in Special Issue
A Framework for Multiple Ground Target Finding and Inspection Using a Multirotor UAS
Previous Article in Journal
Towards the Exploitation of Physical Compliance in Segmented and Electrically Actuated Robotic Legs: A Review Focused on Elastic Mechanisms
Previous Article in Special Issue
Multi-Variant Accuracy Evaluation of UAV Imaging Surveys: A Case Study on Investment Area
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessment of DSMs Using Backpack-Mounted Systems and Drone Techniques to Characterise Ancient Underground Cellars in the Duero Basin (Spain)

by
Serafín López-Cuervo Medina
1,*,
Enrique Pérez-Martín
2,
Tomás R. Herrero Tejedor
2,
Juan F. Prieto
1,
Jesús Velasco
1,
Miguel Ángel Conejo Martín
2,
Alejandra Ezquerra-Canalejo
3 and
Julián Aguirre de Mata
1
1
Departamento de Ingeniería Topográfica y Cartográfica, Escuela Técnica Superior de Ingenieros en Topografía, Geodesia y Cartografía, Universidad Politécnica de Madrid, Campus Sur, A-3, Km 7, 28031 Madrid, Spain
2
Departamento de Ingeniería Agroforestal, Escuela Técnica Superior de Ingeniería Agronómica, Alimentaria y de Biosistemas, Universidad Politécnica de Madrid, Av. Puerta de Hierro, 2, 28040 Madrid, Spain
3
Departamento de Ingeniería y Gestión Forestal y Ambiental, Escuela Técnica Superior de Ingeniería de Montes y del Medio Natural, Universidad Politécnica de Madrid, Ciudad Universitaria, 28040 Madrid, Spain
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(24), 5352; https://doi.org/10.3390/s19245352
Submission received: 30 October 2019 / Revised: 29 November 2019 / Accepted: 2 December 2019 / Published: 4 December 2019

Abstract

:
In this study, a backpack-mounted 3D mobile scanning system and a fixed-wing drone (UAV) have been used to register terrain data on the same space. The study area is part of the ancient underground cellars in the Duero Basin. The aim of this work is to characterise the state of the roofs of these wine cellars by obtaining digital surface models (DSM) using the previously mentioned systems to detect any possible cases of collapse, using four geomatic products obtained with these systems. The results obtained from the process offer sufficient quality to generate valid DSMs in the study area or in a similar area. One limitation of the DSMs generated by backpack MMS is that the outcome depends on the distance of the points to the axis of the track and on the irregularities in the terrain. Specific parameters have been studied, such as the measuring distance from the scanning point in the laser scanner, the angle of incidence with regard to the ground, the surface vegetation, and any irregularities in the terrain. The registration speed and the high definition of the terrain offered by these systems produce a model that can be used to select the correct conservation priorities for this unique space.

1. Introduction

Instruments and techniques for the massive capture of data are increasingly being used to document all types of cultural landscapes and heritages. There are recommendations and criteria for adequate procedures to ensure the defence and preservation of these types of heritages and landscapes in the European context [1]. Many research projects on heritage management use geospatial technologies [2,3,4,5] to generate various products such as digital surface models (DSM) [6,7,8,9,10,11,12,13]. A large number of studies focus on optimising and improving actions with unmanned aircraft vehicles (UAV) [14].
Against this background, our study zone, the underground cellars of El Plantío in Atauta (Soria), declared an Asset of Cultural Interest (Bien de Interés Cultural, BIC) in March 2017, which represents a unique testimony of the life associated with work on the land and the traditional wine production system. It is important to ensure that they are not ultimately forgotten and destroyed, as they are a manifestation of the cultural identity of a large region in the Duero River basin (Figure 1).
In recent years, fixed terrestrial laser scanning (TLS) systems have been used to map and monitor various areas of interest from the point of view of their cultural heritage [15,16,17,18], in archaeological studies [19,20], underground studies [21,22], and civil engineering [23], among others [24]. 3D technologies include both the TLS system and sensors installed on UAV for the documentation, visualisation, and preservation of heritage [25,26,27]. The precision of a digital surface model (DSM) obtained by UAV photogrammetry for documenting surface structures [28] and forms in 3D models [29,30,31] and for identifying constructions in urban planning [32,33] has also been analysed. Chiabrando et al. [19] described a technique for preparing digital surface models in their archaeological studies. Norhafizi validated the use of UAV for creating DSMs of tide data [34]. Villanueva [35] studied DSMs and their application in zones at risk of flooding.
Komarek et al. [36] carried out studies to assess the precision of DSMs obtained by UAV on rural plots. In other cases, DSMs have been assessed with or without ground control points (GCP) taken by means of a real-time kinematic Global Positioning System (RTK-GPS) techniques [37,38,39]. Other studies have evaluated the use of software for generating DSM models from UAV with GCP taken in the field by means of other geomatic methods such as TLS, GPS [40], or UAV photogrammetry techniques [41].
There are examples of studies on the precision of 3D models in indoor spaces and areas through backpack mobile mapping [42,43,44] and assessments of different TLS [45,46,47]. Other works assess the performance of a mobile mapping system (MMS) and backpack mobile mapping [48,49] compared to the use of a TLS [47], and highlight the superior performance of the mobile system, even though its overall precision is lower than with TLS. Campos [50] applied the backpack mobile mapping system in forest mapping where there is limited accessibility. Przemyslaw [51] also used backpack mobile mapping for the geolocation of tree trunks and their comparison with UAV records.
The DSMs obtained are used to compare and complement the information registered with ground penetrating geo-radar technology (GPR) and terrestrial laser scanning (TLS) [52]. In previous studies in the same area [53], DSMs enabled the definition and comparison of wall and ceiling thicknesses in underground cellars to ensure their stability.
The aim of this work is to assess the condition of the roofs of underground cellars in their natural state by obtaining an accurate DSM to characterise, detect, and prevent their collapse. This is accomplished using a backpack-mounted 3D mobile scanning system (backpack MMS) and a fixed-wing drone (UAV).
The study examines the use of backpack MMS in areas of irregular terrain such as the Atauta underground cellar, using data registration parameters and DSM generation including working widths and angles of incidence in the measurement and obstacles. The study also compared it with UAV equipment that enables analysis of the benefits of both systems for generating DSMs of key importance in assessing the current risk status of underground wine cellars.

2. Materials and Methods

2.1. Case Study Description

The study area is part of the series of underground wine cellars of El Plantío in Atauta, Soria (41°31′ N, 3°12′ W), shown in Figure 1, which were declared an Asset of Cultural Interest (BIC) as an “ethnographic collection” on 16 March 2017. Located at the foot of the village of Atauta on an area of 1.9 ha, they are a testimony of the life associated with work on the land and the artisanal wine production system. These underground constructions were used to store and preserve wine.

2.2. Equipment Used to Take the Images

The topographic and photogrammetric survey using UAV techniques was carried out with a Mavinci fixed-wing drone with a Lumix-GX1 camera with a focal distance of 14 mm and a resolution of 4592 × 3448 pixels. The flight was made at a height of 90 m, obtaining a ground sample distance (GSD) of 2.16 cm and taking 344 images by following a flight plan with a regular grid pattern defined in a northwest-southeast direction. The longitudinal overlap was 70%, and the transversal overlap was 50%. Precise coordinates were obtained throughout the flight due to an RTK-GPS receiver located on the UAV, which received corrections from a base on the ground. Also using RTK-GPS techniques, high-precision control points were observed in order to improve the geo-referencing of the photogrammetric model with points on the ground and for a quality check assessment. The deformation in the images caused by the camera [54] is compensated with an autocalibration performed during the aerotriangulation process (Figure 2).

2.3. System Used for Mass Registration with a Laser

A Leica Pegasus data registration system was used as a backpack mobile mapping model (Figure 3). This system incorporates five cameras and two LiDAR (light detection and ranging) scanners for the registration of the 3D point cloud and images. It also has two Velodyne sensors (VLP16) that rotate at 10 Hz and acquire 600,000 points per second at a distance of up to 100 m, even though this may be influenced by several factors, as indicated in its specifications [48,55]. It weighs approximately 13 kg and has a scanning autonomy of three hours. The system includes a SLAM (simultaneous localisation and mapping) algorithm and an IMU (inertial measurement unit) as an aid for generating the 3D model.
Leica Pegasus Backpack allows the acquisition of LiDAR and image data with precise positioning of outdoor and indoor data [18] in a system that is easily transportable by one person. This makes this type of equipment very useful in environments with limited space, underground environments, [20] and in areas with dense vegetation, as well as for managing data on disasters [56] and documenting industrial facilities. It offers the option of including external sensors such as GPR equipment, thermal cameras, noise and pollution sensor, etc., assisted by a flash module for working in conditions of low light. The work software has tools for extracting LiDAR and photogrammetric data and detecting changes, and is compatible with workflows by means of AutoCAD and ArcGIS. The only limitation to its use is its autonomy of four hours due to its batteries.
It took 30 min to configure and calibrate the backpack MMS data registration system, and one hour to survey the study area. The main features of the UAV and the Pegasus backpack are shown in Table 1.

2.4. Control and Assessment System Obtained by GPS

High-precision coordinates were computed on a fixed base using GPS techniques in post-processing to obtain both Ground Evaluation Points (GEP) and Ground Control Points (GCP). The points are distributed to cover the entire area of characterisation and possible collapses on the surface of the underground cellars, which are the same as the UAV flight and the tracks taken by the backpack, as shown in Figure 4.
This GPS base served as a reference for all the topographic and photogrammetric surveys (see Figure 5, Section 1, centre). The equipment used was a Leica Geosystems GX1230 GG, and the data were processed with the Leica Geo Office software, with a relative average precision of more than 0.02 m in all the points. The base GPS receiver was situated in the centre of the study area and all the GCPs and GEPs observed were located at a radius of less than 200 m and measured with another two GPS rover receivers. From this base, 12 GCPs were computed in post-processing to support the UAV. The GCPs were positioned on the periphery and inside the study zone. This same base served as a support for the backpack MMS, and all its tracks were within a range of less than 250 m from the base.
Furthermore, 59 GEP coordinates were also computed by RTK-GPS techniques from the same base, and, subsequently, used in the assessment of the DSMs generated.

2.5. Methods

As stated, the aim of this research is to obtain digital surface models (DSM) on the terrain corresponding to the natural cover of the underground cellars. A methodology was defined in several phases for this purpose, as shown in the diagram in Figure 5. In the first phase, the 45 GEP points were analysed after obtaining the data with methods based on backpack MMS and UAV technologies. These points were identified using Agisoft Photoscan® Professional software and included in the aerotriangulation process, and then identified and extracted from the DSM generated from the dense point cloud in the UAV photogrammetric project. Each GEP point was located in the data from the photographs registered by backpack MMS and measured by stereoscopy with ArcExplorer (Esri, USA) software. The GEP were also identified in the LiDAR point cloud from the backpack MMS. These four measures were compared with the GEP coordinates obtained by the RTK-GPS method.
The results of the comparisons led to the selection of the point cloud-based methods and the rejection of the photogrammetric methods, since they were insufficiently dense to generate DSMs that could be guaranteed to detect possible collapses. However, the photogrammetric backpack MMS was the most accurate method (see results section).
The data obtained with the backpack MMS define the tracks from which to obtain the point cloud covering the terrain. These tracks were used as a common element to establish the zones that cover the total study area and allow the evaluation of the DSM.
In a second phase, the results from the two massive data recording techniques are statistically analysed to compare the numerical and graphic products obtained and to define the DSM more clearly.
As has been mentioned, a supported network of control points was defined with RTK-GPS to serve as the basis for the UAV flight and the MMS backpack. This network established the real precision of both models and allowed the study of parameters such as the distance to the track in the case of backpack MMS, the point density according to the method used, and the veracity of the model with regard to walls, roofs, steeply sloping areas, and other elements. These points acted as a geometric control of the parameters to be assessed. The methodology applied in each system is shown in the diagram in Figure 5 and described below in more detail.

2.6. Processing the UAV Point Cloud

The previously mentioned software was used to generate the point cloud with the images recorded with UAV, and also included their corresponding metadata and the RTK-GPS coordinates of the photocentres of the images referenced on the ground. This type of software uses sfM-MVS algorithms for the orientation and calculation of point clouds and is widely used in UAV work processes due to the large number of images, type of cameras, and auxiliary data taken into account [57,58,59,60].
The sfM-MVS processing workflow used was as follows: initially a feature detection is performed by identifying a large number of key points in each image. With these points, an image matching process is carried out to identify and match these features in all the images in which they are registered. Subsequently, a blunder adjustment is performed with the camera’s self-calibration, photocenter coordinates, and other parameters. Thus, the photogrammetric solution of the external orientation parameters of the images is obtained together with the 3D sparse model composed of the feature points detected in these images, as described in Reference [61].
This study has specifically included the use of GCPs as field control, GEPs as manual photogrammetric tie points, and feature points as automatic tie points or sparse points (see Figure 5, right) in the same photogrammetric adjustment process. Lastly, the digital terrain model (DTM) was created to produce the orthophotograph on which to identify the assessment points and verify the quality of the LiDAR DSM.

2.7. Processing the Backpack MMS Point Cloud

The point clouds from the LiDAR data registered with the backpack MMS platform were computed using the Leica Pegasus Manager software, which also allows the management of the data captured by means of MMS. It is composed of several modules in a workflow that ranges from the prior planning of the work to be done, the acquisition of the data, the subsequent processing and refinement with other sensors and algorithms, and the automatic and manual extraction of the characteristics of interest within the point clouds.
A total of six tracks were obtained (labelled A to F, Figure 4). The points were measured by photogrammetry with the Leica ArcExplorer application. The software includes a tool that allows the stereoscopic measurement of any point in the images from the perspective centres recorded and their rotations, and, thereby, obtains the coordinates of the GEPs. The last step was to identify the GEPs on the orthophotograph obtained by UAV and to measure them in the LiDAR MMS point cloud (see Figure 5, left).

2.8. Comparison of the UAV-Backpack MMS Point Clouds

After comparing the coordinates for each GEP with the DSMs obtained from the UAV and backpack MMS data, the information from each registration system was analysed. This comparison uses the tracks defined with backpack MMS to identify the different sections for analysis, while taking into account the following factors.
  • The surface of the terrain in its natural state is covered with herbaceous and shrubby vegetation, which may pose an obstacle for measurement in both methods. Two types of zone were identified to assess the DSMs: one with exterior corridors with less influence of vegetation, and another on the interior with tracks with a greater presence of grassland vegetation. Some tracks were made to pass over the roofs of the cellars in order to obtain more detailed information in critical areas.
  • Taking the axis of the tracks as a reference for the LiDAR scanning distances, the point cloud obtained on both sides of these tracks was computed and analysed to a limit of between 2.5 and 7.5 m from their axis.
The backpack MMS tracks A-F were used as identifiers for the assessment, and grouped according to the similarity of their features. Tracks A and B are perimetral, defined in areas of broad corridors with little influence of vegetation at a distance of 2.5 m each side of the axis. Tracks C, D, E, and F are located on the interior and, therefore, have a presence of vegetation and irregularities in the terrain, low walls, etc. These six tracks were divided into sections based on the similarity of the type of terrain in order to enable a better comparison between UAV and MMS data. Hence, Track A was divided into five sections, Track B was divided into four sections, Tracks C and E were divided into two sections, and, lastly, Tracks D and F each have only one section. Obstacles caused by constructions were eliminated during the digital processing of the point cloud to avoid errors due to vertical and/or horizontal measuring in the two systems.
For the assessment, a DSM was generated with a resolution of 0.05 m from the point clouds obtained with backpack MMS, and a grid with a point-to-point resolution of 0.10 m was projected on the DSM. The same procedure was followed for the UAV point cloud. Therefore, the resolution and geolocation of the DSMs coincide and allow their subsequent comparison.
Lastly, for the assessment of the DSM comparison at 7.5 m from the axis of the track taken by backpack MMS, the sections with no errors due to obstacles were maintained, and sections A4, A5, B1, B2, and C2 were removed.

3. Results

Before comparing the results of the different methods, it should be noted that a mean square error of 1.9 cm in height was obtained in the calculation of the GEP points.
Ten of the 59 initial GEPs were eliminated since they could not be measured in all four methods including some that were impossible to identify and others had insufficient resolution for providing real coordinates with regard to other methods, such as the eaves of a warehouse in the testing area. Four more points were also eliminated due to problems in identifying them, such as the corner of a bench which—although it could be adequately measured in photogrammetry—was difficult to discern from the LiDAR point clouds.
The following results were obtained from the various methods, according to the distance criteria 0 to 2 m, 2 to 3.5 m, and 3.5 to 10 m.

3.1. Point Cloud Processed with UAV

  • The assessment of coordinates was obtained by triangulation with the UAV images. The GEP points included as linkage points in the aerotriangulation process gave the following results. The mean square error for the three distances is 4.7 cm in distance and 8.9 cm in height. The points were measured on an average of 16 photographs and their internal precision was 1.2 pixels. The standard deviation was up to 6.2 cm in height. This is a “low density” point cloud (2 points/square metre) (Table 2 and Figure 6). Five minutes were required to measure each point in photogrammetry, since the points must be measured in all the photographs. Sixty points were recorded.
  • This section discusses the assessment of points in the UAV dense point cloud. The GEPs identified and measured in the dense point cloud gave the following results. The mean square error for the three distances was 5.0 cm in distance and 10.7 cm in height. The standard deviation of the points measured in the dense point cloud was 7.5 cm (Table 2). The points in the dense clouds were measured. Ten hours were required to make the dense model of 2,400,000 points extracted from this work.

3.2. Point Cloud Processed with Backpack MMS

  • Assessment of LiDAR points recorded by backpack MMS. The mean square error for the three distances was 5.2 cm in distance and 7.0 cm in height. The standard deviation in height was up to 9.2 cm (Table 2 and Figure 6). The point measurement with MMS is an automatic and dynamic process, and the points are obtained while covering the work zone. Two hours were required to record the 115 million points included in the trajectories in the project.
  • The assessment of coordinates was obtained by photogrammetry with ArcExplorer software. The mean square error for the three distances was 10.3 cm in distance and 3.6 cm in height. The standard deviation in height was up to 3.2 cm (Table 2). This is the least productive measuring process, with one point measured every 10 min. The points are identified manually, and the parallax must be manually cancelled in each point.
Table 2 shows the precision and densities obtained with each method. They are then compared with the RTK-GPS points network measured in the area, and the data are grouped by distance to the track with the laser scanner located in the backpack: 0 to 2 m (measurement angle of the laser scanner on the terrain from 90° to 5°), 2 to 3.5 m (measurement angle of 45° to 22°) and over 3.5 m (angle of less than 22°). The greatest precisions, particularly in terms of height, are obtained in the photogrammetric measurement on the backpack images, even though this is the least efficient method in terms of density and production. When the point is clearly defined, no significant loss of precision was observed with regard to distance.

3.3. Comparison of Backpack MMS vs. UAV DSMs

The result of the precision analysis for the DSM at a distance of 2.5 m from the axis of the track is shown in Table 3 and Figure 7. The two DSMs are evaluated with a square grid with a resolution of 0.1 m based on the point clouds obtained with UAV and backpack MMS. The height precision for the tracks on the exterior is 3.8 cm, whereas the precision in interior areas is 5.7 cm in height. Tracks A4, A5, B1, B4, D1, and E2 have a vertical displacement between 0.10 and 0.15 m. All these areas have an influence due to construction walls or other obstacles.
If the distance from the backpack MMS track increases from 2.5 m to 7.5 m on each side of the axis from which the point clouds defining the DSM are obtained, the maximum angle of measurement of backpack MMS on the terrain would decline from 45° to 20°, which increases the error due to the noise produced in the measurement. There are also a higher number of errors due to obstacles. The number of zones in the study was, therefore, reduced in order to avoid errors caused by built elements or obstacles. The study for these distances at 7.5 m is limited to zones A1, A2, A3, B3, and B4 in the exterior part and to zones C1, D1, E1, E2, and F1 in the interior. In overall terms, the mean square error in height ranges from 0.04 m to 0.21 m (Table 3 and Figure 8).
Table 4 shows a comparison between the data obtained with points located at a distance of up to 2.5 and 7.5 m from the backpack MMS track. The correlation coefficient R2 allows the incidence of isolated errors to be analysed when comparing both DSMs.

4. Discussion

The methods for acquiring and processing the data provided by UAV and backpack MMS are of sufficient quality to generate valid DSMs in the study area or similar.
The first part of the work develops the methods of data capture using photogrammetry and a laser scanner with UAV and backpack MMS. The most challenging task was to select the points that could be identified using the different methods. Additionally, 20% of the control points were eliminated due to of the fact that identifying these points in all the methods is not possible.
Except in the case of measurement by photogrammetry, where backpack MMS provides the best precision results with a little under 5 cm in height, the rest of the methods had a precision of around 5 and 10 cm. Better overall results are obtained with UAV methods than with backpack MMS, but this depends on the distance of the points from the axis of the backpack MMS track. Backpack MMS is also better over a short distance under 3 m, with 6.8 cm. At higher distances, the UAV methods obtain a lower precision of over 8 or 9 cm.
In addition to precision, performance and production were also analysed. Manual photogrammetric methods were discarded since they required longer execution times, which represent a higher production cost. The registration of the dense cloud points with UAV proved to be the fastest and most economical method, whereas the registration via MMS gave the best performance, but had a higher production cost.
Given these results, the comprehensive comparison of UAV and backpack MMS point clouds in different zones that are more or less devoid of vegetation and small obstacles allows the analysis of their precision and the influence of each method on the definition of the DSM to be characterised. The precision in clear zones or zones near the track trajectory is 5 cm (Figure 9).
More substantial differences are found at greater distances, and measurement problems also arise due to the lack of information or measurements in an orography such as the one in the study area, with holes/gaps or even obstacles, as can be seen at the most extreme points of the model (Figure 10). Although they are few and more distant from the backpack trajectory, they present a proportionally higher error, which can be seen in Table 3 and Figure 7 and Figure 8.
The clearest example of these differences can be seen in the correlation graphs in Figure 11 (external tracks) and Figure 12 (internal tracks), where the different backpack MMS trajectories and their comparison with the UAV points not only show the R2 coefficients and the correlation equations indicated above, but also highlight the difference in the number and height of the points outside the trend line for the analysis of each track.

5. Conclusions

When comparing the data extracted individually, a similar precision is obtained with an average of around 5 cm in height with both methods, and an average of 10 cm with distance or identification problems. This precision is perfectly acceptable for defining DSMs in this work environment.
Since the precision of both systems is known to be similar in small environments or at short distances from backpack MMS, denser trajectories must be used to reduce errors due to obstacles. A mixed method such as the proposed MMS–UAV technique represents a useful tool for identifying areas that are difficult to determine in the DSM and which lead to the most significant differences in height in the comparison. Given the very high number of points obtained with these procedures, the detection and elimination of these points would make it possible to obtain a DSM with greater precision and a greater level of detail.
The assessment of the DSMs reveals that the tracks followed by backpack mobile mapping present a scarcity of information in some spaces. There are various obstacles and hidden areas in this terrain. In summary, the UAV provides a more homogeneous or stable DSM even though the DSM obtained with backpack mobile mapping is more accurate. This is due to the optimum distance range and the spaces where there are no obstacles or strong rupture lines. Both techniques can, therefore, be considered complementary and reliable for obtaining DSMs for the area where these underground cellars are located. This type of application can help detect deformations in the ground a posteriori.
The use of methods of mass capture offers an excellent opportunity in such a complex area as the exterior surface of the underground cellars of El Plantío in Atauta. These methods have different limitations, such as the irregularity of the terrain, difficult-to-isolate low-growing vegetation, and mobile or fixed obstacles. However, the general precision is high and in line with the data results necessary for their study and preservation.
A novel development is the inclusion of parameters such as the distance to the scanning point, the angles of incidence with regard to the ground, and the study of irregularities in the terrain. A clear comparison of both technologies that conclusively reveals the pros and cons of their use would be impossible without considering these aspects. Their combined use has also been proposed, which may be a source of further improvements in future studies.
The results obtained point to the conclusion that both techniques—albeit not without difficulty—provide DSMs that are capable of defining terrain stability. Due to the registration speed and the precision achieved, both systems allow the assessment of the underground wine cellars. Their use over time will make it possible to establish the necessary priorities to guarantee the conservation of such unique and important spaces such as this site of El Plantío in Atauta.

Author Contributions

Conceptualisation, S.L.-C.M. and E.P.-M., Methodology, S.L.-C.M., E.P.-M., J.F.P., J.V., and T.R.H.T. Investigation, J.F.P., J.V., and T.R.H.T. Data backpack MMS registration M.Á.C.M., A.E.-C., and E.P., Data UAV registration S.L.-C.M. and J.A.d.M. GPS field observation, J.F.P. and J.V. Backpack MMS data processing E.P.-M., M.Á.C.M., and A.E.-C. UAV data processing, S.L.-C.M. and J.A.d.M. GPS data processing, J.F.P., J.V., and T.R.H.T. Visualisation, E.P.-M., M.Á.C.M., and J.A.d.M. Supervision, T.R.H.T. and A.E.-C. All the authors contributed to writing and original draft preparation.

Funding

This work is part of the results of the “Red de Investigación en Paisajes Culturales” research project in the national R+D plan with reference number RED2018-102558-T. It is also supported by the programme for collaboration among the GIAPSI (ETSIINF), GESYP (ETSIAAB) and GIPC (ETSAM) research groups promoted by the Universidad Politécnica de Madrid (UPM) with reference VJOVUPM17IMS.

Acknowledgments

We would like to thank the Atauta Town Hall (San Esteban de Gormaz) and the companies TOPCON and LEICA for their help with the cultural landscape, including administrative and technical support (materials used for experiments). We also want to acknowledge Pru Brooke-Turner (M.A. Cantab.) for her English language and style review.

Conflicts of Interest

The authors declare that there are no conflicts of interest.

References

  1. Council of Europe. Recommendation CM/Rec (2008) 3 of the Committee of Ministers to Member States on the Guidelines for the Implementation of the European Landscape Convention; Council of Europe: Strasbourg, France, 2008. [Google Scholar]
  2. Brown, G.; Brabyn, L. An analysis of the relationships between multiple values and physical landscapes at a regional scale using public participation GIS and landscape character classification. Landsc. Urban Plan. 2012, 107, 317–331. [Google Scholar] [CrossRef]
  3. Skalos, J.; Molnarova, K.; Kottova, P. Land reforms reflected in the farming landscape in East Bohemia and in Southern Sweden—Two faces of modernisation. Appl. Geogr. 2012, 35, 114–123. [Google Scholar] [CrossRef]
  4. Mills, J.W.; Curtis, A.; Kennedy, B.; Kennedy, S.W.; Edwards, J.D. Geospatial video for field data collection. Appl. Geogr. 2010, 30, 533–547. [Google Scholar] [CrossRef]
  5. Koch, A.; Heipke, C. Quality assessment of digital surface models derived from the Shuttle Radar Topography Mission (SRTM). In Proceedings of the Geoscience and Remote Sensing Symposium (IGARSS 2001), Sydney, Australia, 9–13 July 2001; pp. 2863–2865. [Google Scholar]
  6. Levoy, M.; Pulli, K.; Curless, B.; Rusinkiewicz, S.; Koller, D.; Pereira, L.; Ginzton, M.; Anderson, S.; Davis, J.; Ginsberg, J.; et al. The digital Michelangelo project: 3D scanning of large statues. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2000), New Orleans, LA, USA, 23–28 July 2000; pp. 131–144. [Google Scholar]
  7. Beraldin, J.-A.; Picard, M.; El-Hakim, S.F.; Godin, G.; Valzano, V.; Bandiera, A.; Latouche, C. Virtualizing a Byzantine crypt by combining high-resolution textures with laser scanner 3D data. In Proceedings of the 8th International Conference on Virtual Systems and MultiMedia (VSMM 2002), Oral Session 1: Virtual Heritage 1 (VH1), Gyeongju, Korea, 25–27 September 2002. [Google Scholar]
  8. Avrami, E.; Mason, R.; De la Torre, M. Values and Heritage Conservation: Research Report; Getty Conservation Institute: Los Angeles, CA, USA, 2000. [Google Scholar]
  9. Stumpfel, J.; Tchou, C.; Yun, N.; Martinez, P.; Hawkins, T.; Jones, A.; Emerson, B.; Debevec, P.E. Digital Reunification of the Parthenon and its Sculptures. In Proceedings of the 4th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage (VAST 2003), Brighton, UK, 5–7 November 2003; pp. 41–50. [Google Scholar]
  10. Stovel, H. Effective use of authenticity and integrity as world heritage qualifying conditions. City Time 2007, 2, 3. [Google Scholar]
  11. Ikeuchi, K.; Miyazaki, D. Digitally Archiving Cultural Objects; Springer Science & Business Media: Berlin, Germany, 2008; pp. 1–504. ISBN 978-0-387-75807-7. [Google Scholar]
  12. Remondino, F.; El-Hakim, S.; Girardi, S.; Rizzi, A.; Benedetti, S.; Gonzo, L. 3D Virtual Reconstruction and Visualization of Complex Architectures—The 3D-ARCH Project. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2009, 38. [Google Scholar]
  13. Aber, J.S.; Marzolff, I.; Ries, J.B. Small-Format Aerial Photography: Principles, Techniques and Geoscience Applications; Elsevier: Amsterdam, The Netherlands, 2010; pp. 1–266. ISBN 978-0-444-53260-2. [Google Scholar]
  14. Hassanalian, M.; Abdelkefi, A. Classifications, applications, and design challenges of drones: A review. Prog. Aerosp. Sci. 2017, 91, 99–131. [Google Scholar] [CrossRef]
  15. Liang, H.; Li, W.; Lai, S.; Zhu, L.; Jiang, W.; Zhang, Q. The integration of terrestrial laser scanning and terrestrial and unmanned aerial vehicle digital photogrammetry for the documentation of Chinese classical gardens—A case study of Huanxiu Shanzhuang, Suzhou, China. Journal of Cultural Heritage. 2018, 33, 222–230. [Google Scholar] [CrossRef]
  16. Anton, D.; Medjdoub, B.; Shrahily, R.; Moyano, J. Accuracy evaluation of the semi-automatic 3D modeling for historical building information models. Int. J. Archit. Herit. 2018, 12, 790–805. [Google Scholar] [CrossRef] [Green Version]
  17. Sanchez-Aparicio, L.J.; Del Pozo, S.; Ramos, L.F.; Arce, A.; Fernandes, F.M. Heritage site preservation with combined radiometric and geometric analysis of TLS data. Autom. Constr. 2018, 85, 24–39. [Google Scholar] [CrossRef]
  18. Jo, Y.H.; Hong, S. Three-dimensional digital documentation of cultural heritage site based on the convergence of terrestrial laser scanning and unmanned aerial vehicle photogrammetry. ISPRS Int. J. Geo Inf. 2019, 8, 53. [Google Scholar] [CrossRef] [Green Version]
  19. Chiabrando, F.; Nex, F.; Piatti, D.; Rinaudo, F. UAV and RPV systems for photogrammetric surveys in archaeological areas: Two tests in the Piedmont region (Italy). J. Archaeol. Sci. 2011, 38, 697–710. [Google Scholar] [CrossRef]
  20. Masiero, A.; Fissore, F.; Guarnieri, A.; Piragnolo, M.; Vettore, A. Comparison of low cost photogrammetric survey with TLS and Leica pegasus backpack 3D models. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2017, 42, 147. [Google Scholar] [CrossRef] [Green Version]
  21. Pukanska, K.; Bartos, K.; Bella, P.; Rakay, S.; Sabova, J. Comparison of non-contact surveying technologies for modelling underground morphological structures. Acta Montan. Slovaca 2017, 22, 246–256. [Google Scholar]
  22. Aziz, A.S.; Stewart, R.R.; Green, S.L.; Flores, J.B. Locating and characterizing burials using 3D ground-penetrating radar (GPR) and terrestrial laser scanning (TLS) at the historic Mueschke Cemetery, Houston, Texas. J. Archaeol. Sci. Rep. 2016, 8, 392–405. [Google Scholar] [CrossRef]
  23. Kukko, A.; Kaartinen, H.; Hyyppa, J.; Chen, Y. Multiplatform mobile laser scanning: Usability and performance. Sensors 2012, 12, 11712–11733. [Google Scholar] [CrossRef] [Green Version]
  24. Ouedraogo, M.M.; Degre, A.; Debouche, C.; Lisein, J. The evaluation of unmanned aerial system-based photogrammetry and terrestrial laser scanning to generate DEMs of agricultural watersheds. Geomorphoogy 2014, 214, 339–355. [Google Scholar] [CrossRef]
  25. Sun, Z.; Zhang, Y.Y. Using drones and 3D modeling to survey Tibetan architectural heritage: A case study with the multi-door stupa. Sustainability 2018, 10, 2259. [Google Scholar] [CrossRef] [Green Version]
  26. Herrero, T.; Pérez-Martín, E.; Conejo-Martín, M.A.; de Herrera, J.L.; Ezquerra-Canalejo, A.; Velasco-Gómez, J. Assessment of underground wine cellars using geographic information technologies. Surv. Rev. 2014, 47, 202–210. [Google Scholar] [CrossRef] [Green Version]
  27. Bolognesi, M.; Furini, A.; Russo, V.; Pellegrinelli, A.; Russo, P. Testing the low-cost rpas potential in 3D cultural heritage reconstruction. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 2015, 40–45, 229–235. [Google Scholar] [CrossRef] [Green Version]
  28. Kršák, B.; Blišťan, P.; Pauliková, A.; Puškárová, P.; Kovanič, Ľ.; Palková, J.; Zelizňaková, V. Use of low-cost UAV photogrammetry to analyze the accuracy of a digital elevation model in a case study. Measurement 2016, 91, 276–287. [Google Scholar] [CrossRef]
  29. Tilly, N.; Kelterbaum, D.; Zeese, R. Geomorphological mapping with terrestrial laser scanning and uav-based imaging. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2016, 41, 591–597. [Google Scholar] [CrossRef]
  30. Raeva, P.; Filipova, S.; Filipov, D. Volume computation of a stockpile-a study case comparing GPS and UAV measurements in an open pit quarry. In Proceedings of the 23rd ISPRS Congress, Prague, Czech Republic, 12–19 July 2016. [Google Scholar]
  31. Pichon, L.; Ducanchez, A.; Fonta, H.; Tisseyre, B. Quality of digital elevation models obtained from unmanned aerial vehicles for precision viticulture. OENO ONE 2016, 50, 101–111. [Google Scholar] [CrossRef] [Green Version]
  32. Yan, Y.; Tan, Z.; Su, N.; Zhao, C. Building extraction based on an optimized stacked sparse autoencoder of structure and training samples using LIDAR DSM and optical images. Sensors 2017, 17, 1957. [Google Scholar] [CrossRef] [Green Version]
  33. Yan, Y.; Gao, F.; Deng, S.; Su, N. A hierarchical building segmentation in digital surface models for 3D reconstruction. Sensors 2017, 17, 222. [Google Scholar] [CrossRef] [Green Version]
  34. Mohamad, N.; Khanan, M.F.A.; Ahmad, A.; Din, A.H.M.; Shahabi, H. Evaluating water level changes at different tidal phases using UAV photogrammetry and GNSS vertical data. Sensors 2019, 19, 3778. [Google Scholar] [CrossRef] [Green Version]
  35. Escobar Villanueva, J.R.; Iglesias Martinez, L.; Perez Montiel, J.I. DEM generation from fixed-wing UAV imaging and LiDAR-derived ground control points for flood estimations. Sensors 2019, 19, 3205. [Google Scholar] [CrossRef] [Green Version]
  36. Komarek, J.; Kumhalova, J.; Kroulik, M. Surface modelling based on unmanned aerial vehicle photogrammetry and its accuracy assessment. In Proceedings of the International Scientific Conference Engineering for Rural Development, Jeglava, Latvia, 25–27 May 2016. [Google Scholar]
  37. Yeh, M.; Chou, Y.; Yang, L. The evaluation of GPS techniques for UAV-based photogrammetry in urban area. In Proceedings of the 23rd ISPRS Congress, Prague, Czech Republic, 12–19 July 2016. [Google Scholar]
  38. Chang, H.C.; Ge, L.L.; Rizos, C.; Milne, T. Validation of DEMs derived from radar interferometry, airborne laser scanning and photogrammetry by using GPS-RTK. In Proceedings of the International Geoscience and Remote Sensing Symposium Science for Society (IGARSS 2004): Exploring and Managing a Changing Planet, Anchorage, AK, USA, 20–24 September 2004; pp. 2815–2818. [Google Scholar]
  39. Skarlatos, D.; Procopiou, E.; Stavrou, G.; Gregoriou, M. Accuracy assessment of minimum control points for UAV photography and georeferencing. In Proceedings of the 1st International Conference on Remote Sensing and Geoinformation of the Environment (RSCy), Paphos, Cyprus, 8–10 April 2013. [Google Scholar]
  40. Tong, X.; Liu, X.; Chen, P.; Liu, S.; Luan, K.; Li, L.; Liu, S.; Liu, X.; Xie, H.; Jin, Y. Integration of UAV-based photogrammetry and terrestrial laser scanning for the three-dimensional mapping and monitoring of open-pit mine areas. Remote Sens. 2015, 7, 6635–6662. [Google Scholar] [CrossRef] [Green Version]
  41. Tokunaga, M. Accuracy verification of DSM obtained from UAV using commercial software. In Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy, 26–31 July 2015; pp. 3022–3024. [Google Scholar]
  42. Kurian, A.; Morin, K.W. A fast and flexible method for meta-map building for ICP based slam. In Proceedings of the 23rd ISPRS Congress, Prague, Czech Republic, 12–19 July 2016; pp. 273–278. [Google Scholar] [CrossRef]
  43. Velas, M.; Spanel, M.; Sleziak, T.; Habrovec, J.; Herout, A. Indoor and outdoor backpack mapping with calibrated pair of velodyne LiDARs. Sensors 2019, 19, 3944. [Google Scholar] [CrossRef] [Green Version]
  44. Chen, H.; Yu, P. Application of laser SLAM technology in backpack indoor mobile measurement system. In Proceedings of the 4th International Conference on Advances in Energy Resources and Environment Engineering (ICAESEE), Chengdu, China, 29 March 2018. [Google Scholar]
  45. Lehtola, V.V.; Kaartinen, H.; Nuchter, A.; Kaijaluoto, R.; Kukko, A.; Litkey, P.; Honkavaara, E.; Rosnell, T.; Vaaja, M.T.; Virtanen, J.P.; et al. Comparison of the selected state-of-the-art 3D indoor scanning and point cloud generation methods. Remote Sens. 2017, 9, 796. [Google Scholar] [CrossRef] [Green Version]
  46. Nocerino, E.; Menna, F.; Remondino, F.; Toschi, I.; Rodriguez-Gonzalvez, P. Investigation of indoor and outdoor performance of two portable mobile mapping systems. In Proceedings of the Conference on Videometrics, Range Imaging, and Applications XIV, Munich, Germany, 26–27 June 2017. [Google Scholar]
  47. Masiero, A.; Fissore, F.; Guarnieri, A.; Pirotti, F.; Visintini, D.; Vettore, A. Performance evaluation of two indoor mapping systems: Low-cost UWB-aided photogrammetry and backpack laser scanning. Appl. Sci. 2018, 8, 416. [Google Scholar] [CrossRef] [Green Version]
  48. Leica Geosystems. Leica Pegasus: Backpack Wearable Mobile Mapping Solution. Available online: https://leica-geosystems.com/products/mobile-sensor-platforms/capture-platforms/leica-pegasus-backpack (accessed on 1 November 2019).
  49. Lauterbach, H.A.; Borrmann, D.; Hess, R.; Eck, D.; Schilling, K.; Nuechter, A. Evaluation of a backpack-mounted 3D mobile scanning system. Remote Sens. 2015, 7, 13753–13781. [Google Scholar] [CrossRef] [Green Version]
  50. Campos, M.B.; Garcia Tommaselli, A.M.; Honkavaara, E.; Prol, F.d.S.; Kaartinen, H.; El Issaoui, A.; Hakala, T. A backpack-mounted omnidirectional camera with off-the-shelf navigation sensors for mobile terrestrial mapping: Development and forest application. Sensors 2018, 18, 827. [Google Scholar] [CrossRef] [Green Version]
  51. Polewski, P.; Yao, W.; Cao, L.; Gao, S. Marker-free coregistration of UAV and backpack LiDAR point clouds in forested areas. ISPRS J. Photogramm. Remote Sens. 2019, 147, 307–318. [Google Scholar] [CrossRef]
  52. Angel Conejo-Martin, M.; Ramon Herrero-Tejedor, T.; Perez-Martin, E.; Lapazaran-Izargain, J.; Otero-Garcia, J.; Francisco Prieto-Morin, J.; Velasco-Gomez, J. Characterization of underground cellars in the duero basin by GNSS, LIDAR and GPR techniques. Math. Planet Earth 2014, 277–280. [Google Scholar] [CrossRef] [Green Version]
  53. Conejo Martin, M.A. Propuesta Metodológica para el Estudio de Sistemas Topográficos Aplicados a la Reresentación Gráfica de Bodegas Subterráneas Tradicionales. Ph.D. Thesis, E.T.S.I. Agronomos, Madrid, Spain, July 2014. [Google Scholar]
  54. Gruen, A.; Beyer, H.A. System Calibration Through Self-Calibration; Springer: Berlin/Heidelberg, Germany, 2001; pp. 163–193. [Google Scholar]
  55. Leica Geosystems. Leica Pegasus: Backpack. Mobile reality capture. Backpack specifications. Available online: https://leica-geosystems.com/-/media/files/leicageosystems/products/datasheets/leica_pegasusbackpack_ds.ashx?la=en-gb (accessed on 1 November 2019).
  56. Sayama, T.; Matsumoto, K.; Kuwano, Y.; Takara, K. Application of backpack-mounted mobile mapping system and rainfall-runoff-inundation model for flash flood analysis. Water 2019, 11, 963. [Google Scholar] [CrossRef] [Green Version]
  57. Han, X.; Thomasson, J.A.; Bagnall, G.C.; Pugh, N.A.; Horne, D.W.; Rooney, W.L.; Jung, J.; Chang, A.; Malambo, L.; Popescu, S.C.; et al. Measurement and calibration of plant-height from fixed-wing UAV images. Sensors 2018, 18, 4092. [Google Scholar] [CrossRef] [Green Version]
  58. Smith, M.W.; Carrivick, J.L.; Quincey, D.J. Structure from motion photogrammetry in physical geography. Prog. Phys. Geogr. Earth Environ. 2016, 40, 247–275. [Google Scholar] [CrossRef]
  59. Fleming, Z.; Pavlis, T. An orientation based correction method for SfM-MVS point clouds—Implications for field geology. J. Struct. Geol. 2018, 113, 76–89. [Google Scholar] [CrossRef]
  60. Sanz-Ablanedo, E.; Chandler, J.H.; Rodríguez-Pérez, J.R.; Ordóñez, C. Accuracy of unmanned aerial vehicle (UAV) and SfM photogrammetry survey as a function of the number and location of ground control points used. Remote Sens. 2018, 10, 1606. [Google Scholar] [CrossRef] [Green Version]
  61. Eltner, A.; Kaiser, A.; Castillo, C.; Rock, G.; Neugirg, F.; Abellán, A. Image-based surface reconstruction in geomorphometry—Merits, limits and developments. Earth Surf. Dyn. 2016, 4, 359–389. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Location of the study area. The underground cellars are located in Atauta (Soria), a region in the Duero Basin in the north-central part of Spain.
Figure 1. Location of the study area. The underground cellars are located in Atauta (Soria), a region in the Duero Basin in the north-central part of Spain.
Sensors 19 05352 g001
Figure 2. (a) Mavinci UAV used during the registration process. (b) Image orientation process task in Agisoft Photoscan® professional software (http://www.agisoft.com/) showing flight paths and photocenters. (c) 3D view diagram of the recorded images.
Figure 2. (a) Mavinci UAV used during the registration process. (b) Image orientation process task in Agisoft Photoscan® professional software (http://www.agisoft.com/) showing flight paths and photocenters. (c) 3D view diagram of the recorded images.
Sensors 19 05352 g002
Figure 3. (a) GPS Leica GX1230 GG equipment, acting as a reference base. (b) Pegasus backpack system for taking the point cloud in the study area before obtaining the DSM model to be assessed.
Figure 3. (a) GPS Leica GX1230 GG equipment, acting as a reference base. (b) Pegasus backpack system for taking the point cloud in the study area before obtaining the DSM model to be assessed.
Sensors 19 05352 g003
Figure 4. GEP observed using RTK-GPS techniques for the characterisation surveys of collapse zones. Lines depict the backpack mobile mapping tracks (Tracks A to F) used to assess the 3D model.
Figure 4. GEP observed using RTK-GPS techniques for the characterisation surveys of collapse zones. Lines depict the backpack mobile mapping tracks (Tracks A to F) used to assess the 3D model.
Sensors 19 05352 g004
Figure 5. Workflow of the methodology for data acquisition where (1) refers to data acquisition and post-processing for backpack mobile mapping, UAV, and RTK-GPS, and (2) represents DSM processing and stability evaluation. Note the interactions between the benchmark survey (GPS) and backpack mobile mapping and UAV surveys.
Figure 5. Workflow of the methodology for data acquisition where (1) refers to data acquisition and post-processing for backpack mobile mapping, UAV, and RTK-GPS, and (2) represents DSM processing and stability evaluation. Note the interactions between the benchmark survey (GPS) and backpack mobile mapping and UAV surveys.
Sensors 19 05352 g005
Figure 6. Comparison of precision based on the method used and the distance from the axis of backpack MMS.
Figure 6. Comparison of precision based on the method used and the distance from the axis of backpack MMS.
Sensors 19 05352 g006
Figure 7. Distribution of the precise comparison of the point clouds based on the backpack MMS track. Letters denote the different tracks while numbers depict the different sections in the tracks.
Figure 7. Distribution of the precise comparison of the point clouds based on the backpack MMS track. Letters denote the different tracks while numbers depict the different sections in the tracks.
Sensors 19 05352 g007
Figure 8. Precision distribution with the influence of 7.5 m with regard to the backpack MMS track. Letters denote the different tracks while numbers depict the different sections in the tracks.
Figure 8. Precision distribution with the influence of 7.5 m with regard to the backpack MMS track. Letters denote the different tracks while numbers depict the different sections in the tracks.
Sensors 19 05352 g008
Figure 9. Identification of zones with significant differences between UAV and MMS DSMs.
Figure 9. Identification of zones with significant differences between UAV and MMS DSMs.
Sensors 19 05352 g009
Figure 10. Differences in height according to the type of system, the width of the scan, and the obstacles or concealed elements. (Left): example of a zone with a 2.5 m track width. (Right): same area with a 15 m track width. Black areas depict concealed zones not registered in the backpack MMS.
Figure 10. Differences in height according to the type of system, the width of the scan, and the obstacles or concealed elements. (Left): example of a zone with a 2.5 m track width. (Right): same area with a 15 m track width. Black areas depict concealed zones not registered in the backpack MMS.
Sensors 19 05352 g010
Figure 11. Comparison of UAV vs. backpack MMS by external tracks (A,B).
Figure 11. Comparison of UAV vs. backpack MMS by external tracks (A,B).
Sensors 19 05352 g011
Figure 12. Comparison of UAV vs. backpack MMS by internal tracks (CF).
Figure 12. Comparison of UAV vs. backpack MMS by internal tracks (CF).
Sensors 19 05352 g012
Table 1. UAV and MMS system specifications.
Table 1. UAV and MMS system specifications.
Main FeaturesMavinci UAVPegasus Backpack
TechnologyLumix-G1 16 Mpx cameraVelodyne VLP16 laser scanner
Measurement technologyComputation from imagesPolar distance measurement
Distance measurement90 m5–100 m
System resolutionGSD 2.16 cmDist. acc. 3 cm at 100 m
DSM resolution600 points/m236,000 points/m2
Table 2. Precision comparison by method and distance to the backpack MMS track (in metres).
Table 2. Precision comparison by method and distance to the backpack MMS track (in metres).
ProductCoordinate0–22–3.53.5–10
MeanDevMeanDevMeanDev
Backpack MMS photogrammetryHorizontal0.0890.0510.0490.0350.1610.109
Vertical0.0310.0320.0250.0240.0510.033
Backpack MMS point cloudHorizontal0.0660.0570.0320.0200.0540.027
Vertical0.0680.1140.0900.1070.0560.049
UAV photogrammetryHorizontal0.0530.0340.0400.0180.0470.023
Vertical0.0730.0530.1020.0790.0960.057
UAV point cloudHorizontal0.0670.0510.0330.0200.0470.022
Vertical0.0890.0770.1180.0880.1160.063
Table 3. Results of the comparison between UAV and backpack MMS DSMs with points measured at a distance of at least 2.5 m from the backpack MMS track.
Table 3. Results of the comparison between UAV and backpack MMS DSMs with points measured at a distance of at least 2.5 m from the backpack MMS track.
TrackPerimeter (m)Area (m2)Distance (m)UAV ResolutionBackpack MMS ResolutionGrid ResolutionPrecision (m)RMS (m)
A1370564184357,16513,694,02255,578−0.020.04
A218942090255,61111,128,09541,606−0.10.04
A313519663116,0124,222,44319,171−0.10.01
A4951174469,9405,290,73411,562−0.090.03
A559902652,4147,885,7918869−0.160.02
B1981384580,1142,921,95313,628−0.160.02
B215718277111,2265,390,51117,678−0.10.05
B31061595094,7374,219,88615,508−0.080.06
B4236286116180,49413,471,06627,982−0.120.07
C1339348168226,1629,852,31833,758−0.040.04
C2262339126243,34616,488,27733,363−0.090.08
D169833152,1091,691,7638062−0.150.02
E116923283167,18910,230,84522,552−0.070.07
E210915353105,7394,740,50014,961−0.160.07
F1236464116302,08914,207,24045,617−0.060.06
Table 4. Comparison of precision when the width is increased from 2.5 to 7.5 m.
Table 4. Comparison of precision when the width is increased from 2.5 to 7.5 m.
Grid PointsPrecisionRMSR2
Track5 m15 m5 m15 m5 m15 m5 m15 m
A155,578233,444−0.02−0.070.040.140.99980.9959
A241,606135,901−0.10−0.190.040.280.99850.8108
A319,17188,832−0.10−0.10.010.150.99280.9806
B315,50871,411−0.08−0.10.060.110.99690.9792
B427,982144,769−0.12−0.120.070.240.99110.9968
C133,758197,137−0.04−0.090.040.730.99980.9598
D1806246,599−0.15−0.160.020.330.99790.8295
E122,552103,978−0.07−0.140.070.360.99910.9848
E214,96172,501−0.16−0.20.070.170.99670.9567
F145,617158,948−0.06−0.090.060.110.99750.9908

Share and Cite

MDPI and ACS Style

López-Cuervo Medina, S.; Pérez-Martín, E.; Herrero Tejedor, T.R.; Prieto, J.F.; Velasco, J.; Conejo Martín, M.Á.; Ezquerra-Canalejo, A.; Aguirre de Mata, J. Assessment of DSMs Using Backpack-Mounted Systems and Drone Techniques to Characterise Ancient Underground Cellars in the Duero Basin (Spain). Sensors 2019, 19, 5352. https://doi.org/10.3390/s19245352

AMA Style

López-Cuervo Medina S, Pérez-Martín E, Herrero Tejedor TR, Prieto JF, Velasco J, Conejo Martín MÁ, Ezquerra-Canalejo A, Aguirre de Mata J. Assessment of DSMs Using Backpack-Mounted Systems and Drone Techniques to Characterise Ancient Underground Cellars in the Duero Basin (Spain). Sensors. 2019; 19(24):5352. https://doi.org/10.3390/s19245352

Chicago/Turabian Style

López-Cuervo Medina, Serafín, Enrique Pérez-Martín, Tomás R. Herrero Tejedor, Juan F. Prieto, Jesús Velasco, Miguel Ángel Conejo Martín, Alejandra Ezquerra-Canalejo, and Julián Aguirre de Mata. 2019. "Assessment of DSMs Using Backpack-Mounted Systems and Drone Techniques to Characterise Ancient Underground Cellars in the Duero Basin (Spain)" Sensors 19, no. 24: 5352. https://doi.org/10.3390/s19245352

APA Style

López-Cuervo Medina, S., Pérez-Martín, E., Herrero Tejedor, T. R., Prieto, J. F., Velasco, J., Conejo Martín, M. Á., Ezquerra-Canalejo, A., & Aguirre de Mata, J. (2019). Assessment of DSMs Using Backpack-Mounted Systems and Drone Techniques to Characterise Ancient Underground Cellars in the Duero Basin (Spain). Sensors, 19(24), 5352. https://doi.org/10.3390/s19245352

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop