Search Results (14)

Long-wave infrared (LWIR) airborne optical systems for ground imaging are widely utilized in applications such as ground reconnaissance, agricultural monitoring, counterterrorism, and other fields. Traditional oblique-view ground-imaging optical systems suffer from a critical drawback compared to nadir-view systems: the significant variation in object distances between distant and nearby targets. This disparity leads to inconsistent ground resolution (GR), manifesting in images where distant targets exhibit significantly lower resolution than nearby ones. This characteristic is highly detrimental to information acquisition and three-dimensional modeling of the system. Furthermore, the limited field of view of fixed focal length systems prevents the unmanned aerial vehicle (UAV) from acquiring target information effectively across varying flight altitudes. To address this issue, this paper designs an oblique imaging optical system capable of achieving both constant GR and zoom functionality in the LWIR band. By controlling the ground resolution, a LWIR continuous zoom optical system was designed. The system maintains constant GR over the entire field of view. Its modulation transfer function (MTF) approaches the diffraction limit across the full field of view, and the spot diagram remains within Airy’s disk at each view angle. The radius of the spot diagram is smaller than that of the Airy disk, indicating that the geometric aberrations of the system are well corrected. The imaging performance is primarily determined by the wavelength and the F-number. In the case of LWIR, the longer wavelength results in a larger Airy disk radius. The system meets imaging quality requirements and is suitable for air-to-ground target reconnaissance imaging. Full article

Deep learning-based object detection has achieved remarkable maturity after years of intensive research. However, as multi-platform data acquisition becomes increasingly prevalent, spanning satellite, UAV, and ground-based platforms, a critical challenge emerges involving significant vertical perspective variations in captured images. The current object detection literature largely neglects this perspective dimension, particularly the robustness evaluation of single models across diverse viewing angles. To bridge this gap, we first conduct a systematic review categorizing existing approaches into standard and rotated object detection paradigms. Second, we build the Multi-Vertical-Perspective Object Detection (MVPOD) dataset; this dataset is the first comprehensive benchmark integrating spaceborne (nadir), airborne (oblique) and ground-level (horizontal) imagery with dual annotation schemes. Third, rigorous cross-perspective evaluation protocols reveal that vertical viewpoint discrepancies cause measurable performance degradation. Finally, representative methods are benchmarked on the MVPOD dataset, establishing baselines for future research. Full article

The rapid measurement of three-dimensional bridge geometric shapes is crucial for assessing construction quality and in-service structural conditions. Existing geometric shape measurement methods predominantly rely on traditional surveying instruments, which suffer from low efficiency and are limited to sparse point sampling. This study proposes a novel framework that utilizes an airborne LiDAR–camera fusion system for data acquisition, reconstructs high-precision 3D bridge models through real-time mapping, and automatically extracts structural geometric shapes using deep learning. The main contributions include the following: (1) A synchronized LiDAR–camera fusion system integrated with an unmanned aerial vehicle (UAV) and a microprocessor was developed, enabling the flexible and large-scale acquisition of bridge images and point clouds; (2) A multi-sensor fusion mapping method coupling visual-inertial odometry (VIO) and Li-DAR-inertial odometry (LIO) was implemented to construct 3D bridge point clouds in real time robustly; and (3) An instance segmentation network-based approach was proposed to detect key structural components in images, with detected geometric shapes projected from image coordinates to 3D space using LiDAR–camera calibration parameters, addressing challenges in automated large-scale point cloud analysis. The proposed method was validated through geometric shape measurements on a concrete arch bridge. The results demonstrate that compared to the oblique photogrammetry method, the proposed approach reduces errors by 77.13%, while its detection time accounts for 4.18% of that required by a stationary laser scanner and 0.29% of that needed for oblique photogrammetry. Full article

Aerial images captured with the camera optical axis deliberately inclined with respect to the vertical are defined as oblique aerial images. Throughout the evolution of aerial photography, oblique aerial images have held a prominent place since its inception. While vertical airborne images dominated in photogrammetric applications for over a century, the advancements in photogrammetry and computer vision algorithms, coupled with the growing accessibility of oblique images in the market, have propelled the rise of oblique images in recent times. Their emergence is attributed to inherent advantages they offer over vertical images. In this entry, basic definitions, geometric principles and relationships for oblique aerial images, necessary for understanding their underlying geometry, are presented. Full article

Satellite-based soil organic carbon content (SOC) mapping over wide regions is generally hampered by the low soil sampling density and the diversity of soil sampling periods. Some unfavorable topsoil conditions, such as high moisture, rugosity, the presence of crop residues, the limited amplitude of SOC values and the limited area of bare soil when a single image is used, are also among the influencing factors. To generate a reliable SOC map, this study addresses the use of Sentinel-2 (S2) temporal mosaics of bare soil (S2Bsoil) over 6 years jointly with soil moisture products (SMPs) derived from Sentinel 1 and 2 images, SOC measurement data and other environmental covariates derived from digital elevation models, lithology maps and airborne gamma-ray data. In this study, we explore (i) the dates and periods that are preferable to construct temporal mosaics of bare soils while accounting for soil moisture and soil management; (ii) which set of covariates is more relevant to explain the SOC variability. From four sets of covariates, the best contributing set was selected, and the median SOC content along with uncertainty at 90% prediction intervals were mapped at a 25-m resolution from quantile regression forest models. The accuracy of predictions was assessed by 10-fold cross-validation, repeated five times. The models using all the covariates had the best model performance. Airborne gamma-ray thorium, slope and S2 bands (e.g., bands 6, 7, 8, 8a) and indices (e.g., calcareous sedimentary rocks, “calcl”) from the “late winter–spring” time series were the most important covariates in this model. Our results also indicated the important role of neighboring topographic distances and oblique geographic coordinates between remote sensing data and parent material. These data contributed not only to optimizing SOC mapping performance but also provided information related to long-range gradients of SOC spatial variability, which makes sense from a pedological point of view. Full article

Currently, there is a rapid trend in the production of airborne sensors consisting of multi-view cameras or hybrid sensors, i.e., a LiDAR scanner coupled with one or multiple cameras to enrich the data acquisition in terms of colors, texture, completeness of coverage, accuracy, etc. However, the current UAV hybrid systems are mainly equipped with a single camera that will not be sufficient to view the facades of buildings or other complex objects without having double flight paths with a defined oblique angle. This entails extensive flight planning, acquisition duration, extra costs, and data handling. In this paper, a multi-view camera system which is similar to the conventional Maltese cross configurations used in the standard aerial oblique camera systems is simulated. This proposed camera system is integrated with a multi-beam LiDAR to build an efficient UAV hybrid system. To design the low-cost UAV hybrid system, two types of cameras are investigated and proposed, namely the MAPIR Survey and the SenseFly SODA, integrated with a multi-beam digital Ouster OS1-32 LiDAR sensor. Two simulated UAV flight experiments are created with a dedicated methodology and processed with photogrammetric methods. The results show that with a flight speed of 5 m/s and an image overlap of 80/80, an average density of up to 1500 pts/m² can be achieved with adequate facade coverage in one-pass flight strips. Full article

This study conducts an in-depth evaluation of imaging algorithms and software and hardware architectures to meet the capability requirements of real-time image acquisition systems, such as spaceborne and airborne synthetic aperture radar (SAR) systems. By analysing the principles and models of SAR imaging, this research creatively puts forward the fully parallel processing architecture for the back projection (BP) algorithm based on Field-Programmable Gate Array (FPGA). The processing time consumption has significant advantages compared with existing methods. This article describes the BP imaging algorithm, which stands out with its high processing accuracy and two-dimensional decoupling of distance and azimuth, and analyses the algorithmic flow, operation, and storage requirements. The algorithm is divided into five core operations: range pulse compression, upsampling, oblique distance calculation, data reading, and phase accumulation. The architecture and optimisation of the algorithm are presented, and the optimisation methods are described in detail from the perspective of algorithm flow, fixed-point operation, parallel processing, and distributed storage. Next, the maximum resource utilisation rate of the hardware platform in this study is found to be more than 80%, the system power consumption is 21.073 W, and the processing time efficiency is better than designs with other FPGA, DSP, GPU, and CPU. Finally, the correctness of the processing results is verified using actual data. The experimental results showed that 1.1 s were required to generate an image with a size of 900 × 900 pixels at a 200 MHz clock rate. This technology can solve the multi-mode, multi-resolution, and multi-geometry signal processing problems in an integrated manner, thus laying a foundation for the development of a new, high-performance, SAR system for real-time imaging processing. Full article

A multi-year airborne field investigation of remote botanical species identification was conducted involving multiple curated botanical collections. The purpose of the study was to better constrain the observational conditions that most favor remote identification by longwave-infrared spectral imaging and assess the degree to which confidence metrics developed for remote chemical composition determination could be adapted to botanical species classification. Identification success was examined as a function of spatial resolution and viewing obliquity. A key aim was to articulate a procedure for validating inferred species identifications and evaluating the retrieval methodology’s performance for alleviating confusion between species exhibiting spectral similarity at the foliar scale. It was found that several confounding factors degrade confidence in the species identifications to levels that render the approach impractical in the general case. A number of taxa, predominantly evergreen, were nevertheless identified that are amenable to the technique and for which utility may be viable. Full article

Thermal imagery is widely used in various fields of remote sensing. In this study, a novel processing scheme is developed to process the data acquired by the oblique airborne photogrammetric system AOS-Tx8 consisting of four thermal cameras and four RGB cameras with the goal of large-scale area thermal attribute mapping. In order to merge 3D RGB data and 3D thermal data, registration is conducted in four steps: First, thermal and RGB point clouds are generated independently by applying structure from motion (SfM) photogrammetry to both the thermal and RGB imagery. Next, a coarse point cloud registration is performed by the support of georeferencing data (global positioning system, GPS). Subsequently, a fine point cloud registration is conducted by octree-based iterative closest point (ICP). Finally, three different texture mapping strategies are compared. Experimental results showed that the global image pose refinement outperforms the other two strategies at registration accuracy between thermal imagery and RGB point cloud. Potential building thermal leakages in large areas can be fast detected in the generated texture mapping results. Furthermore, a combination of the proposed workflow and the oblique airborne system allows for a detailed thermal analysis of building roofs and facades. Full article

Knowledge about the existing materials in urban areas has, in recent times, increased in importance. With the use of imaging spectroscopy and hyperspectral remote sensing techniques, it is possible to measure and collect the spectra of urban materials. Most spectral libraries consist of either spectra acquired indoors in a controlled lab environment or of spectra from afar using airborne systems accompanied with in situ measurements. Furthermore, most publicly available spectral libraries have, so far, not focused on facade materials but on roofing materials, roads, and pavements. In this study, we present an urban spectral library consisting of collected in situ material spectra with imaging spectroscopy techniques in the visible and near-infrared (VNIR) and short-wave infrared (SWIR) spectral range, with particular focus on facade materials and material variation. The spectral library consists of building materials, such as facade and roofing materials, in addition to surrounding ground material, but with a focus on facades. This novelty is beneficial to the community as there is a shift to oblique-viewed Unmanned Aerial Vehicle (UAV)-based remote sensing and thus, there is a need for new types of spectral libraries. The post-processing consists partly of an intra-set solar irradiance correction and recalculation of reference spectra caused by signal clipping. Furthermore, the clustering of the acquired spectra was performed and evaluated using spectral measures, including Spectral Angle and a modified Spectral Gradient Angle. To confirm and compare the material classes, we used samples from publicly available spectral libraries. The final material classification scheme is based on a hierarchy with subclasses, which enables a spectral library with a larger material variation and offers the possibility to perform a more refined material analysis. The analysis reveals that the color and the surface structure, texture or coating of a material plays a significantly larger role than what has been presented so far. The samples and their corresponding detailed metadata can be found in the Karlsruhe Library of Urban Materials (KLUM) archive. Full article

2.5D map is a convenient and efficient approach to exploiting a massive three-dimensional (3D) city model in web GIS. With the rapid development of oblique airborne photogrammetry and photo-based 3D reconstruction, 3D city models are becoming more and more accessible. 3D Geographic Information System (GIS) can support the interactive visualization of massive 3D city models on various platforms and devices. However, the value and accessibility of existing 3D city models can be augmented by integrating them into web-based two-dimensional (2D) GIS applications. In this paper, we present a step-by-step workflow for generating orthorectified oblique images (2.5D maps) from massive 3D city models. The proposed framework can produce 2.5D maps from an arbitrary perspective, defined by the elevation angle and azimuth angle of a virtual orthographic camera. We demonstrate how 2.5D maps can benefit web-based visualization and exploitation of massive 3D city models. We conclude that a 2.5D map is a compact data representation optimized for web data streaming of 3D city models and that geometric analysis of buildings can be effectively conducted on 2.5D maps. Full article

Aerial reconnaissance continues to be a vital tool for landscape-oriented archaeological research. Although a variety of remote sensing platforms operate within the earth’s atmosphere, the majority of aerial archaeological information is still derived from oblique photographs collected during observer-directed reconnaissance flights, a prospection approach which has dominated archaeological aerial survey for the past century. The resulting highly biased imagery is generally catalogued in sub-optimal (spatial) databases, if at all, after which a small selection of images is orthorectified and interpreted. For decades, this has been the standard approach. Although many innovations, including digital cameras, inertial units, photogrammetry and computer vision algorithms, geographic(al) information systems and computing power have emerged, their potential has not yet been fully exploited in order to re-invent and highly optimise this crucial branch of landscape archaeology. The authors argue that a fundamental change is needed to transform the way aerial archaeologists approach data acquisition and image processing. By addressing the very core concepts of geographically biased aerial archaeological photographs and proposing new imaging technologies, data handling methods and processing procedures, this paper gives a personal opinion on how the methodological components of aerial archaeology, and specifically aerial archaeological photography, should evolve during the next decade if developing a more reliable record of our past is to be our central aim. In this paper, a possible practical solution is illustrated by outlining a turnkey aerial prospection system for total coverage survey together with a semi-automated back-end pipeline that takes care of photograph correction and image enhancement as well as the management and interpretative mapping of the resulting data products. In this way, the proposed system addresses one of many bias issues in archaeological research: the bias we impart to the visual record as a result of selective coverage. While the total coverage approach outlined here may not altogether eliminate survey bias, it can vastly increase the amount of useful information captured during a single reconnaissance flight while mitigating the discriminating effects of observer-based, on-the-fly target selection. Furthermore, the information contained in this paper should make it clear that with current technology it is feasible to do so. This can radically alter the basis for aerial prospection and move landscape archaeology forward, beyond the inherently biased patterns that are currently created by airborne archaeological prospection. Full article

Automatic post-disaster mapping of building damage using remote sensing images is an important and time-critical element of disaster management. The characteristics of remote sensing images available immediately after the disaster are not certain, since they may vary in terms of capturing platform, sensor-view, image scale, and scene complexity. Therefore, a generalized method for damage detection that is impervious to the mentioned image characteristics is desirable. This study aims to develop a method to perform grid-level damage classification of remote sensing images by detecting the damage corresponding to debris, rubble piles, and heavy spalling within a defined grid, regardless of the aforementioned image characteristics. The Visual-Bag-of-Words (BoW) is one of the most widely used and proven frameworks for image classification in the field of computer vision. The framework adopts a kind of feature representation strategy that has been shown to be more efficient for image classification—regardless of the scale and clutter—than conventional global feature representations. In this study supervised models using various radiometric descriptors (histogram of gradient orientations (HoG) and Gabor wavelets) and classifiers (SVM, Random Forests, and Adaboost) were developed for damage classification based on both BoW and conventional global feature representations, and tested with four datasets. Those vary according to the aforementioned image characteristics. The BoW framework outperformed conventional global feature representation approaches in all scenarios (i.e., for all combinations of feature descriptors, classifiers, and datasets), and produced an average accuracy of approximately 90%. Particularly encouraging was an accuracy improvement by 14% (from 77% to 91%) produced by BoW over global representation for the most complex dataset, which was used to test the generalization capability. Full article

In volcanic areas, where it can be difficult to perform direct surveys, digital photogrammetry techniques are rarely adopted for routine volcano monitoring. Nevertheless, they have remarkable potentialities for observing active volcanic features (e.g., fissures, lava flows) and the connected deformation processes. The ability to obtain accurate quantitative data of definite accuracy in short time spans makes digital photogrammetry a suitable method for controlling the evolution of rapidly changing large-area volcanic phenomena. The systematic acquisition of airborne photogrammetric datasets can be adopted for implementing a more effective procedure aimed at long-term volcano monitoring and hazard assessment. In addition, during the volcanic crisis, the frequent acquisition of oblique digital images from helicopter allows for quasi-real-time monitoring to support mitigation actions by civil protection. These images are commonly used to update existing maps through a photo-interpretation approach that provide data of unknown accuracy. This work presents a scientific tool (Orthoview) that implements a straightforward photogrammetric approach to generate digital orthophotos from single-view oblique images provided that at least four Ground Control Points (GCP) and current Digital Elevation Models (DEM) are available. The influence of the view geometry, of sparse and not-signalized GCP and DEM inaccuracies is analyzed for evaluating the performance of the developed tool in comparison with other remote sensing techniques. Results obtained with datasets from Etna and Stromboli volcanoes demonstrate that 2D features measured on the produced orthophotos can reach sub-meter-level accuracy. Full article