Review of Image-Processing-Based Technology for Structural Health Monitoring of Civil Infrastructures

Abstract

The continuous monitoring of civil infrastructures is crucial for ensuring public safety and extending the lifespan of structures. In recent years, image-processing-based technologies have emerged as powerful tools for the structural health monitoring (SHM) of civil infrastructures. This review provides a comprehensive overview of the advancements, applications, and challenges associated with image processing in the field of SHM. The discussion encompasses various imaging techniques such as satellite imagery, Light Detection and Ranging (LiDAR), optical cameras, and other non-destructive testing methods. Key topics include the use of image processing for damage detection, crack identification, deformation monitoring, and overall structural assessment. This review explores the integration of artificial intelligence and machine learning techniques with image processing for enhanced automation and accuracy in SHM. By consolidating the current state of image-processing-based technology for SHM, this review aims to show the full potential of image-based approaches for researchers, engineers, and professionals involved in civil engineering, SHM, image processing, and related fields.

1. Introduction

For structural health monitoring (SHM), the integration of image-processing techniques marks a significant evolution in how we perceive, assess, and maintain structural integrity. SHM is vital for ensuring the safety and longevity of infrastructure, which has traditionally relied on up-to-date sensor-based technology where finding and repairing damage at an early stage could extend the lifespan of a structure [1,2]. Furthermore, the incorporation of advanced image processing into SHM presents a transformative shift, offering a nuanced and comprehensive approach to structural-condition assessment. These image-processing techniques leverage visual data obtained through a variety of imaging methods, including drones equipped with cameras and thermal and ultrasonic imaging [3,4,5]. They enable a detailed examination of structural damages, deformations, and alterations that might elude traditional sensor-based monitoring. This visual narrative not only identifies but also visualizes the extent and nature of structural changes, facilitating proactive maintenance strategies. The significance of integrating image-processing techniques into SHM lies in addressing inherent challenges encountered in conventional monitoring approaches. These techniques surpass the limitations of conventional sensors, particularly in detecting subtle or localized damage that might otherwise remain unnoticed. Moreover, they provide a visual context, enhancing our understanding of structural deformations and damages, thereby aiding in informed decision making regarding maintenance and repair strategies.

Regarding SHM, image-processing techniques encompass a diverse array of methodologies. These methodologies encompass various stages of analysis, including edge detection, texture analysis, and image registration [6,7,8]. Edge detection involves identifying boundaries within an image and highlighting structural features and discontinuities that may indicate potential damage or changes. Texture analysis focuses on characterizing the spatial arrangement of pixels, enabling the identification of patterns or anomalies in the structure’s surface. Image registration aligns and overlays multiple images of the same structure, allowing for precise comparisons and the detection of changes over time. Together, these techniques contribute to the comprehensive analysis of structural images in SHM, aiding in the early detection and monitoring of potential defects or structural deterioration. The utilization of the aforementioned techniques in SHM offers several distinct advantages. Firstly, they enable non-destructive evaluations, allowing for continuous monitoring without compromising the structural integrity of the system. Secondly, their detailed analysis of structural conditions empowers informed decision making concerning maintenance and repair strategies. The applications of these techniques span across industries, ranging from civil engineering to aerospace and mechanical systems, underscoring their universal relevance in safeguarding critical infrastructure.

The integration of image-processing techniques signifies a transformative phase in SHM, revolutionizing our ability to visualize, interpret, and respond to structural data. Its universal applicability across industries emphasizes its potential in ensuring the safety and durability of vital infrastructure. In this work, the authors have overviewed SHM, with a particular emphasis on the stages of image acquisition, image-processing techniques, and the integration of artificial intelligence (AI) for damage detection. This review of image acquisition elucidates the importance of capturing high-quality and relevant data for subsequent analysis. Subsequently, an in-depth examination of image-processing techniques highlights the pivotal role of edge detection, texture analysis, and image registration in enhancing the interpretability of structural images. Furthermore, the incorporation of AI in the damage-detection stage signifies a paradigm shift towards automated and efficient evaluation, offering a promising avenue for the real-time and accurate identification of structural anomalies.

2. Damage Types in Structural Health Monitoring

A wide array of damages can affect structures (Figure 1), necessitating specific monitoring methods for their detection and evaluation. One of the most prevalent types of damage is the emergence of cracks within structures [9]. These cracks can arise from various sources, including excessive loading, material fatigue, or harsh environmental conditions. Detecting these cracks often involves employing a combination of visual inspections [10], acoustic emissions [11], ultrasonic testing [12], or utilizing sensors that measure strain or deformation [13,14,15,16,17,18]. Similarly, corrosion poses a significant threat to structural integrity, gradually deteriorating materials due to environmental reactions. Effective monitoring against corrosion encompasses diverse methods such as the use of electrochemical sensors [19], corrosion-potential measurements [20], visual inspections [21], and other non-destructive testing techniques [22,23,24].

Another critical concern is fatigue damage, resulting from cyclic stress on materials, leading to cumulative microstructural damage and eventual failure [25,26]. Techniques for monitoring fatigue include the deployment of strain gauges [27], vibration analysis [28,29], and the ongoing assessment of changes in material properties over time [30,31]. Impact events can also inflict damage, causing localized structural issues. Detecting such impact damage involves various methodologies such as acoustic-emission methods [32,33,34,35] and employing non-destructive testing techniques like ultrasound [36] or thermography [37]. Deformation, encompassing changes in the structure’s shape or size beyond its elastic limits, requires vigilant monitoring. To detect and track deformations, sensors like strain sensors [38], displacement sensors [39], and monitoring systems capable of tracking changes in structural geometry are employed [40]. Furthermore, delamination, wear and erosion, material degradation, and foundation and settlement issues, as well as water intrusion, each present distinct challenges to structural integrity.

However, while image-processing techniques play a crucial role in detecting and assessing various types of damage in SHM, it is essential to acknowledge that not all damage types can be effectively addressed solely through image processing. Some forms of structural deterioration, such as internal material degradation, complex subsurface defects, or issues requiring specialized sensing methods, may fall beyond the scope of traditional image-processing applications. Certain damage types, like material fatigue or internal corrosion within the structure, may necessitate more specialized testing methods such as advanced sensing technologies, laboratory analyses, or non-optical methods like acoustic monitoring. Internal defects that are not visually apparent or confined to subsurface layers may require techniques like ultrasonic techniques [41] and Ground-Penetrating Radar (GPR) [42,43], which provide insights beyond the capabilities of traditional image processing.

Figure 1. Different types of damages for structures [44,45,46,47].Reprinted with permission from ref. [44]. Copyright 2019 John Wiley and Sons, Adapted form [45], Reprinted with permission from ref. [46]. Copyright 2023 Elsevier, Reprinted with permission from ref. [47]. Copyright 2019 John Wiley and Sons.

Figure 1. Different types of damages for structures [44,45,46,47].Reprinted with permission from ref. [44]. Copyright 2019 John Wiley and Sons, Adapted form [45], Reprinted with permission from ref. [46]. Copyright 2023 Elsevier, Reprinted with permission from ref. [47]. Copyright 2019 John Wiley and Sons.

3. Image-Acquiring Method for SHM

3.1. Drone Equipped with Camera

Drones equipped with high-resolution cameras have revolutionized various fields, including structural inspections and monitoring. These unmanned aerial vehicles (UAVs) offer a versatile and efficient means of capturing detailed imagery of structures that might otherwise be challenging to access. By leveraging these cameras mounted on drones, engineers and researchers can perform comprehensive SHM tasks. The aerial perspective provided by drones allows for the quick and thorough inspection of large areas, such as bridges, towers, or pipelines, offering detailed visual data for analysis. This approach not only enhances the safety of inspectors by reducing the need for risky physical access but also enables the collection of extensive and precise visual information, empowering better decision making for maintenance and ensuring the structural integrity of critical infrastructure. Research on using UAVs equipped with cameras can be found from various authors. Zhao et al. introduced a UAV-based 3D reconstruction model for dam emergency monitoring and inspection [48]. The structure-from-motion method (which is a photogrammetric range-imaging technique to estimate 3D structures using 2D image sequences that may be coupled with local motion signals) was adopted to create a high-precision 3D dam model. The results showed that the reconstruction model demonstrated satisfactory accuracy and substantially improved dam monitoring and inspection efficiency. Reagan et al. combined UAVs with a 3D digital image-correlation technique to perform non-contact, optically based measurements to monitor the health of bridges, where Zemuse H20T was installed onto the UAV for research, as shown in Figure 2 [49]. Results from the study show that the proposed method was able to detect changes to the bridge’s geometry with an uncertainty on the order of 10⁻⁵ m. Ding et al. proposed a UAV-based system for precise concrete-crack-detection and quantification without reference markers to quantify the cracks with widths less than 0.2 mm [50]. More research on using UAVs for acquiring images can be found by various authors [51,52,53,54,55,56].

3.2. Thermography

Thermography is a useful method for acquiring images in SHM which serves as a non-destructive and non-contact method, providing valuable information for the real-time assessment of the health and integrity of structures. This technique involves capturing and analyzing the infrared radiation emitted by the surface of an object. In the context of SHM, thermography helps identify temperature variations in structures, offering insights into potential issues such as delaminations, voids, or moisture ingress. Thermal imaging cameras, commonly used in thermography for SHM, detect infrared radiation and produce images known as thermograms or thermographic images. These images depict the temperature distribution on the surface of the monitored structure. Irregularities in temperature patterns can indicate areas of concern, prompting further investigation or maintenance. Hellstein and Szawedo integrated infrared cameras with 3D scanners to create 3D thermography to enable the creation of 3D thermograms where the temperatures were mapped [57]. The proposed concept was tested during the diagnosis of several industrial composite structures including boats, planes, and wind turbine blades. Zhang et al. established a remote sensing information-extraction method that combined UAVs and infrared thermal imaging technology to automatically detect the structural damage of buildings [58]. The proposed research work was verified using the earthquake search-and-rescue simulation as an example to show an accuracy of 78%. Here, the concept of thermography on the wall cracks of earthquake-damaged buildings can be seen in Figure 3, where a thermographic image can be seen on the right side of the figure. Thermography can also be used to identify damages in bridges, as Omar and Nehdi explored the potential application for detecting subsurface delamination in concrete bridge decks [59]. The findings reveal that a UAV with high-resolution thermal infrared imagery offers an efficient tool for precisely detecting subsurface anomalies in bridge decks. As proven by various researchers, thermography is one of the vital technologies for acquiring required images for SHM [60,61,62,63].

3.3. Light Detection and Ranging (LiDAR) Technology

LiDAR (Light Detection and Ranging) technology stands as a significant asset to SHM by employing laser light to measure distances and create detailed three-dimensional representations of structures. The principle of LiDAR operation involves emitting laser pulses towards a target surface, measuring the reflected light’s time of return, and generating accurate distance measurements. This process results in the creation of precise point clouds that effectively represent the external geometry of the structure. It excels in monitoring structural deformations in real-time, capturing dynamic responses such as vibrations, and identifying surface defects like cracks. LiDAR boasts several advantages, including high precision in measurements and a non-intrusive nature of data collection, eliminating the need for physical contact with the structure. This makes LiDAR suitable for monitoring various structures without causing any disruption. However, LiDAR has limitations to consider. Its capabilities are primarily surface-focused, and it may not capture details beneath surfaces. Additionally, weather conditions and visibility can influence the effectiveness of LiDAR data acquisition.

UAV equipped with a lidar scanner can be automated for damage detection. One of these research findings can be found in the work of Yan et al. [64], where the authors customized a UAV platform with a high-resolution camera and a Velodyne VLP-16 lidar scanner to scan a bridge’s substructure, validating the proposed method’s effectiveness in recognizing concrete cracks with 85% accuracy and quantifying them with less than 10% error compared to manual annotations and measurements. More work on automated damage detection, and one of the most researched target structures, bridges, can be found in various works [65,66,67,68,69,70,71,72,73]; an example of using lasers for crack detection can be seen in Figure 4 [69].

3.4. Ultrasonic Imaging

Ultrasonic imaging, a non-destructive testing technique, plays a crucial role in SHM by utilizing high-frequency sound waves to penetrate materials and generate detailed images of the internal structure. The fundamental principle involves sending ultrasonic waves into a material, measuring the reflected waves’ time, and producing images that highlight structural features and potential anomalies. In SHM applications, ultrasonic imaging is instrumental in detecting anomalies like cracks, voids, and delamination within structures [74,75,76,77,78,79,80,81,82]. Figure 5 shows the general concept of ultrasonic testing for concrete, involving the transmission of ultrasonic waves from a sender (transducer) through the concrete, the detection of reflected waves by a receiver (transducer), and the analysis of the received signals to identify and characterize the defects within the material [82]. It can provide valuable insights into material properties, aiding in the characterization of structural elements, and facilitates thickness measurement for assessing structural integrity.

The image-acquisition process involves deploying ultrasonic transducers on the structure’s surface or embedding them within. These transducers emit ultrasonic waves, and the reflections from interfaces, anomalies, or defects are recorded and processed to create visual representations of the internal structure. Ultrasonic imaging offers several advantages, including high-resolution images for detailed structural analysis and real-time monitoring capabilities that enable timely interventions and maintenance. However, it also has limitations, such as a limited penetration depth in certain materials and the requirement for accessibility to both sides of the material being inspected.

3.5. Ground-Penetrating Radar

Ground-Penetrating Radar (GPR) is a non-destructive imaging technique used to assess subsurface conditions and identify anomalies within structures. The fundamental principle involves emitting short pulses of electromagnetic waves into the structure or ground and recording the reflections that return from the subsurface materials. This process generates detailed images or profiles of the subsurface, offering a cross-sectional view of the internal structure. GPR serves various crucial applications. Firstly, it excels in the detection of anomalies, such as cracks, voids, or delamination within structures. Secondly, it aids in characterizing materials by assessing properties like changes in moisture content, which can significantly impact structural integrity. Moreover, GPR provides depth profiling, offering valuable information about the depth at which anomalies or structural features are located.

The image-acquisition process involves data collection, where GPR equipment transmits and receives electromagnetic pulses, recording the time taken for reflected signals to return; the general use can be seen in Figure 6 [83]. Subsequently, data-processing techniques are applied to create a subsurface profile, and skilled interpretation is crucial to identifying anomalies or structural characteristics. The processed data enables the real-time monitoring of subsurface conditions, facilitating timely interventions and maintenance strategies. GPR offers several advantages in SHM, including its non-destructive nature, allowing for assessments without causing harm to structures. The real-time monitoring capabilities contribute to proactive maintenance and structural-integrity management. However, GPR does have limitations, including depth constraints influenced by material properties and antenna frequency, as well as the need for skilled interpretation due to the complexity of the acquired images. To break these limitations, various authors have tackled the problem to enhance the technology [83,84,85,86,87,88,89,90].

3.6. Satellite Technology

Satellite technology employs various sensors to capture data related to structures and the surrounding environment. One key method is optical imagery, where satellites capture visible and infrared light reflected from the Earth’s surface. Optical sensors measure this reflected light, offering visual information about structures and environmental features. This method is widely used for visual assessment, monitoring changes over time, and identifying structural issues, applicable in diverse SHM contexts, including large-scale infrastructure and environmental monitoring [91,92,93].

Synthetic Aperture Radar (SAR) is another significant satellite-based technique. SAR utilizes microwave signals to penetrate cloud cover, detecting subtle deformations in structures and monitoring ground displacement. SAR is particularly valuable for monitoring large areas and regions with frequent cloud cover, making it applicable to diverse SHM applications [94,95,96,97]. In addition, Interferometric Synthetic Aperture Radar (InSAR) is an advanced technique analyzing interference patterns from multiple SAR images. InSAR is highly sensitive, capable of detecting millimeter-scale deformations in structures and monitoring ground subsidence. Its sensitivity makes it valuable for monitoring subtle changes in structures and landscapes, especially in applications such as infrastructure-stability assessment [98,99,100].

Satellite technology finds applications in SHM for large-scale monitoring, environmental impact assessment, and emergency response. Its advantages include wide coverage, enabling the monitoring of extensive infrastructures, remote sensing capabilities, and the ability to perform temporal analysis by capturing changes and trends in structural conditions over time. However, satellite imagery may have limitations such as lower spatial resolution compared to other imaging techniques, limiting the detection of small-scale details. Additionally, cost considerations and data accessibility, influenced by factors like cloud cover, may impact the availability of high-resolution satellite imagery. In summary, satellite technology is integral to SHM, providing a macroscopic view of structures and landscapes through optical, SAR, and InSAR techniques, with applications ranging from large-scale monitoring to environmental impact assessment and emergency response. (Figure 7).

4. Image-Processing Techniques for SHM

Image-processing techniques are crucial for extracting meaningful information from raw image data, enabling engineers and analysts to detect, analyze, and interpret structural health conditions accurately. Image processing involves techniques and methods used to manipulate, enhance, or analyze images. This includes tasks like noise reduction, edge detection, contrast enhancement, and segmentation, as image quality is often degraded due to factors including lighting conditions such as sunny or cloudy skies. In the context of damage identification for SHM, image-processing techniques are employed to pre-process images, enhance their quality, and extract relevant features or regions that might indicate damage or structural anomalies. For instance, edge detection might highlight cracks or structural discontinuities, while segmentation could isolate damaged areas for further analysis.

4.1. Edge Detection

Edge detection is a computer-vision technique that can be employed as part of the image-processing component in SHM to identify discontinuities or changes in the structure which may indicate damage. Edge-detection algorithms aim to identify boundaries or edges within an image. In the context of SHM, these edges may represent cracks, fractures, or other structural anomalies. One of the latest review works on using image-processing techniques for crack analysis in structures was conducted by Azouz et al. [98]. From their research, the authors reviewed image-processing algorithms to identify the crack and analyze its properties to detect occurred damages. Here, several preprocessing approaches were employed to predict crack propagation, which included image enhancement and image filtering to remove the noise and blur. An example of image processing can be seen in Figure 8, showing typical corner cracks observed in masonry walls around door openings [101]. The cracks are detected through canny and hyperbolic tangent filters, and one can see that it can identify cracks along with other edges and corners. It is a common technique for image processing, on which more work can be found by various researchers [101,102,103,104,105,106,107,108,109].

4.2. Texture Analysis

Texture analysis involves a sophisticated exploration of spatial variations in pixel intensities across structural images where various authors have used it to detect damage including bridges and concrete structures [110,111,112,113,114,115,116]. This nuanced approach employs a repertoire of computational methods to delve into the intricate details of surface textures. Gabor filters, for instance, are adept at capturing both fine and coarse textures by analyzing local spatial frequency contents. The Gray Level Co-occurrence Matrix (GLCM), on the other hand, offers insights into the statistical relationships among pixel values, providing a measure of homogeneity, contrast, and entropy [117,118]. Wavelet transforms enable a multi-scale analysis, unraveling textures at different frequency bands. The aim of these techniques is to discern unique patterns associated with materials, finishes, or potential damage within the structural components. This goes beyond conventional image processing by adding a layer of semantic understanding to the visual data. The quantitative features derived from texture analysis serve as essential inputs for subsequent machine learning algorithms, facilitating the automated detection and classification of structural conditions. By meticulously interpreting textural nuances, this approach enhances the precision of anomaly detection, making it a cornerstone in the proactive monitoring and assessment of structural health over time.

4.3. Image Registration

Image registration is a process that aligns two or more images, taken at different times or from different perspectives, to ensure that corresponding features in the images are spatially aligned [119,120,121,122,123]. This alignment is crucial for various applications, including remote sensing, medical imaging, computer vision, and structural health monitoring. The primary goal of image registration is to correct geometric distortions and differences in scale, rotation, and translation, allowing for accurate the comparison and analysis of the images. The process involves identifying corresponding points or features in the images and applying spatial transformations to bring them into alignment. This alignment can be achieved through various algorithms and mathematical techniques. Furthermore, this alignment is crucial for tracking changes, deformations, or damages in the structure over time. While image registration itself is not a direct method for crack detection, it facilitates the comparison of images that may reveal structural changes, including the presence of cracks. Thus, one can say that this method is particularly valuable when dealing with dynamic structures or monitoring structural changes over extended periods.

One common method for image registration in SHM is intensity-based registration [124,125,126]. This method often employs metrics like normalized cross-correlation or mutual information to align images based on pixel intensities. Normalized cross-correlation is particularly useful when the images have similar modalities, while mutual information is robust for cases where images are acquired using different modalities, such as combining visible and infrared imaging. In [124], the authors researched a hybrid approach given to an image-registration process that included the Random Sample Consensus (RANSAC) algorithm for the accurate assessment of remote sensing satellite images for image registration. The detected points and matched point pairs in both reference and slave image using SURF feature detectors are shown in Figure 9.

Another image-registration method is known as feature-based registration, which relies on identifying and matching distinctive features or key points in the images [127,128,129]. Point-based registration using algorithms like Scale-Invariant Feature Transform (SIFT) or Speeded-Up Robust Features (SURF) is common. These methods enable the identification of corresponding points between images, allowing for accurate alignment even in the presence of rotations or scale changes. Optical flow methods, such as the Lucas–Kanade method [130,131,132], estimate motion vectors between images, making them valuable for monitoring dynamic structural changes or vibrations. Geometric transformation methods, including B-spline registration or Thin-Plate Spline (TPS), offer flexibility for deformable registration, accommodating complex transformations.

4.4. Segmentation

Segmentation is a pivotal image-processing technique aimed at partitioning images of structures into distinct and meaningful regions. The primary objective is to identify and isolate specific structural components or features within the images, facilitating a detailed analysis of their conditions. Segmentation plays a crucial role in tasks such as crack detection, deformation monitoring, and material characterization, contributing to a comprehensive understanding of the structural health of monitored assets.

One common method employed for segmentation in SHM is thresholding [133,134,135,136]. This approach involves setting a threshold value to distinguish different regions based on pixel intensities. Global thresholding applies a uniform threshold across the entire image, while adaptive thresholding adjusts the threshold locally, enhancing adaptability to varying image conditions. Thresholding is particularly useful for applications where structural components exhibit distinct intensity differences, enabling the separation of different regions of interest. Another widely used method is edge-based segmentation, with the Canny Edge Detector being a prominent technique [137,138,139,140]. By identifying gradients and edges within an image, this method allows for the extraction of boundaries and the segmentation of regions based on changes in intensity. Edge-based segmentation is valuable for tasks like crack detection, where the presence of sharp intensity variations signifies potential structural issues.

Region growing is a method that entails the iterative expansion of regions from seed points based on similarity criteria [141,142]. This technique is beneficial when analyzing homogeneous regions with similar properties, contributing to accurate segmentation for tasks such as material characterization. Watershed segmentation is an approach inspired by hydrology, treating pixel intensities as elevations [143,144]. It simulates flooding to separate regions, making it suitable for delineating complex structural features. Furthermore, clustering methods, such as K-Means Clustering, involve grouping pixels into clusters based on their similarity in feature spaces [145,146,147]. This technique is versatile, applicable to various SHM tasks, and particularly useful when structural components exhibit different characteristics. Finally, the advent of deep learning has introduced convolutional neural networks (CNNs) for segmentation tasks in SHM [148,149,150,151]. These models, trained on large datasets, automatically learn hierarchical features, proving effective for complex segmentation tasks. A good review work on CNN-based SHM can be found in the work by Sony et al., whose potential future research is summarized in Figure 10 [149].

5. Artificial Intelligence for the Post-Processing of Image Data

Artificial intelligence (AI) techniques are applied to post-processing in SHM through training models on large datasets that contain labeled examples of various structural conditions [152,153,154]. The trained models learn patterns and relationships between features, enabling them to make informed decisions during post-processing. In the case of deep learning, neural networks automatically learn hierarchical representations of data, allowing for complex feature extraction and interpretation. These AI techniques enhance the automation, accuracy, and efficiency of the post-processing stage, contributing to a more advanced and sophisticated analysis of structural health.

5.1. Machine Learning

Machine learning-based Classification in SHM involves leveraging algorithms to automatically categorize the health status of structures based on extracted features from sensor data or images. Among the common methods used for SHM, Support Vector Machines (SVM) stand out for their ability to find optimal hyperplanes for binary or multiclass classifications, making them effective in distinguishing between healthy and damaged states. Random Forest, an ensemble learning technique, is employed to handle large datasets and enhance classification robustness, and is particularly useful in the complex and dynamic environment of SHM [155,156,157,158,159,160,161].

5.2. Pattern Recognition

Unlike machine learning, which represents specific methodologies within the broader scope of pattern recognition, the concept itself is not tied to particular algorithms. Instead, it encompasses a diverse array of techniques, including classical statistical methods, rule-based systems, and various learning-based approaches. The primary objective of pattern recognition is to enable systems to recognize and make sense of regularities or structures present in data, facilitating informed decision making based on observed patterns.

In SHM, pattern recognition plays a pivotal role in deciphering anomalies or deviations in structural behavior that may signify damage or deterioration. Common techniques for pattern recognition in SHM include Principal Component Analysis (PCA) for dimensionality reduction [162], cluster analysis to group similar patterns [163], Hidden Markov Models (HMM) for modeling sequential data [164], and Autoencoders for unsupervised feature learning [165,166]. Other methods such as Self-Organizing Maps (SOM) [167], Support Vector Machines (SVM) [168,169], and ensemble techniques like bagging and boosting also contribute to pattern recognition in SHM [170,171], aiding in the automatic identification of structural anomalies and providing valuable insights for maintenance and decision making. The choice of a specific method depends on factors such as the nature of the data, the complexity of structural conditions, and the requirements of the SHM application.

6. Current Limitations and Challenges in Image-Based SHM

In the domain of structural health monitoring (SHM), leveraging image-based techniques presents several challenges that influence the effectiveness and reliability of monitoring systems. One significant challenge lies in the complex interpretation of captured images, requiring the precise identification and categorization of various structural anomalies. Distinguishing between normal variations, environmental effects, and actual structural issues demands advanced image-analysis techniques and expert interpretation. Furthermore, the quality and resolution of captured images significantly influence the accuracy of damage detection and characterization. Limitations in image quality due to environmental factors, distance from the target, or equipment constraints might hinder the precise analysis and interpretation of structural conditions. The sheer volume of data generated by high-resolution images poses a practical challenge, necessitating efficient storage, transmission, and processing capabilities. Handling large datasets requires robust algorithms and computing resources to ensure timely and accurate analysis.

The real-time processing and monitoring of structures using image-based techniques remain demanding. Achieving rapid processing and the interpretation of images to detect emerging damage or changes in structural conditions is essential for proactive maintenance, yet it presents ongoing challenges in terms of computational speed and accuracy. The standardization and validation of image-based SHM techniques are essential for ensuring consistency and reliability across different monitoring systems. Establishing standardized protocols and benchmarks while validating these techniques against established methods remains a critical step for their widespread adoption and trust within the industry. Environmental variability poses a significant challenge in image-based SHM. Variations in lighting, weather conditions, or obstructions can impact image quality and consistency, making it challenging to ensure reliable and consistent monitoring.

Integrating image-based SHM with other sensor-based monitoring techniques for a comprehensive assessment of structural health requires synchronization, data fusion, and the creation of unified analysis frameworks. Achieving seamless integration while maintaining accuracy and reliability across different monitoring systems is a complex endeavor. The automation of image analysis using machine learning algorithms for SHM requires robust training datasets, sophisticated algorithms, and continuous improvement efforts to ensure high accuracy and reliability. Developing automated systems that can effectively process and interpret image data in real-time remains a significant challenge. The accessibility and deployment of imaging systems in various locations, especially in remote or inaccessible areas, present logistical challenges. Ensuring the accessibility, ease of installation, and reliability of imaging systems across diverse environments remains a crucial consideration.

Finally, the cost implications associated with implementing high-quality imaging equipment and advanced image-processing systems can be substantial. Striking a balance between costs and the effectiveness of image-based SHM is vital for its widespread adoption and practicality in real-world applications. Addressing these multifaceted challenges involves continual advancements in imaging technology, algorithm development, standardization efforts, and interdisciplinary collaboration. Overcoming these obstacles will enhance the capabilities and reliability of image-based SHM, ensuring the safety and longevity of critical infrastructure.

7. Conclusions

In conclusion, this review paper provides an overview of image-processing-based technologies for the structural health monitoring (SHM) of civil infrastructures. Through the exploration of various damage types that exist for structures, the discussion on image-acquisition methods for SHM, image-processing techniques utilized after acquiring the images, and the emerging role of artificial intelligence in post-processing image data, key insights have been reviewed in this work.

While image-processing techniques are pivotal for identifying and evaluating different types of damage within SHM, not all forms of structural deterioration can be found solely through image processing. Certain types of damage, like internal material degradation, intricate subsurface defects, or issues necessitating specialized sensing methods, may surpass the capabilities of conventional image-processing applications. Thus, the selection of appropriate image acquisition methods, whether using traditional cameras or advanced sensors like LiDAR, infrared or ultrasonic, significantly influences the quality and reliability of SHM data. Furthermore, the diverse spectrum of image-processing techniques, ranging from traditional filters to advanced algorithms like convolutional neural networks, offers a rich toolkit for analyzing and interpreting structural data accurately and efficiently. Recommendations include exploring hybrid approaches combining different techniques to maximize information extraction and improve detection accuracy.

In practical applications, image-processing-based SHM technologies find widespread use in various civil-engineering projects. From monitoring the structural integrity of bridges and tunnels to assessing the health of buildings and pipelines, these technologies play a pivotal role in ensuring the safety, reliability, and longevity of critical infrastructures.