Next Article in Journal
Analyzing the Impact of Responding to Joint Attention on the User Perception of the Robot in Human-Robot Interaction
Next Article in Special Issue
Visual System Inspired Algorithm for Enhanced Visibility in Coronary Angiograms (VIAEVCA)
Previous Article in Journal
Polyetheretherketone Double Functionalization with Bioactive Peptides Improves Human Osteoblast Response
Previous Article in Special Issue
Dual-Coated Antireflective Film for Flexible and Robust Multi-Environmental Optoelectronic Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Eye-Inspired Single-Pixel Imaging with Lateral Inhibition and Variable Resolution for Special Unmanned Vehicle Applications in Tunnel Inspection

1
School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
2
Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
3
The China Railway 12th Bureau Group Company, Ltd., Taiyuan 030027, China
4
Changchun University of Science and Technology, Changchun 130022, China
*
Author to whom correspondence should be addressed.
Biomimetics 2024, 9(12), 768; https://doi.org/10.3390/biomimetics9120768
Submission received: 28 October 2024 / Revised: 26 November 2024 / Accepted: 5 December 2024 / Published: 18 December 2024
(This article belongs to the Special Issue Advanced Biologically Inspired Vision and Its Application)

Abstract

:
This study presents a cutting-edge imaging technique for special unmanned vehicles (UAVs) designed to enhance tunnel inspection capabilities. This technique integrates ghost imaging inspired by the human visual system with lateral inhibition and variable resolution to improve environmental perception in challenging conditions, such as poor lighting and dust. By emulating the high-resolution foveal vision of the human eye, this method significantly enhances the efficiency and quality of image reconstruction for fine targets within the region of interest (ROI). This method utilizes non-uniform speckle patterns coupled with lateral inhibition to augment optical nonlinearity, leading to superior image quality and contrast. Lateral inhibition effectively suppresses background noise, thereby improving the imaging efficiency and substantially increasing the signal-to-noise ratio (SNR) in noisy environments. Extensive indoor experiments and field tests in actual tunnel settings validated the performance of this method. Variable-resolution sampling reduced the number of samples required by 50%, enhancing the reconstruction efficiency without compromising image quality. Field tests demonstrated the system’s ability to successfully image fine targets, such as cables, under dim and dusty conditions, achieving SNRs from 13.5 dB at 10% sampling to 27.7 dB at full sampling. The results underscore the potential of this technique for enhancing environmental perception in special unmanned vehicles, especially in GPS-denied environments with poor lighting and dust.

1. Introduction

In the realm of public safety and infrastructure maintenance, the deployment of special unmanned vehicles (UAVs) has become increasingly vital, particularly in GPS-denied environments such as tunnel inspection and bridge monitoring [1,2,3]. These operations, which are essential for public safety, require frequent and accurate assessments to ensure the integrity and safety of critical infrastructure. However, traditional imaging techniques often struggle in complex environments characterized by poor lighting and the presence of dust [1,4]. The constraints on the size and weight of imaging systems for unmanned vehicles further exacerbate these challenges, demanding a novel approach to optical imaging that is both compact and powerful [5].
Single-pixel imaging (SPI) has emerged as an innovative solution to these limitations, offering structural simplicity, resolution independence, and high sensitivity [6,7,8]. This technology is particularly adept at operating in low-light conditions, presenting a promising new path for enhancing the environmental perception capabilities of UAVs. To address the challenges faced in tunnel inspection, we have partnered with the China Railway 12th Bureau Group Company, Ltd., to develop an eye-inspired single-pixel imaging system with lateral inhibition and variable resolution. This system is designed to significantly enhance a vehicle’s environmental perception capabilities in challenging environments.
Our approach integrates variable-resolution imaging with lateral inhibition, aiming to improve the efficiency and quality of the image reconstruction of fine targets in practical applications. This technique mimics the human eye’s ability to concentrate high-resolution vision only in the region of interest, offering significant advancement in the field of imaging for unmanned vehicle navigation and inspection tasks. By emulating the high-resolution foveal vision of the human eye, this method significantly enhances the efficiency and quality of image reconstruction for fine targets within the region of interest (ROI). This method utilizes non-uniform speckle patterns coupled with lateral inhibition to augment optical nonlinearity, leading to superior image quality and contrast. Lateral inhibition effectively suppresses background noise, thereby improving the imaging efficiency and substantially increasing the signal-to-noise ratio (SNR) in noisy environments [2,9].
The concept of single-pixel imaging is not new; it has been explored extensively in the field of quantum imaging and has recently transitioned to classical computational imaging [6,10,11]. The unique advantage of GI lies in its ability to separate the detection of light from the formation of an image, allowing the use of a single-pixel detector and enabling high-speed, high-resolution imaging [12,13,14]. This is particularly beneficial in scenarios where the imaging environment is hostile or where the target is moving rapidly [7,8,15].
In this study, we present a cutting-edge imaging technique that integrates single-pixel imaging inspired by the human visual system with lateral inhibition and variable resolution to improve environmental perception in challenging conditions, such as those with poor lighting and dust. By emulating the high-resolution foveal vision of the human eye, this method significantly enhances the efficiency and quality of image reconstruction for fine targets within the region of interest (ROI). This method utilizes non-uniform speckle patterns coupled with lateral inhibition to augment optical nonlinearity, leading to superior image quality and contrast. Lateral inhibition effectively suppresses background noise, thereby improving the imaging efficiency and substantially increasing the signal-to-noise ratio (SNR) in noisy environments [2,9].
The structure of this paper is as follows: The subsequent section delves into the principle of our eye-inspired GI, detailing the theoretical underpinnings and the innovative aspects of our approach. We then describe the methods employed in our study, including the experimental setup and the protocol for data acquisition and analysis. The results section presents the findings from our indoor experiments and field tests, demonstrating the performance of our method under controlled conditions and in real-world tunnel scenarios. Finally, we conclude with a discussion of the implications of our results, the potential applications of this technology, and the future directions of our research.
Through this work, we aim to contribute a reliable imaging solution that enhances safety and efficiency in tunnel inspections and other applicable domains, marking a significant advancement over traditional imaging techniques. Our research underscores the potential of bio-inspired computational imaging to overcome the limitations of current technologies and to meet the demanding requirements of special unmanned vehicles in GPS-denied environments.

2. Methods

2.1. Principle

The principle of eye-inspired GI [16,17] is shown in Figure 1, in which the laser is triggered by the main board and illuminates the target through a beam expander. The light is then reflected from the target and modulated by the digital mirror device (DMD) [18,19]. The DMD is loaded with our pre-designed variable-resolution speckles. The square where the target object is located is modulated by a variable-resolution speckle. A single-pixel detector receives light for modulation [20,21]. Finally, the target image is reconstructed and displayed by performing a cross-correlation operation [22] between the light intensity signals and the light field information modulated by the DMD.
From the principle above, the marketable difference of our method is the use of non-uniform patterns combined with the feature of lateral inhibition. Therefore, the advantages of the proposed method include the following: (1) Enhanced Image Quality: The non-uniform speckle pattern increases the optical nonlinearity of the imaging system, which aids in capturing more details and contrast during the imaging process, thereby enhancing image quality. (2) Improved Imaging Efficiency: The lateral inhibition mechanism suppresses background noise and enhances the useful signal, thus improving the imaging efficiency of the system. (3) Improved noise resistance: The lateral inhibition mechanism helps reduce noise interference during the imaging process, particularly in complex or noisy imaging environments; thus, it can significantly enhance the SNR of the imaging.

2.2. Variable-Resolution Projection Pattern

In this study, a new variable-resolution projection pattern is used to replace the traditional fixed-resolution projection pattern. The design of this new pattern is inspired by the non-uniform distribution pattern of receptors on the retina of the human eye, where the projection area is divided into a high-resolution fovea region and a low-resolution marginal region. In the fovea region, we use the standard uniform high-resolution Cartesian sampling method, which avoids the oversampling problem that can occur when using log-polar coordinates in the central region. In the edge region, we use the logarithmic polar coordinate variable-resolution sampling technology, using the characteristics of this coordinate system to compress the image properly. With this design, we successfully simulated the imaging characteristics of the human eye, which provides a high-resolution image in the central area of the field of view and a low-resolution image in the peripheral area of the field of view.
The variable-resolution projection pattern consists of two parts, the foveal region and the edge region, as shown in Figure 2. Figure 2a shows a detailed enlarged view of the edge region; Figure 2b shows the entire variable-resolution projection pattern, including the foveal region and the marginal region; Figure 2c specifically shows the foveal area; Figure 2d shows the marginal region. In the fovea, high-resolution sampling is generated using the traditional Cartesian coordinate system, which avoids the oversampling problem that occurs when using log-polar coordinates in the fovea. The edges are based on a log-polar model that mimics the human eye. If r is used to represent the distance from the pixel point to the center point, then the outer boundary of the foveal region, that is, the ring with radius r0, belongs to the foveal region; and the part outside this ring is the edge region.
According to the difference between the polar diameter and the polar angle, the edge region can be divided into P rings; each ring has Q pixels. In the human-simulated log-polar model, let p and q represent the p-ring and QTH pixel, respectively; then, the variable-resolution structure of the edge region can be calculated by the following equations:
r p + 1 = r 1   ·   p = 1 + sin π Q 1 sin π Q r 1 = r 0 1 sin π Q θ q = q   · 2 π Q                       q = 1,2 , 3 Q ξ = l o g ε r p = l o g ε r 1 + p 1                       ( p = 1,2 , 3 P )
where rp represents the radius of the ring where the PTH ring pixel is located, θq represents the angle corresponding to the q pixel, and ε represents the growth coefficient between the rings.
The steps to achieve the variable-resolution projection pattern are as follows: First, set the radius of the foveal area r0 as a reference. Then, according to the distance between each pixel and the center point, the whole projection pattern is divided into the foveal region and the variable-resolution edge region. In the foveal region, we divide it evenly into Pf pixels according to the conventional method. For the variable-resolution edge region, we calculate the additional parameters required for generation according to specific constraints. For example, if the constraint is the number of pixels per ring Q, then we calculate the growth coefficient between rings ε, the radius of each ring rp, and the number of rings P based on this condition. Then, Formula (1) is used to generate Pp pixels of the edge region. Similarly, other required parameters can be calculated from the number of rings P. Finally, a complete variable-resolution projection pattern is obtained by merging the foveal region with the variable-resolution edge region.

2.3. The SPI with Variable Resolution and Lateral Inhibition

The core theoretical contribution of this method is the integration of variable resolution and lateral inhibition into a single-pixel imaging model. The model mimics the foveated vision of the human eye, where high-resolution imaging is reserved for the region of interest, whereas the periphery is imaged at a lower resolution [23,24]. Meanwhile, lateral inhibition is incorporated to enhance contrast and detail in the final image reconstruction. The image reconstruction based on the SPI pattern model of variable resolution and lateral inhibition includes six steps.
Step 1: Variable resolution modulation function
Variable Resolution Concept: Variable resolution adjusts imaging detail based on the importance of different areas within the field of view (FOV), with high resolution for the region of interest (ROI) and lower resolution for the peripheral areas. The modulation function M(x, y) is expressed as:
M x , y = e x p d 2 ( x , y ) 2 σ 2
where d(x, y) is the distance from point (x, y) to the center of the FOV, and σ is a decay parameter that controls the sharpness of the transition between high- and low-resolution areas.
Step 2: Modulation of the Speckle Pattern
Based on Step 1, the integration of the variable resolution P(x, y) is written as
P x , y = P 0 ( x , y ) · M ( x , y )
where P0(x, y) is the initial uniform speckle pattern and M(x, y) modulates this pattern based on the variable resolution requirement, thereby enhancing the resolution of the ROI.
Step 3: Application of Lateral Inhibition
We introduce the lateral inhibition function S(x, y), which is written as
S x , y =             i f   x , y   i s   i n   t h e   R O I o t h e r w i s e ε 1
where ε is a small positive number. This function is crucial for enhancing the contrast by reducing the effect of the peripheral region.
Step 4: Generation of the Detected Beam
The intensity of the detected beam’s intensity D(x, y) after passing through the target is given by
D x , y = P ( x , y )   · I x x ,   y y d x d y
where P(x′, y′) is the modulated speckle pattern that considers both variable resolution and lateral inhibition, and I(x′ − x, y′ − y) is the intensity distribution of the target.
Step 5: Calculation of the second-order correlation function
The second-order correlation function G2(τ) is used in the imaging process and is written as
G 2 τ = I r e f t I ( t + τ )
This function measures the correlation between the reference beam and the detected beam, which is influenced by the modulated speckle pattern.
Step 6: Image Reconstruction
I ( x , y ) G 2 τ · [ P 0 ( x + x ,   y + y ) · M ( x , y ) · S ( x , y ) ] × d x d y
The reconstructed image I′(x, y) is proportional to the integral of the product of the second-order correlation function and the complex conjugate of the modulated speckle pattern, which includes both variable-resolution and lateral inhibition effects.
From the above processes, by integrating the variable-resolution model more explicitly into the derivation, we enhance the clarity of how different areas within the FOV are treated based on their importance. This approach ensures that the ROI is imaged with a higher resolution and contrast, while peripheral areas are adjusted to reduce noise and interference, leading to a more effective single-pixel imaging technique.
According to the size of the region of interest and the region of non-interest, the log-polar model can be used to generate the spatial variable-resolution sampling structure with different position resolutions. By using the side suppression feature, the projection pattern can be optimized based on the boundary and detail characteristics of the obtained imaging results. In traditional ghost imaging, random speckles or stripes based on image transformation basis are used as projection patterns. However, the characteristics of the current imaging scene are not considered, especially for the low-contrast scene which is poorly imaged by the existing methods. The method proposed in this paper establishes the connection between the scene information and the projection pattern by combining the side suppression feature with the variable-resolution speckle and adaptively adjusts the projection pattern according to the characteristics of the current scene, which can effectively enhance the edge details and improve the contrast and image quality.

3. Experiments and Results

The experiments were designed to validate two critical aspects of the proposed method: the compression of redundant data and the ability to capture clear images under actual working conditions. To address these objectives, both indoor and field experiments were conducted. The indoor experiments utilized discrete optical components to validate the advantages of the compression of redundant data, whereas the field experiments were conducted in real tunnel scenarios to mimic real-world operational challenges.

3.1. Experimental Setup

In the indoor experiments, as shown in Figure 3, we assembled a high-performance system that corresponded to the components diagrammatically represented in the provided image. The heart of our setup was a pulse laser (①) from the DSS 1064 series of the CryLas laser system, selected for its stability and precision to ensure reliable light emission. This was complemented by a Vialux V7001 DMD (②), chosen for its 1024 × 768 resolution and 22 kHz micromirror flip rate, to generate and modulate speckle patterns. The DMD was securely mounted adjacent to the pulse laser, with light-shielding tape applied to prevent stray light interference. Our transmission optical component (③) consisted of a series of precision optical elements, such as lenses and beam shapers that direct and focus the speckle pattern onto the detection target (④) [25,26]. The targets, including triangular, circular, and square shapes, were fabricated using 3D printing technology to construct a 3D scene for imaging, simulating potential tunnel-inspection scenarios. The light reflected from the targets was directed to two single-pixel photodiodes (⑥) [16,27] via a beam splitter (⑤). The photodiode (Thorlabs’ PDA36E, Sorebo Optoelectronic Technology Shanghai, China), recognized for its high sensitivity and wide bandwidth, effectively captured the nuances of the light signals. All these components were mounted on custom 3D-printed bases to ensure accurate alignment. To manage the overall timing of the system, which is crucial for measuring the time intervals of the reflected light signals and facilitating the reconstruction of single-pixel images, we employed a field-programmable gate array (FPGA)-based time-to-digital converter (TDC) system. A data acquisition card (GaGe CSE22G8) was used to collect and digitize the analog signals from the photodiodes, which were then transferred to a computer for further processing and analysis. This comprehensive setup, with its carefully selected and integrated components, allowed us to effectively evaluate the variable-resolution imaging technique under controlled conditions, demonstrating its potential to enhance image quality, especially in capturing fine details within the ROI.
In the indoor experiments, we utilized a setup that included geometric targets, such as a triangular prism with a 10 cm side length, a circular disc with a 10 cm diameter, and a square prism with a 10 cm side length. These targets were strategically positioned 60 cm from the light source.
In the field experiments, we aimed to address the practical challenges of tunnel inspection by collaborating with the China Railway Twelve Bureau to develop a specialized integrated land and air inspection robot. The robot was designed to navigate and inspect the interior walls of tunnels according to pre-planned paths and to transmit the collected inspection data to a terminal for analysis by professionals. Given that the tunnels under inspection are not in their final state, the robot operates in harsh environments characterized by GPS signal blockage, dim lighting, and complex obstacles on the tunnel walls. These conditions make it difficult for the robot to avoid obstacles; the typical obstacles include wires, cables, and angle irons. In the experiments, we selected a cable of 0.5 cm as the target. While existing 3D imaging LiDAR can map the interior of a tunnel and roughly locate larger obstacles, it struggles to accurately image small, fine details; such imaging is crucial for precise localization. Additionally, the size, weight, and power consumption of current LiDAR systems make it challenging to integrate them directly into special unmanned vehicles. We focused on field experiments that imaged fine targets under actual working conditions to guide and enhance the environmental perception capabilities of special unmanned vehicles.
Taking into account the actual working environment, the typical walking distance of the UAVs from the beginning to the detection is 100 m, as shown in Figure 4. The arch height of the railway tunnel in China is different according to the actual situation; for example, the height from the rail surface to the arch of the railway tunnel of the Guiguan Line is 8.68 m. Meanwhile, according to the Design Code for High-Speed Railway Tunnels, it is required to be no less than 8 m, and 10 m is taken for the calculation. Therefore, the covering distance of the system prototype should be no less than 100.5 m. In order to complete the laboratory experiment, the system was integrated, as shown in Figure 3a, and the system test environment is shown in Figure 3b.
We carried out an infield experiment, in which the experimental equipment was placed inside the house; the specific location and system prototype are shown in Figure 5a,b. Two cables were placed 100 m away from the system; the test environment is shown in Figure 5c. The diameter of the cable was 0.5 cm, as shown in Figure 5d.
The prototype, as depicted in Figure 6c, integrates a 120 mm aperture catadioptric telescope for long-range single-pixel imaging of 100 m, enhancing the ability to detect small targets at a distance. Given the harsh conditions in a tunnel, such as dim lighting and the presence of dust, traditional imaging methods struggle to produce clear images. As shown in Figure 6b, even with a mobile phone flash at approximately 5 m, the visibility is significantly limited, and without illumination, as seen in Figure 6d, the cables are nearly indistinguishable to the naked eye. The core components of the rest of the system, including the pulse laser, DMD, and single-pixel detectors, are consistent with those used in our indoor experiments, ensuring a reliable baseline for comparison.

3.2. Results and Discussion

Our experiments aimed to validate the performance of the proposed eye-inspired variable-resolution single-pixel imaging technique under controlled indoor conditions and real-world field scenarios.

3.2.1. Data Compression Performance Verification (Indoor Experiments)

To compare the imaging effects, we used three basic geometric shapes: an equilateral triangle, a circle, and a square, each with a side length or diameter of 10 cm, placed at intervals of 8 cm and 14 cm from each other. The triangle was positioned 60 cm from the light source, covering the entire FOV, which was defined as the region of interest (ROI). We captured data with 2500 samples; the imaging results are shown in Figure 7, where (a) represents the reconstructed intensity maps at different distances, (b) shows the distance maps in different colors, and (c) presents a three-dimensional view.
Compared to the traditional uniform random speckle pattern reconstruction methods, our experiment applied a variable-resolution sampling technique, reducing the number of samples by half. This improvement demonstrates an increase in the reconstruction efficiency while maintaining the image quality, highlighting the potential of optimizing the reconstruction process in GI technology by adjusting the sampling strategy. When the distance between the triangular target and light source was increased to 100 cm, occupying only a part of the imaging FOV, we optimized the imaging effect by selecting the central area of the FOV as the ROI. By mimicking the retinal structure of the human eye, we generated a high-resolution speckle pattern in this area. The central area, with a radius of 42 pixels, was surrounded by five concentric circular rings, each containing 72 pixels, totaling 4432 pixels. The central region was filled with variable-resolution speckles, similar to the human eye, while the peripheral area was filled with random speckles. Even when the sample number was reduced to 1500, which was only 0.1 of the traditional uniform speckle sampling rates, the reconstructed image still achieved good quality, as shown in Figure 8. This result confirms that with an optimized speckle pattern, clear imaging results can still be obtained even at a reduced sampling ratio, thereby effectively verifying the characteristic of variable resolution in compressing redundant data.

3.2.2. Fine Target Imaging Capability Verification

Two cables were placed 100 m away from the system to image them, and the reconstruction quality was compared under different association times, as shown in Figure 9, which shows the system imaging SNR with the system sampling rate ranging from 10% to 100%. It can be seen from the figure that even if the sampling rate is reduced to 10%, the resulting image is still able to maintain a signal-to-noise ratio of up to 35 dB. This shows that even under the condition of a low sampling rate, the system constructed in this paper can still obtain high-quality images, so as to support the UAVs and help them to more accurately perceive the environment and avoid obstacles.
After verifying the feasibility of the system prototype at the simulated site, the system prototype was deployed to the actual application environment, and the site was selected as a section of closed tunnel in Xiongqin (Xiongan to Qinzhou), as shown in Figure 10. The goal is still to image the wire 100 m away from the system prototype; the diameter of the wire is 0.5 cm. The difference is that the tunnel environment is relatively dim, and because it is still in the construction stage, there is still a lot of dust inside, such test conditions are designed to simulate the challenges that may be encountered in practical applications, focusing on the imaging ability of small targets at a distance. Thus, the imaging advantage of this system in a complex environment is demonstrated.
From the experimental environment, it can also be seen that the bad environmental conditions put forward higher requirements for imaging technology. Factors such as lighting and dust in real application scenarios have a significant negative impact on image quality compared to simulation scenarios. In such an environment, it is often difficult for conventional imaging techniques to capture clear and accurate images, resulting in a limited ability to identify and analyze distant targets, as shown in Figure 6b,d.
As emphasized in the experimental preparation, traditional imaging methods struggle to discern the cable targets. Under the same test conditions, our prototype successfully imaged distant wires, demonstrating the ability to maintain a high imaging quality in environments that are both dimly lit and have poor clarity, as shown in Figure 11. The corresponding imaging results at sampling ratios of 10%, 30%, 50%, 70%, and 100% are presented, with quantitative results showing SNR ratios of 13.5 dB, 16.1 dB, 19.6 dB, 24.2 dB, and 27.7 dB, respectively. This experiment revealed that under low-light and dusty conditions, our method is more conducive to capturing images of fine targets.
By comparing the imaging results under different sampling ratios, we found that under low sampling ratio conditions, single-pixel imaging technology combined with variable-resolution sampling and lateral inhibition characteristics could provide higher SNR ratios and clearer images. For instance, in an actual tunnel environment, the imaging result at a 10% sampling ratio had an SNR ratio of 13.5 dB, whereas the result at a 100% sampling ratio had a ratio of 27.7 dB. The experiments demonstrated that, even under the dim conditions inside the tunnel, the prototype system could successfully reconstruct recognizable images, which is crucial for guiding robots to avoid obstacles. This capability not only verified the robustness of the system but also showed its good environmental adaptability in maintaining relatively clear imaging under extreme conditions.

4. Conclusions and Future Works

The experimental results validated the effectiveness of our proposed eye-inspired variable-resolution single-pixel imaging technique for enhancing the environmental perception in special unmanned vehicles (UAVs). This innovative approach, tested extensively in both controlled indoor settings and real-world tunnel scenarios, demonstrated its potential for practical applications. In particular, in GPS-denied tunnel environments with dim lighting and dust, the technique showed a significant improvement in the efficiency and quality of image reconstruction for fine targets. The integration of lateral inhibition was also successful in reducing noise and artifacts, resulting in cleaner image reconstruction.
In future work, the primary focus will be on conducting more comprehensive field tests to confirm the robustness of the system under diverse environmental conditions. There is a clear need to develop advanced image-processing algorithms to achieve real-time imaging capabilities and to integrate this imaging system with autonomous robots or unmanned aerial vehicles (UAVs) for automated inspection tasks. Aligning technology with industry standards and regulatory requirements is also a priority for expediting commercial deployment. Our goal is to develop this technology into a reliable tool that can improve safety and efficiency in tunnel inspection and other applicable areas. By providing clearer and more accurate images than traditional imaging techniques, we hope to help inspectors spot potential problems faster so they can take preventive measures to avoid possible accidents and delays.” This will mark an important advance in imaging technology, providing more efficient and safer solutions for a variety of inspection and monitoring tasks.

Author Contributions

Conceptualization, B.H. and J.C.; methodology, B.H.; software, Q.Z.; validation, Q.Z., B.H. and K.W.; formal analysis, J.C.; investigation, Y.S.; resources, Y.S.; data curation, Q.H.; writing—original draft preparation, M.S.; writing—review and editing, M.S.; visualization, Q.Z.; supervision, J.C.; project administration, K.W.; funding acquisition, Q.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Beijing Nature Science Foundation of China (4232014), National Natural Science Foundation of China (62275022).

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Conflicts of Interest

Kexin Wang was employed by the company The China Railway 12th Bureau Group Company, Ltd. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Chang, Y.; Cheng, Y.; Manzoor, U.; Murray, J. A review of UAV autonomous navigation in GPS-denied environments. Robot. Auton. Syst. 2023, 170, 104533. [Google Scholar] [CrossRef]
  2. Zhang, K.; Cao, J.; Zhang, F.H.; Jiang, Y.; Cheng, Y.; Wang, D.; Hao, Q. Fourier Single-pixel Imaging Based on Lateral Inhibition for Low-contrast Scenes. IEEE Photonics J. 2019, 11, 6901711. [Google Scholar] [CrossRef]
  3. Li, H.; Liu, Z.; Lyu, Y.; Wu, F. Multimodal Image Registration for GPS-denied UAV Navigation Based on Disentangled Representations. In Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023. [Google Scholar]
  4. Chen, Y.; Jiang, J. An Oblique-Robust Absolute Visual Localization Method for GPS-Denied UAV With Satellite Imagery. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5601713. [Google Scholar] [CrossRef]
  5. Wang, F.; Wang, C.; Chen, M.; Gong, W.; Zhang, Y.; Han, S.; Situ, G. Far-field super-resolution ghost imaging with a deep neural network constraint. Light Sci. Appl. 2022, 11, 1. [Google Scholar] [CrossRef]
  6. Baris, I.E.; Jeffrey, H.S. Ghost imaging: From quantum to classical to computational. Adv. Opt. Photon. 2010, 2, 405–450. [Google Scholar]
  7. Shi, M.; Cao, J.; Cui, H.; Zhou, C.; Zhao, T. Advances in Ghost Imaging of Moving Targets: A Review. Biomimetics 2023, 8, 435. [Google Scholar] [CrossRef] [PubMed]
  8. Moodley, C.; Forbes, A. Super-resolved quantum ghost imaging. Sci. Rep. 2022, 12, 10346. [Google Scholar] [CrossRef] [PubMed]
  9. Phillips, D.B.; Sun, M.-J.; Taylor, J.M.; Edgar, M.P.; Barnett, S.M.; Gibson, G.M.; Padgett, M.J. Adaptive foveated single-pixel imaging with dynamic supersampling. Sci. Adv. 2017, 3, e1601782. [Google Scholar] [CrossRef] [PubMed]
  10. Lyu, M.; Wang, W.; Wang, H.; Wang, H.; Li, G.; Chen, N.; Situ, G. Deep-learning-based ghost imaging. Sci. Rep. 2017, 7, 17865. [Google Scholar] [CrossRef] [PubMed]
  11. Shapiro, J.H.; Boyd, R.W. The physics of ghost imaging. Quantum Inf. Process. 2012, 11, 949–993. [Google Scholar] [CrossRef]
  12. Li, W.; Hu, X.; Wu, J.; Fan, K.; Chen, B.; Zhang, C.; Hu, W.; Cao, X.; Jin, B.; Lu, Y.; et al. Dual-color terahertz spatial light modulator for single-pixel imaging. Light Sci. Appl. 2022, 11, 191. [Google Scholar] [CrossRef] [PubMed]
  13. Shapiro, J.H. Computational ghost imaging. Phys. Rev. A 2008, 78, 061802. [Google Scholar] [CrossRef]
  14. Jiang, H.; Zhu, S.; Zhao, H.; Xu, B.; Li, X. Adaptive regional single-pixel imaging based on the Fourier slice theorem. Opt. Express 2017, 25, 15118–15130. [Google Scholar] [CrossRef]
  15. Paniate, A.; Massaro, G.; Avella, A.; Meda, A.; Pepe, F.; Genovese, M.; D’Angelo, M.; Ruo-Berchera, I. Light-field ghost imaging. Phys. Rev. Appl. 2024, 21, 024032. [Google Scholar] [CrossRef]
  16. Edgar, M.P.; Gibson, G.M.; Padgett, M.J. Principles and prospects for single-pixel imaging. Nat. Photonics 2019, 13, 13–20. [Google Scholar] [CrossRef]
  17. Ryczkowski, P.; Barbier, M.; Friberg, A.T.; Dudley, J.; Genty, G. Ghost imaging in the time domain. Nat. Photonics 2016, 10, 167–170. [Google Scholar] [CrossRef]
  18. Vaz, P.G.; Amaral, D.; Requicha Ferreira, L.F.; Morgado, M.; Cardoso, J. Image quality of compressive single-pixel imaging using different Hadamard orderings. Opt. Express 2020, 28, 11666–11681. [Google Scholar] [CrossRef] [PubMed]
  19. Han, S.; Yu, H.; Shen, X.; Liu, H.; Gong, W.; Liu, Z. A Review of Ghost Imaging via Sparsity Constraints. Appl. Sci. 2018, 8, 1379. [Google Scholar] [CrossRef]
  20. He, R.; Weng, Z.; Zhang, Y.; Qin, C.; Zhang, J.; Chen, Q.; Zhang, W. Adaptive Fourier single pixel imaging based on the radial correlation in the Fourier domain. Opt. Express 2021, 29, 36021–36037. [Google Scholar] [CrossRef]
  21. Wang, G.; Zheng, H.; Tang, Z.; Zhou, Y.; Chen, H.; Liu, J.; He, Y.; Yuan, Y.; Li, F.; Xu, Z. All-Optical Naked-Eye Ghost Imaging. Sci. Rep. 2020, 10, 2493. [Google Scholar] [CrossRef] [PubMed]
  22. Khakimov, R.I.; Henson, B.M.; Shin, D.K.; Hodgman, S.S.; Dall, R.G.; Baldwin, K.G.H.; Truscott, A.G. Ghost imaging with atoms. Nature 2016, 540, 100–103. [Google Scholar] [CrossRef]
  23. Hao, Q.; Tao, Y.; Cao, J.; Tang, M.; Cheng, Y.; Zhou, D.; Ning, Y.; Bao, C.; Cui, H. Retina-like Imaging and Its Applications: A Brief Review. Appl. Sci. 2021, 11, 7058. [Google Scholar] [CrossRef]
  24. Graydon, O. Retina-like single-pixel camera. Nat. Photonics 2017, 11, 335. [Google Scholar] [CrossRef]
  25. Orange Kedem, R.; Opatovski, N.; Xiao, D.; Ferdman, B.; Alalouf, O.; Kumar Pal, S.; Wang, Z.; von der Emde, H.; Weber, M.; Sahl, S.J.; et al. Near index matching enables solid diffractive optical element fabrication via additive manufacturing. Light Sci. Appl. 2023, 12, 222. [Google Scholar] [CrossRef]
  26. Etchepareborda, P.; Moulet, M.-H.; Melon, M. Random laser speckle pattern projection for non-contact vibration measurements using a single high-speed camera. Mech. Syst. Signal Process. 2021, 158, 107719. [Google Scholar] [CrossRef]
  27. Chen, C.; Li, Z.; Fu, L. Perovskite photodetector-based single pixel color camera for artificial vision. Light Sci. Appl. 2023, 12, 77. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The principle of eye-inspired GI.
Figure 1. The principle of eye-inspired GI.
Biomimetics 09 00768 g001
Figure 2. Variable-resolution projection pattern structure diagram.
Figure 2. Variable-resolution projection pattern structure diagram.
Biomimetics 09 00768 g002
Figure 3. Indoor experimental setup. (a) The structure of the experiment; (b) the main components used in the indoor experiments.
Figure 3. Indoor experimental setup. (a) The structure of the experiment; (b) the main components used in the indoor experiments.
Biomimetics 09 00768 g003
Figure 4. Schematic diagram of the working distance of the inner wall of the robot tunnel. (a) Working distance diagram; (b) range of coverage.
Figure 4. Schematic diagram of the working distance of the inner wall of the robot tunnel. (a) Working distance diagram; (b) range of coverage.
Biomimetics 09 00768 g004
Figure 5. Setup of the infield experiment. (a) The location of the laboratory equipment; (b) enlarged view of the experimental setup; (c) the environment of the target object; (d) target object.
Figure 5. Setup of the infield experiment. (a) The location of the laboratory equipment; (b) enlarged view of the experimental setup; (c) the environment of the target object; (d) target object.
Biomimetics 09 00768 g005
Figure 6. Field experimental setup. (a) Specialized robot under working conditions. (b,d) are the target of cable under illumination and without illumination. (c) The prototype is displaced at the tunnel entrance.
Figure 6. Field experimental setup. (a) Specialized robot under working conditions. (b,d) are the target of cable under illumination and without illumination. (c) The prototype is displaced at the tunnel entrance.
Biomimetics 09 00768 g006
Figure 7. Traditional uniform-resolution random speckle 3D imaging results. (a) Reconstructed intensity map, (b) reconstructed distance map, and (c) 3D view.
Figure 7. Traditional uniform-resolution random speckle 3D imaging results. (a) Reconstructed intensity map, (b) reconstructed distance map, and (c) 3D view.
Biomimetics 09 00768 g007
Figure 8. Three-dimensional imaging results using eye-inspired variable-resolution speckle method. (a) Reconstructed intensity map, (b) reconstructed distance map, and (c) 3D view.
Figure 8. Three-dimensional imaging results using eye-inspired variable-resolution speckle method. (a) Reconstructed intensity map, (b) reconstructed distance map, and (c) 3D view.
Biomimetics 09 00768 g008
Figure 9. SNRs under different sampling ratios. The sampling ratios from ① to ⑤ were 10, 30, 50, 70, and 100%, respectively.
Figure 9. SNRs under different sampling ratios. The sampling ratios from ① to ⑤ were 10, 30, 50, 70, and 100%, respectively.
Biomimetics 09 00768 g009
Figure 10. A section of closed tunnel in Xiongqin (Xiongan to Qinzhou).
Figure 10. A section of closed tunnel in Xiongqin (Xiongan to Qinzhou).
Biomimetics 09 00768 g010
Figure 11. SNRs under different sampling ratios. The sampling ratios from ① to ⑤ were 10, 30, 50, 70, and 100%, respectively.
Figure 11. SNRs under different sampling ratios. The sampling ratios from ① to ⑤ were 10, 30, 50, 70, and 100%, respectively.
Biomimetics 09 00768 g011
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Han, B.; Zhao, Q.; Shi, M.; Wang, K.; Shen, Y.; Cao, J.; Hao, Q. Eye-Inspired Single-Pixel Imaging with Lateral Inhibition and Variable Resolution for Special Unmanned Vehicle Applications in Tunnel Inspection. Biomimetics 2024, 9, 768. https://doi.org/10.3390/biomimetics9120768

AMA Style

Han B, Zhao Q, Shi M, Wang K, Shen Y, Cao J, Hao Q. Eye-Inspired Single-Pixel Imaging with Lateral Inhibition and Variable Resolution for Special Unmanned Vehicle Applications in Tunnel Inspection. Biomimetics. 2024; 9(12):768. https://doi.org/10.3390/biomimetics9120768

Chicago/Turabian Style

Han, Bin, Quanchao Zhao, Moudan Shi, Kexin Wang, Yunan Shen, Jie Cao, and Qun Hao. 2024. "Eye-Inspired Single-Pixel Imaging with Lateral Inhibition and Variable Resolution for Special Unmanned Vehicle Applications in Tunnel Inspection" Biomimetics 9, no. 12: 768. https://doi.org/10.3390/biomimetics9120768

APA Style

Han, B., Zhao, Q., Shi, M., Wang, K., Shen, Y., Cao, J., & Hao, Q. (2024). Eye-Inspired Single-Pixel Imaging with Lateral Inhibition and Variable Resolution for Special Unmanned Vehicle Applications in Tunnel Inspection. Biomimetics, 9(12), 768. https://doi.org/10.3390/biomimetics9120768

Article Metrics

Back to TopTop