Search Results (16)

Corrosion in maritime ballast tanks is a major driver of maintenance costs and operational risks for maritime assets. Inspections are hampered by complex geometries, hazardous conditions, and the limitations of conventional methods, particularly visual assessment, which struggles with subjectivity, accessibility, and early detection, especially under coatings. This paper critically examines these challenges and explores the potential of Light Detection and Ranging (LiDAR) and Hyperspectral Imaging (HSI) to form the basis of improved inspection approaches. We discuss LiDAR’s utility for accurate 3D mapping and providing a spatial framework and HSI’s potential for objective material identification and surface characterization based on spectral signatures along a wavelength range of 400-1000nm (visible and near infrared). Preliminary findings from laboratory tests are presented, demonstrating the basic feasibility of HSI for differentiating surface conditions (corrosion, coatings, bare metal) and relative coating thickness, alongside LiDAR’s capability for detailed geometric capture. Although these results do not represent a deployable system, they highlight how LiDAR and HSI could address key limitations of current practices and suggest promising directions for future research into integrated sensor-based corrosion assessment strategies. Full article

We explore the use of smartphones to decode data transmitted from LEDs to smartphone cameras in visible light communication (VLC) applied to indoor positioning applications. The LEDs—modified to enable rapid on-off keying—transmit identification codes or optically encoded location data imperceptible to human perception. Equipped with a camera, the smartphone employs a single framed image to detect the presence of the luminaires in the image, decode their transmitted identifiers or locations, and determine the smartphone’s position and orientation relative to the luminaires. The camera captures and processes images continuously. The following fundamental issues are addressed in this research: (i) analyzing the camera parameters on smartphones that affect data decoding results; (ii) exploiting the rolling shutter effect of the CMOS image sensor to receive multiple bits of data encoded in the optical communication line with a single frame shot; (iii) advancing research in developing algorithms to process data from multiple LEDs simultaneously. We conduct experiments to evaluate and analyze feasibility, as well as the challenges of the design, through scenarios varying in distance, transmission frequency, and data length. Full article

Indoor Positioning Systems (IPSs) have multiple applications. For example, they can be used to guide people, to locate items in a warehouse and to support the navigation of Automated Guided Vehicles (AGV). Currently most AGVs use local pre-defined navigation systems, but they lack a global localisation system. Integrating both systems is uncommon due to the inherent challenge in balancing accuracy with coverage. Visible Light Position (VLP) offers accurate and fast localisation, but it encounters scalability limitations. To overcome this, this paper presents a novel Image Sensor-based VLP (IS-VLP) identification method that harnesses existing Light Emitting Diode (LED) lighting infrastructure to substitute both navigation and localisation systems effectively in the whole area. We developed an IPS that achieves six-axis positioning at 90 Hz refresh rate using OpenCV’s solvePnP algorithm and embedded computing. This IPS has been validated in a laboratory environment and successfully deployed in a real factory to position an operative AGV. The system has resulted in accuracies better than 12 cm for 95% of the measurements. This work advances towards positioning VLP as an appealing choice for IPS in industrial environments, offering an inexpensive, scalable, accurate and robust solution. Full article

Optical sensor arrays are widely used in obtaining fingerprints of samples, allowing for solutions of recognition and identification problems. An approach to extending the functionality of the sensor arrays is using a kinetic factor by conducting indicator reactions that proceed at measurable rates. In this study, we propose a method for the discrimination of proteins based on their oxidation by sodium hypochlorite with the formation of the products, which, in turn, feature oxidation properties. As reducing agents to visualize these products, carbocyanine dyes IR-783 and Cy5.5-COOH are added to the reaction mixture at pH 5.3, and different spectral characteristics are registered every several minutes (absorbance in the visible region and fluorescence under excitation by UV (254 and 365 nm) and red light). The intensities of the photographic images of the 96-well plate are processed by principal component analysis (PCA) and linear discriminant analysis (LDA). Six model proteins (bovine and human serum albumins, γ-globulin, lysozyme, pepsin, and proteinase K) and 10 rennet samples (mixtures of chymosin and pepsin from different manufacturers) are recognized by the proposed method. The method is rapid and simple and uses only commercially available reagents. Full article

In order to realize the cooperative localization of multi-unmanned platforms in the GNSS-denied environment, this paper proposes a collaborative SLAM (simultaneous localization and mapping, SLAM) framework based on image feature point matching. Without GNSS, a single unmanned platform UGV and UAV (unmanned ground vehicle, UGV; unmanned aerial vehicle, UAV) equipped with vision and IMU (inertial measurement unit, IMU) sensors can exchange information through data communication to jointly build a three-dimensional visual point map, and determine the relative position of each other through visual-based position re- identification and PnP (Perspective-n-Points, PnP) methods. When any agent can receive reliable GNSS signals, GNSS positioning information will greatly improve the positioning accuracy without changing the positioning algorithm framework. In order to achieve this function, we designed a set of two-stage position estimation algorithms. In the first stage, we used the modified ORB-SLAM3 algorithm for position estimation by fusing visual and IMU information. In the second stage, we integrated GNSS positioning and cooperative positioning information using the factor graph optimization (FGO) algorithm. Our framework consists of an UGV as the central server node and three UAVs carried by the UGV, that will collaborate on space exploration missions. Finally, we simulated the influence of different visibility and lighting conditions on the framework function on the virtual simulation experiment platform built based on ROS (robot operating system, ROS) and Unity3D. The accuracy of the cooperative localization algorithm and the single platform localization algorithm was evaluated. In the two cases of GNSS-denied and GNSS-challenged, the error of co-location reduced by 15.5% and 19.7%, respectively, compared with single-platform independent positioning. Full article

Robustness is a key factor for real-time positioning and navigation, especially for high-speed vehicles. While visible light positioning (VLP) based on LED illumination and image sensors is widely studied, most of the VLP systems still suffer from the high positioning latency and the image blurs caused by high-speed movements. In this paper, a robust VLP system for high-speed vehicles is proposed based on a deep learning and data-driven approach. The proposed system can significantly increase the success rate of decoding VLP-LED user identifications (UID) from blurred images and reduce the computational latency for detecting and extracting VLP-LED stripe image regions from captured images. Experimental results show that the success rate of UID decoding using the proposed BN-CNN model could be higher than 98% when that of the traditional Zbar-based decoder falls to 0, while the computational time for positioning is decreased to 9.19 ms and the supported moving speed of our scheme can achieve 38.5 km/h. Therefore, the proposed VLP system can enhance the robustness against high-speed movement and guarantee the real-time response for positioning and navigation for high-speed vehicles. Full article

Unpressurized aircraft circuits facilitate the initiation of electrical discharges in wiring systems, with consequent damage to related insulation materials and safety hazards, that can and have already caused severe incidents and accidents. Specific sensors and solutions must be developed to detect these types of faults at a very incipient stage, before further damage occurs. Electrical discharges in air generate the corona effect, which is characterized by emissions of bluish light, which are found in the ultraviolet (UV) and visible spectra. However, due to sunlight interference, the corona effect is very difficult to detect at the very initial stage, so the use of solar-blind sensors can be a possible solution. This work analyzes the feasibility of using inexpensive non-invasive solar-blind sensors in a range of pressures compatible with aircraft environments to detect the electrical discharges at a very incipient stage. Their behavior and sensitivity compared with other alternatives, i.e., an antenna sensor and a CMOS imaging sensor, is also assessed. Experimental results presented in this paper show that the analyzed solar-blind sensors can be applied for the on-line detection of electrical discharges in unpressurized aircraft environments at the very initial stage, thus facilitating and enabling the application of predictive maintenance strategies. They also offer the possibility to be combined with existing electrical protections to expand their capabilities and improve their sensitivity to detect very early discharges, thus allowing the timely identification of their occurrence. Full article

In this paper, we demonstrate a fiber-optic surface plasmon resonance (FO-SPR) biosensor based on image processing and back propagation (BP) neural network. The transmitted light of the FO-SPR sensor was captured by using visible (VIS) and near-infrared (NIR) CMOS sensors. The optical information related to the SPR effect was extracted from images based on grayscale conversion and an edge detection algorithm. To achieve accurate monitoring of refractive index (RI) changes, the grayscale means of the VIS and NIR images and the RGB summation of the edge-detected images were used as training and test inputs for the BP neural network. We verified the effectiveness and superiority of this sensing system by experiments on sodium chloride solution identification and protein binding detection. This work is promising for practical applications in standardized biochemical sensing. Full article

The South China Sea (SCS) is one of the most important fishery resource bases in the world. Marine fisheries, as a crucial component of regional food security and national revenue, raise wide concern about marine ecology, social-economic and political consequences at regional, national and local scales. The large-scale dynamic detection and analysis of fishing activity in the SCS is still unclear because of the accessibility of in-site data, finite automatic identification system (AIS) usage, complex geopolitics and poor additional data coverage. Nighttime light imagery (NTL) derived from low light imaging sensors and the popularity of light fishing in the SCS offers a unique way to unveil fishing activities and its dynamics. In this study, we proposed a set of algorithms for automatic detection of nighttime fishing activity and provided the first large-scale dynamic analysis of nighttime fishing activity in the SCS using monthly Visible Infrared Imaging Radiometer Suite (VIIRS) images between 2012 and 2019. The proposed method effectively minimized the spatio-temporal fluctuations in radiance values of background and their implications to ship detection by integrating high radiance gradient detection and local adaptive thresholding. Further, nighttime fishing activity trajectories were decomposed into trend and seasonal components by using Hilbert-Huang transformation (HHT) to accurately access general trends and the seasonality of nighttime fishing activity in the SCS. The typical subregions analysis, environmental driver analysis, correlation coefficient analysis and hot spot analysis were integrated to characterize the nighttime fishing activity. It appears that the nighttime fishing activity in the SCS exhibited spatio-temporal variability and heterogeneity and was shaped by policy and natural factors such as holidays, annual Chinese fishery moratoria in the Chinese Exclusive Economic Zone (EEZ) and seasonal tropical storm activity. Full article

Remotely sensed data can provide the basis for timely and efficient building damage maps that are of fundamental importance to support the response activities following disaster events. However, the generation of these maps continues to be mainly based on the manual extraction of relevant information in operational frameworks. Considering the identification of visible structural damages caused by earthquakes and explosions, several recent works have shown that Convolutional Neural Networks (CNN) outperform traditional methods. However, the limited availability of publicly available image datasets depicting structural disaster damages, and the wide variety of sensors and spatial resolution used for these acquisitions (from space, aerial and UAV platforms), have limited the clarity of how these networks can effectively serve First Responder needs and emergency mapping service requirements. In this paper, an advanced CNN for visible structural damage detection is tested to shed some light on what deep learning networks can currently deliver, and its adoption in realistic operational conditions after earthquakes and explosions is critically discussed. The heterogeneous and large datasets collected by the authors covering different locations, spatial resolutions and platforms were used to assess the network performances in terms of transfer learning with specific regard to geographical transferability of the trained network to imagery acquired in different locations. The computational time needed to deliver these maps is also assessed. Results show that quality metrics are influenced by the composition of training samples used in the network. To promote their wider use, three pre-trained networks—optimized for satellite, airborne and UAV image spatial resolutions and viewing angles—are made freely available to the scientific community. Full article

The Operational Linescan System (OLS) carried by the National Defense Meteorological Satellite Program (DMSP) can capture the weak visible radiation emitted from earth at night and produce a series of annual cloudless nighttime light (NTL) images, effectively supporting multi-scale, long-term human activities and urbanization process research. However, the interannual instability and sensor bias of NTL time series products greatly limit further studies of lighting data in time series with OLS. Several calibration models for OLS have been proposed to implement interannual corrections to improve the continuity and consistency of time series NTL products; however, due to the subjective factors intervention and insufficient automation in the calibration process, the interannual correction study of NTL time series images is still worth being developed further. Therefore, to avoid the involvement of subjective factors and to optimize the Pseudo-Invariant Features (PIF) identification, an interannual calibration model Pixel-based PIF (PBPIF) is proposed, which identifies PIF by pixel fluctuation characteristics. Results show that a PBPIF-based model can reduce subjective interference and improve the degree of automation during the NTL interannual calibration process. The calibration performance evaluation based on Total Sum of Lights (TSOL) and Sum of the Normalized Difference Index (SNDI) shows that compared to the traditional PIF-based (tPIF-based) and Ridgeline Sampling Regression based (RSR-based) models, the PBPIF-based one achieves better performance in reducing NTL interannual turbulence and minimizing the deviation between sensors. In addition, based on the corrected NTL time series products, pixel-level linear regression analysis is implemented to maximize the potential of the NTL resolution to produce global Light Intensity Change Coefficient (LICC). The results of global LICC can be widely applied to the detailed study of the characteristics of economic development and urbanization. Full article

In this paper, an online to offline (O2O) method based on visible light communication (VLC) is proposed, which is different from the traditional VLC with modulation and demodulation. It is a new VLC with modulation and recognition. We use RGB light emitting diode (RGB-LED) as the transmitter, and use Pulse Width Modulation (PWM) to modulate the signal to make it flicker at high frequency. Therefore, several features are created. At the receiver, the complementary metal-oxide-semiconductor (CMOS) image sensor is applied to our system to capture LED images with stripes. A convolution neural network (CNN) is then introduced in our system as a classifier. By offline training for the classifiers and online recognition of LED-ID, the scheme proposed could improve the speed of LED-ID (the unique identification of each different LED) identification and improve the robustness of the system. This is the first application of CNN in the field of VLC. Full article

Visible Light Positioning (VLP) is widely recognized as a cost-effective solution for indoor positioning with increasing demand. However, the nonlinearity and highly complex relationship between three-dimensional world coordinate and two-dimensional image coordinate hinders the good performance of image-sensor-based VLP. Therefore, there is a need to develop effective VLP algorithms to locate the positioning terminal using image sensor. Besides, due to the high computational cost of image processing, most existing VLP systems do not achieve satisfactory performance in terms of real-time ability and positioning accuracy, both of which are significant for the performance of indoor positioning system. In addition, the accurate identification of the ID information of each LED (LED-ID) is important for positioning, because if the LED-ID is not recognized well, the positioning can only be achieved in a particular positioning unit and cannot be applied to a large scene with many LEDs. Therefore, an effective image-sensor-based double-light positioning system is proposed in this paper to solve the above problems. We also set up relevant experiments to test the performance of the proposed system, which utilizes the rolling shutter mechanism of the Complementary Metal Oxide Semiconductor (CMOS) image sensor. Machine learning was used to identify the LED-ID for better results. Simulation results show that the proposed double-light positioning system could deliver satisfactory performance in terms of both the real-time ability and the accuracy of positioning. Moreover, the proposed double-light positioning algorithm has low complexity and takes the symmetry problem of angle into consideration, which has never been considered before. Experiments confirmed that the proposed double-light positioning system can provide an accuracy of 3.85 cm with an average computing time of 56.28 ms, making it a promising candidate for future indoor positioning applications. Full article

Visible light positioning (VLP) is a promising technology for indoor navigation. However, most studies of VLP systems nowadays only focus on positioning accuracy, whereas robustness and real-time ability are often overlooked, which are all indispensable in actual VLP situations. Thus, we propose a novel VLP method based on mean shift (MS) algorithm and unscented Kalman filter (UKF) using image sensors as the positioning terminal and a Light Emitting Diode (LED) as the transmitting terminal. The main part of our VLP method is the MS algorithm, realizing high positioning accuracy with good robustness. Besides, UKF equips the mean shift algorithm with the capacity to track high-speed targets and improves the positioning accuracy when the LED is shielded. Moreover, a LED-ID (the identification of the LED) recognition algorithm proposed in our previous work was utilized to locate the LED in the initial frame, which also initialized MS and UKF. Furthermore, experiments showed that the positioning accuracy of our VLP algorithm was 0.42 cm, and the average processing time per frame was 24.93 ms. Also, even when half of the LED was shielded, the accuracy was maintained at 1.41 cm. All these data demonstrate that our proposed algorithm has excellent accuracy, strong robustness, and good real-time ability. Full article

High-quality video observations are very much needed in underwater environments for the monitoring of several ecosystem indicators and to support the sustainable development and management of almost all activities in the ocean. Reliable video observations are however challenging to collect, because of the generally poor visibility conditions and the difficulties to deploy cost-effective sensors and platforms in the marine environment. Visibility in water is regulated by natural light availability at different depths, and by the presence of suspended particles, scattering incident light in all directions. Those elements are also largely variable in time and space, making it difficult to identify technological solutions that can be used in all conditions. By combining state-of-the-art “time of flight” (ToF) image sensors and innovative pulsed laser illumination, we have developed a range-gated camera system (UTOFIA) that enables affordable and enhanced 3D underwater imaging at high resolution. This range-gated solution allows users to eliminate close-range backscattering, improving quality of the images and providing information on the distance of each illuminated object, hence giving access to real-time 3D measurements. Furthermore, as the system is based on pulsed laser light, it is almost independent of natural light conditions and can achieve similar performances at an extended depth range. We use this system to collect observations in different oceanographic conditions and for different applications, including aquaculture monitoring, seafloor mapping, litter identifications and structure inspection. Performances are evaluated by comparing images to regular cameras and by using standard targets to assess accuracy and precision of distance measurements. We suggest that this type of technology can become a standard in underwater 3D imaging to support the future development of the ocean economy. Full article