Next Article in Journal
Exploring the Socio-Demographic Profile of Non-Completion in Public Oral Healthcare Services: A Cross-Sectional Study in Melbourne, Victoria
Previous Article in Journal
MIRA-ChatGLM: A Fine-Tuned Large Language Model for Intelligent Risk Assessment in Coal Mining
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A LiDAR-Based Backfill Monitoring System

1
State Key Laboratory for Fine Exploration and Intelligent Development of Coal Resources, China University of Mining and Technology, Xuzhou 221116, China
2
Key Laboratory of Geotechnical and Underground Engineering, Department of Geotechnical Engineering, Ministry of Education, Tongji University, Shanghai 200092, China
3
School of Resources and Safety Engineering, Central South University, Changsha 410083, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(24), 12073; https://doi.org/10.3390/app142412073
Submission received: 22 July 2024 / Revised: 12 December 2024 / Accepted: 17 December 2024 / Published: 23 December 2024

Abstract

:
A backfill system in underground mines supports the walls and roofs of mined-out areas and improves the structural integrity of mines. However, there has been a significant gap in the visualization and monitoring of the backfill progress. To better observe the process of the paste backfill material filling the tunnels, a LiDAR-based backfill monitoring system is proposed. As long as the rising top surface of the backfill material enters the LiDAR range, the proposed system can compute the plane coefficient of this surface. The intersection boundary of the tunnel and the backfill material can be obtained by substituting the plane coefficient into the space where the initial tunnel is located. A surface point generation and slurry point determination algorithm are proposed to obtain the point cloud of the backfill body based on the intersection boundary. After Poisson surface reconstruction and volume computation, the point cloud model is reconstructed into a 3D mesh, and the backfill progress is digitized as the ratio of the backfill body volume to the initial tunnel volume. The volumes of the meshes are compared with the results computed by two other algorithms; the error is less than 1%. The time to compute a set of data increases with the amount of data, ranging from 8 to 20 s, which is sufficient to update a set of data with a tiny increase in progress. As the digitized results update, the visualization progress is transmitted to the mining control center, allowing unexpected problems inside the tunnel to be monitored and addressed based on the messages provided by the proposed system.

1. Introduction

As a key method in underground mining, cemented paste backfill involves mixing tailings, water, and cement into a slurry, which is then transported through pipelines to fill mined-out tunnels, providing essential ground support [1]. A retaining wall is often constructed to contain the backfill, allowing the slurry to harden in a controlled area, thereby reinforcing the surrounding rock and ensuring safe operations [2]. A nonstop backfill process is crucial, as overfilling, rapid filling, or poor curing can lead to accidents, property damage, production losses, or operational shutdowns [3].
In this regard, various research studies have been implemented to monitor the filling condition and guarantee a better filling effect. A comprehensive monitoring system, including total earth pressure cells, water pressure/suction cells, electromagnetic transducers, etc., was utilized to study poorly understood phenomena such as stress arching within the backfill mass, temperature-induced stresses, and the retaining wall pressure reduction with increasing setback from the stope [4]. In regard to the retaining wall, the in-stope pressure monitoring instrument for the retaining wall has been deployed to determine the relationship between the rise rate of cemented paste backfill and the moderating effect of cement hydration on in situ pressures [5]. Inside the backfill material, roof subsidence sensors and stress sensors were installed during coal mining and backfilling to monitor the variations in subsidence and stress, thus the stress distribution in the coal mine gob was analyzed [6]. To investigate the variation law of the stope backfill strength along the flow direction of the slurry, the VS150 three-dimensional laser scanner was used to scan the final flowing track of slurry 28 days after the completion of the backfill process [7]. In the wider area, Zhang et al. [8] conducted field monitoring of cemented paste backfill in an underground coal mine, including measurements of temperature, humidity, stress conditions inside the backfill body, and displacement. This provides guidance for backfilling design and predictions of surface subsidence in underground mines. Backfill grouting is also generally used to limit the ground surface settlement induced by shield tunneling, which also provides valuable guidance for backfill monitors in underground mines. Ground-penetrating radar (GPR) was employed in a shield tunneling machine to monitor the thickness and volume of the grouting layer, successfully detecting several defects [9,10]. In recent years, advanced technologies such as intelligent sensors and artificial intelligence have been used to detect subsidence and assess the stability of backfill bodies, making backfill monitoring safer and more efficient [11,12,13,14].
However, former studies on backfill monitors, as highlighted earlier, have primarily focused on the physical and mechanical parameters during the backfill process detected using different types of sensors, with the aim of ensuring a stable backfill system; nevertheless, methods for monitoring backfill progress are still insufficient. In general mining operations, the methods for monitoring the backfill progress are often rudimentary. These typically involve using indirect indicators like the rate of material usage and pumping pressure. Without advanced sensors or real-time data monitoring, miners rely on experience, occasional sampling, or manual gauges to estimate when the backfill process is nearing completion. If there were a way to digitize and visualize the backfill progress, we could monitor the process more intuitively, identify issues in a timely manner, prevent the waste of backfill materials, and reduce costs.
Among the methods for digitizing and visualizing three-dimensional scenes, LiDAR sensors and related technologies have rapidly developed in recent years, driven by the surge in autonomous driving applications [15]. LiDAR emits laser beams into the surrounding environment and receives the reflected laser signals. By measuring the round-trip time of the laser, it can determine the position and shape of objects in three-dimensional space. These data are compiled into a point cloud, which is a collection of points distributed in space. Through a series of point cloud processing algorithms, the scene can be modeled with high precision [16,17]. In underground structures, where dust concentration is high and light conditions are poor, traditional visual monitoring schemes are not suitable. LiDAR is not sensitive to ambient light brightness and has strong anti-interference capabilities, making it widely used in underground environments. Methods for processing chronological LiDAR data obtained in underground tunnels typically involve comparing the latest scan with previous ones to identify and calculate tunnel deformations [18,19,20,21,22,23]. LiDAR can be used to estimate the volume of blasted rock [24] and load volume in trucks [25,26] by adding the top surface of materials scanned by LiDAR to the container boundaries.
In this work, LiDAR technology was applied to obtain the three-dimensional spatial form of the backfill process. To digitize and visualize backfill progress, a simulation environment of the paste backfill process was constructed using CARLA, a flexible and open-source simulator designed for autonomous driving research, allowing for the customization of sensor suites and environmental conditions [27]. Algorithms to compute the backfill progress were tested within this simulation environment, and a LiDAR-based backfill monitoring system was designed and assembled to perform the aforementioned functions.

2. Materials

2.1. Mechanism of Fundamental Devices

The proposed system workflow relies on the point cloud data obtained from LiDAR scanners. Equation (1), typically used by LiDAR to calculate the distance of each point, is based on the principle of measuring the round-trip time of light [28]. On account of the distance of each point calculated using Equation (2), the coordinate of one of the points scanned by LiDAR is illustrated in Figure 1.
d = c · t 2
x = d · cos ( ϕ ) · sin ( θ ) y = d · cos ( ϕ ) · cos ( θ ) z = d · sin ( ϕ )
where d represents the distance from the point to the LiDAR, θ is the horizontal scanning angle, ϕ is the vertical scanning angle, and x , y , z are the coordinates of the point in three-dimensional space.
A point cloud is a collection of points scanned by LiDAR in three-dimensional space. Given the need for rapid processing and computation of complex point cloud data, designing a device that integrates LiDAR technology with an NUC (next unit of computing, a minicomputer developed by Intel) mainboard is crucial for achieving a semi-autonomous monitoring process. Unlike open-pit scenes, underground mine tunnels present unique challenges with their winding paths, limited visibility, and simple geometric features. Additionally, the working conditions within underground mines are characterized by high temperatures and pressures [29]. From the perspective of security and efficiency, a explosion-proof, multi-functional backfill monitor based on LiDAR technology was designed and assembled.

2.2. LiDAR-Based Backfill Monitor

The LiDAR-based backfill monitor consists of two primary components, the LiDAR and the main body case, as shown in Figure 2. The LiDAR is connected to the main body casing via a swivel component, which is used to fine-tune the positioning angle in complex installation environments. The main body casing features an explosion-proof design, comprising a power port, a power switch, and a Type-C port. Additionally, a mainboard removed from the NUC is fixed at the center of the casing. A single external power source can supply power to both the LiDAR and the NUC mainboard simultaneously by simply pressing the power switch. The LiDAR collects point cloud data, which are then transmitted via an Ethernet cable to the NUC mainboard for processing. To minimize costs while maximizing operational efficiency and quality, an Intel NUC-11 (manufactured by Intel Corporation, Santa Clara, CA, USA) and Livox Mid-40 LiDAR (manufactured by Livox Technology Company, Shenzhen, China) were selected. Table 1 shows the basic parameters of the Mid-40 LiDAR.

3. Methods

The backfill progress is expressed as the volume of the backfill material divided by the volume of the initial tunnel (Equation (3)). Thus, the key to calculate the filling progress is to find the slurry surface, then reconstruct the mesh model of the intersection body, and estimate the volume of the filling body at every moment. The approach used in calculating the backfill progress is shown in Figure 3. As long as the backfill monitor remains open, these three steps will continue to cycle:
P = v m v t
Here, P represents the backfill progress, v m is the volume of the backfill material, and v t denotes the initial tunnel volume.
The following steps are used in this process:
(1) Slurry surface fitting involves applying the ICP (Iterative Closest Point, which aligns two point clouds by iteratively minimizing the distance between corresponding points) registration algorithm [30] to align the initial tunnel point cloud with the backfilling point cloud, and capturing the point cloud data representing the top surface of the backfill material. After completing step 1, the top surface is located and the point cloud of the surface boundary is obtained (see Section 3.1);
(2) Generate points of slurry surface, and determine which points belong to the slurry body. After completing step 2, the entire point cloud model of backfill body is obtained (see Section 3.2);
(3) Reconstruct the point cloud model into a 3D mesh, and compute the volumes of both the slurry body and the original tunnel in order to generate the backfill progress output (see Section 3.3).

3.1. Slurry Surface Fitting

Similar to methods that combine the top surface of the load and the truck bucket to estimate load volume, the backfill monitoring system estimates the volume by combining the backfill material with the space below its boundary [25,26]. Previous methods deployed LiDAR to scan the top surface of the trucks and directly used these data to reconstruct the load model. However, the slurry top surface remains nearly level over a large area according to the rheological properties of paste [31]. Instead of directly using the point cloud of the top surface, this method locates the entire slurry surface by using RANSAC (Random Sample Consensus, which fits models to data with outliers by randomly sampling subsets to find the best fit) algorithm to obtain the coefficients of the plane equation from data within the LiDAR range [32]. The coefficients indicate the location of the top surface in geometric space. This is equivalent to assuming that at locations far from the LiDAR, the head height remains the same as the rising slurry surface. The estimated volume would then represent the entire tunnel volume beneath the slurry top surface.
If the plane-fitting algorithm is directly used for the point cloud model, either the slurry plane needs to be screened out among a large numbers of fitted planes, or the fitting results are possibly not correct. Since the results of each LiDAR scan are stored in chronological order, which is closely related to the process of the rising backfill slurry, as long as the subsequent scans are compared with the initial scans, the rising slurry surface with a few noise points can be screened out, as follows:
The first ten scans are merged and named cloud_base. The subsequent point cloud models are merged by every ten scans and the merged model is named cloud_process. Each point in cloud_process is iterated and placed into the three-dimensional space of cloud_base. For each point in cloud_process, if there are fewer than three points from cloud_base within the surrounding spherical space defined by a radius threshold, this point in cloud_process should be classified as an outlier, so that the backfill slurry surface can be roughly screened out.
On the basis of the preliminary screening, the RANSAC algorithm can be used to accurately find the backfill slurry surface, and the coefficient of the slurry plane equation can be obtained. The intersection boundary of the backfill slurry surface and the tunnel can be obtained by substituting the coefficients of the plane equation back to the tunnel.

3.2. Slurry Points Determination and Generation

This step aims to generate the complete point cloud model of the backfill body, consisting of two main components.

3.2.1. Slurry Points Determination

Assume the plane equation of slurry surface is ax + by + cz + d = 0 and a point P (A, B, C) is not on the surface. The signed distance from point P to the surface is the result of substituting the coordinate of P to the plane equation. A positive value indicates that point P is on one side of the plane, while a negative value signifies it is on the opposite side. Therefore, points under the backfill slurry surface can be determined as follows:
In the two three-dimensional spaces divided by the slurry surface, it is crucial to select a point that consistently lies on the opposite side of the slurry points. The product of the signed distance from this point to the slurry surface and the signed distance from slurry points to the slurry surface must be negative. Since the Livox Mid-40 LiDAR always maintains itself as the origin, and the scanning space is a conical space in the positive direction of x-, y-, and z-axes, thus the point (−1, 100, 100) on the upper space above the slurry surface is selected. The procedure is illustrated in Figure 4.

3.2.2. Surface Point Generation Using the Moving Sampling Method

The process of 3D surface reconstruction creates a continuous 3D surface from a set of scattered 3D point data. It is necessary to ensure that the point cloud model is watertight, otherwise the void will cause the normal vector to be miscalculated, and the generated 3D grid model may not be watertight. However, according to the work in the previous section, substituting the coefficient of the plane equation into the tunnel point cloud model can only obtain the intersection boundary between the backfill slurry surface and the tunnel. However, there is no point on the slurry plane. Therefore, it is necessary to generate points on the slurry surface.
Since the front of the LiDAR scanning space is the positive direction of the x-axis, which is also the orientation of the tunnel, the moving sampling method can be used to generate plane point clouds according to this feature. First, the points with the maximum and minimum x values in the intersection boundary between the slurry surface and the tunnel are obtained, and named as x_max and x_min, respectively. Sampling points are arranged every certain distance from x_min to x_max. If there are more than two points on the intersection boundary equal to the x-coordinate of the sampling point, a line point cloud is uniformly generated on the line between the two farthest points between these points. By moving the sampling point from x_min to x_max according to the above method, a uniform point cloud covering the plane of the intersection boundary can be generated, as illustrated in Figure 5.

3.3. Backfill Progress Computation

Poisson surface reconstruction is to generate high-quality 3D surface models from a given set of disordered point cloud data [33]. By calculating the normal vector of the point set and applying the Poisson surface reconstruction algorithm, meshes of the tunnel and the backfill body are obtained, which can facilitate the subsequent backfill volume calculation and visual monitoring of the backfill progress.
The mesh is regarded as a tetrahedron composed of multiple triangular faces and the coordinate origin. The volume of each tetrahedron can be obtained through the following vector operations [34]:
V = 1 6 v 1 · v 2 × v 3
where v 1 , v 2 , v 3 are the coordinate vectors of the three vertices that define the tetrahedron.
When encoding all vertices of a mesh into triangles, the computer stores all the vertices sequentially in a list. Triangles are defined by vertex indices, which point to specific vertices in the list. For example, a triangle might be defined by the indices [0, 2, 5], indicating that it is composed of the 1st, 3rd, and 6th vertices in the vertex list. The order of the triangle vertices (clockwise or counterclockwise) determines the direction of the normal vector, which affects the orientation of the face. According to the right-hand rule, if the vertices of a triangle face are arranged clockwise, the face is oriented toward the origin, representing the front. The signed volume of tetrahedrons formed by the fronts and the origin are positive, and tetrahedrons formed by the backs and the origin are negative (Figure 6). By calculating the sum of the signed volumes of all tetrahedrons, the result is the volume of the entire mesh.

4. Experiment

A simulation environment is constructed based on the real-world workflow’s construction steps, device arrangement, and communication methods to replicate real-world conditions of the cemented paste backfill process in underground mines. The proposed methods for digitizing and visualizing the backfill progress are tested within this environment, and the results of each step are presented in this section.

4.1. The Operational System Workflow in Mines

The operational workflow of the proposed system applied in underground mines is illustrated in Figure 7. The initial information of the tunnel before backfill should be obtained by a technician before starting filling the tunnel with the backfill material. The LiDAR is used to scan the target tunnel from the top to the end, point cloud data are recorded and save as an ROS bag (a file format used for storing message streams in Robot Operating System [35]). The SLAM (Simultaneous Localization And Mapping) [36,37] technology is used to build the three-dimensional point cloud map of the tunnel. This initial map is detailed and precise, showcasing physical characteristics and arrangement of rocks. When the retaining wall is under construction, it is necessary to consider grooving the top of the wall to fix the backfill monitor. As the backfill material slowly enters the tunnel, the LiDAR begins operating.
The backfill 3D geometric model generated in the NUC can be stored in various digital formats, which can be directly imported and visualized in most 3D model processing software. After the three-dimensional model of the backfill body is obtained, the tunnel model and the slurry model are visualized with different marks and colors to visually display the backfilling situation. Based on the communication networks used in the mine where the backfill monitor is deployed, the calculation results are transmitted to the mining control center via LAN (Local Area Network), 5G, or WiFi [38,39,40]. Therefore, the control center can monitor the backfill progress and make corresponding control measures according to all kinds of emergencies.

4.2. Simulation Environment of Backfill

For tunnel paste backfill simulation, CARLA is not only necessary to edit the dynamic properties of the backfill body to simulate the backfill process, but also to build different lengths and shapes of tunnels to improve the generalization ability of the backfill monitoring model. The flexible environment editing capability in CARLA can meet the above requirements. The simulation environment of backfill is designed correspond to the on-site backfill scenario described in Section 4.1.
In CARLA, three different shapes (straight, slightly curvy, and curvy) of tunnels are chosen from the 3D model of an underground mine, the dip angle of each tunnel is 5°, and the selected filling length is about 170 m (Figure 8). The simulation represents an idealized scenario where the tunnel is not supported by any structures such as rock bolts or reinforcing mesh, and there are no backfill dams controlling the backfill process. First, retaining walls are placed at the bottom of the tunnels, and the tunnels are mapped by SLAM technology to obtain the initial point cloud data. Secondly, a new retaining wall is built at the entrance of each tunnel (Figure 9a), and a space on the top of the retaining wall is reserved for placing the LiDAR sensor(Figure 9b). A LiDAR sensor is set up that meets the basic parameters of the Livox Mid-40 LiDAR, and the measuring ranges of 100 m and 200 m are designed, respectively, to simulate application scenarios in various lengths of tunnels. Finally, three cuboids are placed beneath tunnels and edited to rise continuously (Figure 9a), simulating the process of filling the tunnel with slurry. Two cubes are placed in the surrounding rocks of each tunnel to construct correspondences for the registration algorithm. The diagram of LiDAR scans at three different times and the point cloud of the unfilled tunnel are shown in Figure 10. Obviously, the only change in the scanning area is the red slurry top surface, due to the fixed position of the LiDAR placement. By processing each LiDAR scan, the backfill progress of different periods can be calculated.
To improve the generalization ability of the filling monitoring model, different simulation environments are designed. Parameters of simulation environments are presented in Table 2. According to the mechanism of backfill progress computation and the experiment results, results are not affected by different dip angles. Therefore, only tunnels with a 5° dip angle are adopted.

4.3. Results of Each Step

According to the backfill progress computation workflow described in Section 3, the processing of a set of LiDAR scans includes three steps, representing one complete cycle of computing the current backfill progress. Algorithms were tested in the simulation environments of backfill (see Table 2), and results of LiDAR with ranges of 100 m were selected to illustrate the results of each step, as shown in Figure 11.
In step 1, the intersection boundary of the tunnel and the backfill slurry surface was extracted. For the purpose of improving the computing speed, the initial tunnel point cloud has been downsampled, making the intersection boundary sparser. As a result, the surface point cloud generated by the moving sampling method in step 2 is sparser, but this does not affect the subsequent surface reconstruction and volume calculation results. In step 3, the mesh of the filling body generated by Poisson surface reconstruction is illustrated above the point cloud result, which shows the filling condition inside the tunnel. Dragging the left mouse button allows for monitoring the filling progress from different angles, but the computation results are always oriented towards the user.
The computation results of step 3 are presented using the visualization tool Rviz [41]. The visualization results include the volume of the slurry and the initial tunnel and the division of slurry volume and tunnel volume. For each set of LiDAR scans processed, the slurry volume and backfill progress are updated.

4.4. Accuracy

An accurate method to measure the progress of the backfill process is not available, so the precision can be evaluated by comparing it with other approaches, such as Monte Carlo-based volume estimation [42] and Hexahedrization [43].
The Monte Carlo method can be used to estimate the volume of a point cloud by randomly sampling points in a defined bounding box and determining the proportion of points that fall within the point cloud. Here is a step-by-step outline of how it works:
(1) Define the Bounding Box Volume: Enclose the point cloud within a simple geometric shape with a known volume.
(2) Generate Random Points: Randomly generate a large number of points within the bounding volume.
(3) Count Points Inside: Check how many of the random points fall within the point cloud.
(4) Estimate Volume: Calculate the point cloud volume using Equation (5)
V TargetObject = lim n n InsidePoints N · V Box
The Hexahedrization method involves filling the model with a finite number of small hexahedra and then summing the volumes of all the hexahedra to obtain the volume of the model (Equation (6)). The steps are as follows:
(1) Define the bounding box, then divide the entire bounding box into hexahedral cells according to the provided hexahedral element dimensions.
(2) Perform planar cuts through the center of the bounding box along any axis and perpendicular to that axis, generating a series of cross-sections for the surface model.
(3) In each cross-section, calculate the volume of the hexahedra within the contour line of the model and sum them up.
V = i = 0 n v i
where v i is the volume of the i-th hexahedron, and n is the total number of hexahedra.
Given that the development of volume computation algorithms is relatively mature and the tunnel model is not particularly complex, the results from several methods are quite similar. Both of the results obtained using the methods described above show less than 1% difference compared to the result computed by the method in Section 3.3. On the premise of ignoring the errors generated by other steps, such as the low scanning accuracy of LiDAR and the low Poisson surface reconstruction accuracy, it can be seen that the accuracy of backfill monitor is high. By further upgrading each step in the backfill progress workflow, such as applying LiDAR sensors with a higher range and point rate, and optimizing the RANSAC and surface reconstruction algorithms, the overall accuracy could be improved.

4.5. Processing Speed

The time to process each set of scans in different LiDAR ranges is shown in Figure 12. Inside the slightly curvy tunnel, the top space of the retaining wall is larger than that of the other tunnels, causing the progress to end at around 80%. Additionally, the curvature of the tunnel causes the laser beam to be blocked, delaying the start of progress monitoring in such tunnels. While increasing the LiDAR range (e.g., to 200 m) can allow earlier detection of the slurry top surface, it remains constrained by obstructions at corners.
Overall, as the size of the backfill body increases, the time taken to process each set of scans becomes longer. The time is not affected by the curvature of tunnels, but the number of points in each LiDAR scan takes a toll of the processing speed. Nonetheless, the maximum time to process a set of scans is 20 s. For the straight tunnel with a volume of 8990 m3, there is up to a 0.006% increase in backfill progress within 20 s, based on a flow rate of 100 m3/h. Determining the critical flow velocity of the backfill mixture is crucial for accurately estimating the backfilling time [44]. In conclusion, the backfill monitor is sensitive, and is capable of capturing the rising slurry top surface and effectively monitoring the backfill progress.

5. Conclusions

A LiDAR-based backfill monitoring system was designed to monitor the process of slurry entering and filling the mined-out tunnel. LiDAR technology was used to obtain the constantly changing spacial distribution shape of the filling process. An NUC was connected to the LiDAR to compute the backfill progress and return the real-time processed results to the mining control center. The proposed system enables timely monitoring and precise visualization of backfill progress, demonstrating its feasibility and practicality.
A simulation environment of backfill was constructed. Different types of filling conditions were designed and recorded into ROS bags using a simulated LiDAR sensor. Because of the fixed LiDAR position, the only change in all of the LiDAR scans is the ever-rising top surface of the slurry. Therefore, the key to compute the backfill progress is to compute the volume of the growing backfill body.
To exploit this feature, outlier searching and the RANSAC plane-fitting algorithm were used to locate and screen out the top surface, which is recognized as the intersection boundary of the slurry top surface and the tunnel. After applying slurry points determination and the moving sampling method, the whole point cloud of backfill body was generated. By using Poisson surface reconstruction on the point cloud of the backfill body, the triangular mesh was obtained. The backfill progress was determined by computing the percentage of the slurry to the volume of the tunnel.
If the accuracy of LiDAR scanning and Poisson reconstruction algorithm are not considered, the error of volume calculation results compared with other methods is less than 1%. In the late stage of backfill, the large amount of point cloud data affects the processing speed of Poisson surface reconstruction and volume computation, resulting in the time to process one set of LiDAR scans to rise to around 45 s. According to the designed flow rate of the slurry, the maximum time to update the progress is less than the time needed for the progress to increase by 0.5%.
The backfill system in underground mining includes both tunnel and mined-out area backfilling. A key limitation of the proposed system is that a single LiDAR cannot capture the vast mined-out areas, even with a wide field of view. Multiple LiDAR sensors are required, and challenges in data transmission, fusion, and processing must be addressed.
Additionally, measurements for filling thick deposits with layered divisions can be a valuable consideration for future work. Layered backfilling allows for better control over material distribution and settling behavior, which can influence the accuracy of volume calculations and the overall progress monitoring. This approach could improve the robustness of backfill monitoring systems in complex mining environments.

Author Contributions

Conceptualization, X.X. and L.B.; methodology, X.X., L.B. and P.H.; software, L.B. and P.H.; validation, Z.H. and Z.Z.; formal analysis, Z.H. and Z.Z.; investigation, Z.H. and Z.Z.; resources, X.X.; data curation, Z.H. and Z.Z.; writing—original draft preparation, L.B. and P.H.; writing—review and editing, X.X., L.B. and P.H.; visualization, Z.H. and Z.Z.; supervision, X.X.; project administration, X.X.; funding acquisition, X.X. and L.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Key R&D Program of China, grant number 2023YFC2907305.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data supporting this study’s findings are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Li, Z.; Shi, X.; Chen, X. Effect of Rice Straw on Tensile Properties of Tailings Cemented Paste Backfill. Appl. Sci. 2022, 12, 526. [Google Scholar] [CrossRef]
  2. Skrzypkowski, K. 3D numerical modelling of the application of cemented paste backfill on displacements around strip excavations. Energies 2021, 14, 7750. [Google Scholar] [CrossRef]
  3. Karaoglu, K.; Yilmaz, E. Cemented paste backfill pressure monitoring and field testing. In Paste Tailings Management; Springer: Berlin/Heidelberg, Germany, 2017; pp. 195–214. [Google Scholar]
  4. Grabinsky, M. In situ monitoring for ground truthing paste backfill designs. In Paste 2010: Proceedings of the Thirteenth International Seminar on Paste and Thickened Tailings, Toronto, ON, Canada, 3–6 May 2010; Australian Centre for Geomechanics: Crawley, Australia, 2010; pp. 85–98. [Google Scholar]
  5. Thompson, B.D.; Bawden, W.F.; Grabinsky, M. In situ measurements of cemented paste backfill at the Cayeli Mine. Can. Geotech. J. 2012, 49, 755–772. [Google Scholar] [CrossRef]
  6. Li, M.; Zhang, J.; Wu, Z.; Sun, K. Calculation and monitoring analysis of stress distribution in a coal mine gob filled with waste rock backfill materials. Arab. J. Geosci. 2019, 12, 418. [Google Scholar] [CrossRef]
  7. Lu, H.; Zhang, S. Design of roof-contacted filling ratio and filling holes in the sublevel open stoping with subsequent filling method. Int. J. Min. Miner. Eng. 2017, 8, 265–279. [Google Scholar] [CrossRef]
  8. Zhang, X.; Zhao, J.; Xin, L.; Wang, K.; Pan, H. Monitoring and assessment of cemented paste backfill containing coal gangue and fly ash in an underground mine. Adv. Mater. Sci. Eng. 2021, 2021, 5946148. [Google Scholar] [CrossRef]
  9. Yu, Q.m.; Zhou, H.l.; Wang, Y.h.; Duan, R.x. Quality monitoring of metro grouting behind segment using ground penetrating radar. Constr. Build. Mater. 2016, 110, 189–200. [Google Scholar] [CrossRef]
  10. Zeng, L.; Zhou, B.; Xie, X.; Zhao, Y.; Liu, H.; Zhang, Y.; Shahrour, I. A novel real-time monitoring system for the measurement of the annular grout thickness during simultaneous backfill grouting. Tunn. Undergr. Space Technol. 2020, 105, 103567. [Google Scholar] [CrossRef]
  11. Nguyen, L.Q.; Le, T.T.T.; Nguyen, T.G.; Tran, D.T. Prediction of underground mining-induced subsidence: Artificial neural network based approach. Min. Min. Depos. 2023, 17, 45–52. [Google Scholar] [CrossRef]
  12. Wu, C.; Huang, H.; Zhang, L.; Chen, J.; Tong, Y.; Zhou, M. Towards automated 3D evaluation of water leakage on a tunnel face via improved GAN and self-attention DL model. Tunn. Undergr. Space Technol. 2023, 142, 105432. [Google Scholar] [CrossRef]
  13. Chang, K.; Zhao, Z.; Zhou, D.; Tian, Z.; Wang, C. Prediction of Surface Subsidence in Mining Areas Based on Ascending-Descending Orbits Small Baseline Subset InSAR and Neural Network Optimization Models. Sensors 2024, 24, 4770. [Google Scholar] [CrossRef] [PubMed]
  14. Huang, H.; Wu, C.; Zhou, M.; Chen, J.; Han, T.; Zhang, L. Rock mass quality prediction on tunnel faces with incomplete multi-source dataset via tree-augmented naive Bayesian network. Int. J. Min. Sci. Technol. 2024, 34, 323–337. [Google Scholar] [CrossRef]
  15. Roriz, R.; Cabral, J.; Gomes, T. Automotive LiDAR technology: A survey. IEEE Trans. Intell. Transp. Syst. 2021, 23, 6282–6297. [Google Scholar] [CrossRef]
  16. Behroozpour, B.; Sandborn, P.A.; Wu, M.C.; Boser, B.E. Lidar system architectures and circuits. IEEE Commun. Mag. 2017, 55, 135–142. [Google Scholar] [CrossRef]
  17. Raj, T.; Hanim Hashim, F.; Baseri Huddin, A.; Ibrahim, M.F.; Hussain, A. A survey on LiDAR scanning mechanisms. Electronics 2020, 9, 741. [Google Scholar] [CrossRef]
  18. Han, J.Y.; Guo, J.; Jiang, Y.S. Monitoring tunnel deformations by means of multi-epoch dispersed 3D LiDAR point clouds: An improved approach. Tunn. Undergr. Space Technol. 2013, 38, 385–389. [Google Scholar] [CrossRef]
  19. Xie, X.; Lu, X. Development of a 3D modeling algorithm for tunnel deformation monitoring based on terrestrial laser scanning. Undergr. Space 2017, 2, 16–29. [Google Scholar] [CrossRef]
  20. Yi, C.; Lu, D.; Xie, Q.; Xu, J.; Wang, J. Tunnel deformation inspection via global spatial axis extraction from 3D raw point cloud. Sensors 2020, 20, 6815. [Google Scholar] [CrossRef] [PubMed]
  21. Jiang, Q.; Zhong, S.; Pan, P.Z.; Shi, Y.; Guo, H.; Kou, Y. Observe the temporal evolution of deep tunnel’s 3D deformation by 3D laser scanning in the Jinchuan No. 2 Mine. Tunn. Undergr. Space Technol. 2020, 97, 103237. [Google Scholar] [CrossRef]
  22. Chen, B.; Zhao, Z.; Bi, L.; Wang, Z. RM2D: An automated and robust laser-based framework for mobile tunnel deformation detection. Undergr. Space 2025, 20, 241–258. [Google Scholar] [CrossRef]
  23. Cui, H.; Ren, X.; Mao, Q.; Hu, Q.; Wang, W. Shield subway tunnel deformation detection based on mobile laser scanning. Autom. Constr. 2019, 106, 102889. [Google Scholar] [CrossRef]
  24. Engin, I.C.; Maerz, N.H.; Boyko, K.J.; Reals, R. Practical measurement of size distribution of blasted rocks using LiDAR scan data. Rock Mech. Rock Eng. 2020, 53, 4653–4671. [Google Scholar] [CrossRef]
  25. Amorim, L.L.; Mutz, F.; De Souza, A.F.; Badue, C.; Oliveira-Santos, T. Simple and effective load volume estimation in moving trucks using lidars. In Proceedings of the 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Rio de Janeiro, Brazil, 28–31 October 2019; pp. 210–217. [Google Scholar]
  26. Pinto, M. Estimation and Visualization of the Truck Payload Volume and Distribution Using Internet of Things, Machine Learning and Augmented Reality. Ph.D. Thesis, University of British Columbia, Vancouver, BC, Canada, 2019. [Google Scholar]
  27. Dosovitskiy, A.; Ros, G.; Codevilla, F.; Lopez, A.; Koltun, V. CARLA: An open urban driving simulator. In Proceedings of the Conference on Robot Learning, PMLR, Mountain View, CA, USA, 13–15 November 2017; pp. 1–16. [Google Scholar]
  28. Liu, J.; Sun, Q.; Fan, Z.; Jia, Y. TOF lidar development in autonomous vehicle. In Proceedings of the 2018 IEEE 3rd Optoelectronics Global Conference (OGC), Shenzhen, China, 4–7 September 2018; pp. 185–190. [Google Scholar]
  29. Wagner, H. Deep mining: A rock engineering challenge. Rock Mech. Rock Eng. 2019, 52, 1417–1446. [Google Scholar] [CrossRef]
  30. Sharp, G.C.; Lee, S.W.; Wehe, D.K. ICP registration using invariant features. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24, 90–102. [Google Scholar] [CrossRef]
  31. Wu, A.; Ruan, Z.; Wang, J. Rheological behavior of paste in metal mines. Int. J. Miner. Metall. Mater. 2022, 29, 717–726. [Google Scholar] [CrossRef]
  32. Derpanis, K.G. Overview of the RANSAC Algorithm. Image 2010, 4, 2–3. [Google Scholar]
  33. Kazhdan, M.; Hoppe, H. Screened poisson surface reconstruction. ACM Trans. Graph. 2013, 32, 1–13. [Google Scholar] [CrossRef]
  34. Lien, S.l.; Kajiya, J.T. A symbolic method for calculating the integral properties of arbitrary nonconvex polyhedra. IEEE Comput. Graph. Appl. 1984, 4, 35–42. [Google Scholar] [CrossRef]
  35. Macenski, S.; Foote, T.; Gerkey, B.; Lalancette, C.; Woodall, W. Robot Operating System 2: Design, architecture, and uses in the wild. Sci. Robot. 2022, 7, eabm6074. [Google Scholar] [CrossRef]
  36. Taketomi, T.; Uchiyama, H.; Ikeda, S. Visual SLAM algorithms: A survey from 2010 to 2016. IPSJ Trans. Comput. Vis. Appl. 2017, 9, 16. [Google Scholar] [CrossRef]
  37. Xu, W.; Cai, Y.; He, D.; Lin, J.; Zhang, F. Fast-lio2: Fast direct lidar-inertial odometry. IEEE Trans. Robot. 2022, 38, 2053–2073. [Google Scholar] [CrossRef]
  38. Chen, M.; Zhang, J. The application of WiFi 6 technology in underground mine. IOP Conf. Ser. Earth Environ. Sci. 2021, 687, 012153. [Google Scholar]
  39. Zhang, L.; Yang, W.; Fang, W.; Jiang, Y.; Zhao, Q. Periodic Monitoring and Filtering Suppression of Signal Interference in Mine 5G Communication. Appl. Sci. 2022, 12, 7689. [Google Scholar] [CrossRef]
  40. Einicke, G.; Duff, E.; Reid, D.; Ralston, J.; Cunningham, J.; Hainsworth, D.; Roberts, J.M.; Corke, P. The application of wireless LANs in mine automation. In Proceedings of the Evans Conference-Creating the Virtual Enterprise-Leveraging Wireless Technology within Existing Business Models for Corporate Advantage, Sydney, Australia, 8–9 August 2002. [Google Scholar]
  41. Pütz, S.; Wiemann, T.; Hertzberg, J. Tools for visualizing, annotating and storing triangle meshes in ROS and RViz. In Proceedings of the 2019 European Conference on Mobile Robots (ECMR), Prague, Czech Republic, 4–6 September 2019; p. 1. [Google Scholar]
  42. Covre, N.; Luchetti, A.; Lancini, M.; Pasinetti, S.; Bertolazzi, E.; De Cecco, M. Monte Carlo-based 3D surface point cloud volume estimation by exploding local cubes faces. Acta IMEKO 2022, 11, 1–9. [Google Scholar] [CrossRef]
  43. Lin, B. Study of Key Technology of Platform of Digital Mining Software System; Central South University: Changsha, China, 2010. [Google Scholar]
  44. Skrzypkowski, K. Determination of the backfilling time for the zinc and lead ore deposits with application of the BackfillCAD model. Energies 2021, 14, 3186. [Google Scholar] [CrossRef]
Figure 1. Coordinate of one point scanned by LiDAR.
Figure 1. Coordinate of one point scanned by LiDAR.
Applsci 14 12073 g001
Figure 2. Backfill monitor.
Figure 2. Backfill monitor.
Applsci 14 12073 g002
Figure 3. Backfill progress computation workflow.
Figure 3. Backfill progress computation workflow.
Applsci 14 12073 g003
Figure 4. Slurry points determination.
Figure 4. Slurry points determination.
Applsci 14 12073 g004
Figure 5. Moving sampling method.
Figure 5. Moving sampling method.
Applsci 14 12073 g005
Figure 6. Calculation of signed volume.
Figure 6. Calculation of signed volume.
Applsci 14 12073 g006
Figure 7. System workflow.
Figure 7. System workflow.
Applsci 14 12073 g007
Figure 8. The overview map of the underground mine simulation environment: (a) lateral view; (b) top view. In the CARLA simulation environment, cuboids and retaining walls are used to restrict the LiDAR laser beams. Therefore, the size can be larger than in real-world conditions.
Figure 8. The overview map of the underground mine simulation environment: (a) lateral view; (b) top view. In the CARLA simulation environment, cuboids and retaining walls are used to restrict the LiDAR laser beams. Therefore, the size can be larger than in real-world conditions.
Applsci 14 12073 g008
Figure 9. Simulation of backfill progress: (a) external simulation environment before backfill; (b) internal simulation environment before backfill; (c) internal simulation environment of the earlier backfill process; (d) internal simulation environment of the later backfill process; (e) external simulation environment of the interim backfill process.
Figure 9. Simulation of backfill progress: (a) external simulation environment before backfill; (b) internal simulation environment before backfill; (c) internal simulation environment of the earlier backfill process; (d) internal simulation environment of the later backfill process; (e) external simulation environment of the interim backfill process.
Applsci 14 12073 g009
Figure 10. Diagram of point cloud data in the backfill monitor.
Figure 10. Diagram of point cloud data in the backfill monitor.
Applsci 14 12073 g010
Figure 11. Results of steps for a set of LiDAR scans in different tunnels: (a) results of each step in a straight tunnel; (b) results of each step in a slightly curvy tunnel; (c) results of each step in a curvy tunnel.
Figure 11. Results of steps for a set of LiDAR scans in different tunnels: (a) results of each step in a straight tunnel; (b) results of each step in a slightly curvy tunnel; (c) results of each step in a curvy tunnel.
Applsci 14 12073 g011
Figure 12. The time to process each set of scans: (a) results in the LiDAR range of 100 m; (b) results in the LiDAR range of 200 m.
Figure 12. The time to process each set of scans: (a) results in the LiDAR range of 100 m; (b) results in the LiDAR range of 200 m.
Applsci 14 12073 g012
Table 1. Basic parameters for the Livox Mid-40 LiDAR.
Table 1. Basic parameters for the Livox Mid-40 LiDAR.
ParameterSpecification
Laser Wavelength905 nm
Laser SafetyClass 1 (IEC60825-1)
90 m @ 10% reflectivity
Range130 m @ 20% reflectivity
260 m @ 80% reflectivity
FOV (Field of View)38.4° (circular)
Point Rate100,000 points/s
Operating Temperature−20 °C to 65 °C
Water and Dust RatingIP674
Supply Voltage Range10 to 16 V DC
Data Delay2 ms
Table 2. Simulation environments’ parameters.
Table 2. Simulation environments’ parameters.
Simulation EnvironmentCurvatureLiDAR Range
1#Straight100 m
2#Slightly curvy100 m
3#Curvy100 m
4#Straight200 m
5#Slightly curvy200 m
6#Curvy200 m
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xu, X.; Huang, P.; He, Z.; Zhao, Z.; Bi, L. A LiDAR-Based Backfill Monitoring System. Appl. Sci. 2024, 14, 12073. https://doi.org/10.3390/app142412073

AMA Style

Xu X, Huang P, He Z, Zhao Z, Bi L. A LiDAR-Based Backfill Monitoring System. Applied Sciences. 2024; 14(24):12073. https://doi.org/10.3390/app142412073

Chicago/Turabian Style

Xu, Xingliang, Pengli Huang, Zhengxiang He, Ziyu Zhao, and Lin Bi. 2024. "A LiDAR-Based Backfill Monitoring System" Applied Sciences 14, no. 24: 12073. https://doi.org/10.3390/app142412073

APA Style

Xu, X., Huang, P., He, Z., Zhao, Z., & Bi, L. (2024). A LiDAR-Based Backfill Monitoring System. Applied Sciences, 14(24), 12073. https://doi.org/10.3390/app142412073

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop