Next Article in Journal
An ISAR Image Component Recognition Method Based on Semantic Segmentation and Mask Matching
Next Article in Special Issue
Extraction and Application of Hydraulic Support Safety Valve Characteristic Parameters Based on Roof Pressure Data
Previous Article in Journal
The Influence of Visibility on the Opportunity to Perform Flight Operations with Various Categories of the Instrument Landing System
Previous Article in Special Issue
Preliminary Design and On-Site Testing Methodology of Roof-Cutting for Entry Retaining in Underground Coal Mine
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on the Three-Machines Perception System and Information Fusion Technology for Intelligent Work Faces

1
School of Mines, China University of Mining and Technology, Xuzhou 221116, China
2
Research Center of Intelligent Mining, China University of Mining and Technology, Xuzhou 221116, China
3
The 707th Research Institute of China State Shipbuilding Corporation Limited, Tianjin 300131, China
4
Tianjin Navigation Instruments Research Institute, Tianjin 300131, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(18), 7956; https://doi.org/10.3390/s23187956
Submission received: 20 August 2023 / Revised: 13 September 2023 / Accepted: 15 September 2023 / Published: 18 September 2023
(This article belongs to the Special Issue Recent Advances in Optical Sensor for Mining)

Abstract

:
The foundation of intelligent collaborative control of a shearer, scraper conveyor, and hydraulic support (three-machines) is to achieve the precise perception of the status of the three-machines and the full integration of information between the equipment. In order to solve the problems of information isolation and non-flow, independence between equipment, and weak cooperation of three-machines due to an insufficient fusion of perception data, a fusion method of the equipment’s state perception system on the intelligent working surface was proposed. Firstly, an intelligent perception system for the state of the three-machines in the working face was established based on fiber optic sensing technology and inertial navigation technology. Then, the datum coordinate system is created on the working surface to uniformly describe the status of the three-machines and the spatial position relationship between the three-machines is established using a scraper conveyor as a bridge so that the three-machines become a mutually restricted and collaborative equipment system. Finally, an indoor test was carried out to verify the relational model of the spatial position of the three-machines. The results indicate that the intelligent working face three-machines perception system based on fiber optic sensing technology and inertial navigation technology can achieve the fusion of monitoring data and unified expression of equipment status. The research results provide an important reference for building an intelligent perception, intelligent decision-making, and automatic execution system for coal mines.

1. Introduction

Since the release of the Guiding Opinions on Accelerating the Development of Intelligent Coal Mines, the coal industry has vigorously promoted the construction of intelligent coal mines with technological innovation as its core driving force. The proposal of the national double carbon strategy further promotes the construction of a multi-industry chain and multi-system integrated intelligent coal mining system in the coal industry, moving towards a modern mining path of green intelligence, safety, efficiency, and sustainable development [1,2]. The process of intelligent construction in coal mines generates a large amount of information and data, and new technological means are used for data fusion and analysis, which is in line with the national strategy of “building a digital China” and “adhering to innovation driven development” [3].
With the advancement of intelligent construction in coal mines, coal mine production has achieved the goal of reducing personnel in the working face and is moving towards the goal of fewer or even unmanned personnel [4,5]. The hydraulic support, scraper conveyor, and shearer (three-machines), as the core equipment of fully mechanized mining faces, have been equipped with basic attitude and position perception functions, and new technologies are constantly emerging and applied to the field of coal mining to help improve the state perception level of the three-machines.
Due to the harsh environment and technological limitations in coal mines, traditional methods, such as gear counting, ultrasonic reflection, and infrared reflection, are used to monitor coal mining machines, all of which have many problems [6]. Fang Xinqiu et al. [7] used the inertial navigation system to monitor the shearer, but also faced the problem of low accuracy. Fan Qigao et al. [8] created an error analysis model using the extended Kalman filter to improve the positioning accuracy of strapdown inertial navigation system (SINS) shearer. Yang Hai et al. [9] used a motion constraint-assisted SINS zero velocity update model to improve the positioning accuracy during the operation process. Chen Yuming et al. [10] proposed an initial alignment compensation strategy based on the mechanical model of coal mining machinery to solve the performance degradation problem of the underground initial alignment algorithm in coal mines. WU Gang et al. [11,12] proposed an SNIS error compensation model through theoretical analysis and simulation experiments and conducted experimental verification. Ge Shirong et al. [13] developed a device for detecting the position and attitude of the shearer based on the working face geographic information system with inertial navigation device and shaft encoder as sensing elements. Zhang Boyuan et al. [14] proposed two deviation angle calibration algorithms based on the two-point method.
The attitude detection objects of hydraulic support mainly include the support height and the attitude angle of base, top beam, and cover beam. Vaze Jai et al. [15] established a mathematical model to calculate the posture in a hydraulic support using the length and angle of the column and connecting rod. Zhang Yi et al. [16] proposed a straightness monitoring method for advanced hydraulic supports in order to monitor the position and posture of the supports in the roadway. Jiao Xiubo et al. [17] proposed an intelligent decision-making method for the hydraulic support position and attitude self-adjustment based on digital twin system driving. Chen Ningning et al. [18,19] developed an inclination sensor and pressure sensor based on fiber Bragg grating technology and built the attitude detection method of hydraulic support based on fiber sensing technology. Chen Hongyue et al. [20] proposed a measurement method for the attitude angle of the top beam of advanced hydraulic supports based on visual inspection technology. Zeng Qingliang et al. [21] proposed a binocular vision detection method to solve the problem of difficult real-time pose and straightness detection of hydraulic supports in unmanned coal mine working faces under complex geological conditions.
The detection methods of scraper conveyor straightness can be divided into the following two categories: indirect detection and direct detection. The indirect method is mainly to invert the shape of the scraper conveyor through the shearer or hydraulic support, while the direct method is to directly detect the shape of the scraper conveyor body. In 2003, the Australian Federal Academy of Sciences (CSIRO) applied a strapdown inertial navigation technology to automated coal mining technology [22]. Kelly et al. [23] obtained the position and attitude information of the shearer based on inertial navigation technology, which can indirectly reverse the straightness state of the scraper conveyor. Fang Xinqiu et al. [24,25,26,27] developed a three-dimensional curvature (shape) sensor based on fiber optic sensing technology for the real-time dynamic perception of the motion form of scraper conveyors, and developed a curve reconstruction algorithm to achieve three-dimensional shape detection of scraper conveyors. Hao Shangqing et al. [28] constructed a geometric measurement model for the scraper conveyor based on the position of the shearer. Song Yang et al. [29] constructed a precision compensation model for the rotational error angle to improve the accuracy of fiber Bragg grating (FBG) curvature sensors for scraper conveyors. Xie Jiacheng et al. [30] used a collaborative analysis solution method to calculate the posture of a curved scraper conveyor. Li Suhua et al. [31] proposed a straightening method based on the motion law of a floating connection mechanism and established a virtual straightening system for “coal seams and equipment”.
Through the continuous efforts of researchers, the state perception system of the three-machines is becoming more and more perfect. However, the perception system of the three-machines is independent of each other, and the data are not intercommunicating, resulting in the processing degree of the perception information being unable to support the linkage control of the three-machines, which seriously hinders the development of the perception data fusion decision and the collaborative control of the intelligent three-machines. In this paper, an intelligent sensing system of three-machines on the working face based on optical fiber sensing and inertial navigation technology is constructed, and a fusion method of the sensing information of the three-machines is further proposed. The information of the three-machines is fused in the same reference frame, and the location information of the three-machines is transferred between the devices. This research is of great significance for the coordination and intelligent control of the three-machines.

2. Intelligent Perception System for Three-Machines Status

2.1. Optical Fiber Sensor

Fiber optic sensing technology has the advantages of high accuracy and strong anti-interference ability. After reasonable packaging, it can achieve strong environmental tolerance, and the networking methods are flexible and diverse [32,33]. After proposing the unmanned working face mining technology system, Fang et al. [34] conducted research on the application of fiber optic sensing technology in coal mining, such as the basic principles of fiber optic sensing technology, information sensing principles, mechanical models of information transmission, packaging technology, etc.
In order to cope with the complexity of coal mine application scenarios, the author’s team proposed the following three FBG packaging technologies: surface adhesive, grooved landfill, and surface adhesive substrate, and further developed the FBG pressure sensor [19], FBG inclination sensor [20], and FBG 3D curvature sensor [31]. It can not only ensure accuracy, but also work stably in the complex coal mining environment for a long time [35], providing a set of reliable sensors for the construction of intelligent coal mining face.

2.2. Scraper Conveyor Straightness Fiber Sensing System

The spatial shape of the scraper conveyor is affected by the complex floor conditions and the cumulative error of the hydraulic support pushing action; moreover, its body shape presents different degrees of bending in the horizontal and vertical directions. The bending section is too long, which increases the time for the shearer to cut one cut of coal. The bending section is too short, and pushing the scraper conveyor chute may cause the scraper chain to top [36]. The straightness perception of the scraper conveyor is helpful to adjust the straightness of the scraper conveyor body in advance to avoid stopping production due to bending of the body. The FBG 3D curvature sensor and spatial curve reconstruction algorithm were used to build an intelligent sensing system for the straightness of the scraper conveyor using FBG (Figure 1), which is used to obtain real-time online 3D bending shape information of the scraper conveyor [25]. The FBG 3D curvature sensor is shown in Figure 2.
According to coal mine safety regulations, the temperature of the working face should be below 26 °C. Moreover, the working surface temperature of modern intelligent mines is at the optimal temperature suitable for the human body, which is considered a constant temperature environment, so the impact of temperature on FBG is ignored.

2.3. Hydraulic Support State Fiber Sensing System

The hydraulic support not only supports the top plate of the working face to provide a safe coal cutting space for the shearer, but also drives the scraper conveyor forward to achieve a continuous and safe advancement of the mining face by completing the four basic actions of lifting, lowering, pushing, and moving [37]. If the hydraulic support exhibits abnormal attitudes, such as tilting, collision, or tilting of the top beam, it will seriously affect the advancement of the working face and the safety of the mining space; therefore, hydraulic support state perception is an important part of intelligent coal mining face construction. The FBG inclination sensor and FBG pressure sensor are used to build a fiber intelligent sensing system for hydraulic support. Based on the hydraulic support attitude perception index and the kinematics model, real-time online perception system of the hydraulic support base and link attitude, working resistance, and top beam attitude is realized (Figure 1). The FBG pressure sensor and the FBG inclination sensor are shown in Figure 3.

2.4. Shearer State Perception System

The position and attitude detection of shearer is an important foundation for achieving intelligent production in fully mechanized mining faces. The spatial walking trajectory of the shearer not only reflects the straightness of the scraper conveyor, but also affects the timeliness of the hydraulic support movement execution. As shown in Figure 4, an advanced inertial navigation device is installed on the body of shearer to obtain the position and attitude information during its operation. However, the inertial measurement unit (IMU) has poor adaptability in complex environments, such as underground coal mines, making it difficult to achieve accuracy when working on the ground. Therefore, Wu Gang et al. [8,9] proposed a shearer attitude error compensation model based on fiber optic strapdown inertial navigation to improve the perception accuracy of IMU in coal mines and obtain real-time and accurate information about the position and operating attitude of the shearer.

3. Three-Machines State Perception Information Fusion

3.1. Establishment of Datum Coordinate System

The attitude and spatial position relationship information of the three-machines is the basis for determining their constraint relationships, working parameters, task coordination strategies, etc. In the linkage relationship of the three-machines, the scraper conveyor is like a bridge connecting the coal mining machine and the hydraulic support, and at the same time, the three also form a special relationship body that is both collaborative and mutually constrained. The relational model of the spatial position of the three-machines will be proposed in this part, which can assist the three-machines intelligent control system to carry out equipment information perception, data transmission, data fusion analysis, and intelligent decision-making. However, in fact, the on-site operators in the coal mine can easily and quickly locate the equipment through the serial number of the hydraulic support, so when building the relational model of the spatial position of the three-machines, the serial number information of the hydraulic support is introduced, which is convenient for on-site operators to use.
The state information of the three-machines on the intelligent working face is fused and described in the same coordinate system, which can easily and quickly express and calculate the spatial position, attitude, and relative spatial relationship of the three-machines. The coordinate systems often used to describe the state of the equipment include the geocentric inertial coordinate system, earth coordinate system, geographic coordinate system, navigation coordinate system, and body coordinate system. Therefore, an appropriate reference system should be selected as the datum coordinate system of the working face, and then the local coordinate system should be determined according to the operation characteristics of the equipment. The state information of the equipment is transformed from the local coordinate system to the common reference coordinate system to complete the fusion expression of the attitude and position information of the equipment. In this paper, a datum coordinate system (d-system) is established with the midpoint of the scraper conveyor head as the origin, the positive direction of Z axis points to the sky, and the positive direction of X axis points to the advancing direction of the working face. The positive direction of the Y axis is parallel to the working face and conforms to the right-hand rule. When the scraper conveyor is in an ideal straight state, the Y axis coincides with the central axis of the scraper conveyor body, as shown in Figure 4.

3.2. Scraper Conveyor Bend Section Description

Assuming that the body of the scraper conveyor is connected by n + 1 middle chutes through n connection points. The FBG sensing units is installed at n positions in the FBG 3D curvature sensor, corresponding to the connection of the middle chute of the scraper conveyor, and can obtain real-time position curvature information. The information of these n positions can be obtained by the interpolation and reconstruction algorithm of the FBG sensing system of the scraper conveyor straightness, and they are described as P in the reference coordinate system (d system) as follows:
P = p 1 , p 2 , p 3 , , p n = ( x 1 , y 1 , z 1 ) , ( x 2 , y 2 , z 2 ) , , ( x n , y n , z n )
Due to the fact that the scraper conveyor is composed of multiple middle chutes with a length of s, when the body is in a bent state, the middle chute will not deform, while the adjacent middle chutes will move together to form a certain angle. Therefore, the coordinates of the middle chute connection point will be used to describe the bending section of the scraper conveyor body.
As shown in Figure 5, first sort the middle chutes (1, 2, 3... n + 1) of the scraper conveyor and the FBG (1, 2, 3... n) in the FBG 3D curve sensor. Suppose that the scraper conveyor starts to bend from the middle chute of section j and section k in the horizontal and vertical directions, respectively, and the middle chute of section (x + 1) is bent in both directions, then the curvature of the bending section in the horizontal and vertical directions are expressed as q j 1 q j + x and q k 1 q k + x , and the coordinate points set C1 and C2 of (x + 2) the FBG positions corresponding to the bending section and the coordinates of the beginning and end points of the bending section are, respectively, as follows:
C 1 = q j 1 , q j , q j + 1 , , q j + x q j 1 = ( x j 1 , y j 1 , z j 1 ) q j + x = ( x j + x , y j + x , z j + x ) , C 2 = q k 1 , q j , q k + 1 , , q k + x q k 1 = ( x k 1 , y k 1 , z k 1 ) q k + x = ( x k + x , y k + x , z k + x )
The angle at which the scraper conveyor deviates from the position of the fuselage under ideal conditions in both the horizontal and vertical directions is used to represent the bending degree of the fuselage (Figure 6). The angle of deviation is represented by the angle between the Y axis and the line, and the line is the maximum deviation point and departure point in the bending section. The deviation angle φcH of horizontal bending q j 1 q j + x and the deviation angle γcV of vertical bending q k 1 q k + x are calculated as follows:
Δ x max H = max x j + 1 x j , x j + 2 x j , , x j + x x j Δ y max H = max y j + 1 y j , y j + 2 y j , , y j + x y j φ c H = arctan ( Δ x max H / Δ y max H )
Δ y max V = max y k + 1 y k , y k + 2 y k , , y k + x y k Δ z max V = max z k + 1 z k , z k + 2 z k , , z k + x z k γ c V = arctan ( Δ z max V / Δ y max V )
where, Δ x max H , Δ y max H , Δ y max V and Δ y max V denote the length of the bending section in the XYZ direction, respectively.

3.3. Hydraulic Support Status Description

3.3.1. Hydraulic Support Attitude Description

In Figure 7, local coordinate systems OiaXiaYiaZia (Oia-system), OibXibYibZib (Oib-system) and OicXicYicZic (Oic-system) are used to describe the attitude of the base, cover beam, and top beam of the hydraulic support, respectively, where i denotes the support number, a, b, and c denote the base, cover beam, and top beam, re spectively. And the initial state of the local coordinate system is consistent with the reference coordinate system. The coordinate system conversion is used to describe the attitude of each part of the hydraulic support in the d-system. The conversion of d-system to the local coordinate system is achieved by rotating φ, θ, γ around Z, X, and Y, respectively, three times as follows:
O X Y Z C φ Z O 1 X 1 Y 1 Z 1 C θ X O 2 X 2 Y 2 Z 2 C γ Y O i X i Y i Z i ,
Therefore, the solution equation describing the attitude of the three parts of the hydraulic support is as follows:
( C d i a , C d i b , C d i c ) = C γ C θ C φ
C φ = cos φ sin φ 0 sin φ cos φ 0 0 0 1 ,   C θ = 1 0 0 0 cos θ sin θ 0 sin θ cos θ ,   C γ = cos γ 0 sin γ 0 1 0 sin γ 0 cos γ
C γ C θ C φ = cos γ 0 sin γ 0 1 0 sin γ 0 cos γ 1 0 0 0 cos θ sin θ 0 sin θ cos θ cos φ sin φ 0 sin φ cos φ 0 0 0 1 = cos γ cos φ + sin γ sin θ sin φ sin φ cos θ sin γ cos φ cos γ sin φ sin θ cos γ sin φ + sin γ sin θ cos φ cos φ cos θ sin γ sin φ cos γ sin φ cos θ sin γ cos θ sin θ cos γ cos θ

3.3.2. Hydraulic Support Position Description

The origin Oia of the local coordinate system of the hydraulic support base is selected as a reference point to describe the position of the hydraulic support (Figure 7). The vector O O i a denotes the position of a hydraulic support in the d-system at some time. Therefore, the vector denotes the position of the hydraulic support in the d-system at this time as follows:
O O i a = x i a , y i a , z i a = O A , O B , O i a O i a
where, OA denotes the distance from the origin Oia of the local coordinate system Oia-system to the Y axis of the d-system; OB denotes the distance from the origin Oib of the local coordinate system Oia-system to the X axis of the d-system; OiaOia′ denotes the distance from the origin of Oia-system Oia to the plane of XiaOiaYia, and Oia′ denotes the projection point of Oia on the d-system XOY plane. When the bottom plate of the working face is in an ideal horizontal state, the value of OiaOia′ is 0.

3.3.3. Analyze the Position Coordinates of the Hydraulic Support

The hydraulic supports are arranged in the order of 1, 2, 3… i from the vicinity of the machine head to the tail (Figure 7). The arrangement relationship between the hydraulic supports and the middle chute of the scraper conveyor is shown in Figure 8, and the positions of n FBGs are all located in the middle of the two hydraulic supports. The number of hydraulic supports in the intelligent working face is more than the number of FBG positions, so there is a quantitative relationship between the serial number of FBGs and the serial number of hydraulic supports. It is only necessary to determine the serial number of hydraulic supports on both sides of the position of the No.1 FBG when arranging the FBG 3D curvature sensor. Assuming that the No.1 FBG position is located between the No.N and No.(N + 1) hydraulic support, and the No.j FBG position is located between the No.i and No.(i + 1) hydraulic support, the relationship between i and j is as follows:
i = j + N 1
The No.i hydraulic support is located between the No.j and No.(j−1) FBG positions. For any hydraulic support numbered i, the local coordinate system OiaXiaYiaZia of its base and the spatial relationship between the hydraulic support and its corresponding central slot are shown in Figure 8. Point Oia (xia, yia, zia) can be calculated according to point Oj (xj, yj, zj) and coordinate point Oj−1 through square (10).
x i a = x j d x d p = x j 1 + d x d p = x j 1 d p + ( x j x j 1 ) / 2 y i a = y j d y = y j 1 + d y = y j 1 + ( y j y j 1 ) / 2 z i a = z j = z j 1
where, dx and dy denote the distance between the two adjacent FBG positions in the X and Y axis directions, respectively, and dp denotes the distance between the base origin Oia and the middle chute, which takes a value according to the state of the hydraulic support. When the hydraulic support is pushed, dp takes a maximum value dpmax. After the following maneuvering is completed, dp is reduced to dpmin.
Equation (10) can be used to represent the spatial position relationship between the hydraulic support and the scraper conveyor, while retaining the relationship between the scraper conveyor and the serial number of the hydraulic support. The position of the bending section of the scraper conveyor can be represented by the serial number of the hydraulic support.

3.4. Shearer’s Condition Description

3.4.1. Shearer Attitude Description

The fiber optic inertial measurement unit used to obtain the attitude information of the shearer also needs to transform coordinate system (Figure 9). Similar to the description of the attitude of the hydraulic support, it describes the attitude information of the shearer in d-system. As with Equation (4), the conversion of the same d-system to the ObXbYbZb (Ob-system) of the shearer is realized by rotating φ, θ, and γ around Z, X, and Y, respectively, by three times of a single coordinate axis. The conversion of coordinate system can be realized by combining Equations (11) and (6).
C d b = C γ C θ C φ

3.4.2. Shearer Position Description

When the shearer moves back and forth along the scraper conveyor on the working face, the origin of the shearer’s Ob-system is used as a reference point to describe the spatial position of the shearer. Under ideal conditions, the running trajectory of the shearer is flat and coincides with the central axis of the scraper conveyor body, which means that the trajectory of its straight section is parallel to the Y axis of the d-system. In fact, the running trajectory of shearer is not a straight line, but fluctuates around the Y axis of the d-system as the body of the scraper conveyor bends. Assuming that at a certain moment, the shearer runs to the position shown in Figure 9, and the vector O O b represents the position of the shearer in the d-system at this time:
O O b = x b , y b , z b = O A , O B , O C
where, OC = ObOb, Ob′ denotes the projection of Ob on the XOY plane. Equation (12) only shows the vector expression of the shearer position, and the coordinates of the vector need to be obtained through the inertial navigation system installed on the shearer. The specific process is not described here. This section will study the mathematical relationship between the serial numbers of the shearer and the hydraulic support, based on the obtained position coordinate Ob ( x b , y b , z b ) of the shearer.
The characteristic of the movement of the shearer is to perform a back-and-forth motion on the scraper conveyor; that is, to perform a back-and-forth motion along the Y axis of the d-system. Therefore, determining the relationship between the shearer and the hydraulic support only requires considering the Y value of the coordinate points of the two positions. As shown in Figure 10, the spatial relationship between the b-system origin Ob of the shearer and the origin Oia of a certain hydraulic support base at a certain moment is shown. The position of point Ob is mostly between two adjacent hydraulic supports. Equation (13) is used to roughly calculate the serial numbers of the hydraulic supports corresponding to the shearer. Assuming that there are also k hydraulic supports in the negative Y axis direction of the d-system, the calculation result of Equation (13) is taken as an integer upwards, and then Equation (14) is used for serial number calibration. The calibration range is about k hydraulic supports.
i = y b / d h + 1
where, yb denotes the Y coordinate value of the shearer position. Dh denotes he distance between hydraulic supports. ⌈ ⌉ denotes the integer symbol taken upwards.
y s = min y i a y b , y ( i + 1 ) a y b , y ( i + 2 ) a y b , y ( i + 3 ) a y b , y ( i + 4 ) a y b
where, Δys denotes the actual distance value between the hydraulic support and the shearer in the Y axis direction. Y(i+2)a denotes the Y axis coordinate value of the No.(i + 2) hydraulic support, (i + 2) denotes the serial number of the hydraulic support. A denotes the local coordinate system of the hydraulic support base.
At the minimum value of ys, the corresponding hydraulic support serial number is the serial number of the hydraulic support closest to the position of the shearer.

4. Three-Machines Spatial Position Relational Model Verification Test

An indoor test system was set up to verify the mathematical model of the spatial relationship between the three machines. The indoor test platform was built with the straightness sensing system of the scraper conveyor as the center. As shown in Figure 11, the FBG 3D curvature sensors containing 7 FBG positions were laid, and the FBG positions were ranked from 1 to 7 from right to left. Then, the 8 middle chutes and 10 hydraulic supports are simulated on both sides of the FBG 3D curvature sensor. The length of the middle chutes is lc = 1.75 m and the width b = 0.8 m, and the sequence is from 1 to 8. The distance between the hydraulic support dh = 1.75 m, the distance between the hydraulic support and the middle chute dp = 1.2 m, in order of from 1 to 10, where the negative direction of the Y axis hydraulic support one (k = 1); that is, the position of the first FBG is between the second and the third hydraulic support (N = 1). Then, Equation (9) is transformed into the following: i = j + 1.
The spatial position relationship of the three-machines is mainly related to the X and Y axis directions, so this model validation test only considers the case of the scraper conveyor body in the XOY plane.

4.1. The Scraper Conveyor Is in a Straight Line State

As shown in Figure 11, the following is a set of coordinate points for 7 FBG positions: Cs1 = {q1, q2, q3q8} = {(−0.45, 1.77, 0), (−0.44, 3.53, 0), (−0.44, 5.29, 0), (−0.45, 7.05, 0), (−0.45, 8.80, 0), (−0.45, 10.44, 0), (−0.46, 12.20, 0)}.
The following set of coordinate points of the hydraulic support can be calculated using Equation (10): Ch1 = {h1, h2, h3h10} = {(−1.65, −0.88, 0), (−1.65, 0.88, 0), (−1.65, 2.65, 0), (−1.64, 4.41, 0), (−1.65, 6.17, 0), (−1.65, 7.92, 0), (−1.65, 9.62, 0), (−1.65, 11.32, 0), (−1.65, 13.13, 0), (−1.65, 14.88, 0)}.
The following set of three shearer position coordinate points is randomly given: Csh1 = {s1, s2, s3} = {(−0.52, 4.23, 0), (−0.56, 7.45, 0), (−1.53, 10.76, 0)}.
According to Equations (13) and (14), the corresponding hydraulic numbers of the shearer are {4, 6, 8}.

4.2. The Scraper Conveyor Is in a Local Bending State

As shown in Figure 12, the following is set of coordinate points for 7 FBG positions: Cs2 = {q1, q2, q3q8} = {(−0.45, 1.77, 0), (−0.45, 3.46, 0), (−0.45, 5.24, 0), (−0.56, 7.03, 0), (−0.59, 8.56, 0), (−0.97, 10.00, 0), (−2.17, 11.78, 0)}.
The following set of coordinate points of the hydraulic support can be calculated using Equation (10): Ch2 = {h1, h2, h3h10} {(−1.67, −0.88, 0), (−1.67, 0.88, 0), (−1.67, 2.61, 0), (−1.70, 4.36, 0), (−1.73, 6.14, 0), (−1.76, 7.79, 0), (−1.97, 9.29, 0), (−2.77, 10.89, 0), (−2.77, 12.64, 0), (−2.77, 14.39, 0)}.
The following set of three shearer position coordinate points is randomly given: Csh2 = {s1, s2, s3} = {(−0.45, 6.46, 0), (−0.45, 9.86, 0), (−0.45, 11.50, 0)}.
According to Equations (13) and (14), the corresponding hydraulic numbers of the shearer are {5, 7, 8}.
The test results show that the spatial position relationship model of the three-machines can realize the fusion and flow of the position relationship of the three-machines, and the position coordinates of the hydraulic support can be obtained according to the shape information of the scraper conveyor, which is of great significance for the linkage and cooperative control of the three-machines on the working face.

5. Conclusions

(1)
The intelligent perception system of the three-machines in the intelligent working face has been successfully built based on fiber optic sensing technology and inertial navigation technology, and the fusion expression of the state perception information of the three-machines has been achieved.
(2)
The datum coordinate system of the working face was established at the head position of the scraper conveyor and successfully used to describe the position and attitude information of the three-machines equipment.
(3)
The spatial position relationship model of the three-machines in this article has been established and successfully applied to the fusion of position information of the three-machines, and its feasibility has been verified through indoor experiments.
(4)
Although we have verified the feasibility of the fusion method, we have not conducted system integration, so we have not yet compared it with existing systems, and the required reaction time and latency of the fusion method have not been verified. This article also did not consider the impact of temperature changes, so temperature compensation design should be added in environments with large temperature differences. These contents will become the next research focus.

Author Contributions

Conceptualization, H.F. and X.F.; software, H.F.; validation, H.F., X.F. and M.L.; formal analysis, H.F. and Y.S.; investigation, Y.S. and X.Z.; data curation, H.F.; writing—original draft preparation, H.F. and X.F.; writing—review and editing, H.F., X.F., N.C., Y.S.; G.W. and M.L.; project administration, H.F. and X.F.; funding acquisition, X.F., G.W. and M.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (No. 51874276, 52004273 and 52104167), the Natural Science Foundation of Jiangsu Province (No. BK20200639), the Fundamental Research Funds for the Central Universities (No. 2020ZDPY0209).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data and code used or analyzed in this study are available from the corresponding author on reasonable request.

Acknowledgments

The author thanks the editor and anonymous reviewer of the paper. Their constructive suggestions and opinions will help improve the quality of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yuan, X.; Wu, Y.; Sun, L.; Wang, X. Research on Efficient Construction Paths for Intelligent Coal Mines in China from the Configuration Perspective. Appl. Sci. 2023, 13, 673. [Google Scholar] [CrossRef]
  2. Wang, G.; Chao, Y.; Cao, Y.; Jiang, T.; Han, W.; Chen, Z. A comprehensive review of research works based on evolutionary game theory for sustainable energy development. Energy Rep. 2022, 8, 114–136. [Google Scholar] [CrossRef]
  3. Shi, Y.; Zhang, T.; Jiang, Y. Digital Economy, Technological Innovation and Urban Resilience. Sustainability 2023, 15, 9250. [Google Scholar] [CrossRef]
  4. Wang, G. New technological progress of coal mine intelligence and its problems. Coal Sci. Technol. 2022, 50, 1–27. [Google Scholar] [CrossRef]
  5. Ralston, J.C.; Reid, D.C.; Dunn, M.T.; Hainsworth, D.W. Longwall automation: Delivering enabling technology to achieve safer and more productive underground mining. Int. J. Min. Sci. Technol. 2015, 25, 865–876. [Google Scholar] [CrossRef]
  6. Li, S.; Ren, H. Research status and development trend of position and posture measurement technology on hydraulic support, scraper conveyor, shearer in fully-mechanized mining face. Coal Sci. Technol. 2020, 48, 218–226. [Google Scholar] [CrossRef]
  7. Fang, X.; Zhao, J.; Hu, Y. Tests and error analysis of a self-positioning shearer operating at a manless working face. Min. Sci. Technol. 2010, 20, 53–58. [Google Scholar] [CrossRef]
  8. Fan, Q.; Li, W.; Hui, J.; Wu, L.; Yu, Z.; Yan, W.; Zhou, L. Integrated Positioning for Coal Mining Machinery in Enclosed Underground Mine Based on SINS/WSN. Sci. World J. 2014, 2014, 460415. [Google Scholar] [CrossRef]
  9. Yang, H.; Li, W.; Luo, T.; Liang, H.; Zhang, H.; Gu, Y.; Luo, C. Research on the Strategy of Motion Constraint-Aided ZUPT for the SINS Positioning System of a Shearer. Micromachines 2017, 8, 340. [Google Scholar] [CrossRef]
  10. Chen, Y.M.; Li, W.; Yang, H.; Xia, T. Research on the Compensation Strategy of the Initial Alignment of the SINS Based on the Dynamic Model of the Shearer. IEEE Access 2019, 7, 36736–36747. [Google Scholar] [CrossRef]
  11. Wu, G.; Fang, X.; Zhang, L.; Liang, M.; Lv, J.; Quan, Z. Positioning Accuracy of the Shearer Based on a Strapdown Inertial Navigation System in Underground Coal Mining. Appl. Sci. 2020, 10, 2176. [Google Scholar] [CrossRef]
  12. Wu, G.; Fang, X.; Song, Y.; Liang, M.; Chen, N. Study on the Shearer Attitude Sensing Error Compensation Method Based on Strapdown Inertial Navigation System. Appl. Sci. 2022, 12, 10848. [Google Scholar] [CrossRef]
  13. Ge, S.; Su, Z.; Li, A.; Wang, S.; Hao, S.; Liu, W.; Meng, L. Study on the positioning and orientation of a shearer based on geographic information system. J. China Coal Soc. 2015, 40, 2503–2508. [Google Scholar] [CrossRef]
  14. Zhang, B.; Wang, S.; Ge, S. Effects of initial alignment error and installation noncoincidence on the shearer positioning accuracy and calibration method. J. China Coal Soc. 2017, 42, 789–795. [Google Scholar] [CrossRef]
  15. Vaze, J.; Jenkins, B.R.; Teng, J.; Tuteja, N.K. Soils fieldwork, analysis, and interpretation to support hydraulic and hydrodynamic modelling in the Murray floodplains. Soil Res. 2010, 48, 295–308. [Google Scholar] [CrossRef]
  16. Zhang, Y.; Zhang, H.; Gao, K.; Xu, W.; Zeng, Q. New Method and Experiment for Detecting Relative Position and Posture of the Hydraulic Support. IEEE Access 2019, 7, 181842–181854. [Google Scholar] [CrossRef]
  17. Jiao, X.; Xie, J.; Wang, X.; Yan, Z.; Hao, Z.; Wang, X. Intelligent decision method for the position and attitude self-adjustment of hydraulic support groups driven by a digital twin system. Measurement 2022, 202, 111722. [Google Scholar] [CrossRef]
  18. Chen, N.; Fang, X.; Liang, M.; Xue, X.; Zhang, F.; Wu, G.; Qiao, F. Research on Hydraulic Support Attitude Monitoring Method Merging FBG Sensing Technology and AdaBoost Algorithm. Sustainability 2023, 15, 2239. [Google Scholar] [CrossRef]
  19. Liang, M.F.; Fang, X.Q.; Li, S.; Wu, G.; Ma, M.; Zhang, Y.G. A fiber Bragg grating tilt sensor for posture monitoring of hydraulic supports in coal mine working face. Measurement 2019, 138, 305–313. [Google Scholar] [CrossRef]
  20. Chen, H.; Chen, Q.; Chen, H.; Yang, X.; Wang, X. Measurement of displacement and top beam attitude angle of advanced hydraulic support based on visual detection. Measurement 2023, 219, 113264. [Google Scholar] [CrossRef]
  21. Zeng, Q.; Xu, W.; Gao, K. Measurement Method and Experiment of Hydraulic Support Group Attitude and Straightness Based on Binocular Vision. IEEE Trans. Instrum. Meas. 2023, 72, 7502814. [Google Scholar] [CrossRef]
  22. Li, S.; Xie, J.; Wang, X.; Ren, F.; Zhang, X.; Bao, Q. Path Planning of Hydraulic Support Pushing Mechanism Based on Extreme Learning Machine and Descartes Path Planning. Symmetry 2021, 13, 97. [Google Scholar] [CrossRef]
  23. Kelly, M.; Hainsworth, D.; Reid, D.; Caris, C.; Gurgenci, H. Progress towards longwall automation. In Proceedings of the 5th International Symposium on Mining Science and Technology, Xuzhou, China, 20–22 October 2004. [Google Scholar]
  24. Fang, X.; Ning, Y.; Li, S.; Liang, M.; Wu, G.; Gu, C. Research on key technique of straightness perception of scraper conveyor based on fiber grating. Coal Sci. Technol. 2019, 47, 152–158. [Google Scholar] [CrossRef]
  25. Fang, X.; Liang, M.; Li, S.; Zhang, L.; Yan, H.; Xie, X.; Yu, R.; Wu, G.; Lv, J. Key technologies of multi-parameter accurate perception and security decision in intelligent working face. J. China Coal Soc. 2020, 45, 493–508. [Google Scholar] [CrossRef]
  26. Wu, G.; Qiao, F.; Fang, X.; Liang, M.; Song, Y. Straightness Perception Mechanism of Scraper Conveyor Based on the Three-Dimensional Curvature Sensing of FBG. Appl. Sci. 2023, 13, 3619. [Google Scholar] [CrossRef]
  27. Chen, N.N.; Fang, X.Q.; Feng, H.T.; Liang, M.F.; Wu, G.; Song, Y.; Zhang, F. Scraper conveyor shape sensing technology based on orthogonal optical fiber strain. Meas. Sci. Technol. 2023, 34, 125103. [Google Scholar] [CrossRef]
  28. Hao, S.; Wang, S.; Malekian, R.; Zhang, B.; Liu, W.; Li, Z. A Geometry Surveying Model and Instrument of a Scraper Conveyor in Unmanned Longwall Mining Faces. IEEE Access 2017, 5, 4095–4103. [Google Scholar] [CrossRef]
  29. Song, Y.; Fang, X.; Wu, G.; Chen, N.; Liang, M.; Xu, Z.; Zhang, F. Research on Straightness Perception Compensation Model of FBG Scraper Conveyor Based on Rotation Error Angle. Sensors 2022, 22, 6399. [Google Scholar] [CrossRef]
  30. Xie, J.; Yang, Z.; Wang, X.; Wang, S.; Zhang, Q. Cooperative solving method of chute postures in the bending section of a scraper conveyor. Adv. Mech. Eng. 2018, 10, 1687814018767684. [Google Scholar] [CrossRef]
  31. Li, S.; Xie, J.; Ren, F.; Zhang, X.; Wang, X.; Wang, B. Virtual straightening of scraper conveyor based on the position and attitude solution of industrial robot model. Int. J. Coal Sci. Technol. 2021, 8, 1149–1170. [Google Scholar] [CrossRef]
  32. Liang, M.; Fang, X.; Wu, G.; Xue, G.; Li, H. A fiber bragg grating pressure sensor with temperature compensation based on diaphragm-cantilever structure. Optik 2017, 145, 503–512. [Google Scholar] [CrossRef]
  33. Yuan, L.; Tong, W.; Jiang, S.; Yang, Y.; Meng, Z.; Dong, Y.; Rao, Y.; He, Z.; Jin, W.; Liu, T.; et al. Road map of fiber optic sensor technology in China. Acta Opt. Sin. 2022, 42, 9–42. [Google Scholar]
  34. Fang, X.; He, J.; Zhang, B.; Guo, M. Self-positioning system of the shearer in unmanned workface. J. Xi’an Univ. Sci. Technol. 2008, 28, 349–353. [Google Scholar] [CrossRef]
  35. Liang, M.; Chen, N.; Fang, X.; Wu, G. Strain transferring mechanism analysis of the surface-bonded FBG sensor. Appl. Opt. 2018, 57, 5837–5843. [Google Scholar] [CrossRef]
  36. Wang, S.; Ge, S.; Wang, S.; Li, Z.; Wang, Z. Development and challenge of unmanned autonomous longwall fully-mechanized coal mining face. Coal Sci. Technol. 2022, 50, 231–243. [Google Scholar] [CrossRef]
  37. Gao, Y.; Yang, Y.; Chang, Y.; Zhang, X.; Li, G.; Liang, D.; Cui, K.; Wu, X.; Wei, Z. Status and prospect of key technologies of intelligentization of fully-mechanized coal mining face. Coal Sci. Technol. 2021, 49, 1–22. [Google Scholar] [CrossRef]
Figure 1. Establishment of d-system and three-machines state sensing system for working face.
Figure 1. Establishment of d-system and three-machines state sensing system for working face.
Sensors 23 07956 g001
Figure 2. Schematic diagram and product diagram of FBG 3D curvature sensor (a) structural schematic diagram of FBG 3D curvature sensor; (b) FBG 3D curvature sensor products.
Figure 2. Schematic diagram and product diagram of FBG 3D curvature sensor (a) structural schematic diagram of FBG 3D curvature sensor; (b) FBG 3D curvature sensor products.
Sensors 23 07956 g002
Figure 3. Hydraulic support status sensing sensor. (a) FBG inclination sensor; (b) FBG pressure sensor.
Figure 3. Hydraulic support status sensing sensor. (a) FBG inclination sensor; (b) FBG pressure sensor.
Sensors 23 07956 g003
Figure 4. Position and attitude perception of shearer based on IMU.
Figure 4. Position and attitude perception of shearer based on IMU.
Sensors 23 07956 g004
Figure 5. Layout diagram of straightness perception system for scraper conveyor.
Figure 5. Layout diagram of straightness perception system for scraper conveyor.
Sensors 23 07956 g005
Figure 6. Schematic diagram of bending section of scraper conveyor.
Figure 6. Schematic diagram of bending section of scraper conveyor.
Sensors 23 07956 g006
Figure 7. Schematic diagram of position and attitude perception system for hydraulic support.
Figure 7. Schematic diagram of position and attitude perception system for hydraulic support.
Sensors 23 07956 g007
Figure 8. Schematic diagram of the position relationship between hydraulic support and FBG.
Figure 8. Schematic diagram of the position relationship between hydraulic support and FBG.
Sensors 23 07956 g008
Figure 9. Description of shearer status information.
Figure 9. Description of shearer status information.
Sensors 23 07956 g009
Figure 10. Diagram of the position relationship between shearer and hydraulic support.
Figure 10. Diagram of the position relationship between shearer and hydraulic support.
Sensors 23 07956 g010
Figure 11. Scraper conveyor under straight line conditions.
Figure 11. Scraper conveyor under straight line conditions.
Sensors 23 07956 g011
Figure 12. Scraper conveyor under bending conditions.
Figure 12. Scraper conveyor under bending conditions.
Sensors 23 07956 g012
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Feng, H.; Fang, X.; Chen, N.; Song, Y.; Liang, M.; Wu, G.; Zhang, X. Research on the Three-Machines Perception System and Information Fusion Technology for Intelligent Work Faces. Sensors 2023, 23, 7956. https://doi.org/10.3390/s23187956

AMA Style

Feng H, Fang X, Chen N, Song Y, Liang M, Wu G, Zhang X. Research on the Three-Machines Perception System and Information Fusion Technology for Intelligent Work Faces. Sensors. 2023; 23(18):7956. https://doi.org/10.3390/s23187956

Chicago/Turabian Style

Feng, Haotian, Xinqiu Fang, Ningning Chen, Yang Song, Minfu Liang, Gang Wu, and Xinyuan Zhang. 2023. "Research on the Three-Machines Perception System and Information Fusion Technology for Intelligent Work Faces" Sensors 23, no. 18: 7956. https://doi.org/10.3390/s23187956

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop