Next Article in Journal
Techno-Economic Assessment of the Integration of Direct Air Capture and the Production of Solar Fuels
Previous Article in Journal
Optimization of Operating Hydrogen Storage System for Coal–Wind–Solar Power Generation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Rockburst Intensity Level Prediction Method Based on FA-SSA-PNN Model

1
School of Land and Resources Engineering, Kunming University of Science and Technology, Kunming 650093, China
2
Yunnan Key Laboratory of Sino-German Blue Mining and Utilization of Special Underground Space, Kunming 650093, China
*
Author to whom correspondence should be addressed.
Energies 2022, 15(14), 5016; https://doi.org/10.3390/en15145016
Submission received: 25 May 2022 / Revised: 30 June 2022 / Accepted: 6 July 2022 / Published: 8 July 2022

Abstract

:
To accurately and reliably predict the occurrence of rockburst disasters, a rockburst intensity level prediction model based on FA-SSA-PNN is proposed. Crding to the internal and external factors of rockburst occurrence, six rockburst influencing factors (σθ, σt, σc, σc/σt, σθ/σc, Wet) were selected to build a rockburst intensity level prediction index system. Seventy-five sets of typical rockburst case data at home and abroad were collected, the original data were preprocessed based on factor analysis (FA), and the comprehensive rockburst prediction indexes, CPI1, CPI2, and CPI3, obtained after dimensionality reduction, were used as the input features of the SSA-PNN model. Sixty sets of rockburst case data were extracted as the training set, and the remaining 15 sets of rockburst case data were used as the test set. After the model training was completed, the model prediction results were analysed and evaluated. The research results show that the proposed rockburst intensity level prediction method based on the FA-SSA-PNN model has the advantages of high prediction accuracy and fast convergence, which can accurately and reliably predict the rockburst intensity level in a short period of time and can be used as a new method for rockburst intensity level prediction, providing better guidance for rockburst prediction problems in deep rock projects.

1. Introduction

Rockburst is a deep underground rock construction process of hard and brittle surrounding rock due to excavation, mining, or other external disturbances, triggered by the rapid and violent release of the elastic properties gathered in the rock and leads to the production of surrounding rock fragments by bursting, rapid ejection, or throwing the dynamic destabilization phenomenon, which are sudden, random, and extremely hazardous geological hazards [1,2,3]. In recent years, with the reduction of shallow mineral resources, more and more underground rock works are moving deeper at an unprecedented rate, and the rockburst hazards problem is becoming increasingly prominent. These hazards have been a pressing problem in deep underground rock engineering, often causing huge losses to construction personnel, equipment, and buildings, which in turn seriously affects the construction process, so it is particularly important to accurately predict the occurrence of rockburst hazards. Accurate and reliable prediction of rockburst hazards effectively avoids and controls rockbursts, and rockburst prediction has become a hot spot for research in the field of deep underground rock engineering [4].
In order to accurately predict the intensity level of rockburst, many experts and scholars at home and abroad have carried out exploratory research on rockburst prediction methods, which can be classified into three categories: The first category is the acoustic emission technique [5], microseismic observation technique [6], and other methods of rockburst prediction based on field measurements; the second category is a single-factor prediction method, where the discrimination of rockburst intensity levels varies slightly with the criterion, such as Hoek criterion [7], N-Jhelum criterion [8], Erlang Mountain criterion [9], and Lujiayou criterion [10], etc. With the continuous research on the problem of rockburst prediction, a large number of scholars have gradually realized the complexity of the mechanism of rockburst and the many factors that induce rockburst [11,12,13], but it is difficult to accurately predict rockburst using only single-factor prediction methods. At present, non-linear theory uses more than just the third category of rockburst prediction methods, that is, the multi-factor integrated prediction method and the multi-factor integrated prediction method, to integrate rock mechanics parameters and a variety of rockburst criterion to achieve rockburst intensity level prediction. The multi-factor integrated prediction method, according to the different non-linear theory, is divided into two subcategories. The former is mainly based on mathematical methods to predict the rockburst intensity level, which are representative of ideal point method [14], cloud model theory [15,16], fuzzy comprehensive evaluation method [17,18,19], uncertainty measurement theory [20], gray system theory [21], the TOPSIS method [22], discriminant by distance method [23], and the extenics theory [3]. The latter is mainly based on intelligent algorithms to predict rockburst intensity levels, such as self-organizing feature mapping neural networks [24], machine learning [25,26], deep neural networks [27], generalized regression neural networks [28], and sarticle swarm optimization [29].
All of the above rockburst prediction methods have achieved some success, enriching the theory of rockburst prediction. However, there are still some shortcomings, for example, when ignoring the impact of correlation between rockburst prediction indicators on the prediction results, due to the diversity of factors affecting the occurrence of rockburst, there is a certain correlation between rockburst prediction indicators, which will not only lead to double calculation of indicators, increasing the workload in the prediction process, but will directly affect the accuracy and reliability of the prediction results. Therefore, the elimination of correlation between indicators is the key to accurate prediction of rockbursts, and research on the elimination of correlation between rockburst prediction indicators is necessary.
Factor analysis (FA) [30] is the extension and development of principal component analysis, which regroups the information of the original variables to find out the common factors affecting the variables and can make the factor variables more interpretable and give high naming clarity by rotation. At present, the application of factor analysis method in rockburst intensity level prediction is relatively small in order to eliminate the correlation between rockburst prediction indicators. This paper uses the factor analysis method to extract the characteristics of rockburst prediction indicators, using the original rockburst prediction indicators with minimal loss of information, with comprehensive rockburst indicators, as much as possible to reflect the original rockburst prediction indicators information, which is a good solution to the problem of overlapping information indicators.
Probabilistic neural networks (PNNs) were proposed by Dr. D. F. Specht in 1988 and can implement the functions of nonlinear learning algorithms using linear learning algorithms, with the advantages of simple structure, good expansion performance, fast convergence, and high fault tolerance [31]. However, when the probabilistic neural network is used, the problem of selecting the optimal smoothing factor is somewhat subjective and tedious. Therefore, this paper uses the sparrow search algorithm (SSA) to select the optimal smoothing factor, which has the advantages of being rapid and efficient when optimizing for a single objective and good merit-seeking ability and solves the problem of selecting the optimal smoothing factor very well.
Combining the above research, this paper selects 75 groups of typical rockburst case data, combines factor analysis method, sparrow search algorithm, and probabilistic neural network, and establishes a rockburst intensity level prediction method based on the FA-SSA-PNN model. The method has the advantages of simple logic, easy implementation, strong generalization ability of the model, high prediction accuracy, fast convergence, and applicability to small samples, which can be used as a new method for rockburst intensity level prediction. The present research results provide an important basis for predicting the rockburst intensity level in advance and provide preparation time for rockburst disaster prevention and control, and the method in this paper can also provide a reference for other geological hazard prediction problems similar to rockburst disasters.

2. Methods

2.1. Factor Analysis (FA)

Factor analysis (FA), is a multivariate statistical analysis method that combines multiple variables (or samples) with intricate relationships into a smaller number of factors. The calculation process is as follows:
With n rockburst predictor variables X1, X2, …, Xn, n rockburst prediction variables can be represented by m factors F1, F2, …, Fm and the product of an An×m order factor loading matrix plus a special factor ε = (ε1, ε2, …, εn) (nm), while the established mathematical model of factor analysis is: Xn = An×mFm + εn, i.e., Equation (1):
[ X 1 X 2 X n ] = [ a 11 a 12 a 1 m a 21 a 22 a 2 m a n 1 a n 2 a n m ] [ F 1 F 2 F m ] + [ ε 1 ε 2 ε n ] ,
F1, F2, …, and Fm are m independent common factors. The matrix An×m is called the factor loading matrix. anm denotes the weight of the nth variable on the mth factor variable, which reflects the importance of the common factor on the variable, and is important for explaining the common factor. The special factors in the model have a small effect relative to the main factor Fm in Equation (1) and are neglected in the study. The steps of the factor analysis are as follows:
The raw data need to be normalized before factor analysis to eliminate the effect of order of magnitude on the calculated results. The normalized treatment in this paper is specified as follows:
{ X i j * = ( X i j * X min ) / ( X max X min ) X i j * = ( X max X i j * ) / ( X max X min ) ,
Equation: Xmax is the maximum value in the sample; Xmin is the smallest value in the sample; Xij* is the normalized data value of indicator Xij in the sample, i = 1, 2, …, n; j = 1, 2, …, m.
After the normalized process, the factor loading matrix is calculated from the eigenvalues λi of the sample correlation matrix R, which is symmetric,
R = [ 1 r 21 r 31 r p 1 r 21 1 r 21 r p 2 r 31 r 32 1 r p 3 r q 1 r q 2 r q 3 1 ] ,
Equation: rqp is the correlation coefficient of the variable Fm with Fn.
r q p = cov ( F q F p ) D ( F q ) D ( F p ) ,
Equation: cov(Fq, Fp) is the covariance of Fq and Fp; D(Fq) and D(Fp) are the variances of Fq and Fp, respectively. The raw sample data have been normalized so that there is:
D ( F q ) = D ( F p ) = 1 b i r = a i r cos θ + a i r sin θ r q p = a q p } .
From the above equation, aqp can be regarded as the correlation coefficient between Fq and Fp, which also exactly indicates the degree of linear combination of Xm and Fm. λi (i = 1, 2, …, m) are all the characteristic roots of the sample correlation matrix R, finding all the characteristic root λi (i = 1, 2, …, m) of the sample correlation matrix R and the corresponding normalized eigenvectors Ui (i = 1, 2, …, m),
λ 1 λ 2 λ m 0 ,
The eigenvectors are used to form the eigenvector matrix U = (U1, U2, …, Um), and the load matrix is derived from the characteristic root and eigenvectors A,
A = ( λ 1 U 1 , λ 2 U 2 , , λ m U m ,
The first k column vectors of the loading matrix A are used as the factor loading matrix, and the cumulative contribution of the factors is required,
i = 1 k λ i i = 1 m λ i 85 % .
The maximum variance method was chosen to perform the common factor rotation, and the new loading matrix B was obtained by left multiplying the loading matrix A with the orthogonal matrix Γ,
[ Γ ] = [ cos θ sin θ sin θ cos θ ] .
Let the elements of the ith row and jth column of B be bij, then we have:
b i r = a i r cos θ + a i r sin θ b i r = a i r cos θ + a i r sin θ } ,
where θ is the orthogonal rotation angle, i = (1, 2, …, p); r, j = (1, 2, …, n). After this transformation, the aim is to polarize the loading matrix and spread the factor contributions as much as possible, i.e., the b2ir, b2ig 2 sets of data are required to be spread as much as possible, the degree of dispersion is expressed by the variance of the samples (V1, V2, …, Vn), and the total variance is required to be maximum, that is, the request:
G = V 1 + V 2 + + V n = max ,
When the number of common factors is more than 2 (i.e., when m > 2), the orthogonal matrix Γ can generally only be obtained iteratively, and then a total of C m 2 = m ( m 1 ) / 2 rotations are required, after which a second round of C m 2 pairwise rotations can be performed, and so on until the variance converges to a certain limit and the rotation is stopped. The steps of factor analysis in this paper are shown in Figure 1.

2.2. Sparrow Search Algorithm (SSA)

The Sparrow Search Algorithm [32] (SSA) is a new swarm intelligence optimization algorithm proposed in 2020 to simulate sparrow foraging and anti-predation behaviors, which divides the sparrows in the population into a discoverer, a follower, and a certain ratio of scouts. The finder is responsible for finding food, the follower joins the finder for foraging, and the scout is responsible for scouting the surrounding environment and alerting to the danger in time.
The sparrow as a discoverer has good adaptability. It will preferentially obtain food and provide foraging orientation for followers during foraging, and the location update of the discoverer in each iteration is described as in Equation (12):
x i j t exp ( i α i t e r max ) , R 2 < S T x i j t exp ( i α i t e r max ) , R 2 < S T } = x i j t + 1 ,
where t is the current number of iterations; L is an all-1 matrix of 1 × d; itermax is the maximum number of iterations; Q and α are random numbers; x i j t denotes the position of the ith sparrow in the jth dimension at iteration t; R2 and ST are the warning value and safety threshold. When R2 < ST, it means there is no danger in the surrounding environment and the foraging range can continue to be expanded, and when R2ST, it means the scout detects danger in the surrounding area and sends an alert to the population, telling the population to move to a safe area as soon as possible.
The updated description of the follower’s location is as follows:
Q exp ( x w j t x i j t i 2 ) , i > N 2 x p j t + 1 + | x i j t x p j t + 1 | A + L , o t h e r } = x i j t + 1 ,
where A is a d-column matrix with random element values of 1 or −1 and A+ = AT(AAT)−1; xpj is the optimal position of the discoverer; xwj is the worst position in the game.
The scout generates the initial position randomly, and its subsequent position is updated as in Equation (14):
x i j t + β | x i j t x b j t | , f i > f g x i j t + K | x i j t x W J t | ( f i f w ) + ε , f i = f g } = x i j t + 1 ,
where xbj indicates the global best position; β denotes the iteration step size; fi indicates the current level of adaptation; fg and fw denote the global optimal and worst adaptation degrees; K is a random number between [−1, 1]; ε is the smallest constant that prevents the denominator from going to zero.
After completing one round of iterations, as described above, the position of the population will be changed in some way, and each iteration will make the population change in the direction of better fitness, and finally the optimal fitness will be obtained.

2.3. Probabilistic Neural Network (PNN)

The Probabilistic Neural Network ((PNN)) [33,34] is a feed forward neural network based on radial basis neural network, which uses the Parzen window function to calculate the conditional probability density function of the samples to be recognized and then completes the classification and recognition of patterns by Bayes classification criterion, and its topology is shown in Figure 2.
The role of the input layer is to receive the training sample data and multiply the values x of the input sample parameters with the weighting coefficients wi to obtain the scalar product Zi input to the model layer, as shown in Equation (15):
Z i = x w i ,
The pattern layer is used to calculate the matching relationship between the input vector and each pattern and return a scalar value. The vector Z is input to the pattern layer, and the input and output relationship of the jth neuron of the ith class of patterns in the pattern layer is:
φ i j = 1 ( 2 π ) 1 2 σ d e x p [ ( Z Z i j ) ( Z Z i j ) ] T / σ 2 ,
where φij is the output value of the jth neuron of the ith class of patterns in the pattern layer; σ is the smoothing factor; d is the dimensionality of the sample space data; and Zij is the jth center of the ith class of samples.
The main role of the summation layer is linear summation and weighted averaging. The summation layer takes the outputs of neurons belonging to the same class in the pattern layer and makes a weighted average,
v i = j - 1 L ϕ i j / L ,
where vi is the output of class i, (i = 1, 2, …, n); n is the total number of training sample patterns; L denotes the number of neurons in class i.
The last layer is the output layer and the Bayesian classification rule is applied to the output of the summation layer, and the neuron with the maximum posterior probability density is found to have an output of 1 among all the output layer neurons, and the rest of the neurons have an output of 0,
y = arg max ( f i ) ,
where y indicates the output of the output layer.

3. Dataset Preparations

3.1. Selection of Rockburst Prediction Indicators

The rockburst mechanism is complex and has significant randomness and suddenness. The selection of indicators is the key to accurately predicting the rockburst. The selection of predictive indicators should meet the following conditions: (1) less influenced by external factors, so the actual measured values of indicators are easy to obtain; (2) has a good representative, so it can accurately reflect the main characteristics of the occurrence of rockbursts; (3) capable of reflecting comprehensive information on rockburst characteristics. This paper is based on a large number of rockburst case study analyses to determine the rockburst prediction evaluation indicators.
From the geological structure of the occurrence of rockbursts, rockbursts usually occur in the deeper buried underground works and higher structural stress in the rock mass. From the structural surface of the rock, rockburst often occurs near the hard structural surface, and the more irregular the structural surface, the more likely to occur rockburst. The maximum tangential stress in the surrounding rock can reflect the above factors well, so the maximum tangential stress in the surrounding rock (σθ) is selected as the rockburst prediction evaluation indicators.
The occurrence of rockburst section form of the surrounding rock is mainly tensile damage, and rockburst usually occurs in the structural integrity and hard rock. The hardness of the rock is usually expressed in terms of uniaxial compressive strength. Through reading a large amount of literature, we found that the actual rockburst case of uniaxial tensile strength and uniaxial compressive strength is more documented, and most of the rock projects need to obtain these two mechanical properties, so the uniaxial tensile strength (σt) and uniaxial compressive strength (σc) are rockburst prediction evaluation indicators.
From an energy point of view, rockburst is the rapid release of energy gathered in high-energy reservoirs. Under the same stress conditions, the elastic energy index, the performance of rock aggregation, and the release of energy is positively correlated, so the rock elastic energy index (Wet) is selected as the rockburst prediction indicators. A number of rockburst cases have shown that the occurrence of rockbursts is closely related to the brittleness of the rock, and the brittleness coefficient of the rock is often used as a rockburst criterion. The stress coefficient is also commonly used as a rockburst criterion; therefore, the brittleness index (σc/σt) and the stress coefficient (σθ/σc) are rockburst prediction evaluation indicators.
Comprehensive analysis of the above, according to the causes and characteristics of the occurrence of rockburst, six rockburst impact factors (σθ, σt, σc, σc/σt, σθ/σc, Wet) were selected as the rockburst prediction indicators in this paper.

3.2. Sample Library of Rockburst Case Data

Rockburst is currently a common geological hazard in many underground rock projects at home and abroad, and many engineering rockburst cases have been well documented. In this paper, through literature research [35,36,37,38], based on the rockburst prediction evaluation indicators selected by the study, 75 groups of typical rockburst cases at home and abroad were selected, and some of the raw data are shown in Table 1, and the rockburst intensity level was divided into four levels, of which the actual distribution of rockburst levels is shown in Figure 3.
The number of rockburst case data collected in the least number of I samples, 14; the number of II samples is 17; the number of III samples is the most, 29; the number of IV samples is 15; the ratio of various types of samples is 1.4:1.7:2.9:1.5; there is a certain imbalance in the characteristics of various types of samples. However, the ratio of the maximum sample size to the minimum sample size is only slightly greater than 2. The imbalance problem of rockburst samples is small. Figure 4 shows the violin diagram of rockburst prediction evaluation indicators, whose horizontal coordinates indicate different rockburst levels, and vertical coordinates are rockburst prediction evaluation indicators. The violin chart is a combination of a box chart and a nuclear density chart, which gives a good indication of the shape of the distribution of the data. The white dot in the middle of the box line box indicates the median, the middle box line box indicates the interquartile range, the thin line extending from it represents the 95% confidence interval, and the outer shape is the nuclear density estimate.

4. Implementation Process of FA-SSA-PNN Model

4.1. Model Construction Steps

The 75 groups of rockburst case data collected show that there is variability in the dimensionality, which in turn leads to a decrease in the accuracy of the rockburst prediction model. In order to eliminate the impact of the difference in the dimensionality between the indicators and improve the accuracy of the rockburst prediction model, it is necessary to reduce the original rockburst prediction data, the dimensionality of the resulting comprehensive rockburst prediction data into the rockburst prediction model, and the prediction results of the model for analysis and discussion.
In this paper, Matlab software to program the calculation of the neural network algorithm to establish the FA-SSA-PNN rockburst prediction model process is shown in Figure 5, and the main steps are as follows:
Step 1: Analysis of the impact of rockburst factors; the selection of rockburst prediction indicators.
Step 2: Collect rockburst case data according to the selected rockburst prediction indicators.
Step 3: Use factor analysis to reduce the dimensionality of the collected rockburst case data to obtain the comprehensive rockburst prediction index CPI1, CPI2, CPI3.
Step 4: Partition the data set of the rockburst case data after dimensionality reduction processing; extract 80% of the overall rockburst prediction data samples as the training sets and 20% of the overall samples as the test sets.
Step 5: Imported the training samples into the SSA-PNN model and use the training for model training and updating parameters.
Step 6: After the training is completed, input the test samples to the model to test the network performance, get the rockburst intensity level prediction results, and calculate the accuracy of its rockburst intensity level prediction.

4.2. Test of Applicability of Factor Analysis

The rockburst cases at home and abroad were collected and organized, 75 groups of typical rockburst cases were selected as the sample data of the FA-SSA-PNN rockburst prediction model, the KMO test and Bartlett’s spherical test were used to test the applicability of factor analysis on the sample data, and the test results and applicability test criteria are shown in Table 2 and Table 3. It can be seen from Table 2 and Table 3 that it is feasible to conduct factor analysis on the selected rockburst case data.

4.3. Data Processing

The absolute value of the correlation coefficient r reflects the degree of linear correlation between the two rockburst prediction evaluation indicators. When |r| < 0.3, it means that the correlation between the two rockburst prediction evaluation indicators is extremely weak and can be regarded as uncorrelated; when 0.3 < |r| < 0.5, the two rockburst prediction evaluation indicators are low correlated; when 0.5 < |r| < 0.8, the two rockburst prediction evaluation indicators are significantly correlated; when 0.8 < |r| < 1, the two rockburst prediction evaluation indicators are extremely correlated. Correlation analysis of rockburst prediction evaluation indicators and the correlation coefficient between predictors is shown in Table 4. The absolute values of the correlation coefficients between σθ and σc, σθ and σt, σθ and σθ/σc, σc and σt, σc and Wet, and σt and σc/σt were all greater than 0.5, indicating that the rockburst prediction evaluation indicators were significantly correlated with each other and the sample data were suitable for factor analysis.
Factor analysis was used to reduce the dimensionality of the standardized 75 sets of rockburst data, and Mardia gave the correspondence between the original number of variables and the number of principal factors after dimensionality reduction in Table 5. In this paper, 6 rockburst prediction evaluation indicators were selected as the original number of variables, so the number of principal factors after factor analysis was set to 3. Table 6 shows the total variance interpretation of the rockburst prediction evaluation indicators, and we can see that the eigen values of the first three factor variables are all greater than 1 and the cumulative contribution of the first three principal factors is 85.538% > 85%, indicating that the first three principal factors retain 85.538% of the information carried by the original variables, so the extraction of the first three principal factors as influencing factors is consistent with the previous setting.
The changes in factor loadings before and after rotation are shown in Table 7. Combining the positive and negative correlations and the composite rate, it can be seen that the principal factor F1 is significantly positively correlated with the rockburst prediction evaluation indicators σθ, σc, σt, σθ/σc, indicating that the principal factor F1 concentrates on the maximum tangential stress, compressive strength, compressive strength, and the influence of the stress coefficient on the prediction results of rockburst. The principal factor F2 is only positively correlated with the indicator σc/σt, indicating that the main factor F2 combines the information of the indicators of the brittleness index, which can be referred to as the brittleness factor. The main factor F3 is positively correlated with the indicator Wet only and can be referred to as the energy factor.
Table 8 shows the factor score coefficient matrix. The factor analysis reallocated the weights of the impact of rockburst prediction evaluation indicators on the principal factor and reduced the impact of poorly correlated rockburst prediction evaluation indicators on the principal factor, resulting in a functional expression between the principal factors Y1, Y2, Y3 and the six rockburst prediction evaluation indicators, as follows ( x i * is the standardized data value of x i ).
Y 1 = 0.243 x 1 * + 0.444 x 2 * + 0.212 x 3 * 0.166 x 4 * + 0.185 x 5 * + 0.363 x 6 * Y 2 = 0.227 x 1 * + 0.061 x 2 * 0.376 x 3 * 0.050 x 4 * + 0.793 x 5 * + 0.136 x 6 * Y 3 = 0.409 x 1 * 0.266 x 2 * 0.103 x 3 * 0.736 x 4 * + 0.006 x 5 * + 0.095 x 6 * } ,
Standardized data are substituted into Equations (17)–(19) to obtain partial principal factor data (Table 1). The principal factor retains most of the information in the original data, so the three principal factors are comprehensive rockburst prediction evaluation indicators CPI1, CPI2, CPI3.

4.4. Datasets Segmentation

The sample data of rockburst after factor analysis (see Table 1) were divided into datasets, and 20% of the 75 sets of rockburst case data were taken as the test set, while 80% of the remaining data were used as the training set of the neural network model. After the division, there were 60 sets of sample data in the training set, and the training set was used to train the neural network model and update the parameters. There were 15 sets of sample data in the test set, and the test set was used to evaluate the generalization ability of the model and test the real prediction accuracy of the model.

4.5. Model Parameter Setting and Implementation

The traditional PNN model uses the original rockburst prediction evaluation indicators (σθ, σt, σc, σc/σt, σθ/σc, Wet) as the input vectors of the model. The FA-SAA-PNN rockburst prediction model developed in this paper used factor analysis to preprocess the original rockburst prediction evaluation indicators, and the comprehensive rockburst prediction indicators CPI1, CPI2, CPI3 obtained after factor analysis were used as the prediction input vectors of the model. The selection of the smoothing factor is the key to the performance of PNN networks, and when the value of the smoothing factor is too small, it tends to cause the network to be overfitted and in essence a nearest neighbor classifier; when the value of the smoothing factor is too large, the details cannot be fully distinguished so close to a linear classifier [39]. This paper makes use of the good global search ability of the SSA algorithm to optimize the smooth factor of PNN neural network. The algorithm has the advantages of being rapid and efficient when optimizing for a single objective, as well as good merit-seeking ability, which solves the problem of selecting the optimal smoothing factor and improves the accuracy of the prediction model.
At present, there is no uniform standard for rockburst intensity grading, and scholars have recognized the rockburst intensity level in four classes, respectively: no rockburst (I), minor rockburst (II), medium rockburst (III), and strong rockburst (IV). This paper uses the PNN network model output vector set to 1 × 4 line vector, the i class in the line vector of the i neuron output value of 1, and the rest of the neuron output value of 0, such as the output vector is (0, 0, 1, 0), which means that the prediction model predicts the sample data as a medium rockburst (III).
The main parameters of the FA-SSA-PNN model are shown in Table 9, and the rockburst prediction model is programmed and calculated in this paper using Matlab software version 2018b, and the code implementation is based on M language.

5. Model Performance Evaluation and Comparison

To verify the merit of the FA-SSA-PNN rockburst prediction model, test samples were input into the FA-SSA-PNN model, FA-PNN model, PNN model, RF model, SVM model, and ANN model [39], and the prediction results of each model are shown in Figure 6. To comprehensively evaluate the classification performance of each model, F1 value (the summed average of precision and recall), macro-average F1 value (the arithmetic mean of F1 for each category), and accuracy rate are used as the evaluation indicators of the models in this paper. F1 value and macro-average F1 value reflect the classification performance of the models for different rockburst intensity levels, and accuracy rate reflects the overall classification performance of the models.
The evaluation indicators for the six rockburst prediction models are shown in Table 10, and a comparison of the models shows that:
(1)
The FA-SSA-PNN model does not improve the F1 value of the primary rockburst compared to the PNN model; the F1 value for Level 2 rockburst is increased by 50% (from 50% to 100%); the F1 value for Level 3 rockburst is increased by 25.6% (from 66.7% to 92.3%); and the F1 value for Level 4 rockburst is increased by 20% (from 80% to 100%).
(2)
Compared with the original PNN model, the macro-average F1 value reflecting the classification performance of the model for different rockburst intensity level increased by 18.9% (from 69.2% to 88.1%) after the introduction of FA dimensionality reduction, and the macro-average F1 value improved but remained low, and then, after the optimization of the PNN neural network by the SSA algorithm, the macro-average F1 value increased by another 5% (from 88.1% to 93.1%), and the macro-average F1 values of the FA-SSA-PNN model were significantly higher than those of the other five rockburst prediction models.
(3)
The accuracy of the FA-PNN model after the introduction of FA improved by 13.3% (from 66.7% to 80%) compared with the original PNN model, and then, after the optimization of the PNN neural network by the SSA algorithm, the accuracy of the model improved by another 13.3% (from 80% to 93.3%), and the prediction accuracy of the FA-SSA-PNNN model was significantly higher than that of the other models, verifying the advantages and disadvantages of the FA-SSA-PNN rockburst intensity level prediction model.

6. Conclusions

As more and more underground rock projects move deeper at an unprecedented rate, the geological environment in which the rock masses are embedded is more complex, and the problem of rockburst hazards is becoming increasingly prominent. In this paper, based on 75 sets of typical rockburst case data collected, a rockburst intensity level prediction model based on FA-SSA-PNN is established, and F1 value, macro-averaged F1 value, and accuracy rate are introduced as the evaluation indexes of rockburst prediction model classification performance. This study proposes a new method for predicting the intensity level of rockbursts, which provides better guidance for the problem of predicting rockbursts in deep underground rock projects and can provide a reference for other geological hazard prediction problems similar to rockburst hazards, with the following main conclusions:
(1)
The maximum tangentialstress of surrounding rock (σθ), uniaxial tensile strength (σt), uniaxial compressive strength (σc), brittleness index (σc/σt), stress coefficient (σθ/σc), and elastic energy index (Wet) of surrounding rock are selected to form a rockburst prediction index system. The characteristic information of the original rockburst prediction indexes was compressed and extracted by the factor analysis method, and three comprehensive rockburst prediction indexes, CPI1,CPI2, and CPI3, were obtained. The introduction of factor analysis into the rockburst intensity level prediction eliminates the correlation between indicators and solves the problem of overlapping information of indicators, so that the comprehensive prediction index of rockburst after dimensionality reduction has a broader mathematical expression of Gaussian function in the PNN model.
(2)
Fifteen sets of rockburst case data were sampled as test data, and the prediction results of the FA-PNN model were analyzed and compared with those of the original PNN model. It was found that the macro-average F1 value and accuracy of the FA-PNN model were improved, with the macro-average F1 value reaching 88.1% (from 69.6% to 88.1%) and the accuracy rate reaching 80% (from 66.7% to 80%).
(3)
The SSA algorithm was used to select the smoothing factors in PNN to avoid the subjectivity and contingency of the existence of artificial preset smoothing factors. The comparison between the prediction results of FA-SSA-PNN rockburst prediction model and those of FA-PNN rockburst prediction model shows that, after the introduction of SSA algorithm, the accuracy of FA-SSA-PNN rockburst prediction model significantly improved, reaching 93.3% (increased from 80% to 93.3%), and the macro-average F1 value is 93.1% (increased from 88.1% to 93.1%). Moreover, the SSA algorithm has good optimization ability and can complete the optimization of smoothing factors in a few seconds. It greatly reduces the operation time of the model and improves the prediction efficiency of the model.
(4)
The prediction results of the FA-SSA-PNN model were compared and analyzed with those of the FA-PNN model, PNN model, RF model, SVM model, and ANN model, and the results showed that the macro-averaged F1 values and the prediction accuracy of the FA-SSA-PNN model were significantly higher than those of the other five models, which verified the feasibility and effectiveness of the FA-SSA-PNN rockburst prediction model.
The complexity of the rockburst mechanism and the many factors that induce rockburst, such as the traditional rockburst prediction methods, have not been able to make accurate and efficient predictions of the rockburst intensity level. Therefore, it will become more and more important to propose new methods for predicting rockburst intensity levels.

Author Contributions

Conceptualization, G.X. and K.L.; methodology, G.X.; software, G.X.; validation, Q.Q. and M.L.; formal analysis, G.X.; resources, R.Y.; data curation, G.X. and M.L.; writing—original draft preparation, G.X.; writing—review and editing, K.L. and Q.Q., supervision M.L. and R.Y.; visualization, Q.Q. and M.L.; supervision, R.Y.; project administration, Q.Q.; funding acquisition, K.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China (Grant No. 51934003) and the Yunnan major scientific and technological special project (Grant No. 202102AG050024).

Data Availability Statement

No applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Feng, X.; Xiao, Y.; Feng, G.; Yao, Z.; Chen, B.; Yang, C.; Su, G. Study on the development process of rockbursts. Chin. J. Rock Mech. Eng. 2019, 38, 649–673. [Google Scholar] [CrossRef]
  2. He, S.; Song, D.; Li, Z.; He, X.; Chen, J.; Li, D.; Tian, X. Precursor of Spatio-temporal Evolution Law of MS and AE Activities for Rock Burst Warning in Steeply Inclined and Extremely Thick Coal Seams Under Caving Mining Conditions. Rock Mech. Rock Eng. 2019, 52, 2415–2435. [Google Scholar] [CrossRef]
  3. Xue, Y.; Li, Z.; Li, S.; Qiu, D.; Tao, Y.; Wang, L.; Yang, W.; Zhang, K. Prediction of rock burst in underground caverns based on rough set and extensible comprehensive evaluation. Bull. Eng. Geol. Environ. 2019, 78, 417–429. [Google Scholar] [CrossRef]
  4. Li, X.; Gong, F.; Wang, S.; Li, D.; Tao, M.; Zhou, J.; Huang, L.; Ma, C.; Du, K.; Feng, F. Coupled static-dynamic loading mechanical mechanism and dynamic criterion of rockburst in deep hard rock mines. Chin. J. Rock Mech. Eng. 2019, 38, 708–723. [Google Scholar] [CrossRef]
  5. Lin, M.; Gao, C.; Xia, Y.; Zhang, D.; Liu, X.; Liang, X. Rock burst initiation and precursors in a model specimen based on acoustic emission and infrared monitoring. Arab. J. Geosci. 2022, 15, 333. [Google Scholar] [CrossRef]
  6. Ren, J.; Zhang, W.; Wu, Z.; Li, J.; Shen, Y. Microseismic Signals in Heading Face of Tengdong Coal Mine and Their Application for Rock Burst Monitoring. Shock. Vib. 2021, 2021, 6650446. [Google Scholar] [CrossRef]
  7. Shirani Faradonbeh, R.; Shaffiee Haghshenas, S.; Taheri, A.; Mikaei, R. Application of self-organizing map and fuzzy c-mean techniques for rockburst clustering in deep underground projects. Neural Comput. Appl. 2019, 32, 8545–8559. [Google Scholar] [CrossRef]
  8. Ma, C.; Chen, W.; Tan, X.; Tian, H.; Yang, J.; Yu, J. Novel rockburst criterion based on the TBM tunnel construction of the Neelum–Jhelum (NJ) hydroelectric project in Pakistan. Tunn. Undergr. Space Technol. 2018, 81, 391–402. [Google Scholar] [CrossRef]
  9. Xu, L.; Wang, L. Study on the laws of rockburst and its forecasting in the tunnel of Erlang Mountain road. Chin. J. Geotech. Eng. 1999, 21, 569–572. [Google Scholar]
  10. Lu, J. Study on mechanism of rockburst in a headrace tunnel. In 1st National Congress of Chinese Society for Numerical Calculation and Model Experiment of Rock Mechanics; Southwest Jiaotong University Press: Chengdu, China, 1986; pp. 210–214. [Google Scholar]
  11. Jiang, L.; Kong, P.; Zhang, P.; Shu, J.; Wang, Q.; Chen, L.; Wu, Q. Dynamic Analysis of the Rock Burst Potential of a Longwall Panel Intersecting with a Fault. Rock Mech. Rock Eng. 2019, 53, 1737–1754. [Google Scholar] [CrossRef]
  12. Yang, Z.; Liu, C.; Zhu, H.; Xie, F.; Dou, L.; Chen, J. Mechanism of rock burst caused by fracture of key strata during irregular working face mining and its prevention methods. Int. J. Min. Sci. Technol. 2019, 29, 889–897. [Google Scholar] [CrossRef]
  13. Ma, T.; Tang, C.; Tang, S.; Kuang, L.; Yu, Q.; Kong, D.; Zhu, X. Rockburst mechanism and prediction based on microseismic monitoring. Int. J. Rock Mech. Min. Sci. 2018, 110, 177–188. [Google Scholar] [CrossRef]
  14. Xu, C.; Liu, X.; Wang, E.; Zhang, Y.; Wang, S. Rockburst prediction and classification based on the idealpoint method of information theory. Tunn. Undergr. Space Technol. 2018, 81, 382–390. [Google Scholar] [CrossRef]
  15. Guo, J.; Zhang, W.; Zhao, Y. A multidimensional cloud model for rockburst prediction. Chin. J. Rock Mech. Eng. 2018, 37, 1199–1206. [Google Scholar] [CrossRef]
  16. Lin, Y.; Zhou, K.; Li, J. Application of cloud model in rock burst prediction and performance comparison with three machine learnings algorithms. IEEE Access 2018, 30, 958–968. [Google Scholar] [CrossRef]
  17. Wang, X.; Li, S.; Xu, Z.; Xue, Y.; Hu, J.; Li, Z.; Zhang, B. An interval fuzzy comprehensive assessment method for rock burst in underground caverns and its engineering application. Bull. Eng. Geol. Environ. 2019, 78, 5161–5176. [Google Scholar] [CrossRef]
  18. Adoko, A.; Gokceoglu, C.; Wu, L.; Zuo, Q. Knowledge-based and data-driven fuzzy modeling for rockburst prediction. Int. J. Rock Mech. Min. Sci. 2013, 61, 86–95. [Google Scholar] [CrossRef]
  19. Wang, C.; Wu, A.; Lu, H.; Bao, T.; Liu, X. Predicting rockburst tendency based on fuzzy matter–element model. Int. J. Rock Mech. Min. Sci. 2015, 75, 224–232. [Google Scholar] [CrossRef]
  20. Shi, X.; Zhou, J.; Dong, L.; Hu, H.; Wang, H.; Chen, S. Application of unascertained measurement model to prediction of classification of rock burst Intensity. Chin. J. Rock Mech. Eng. 2010, 29, 2720–2726. [Google Scholar]
  21. Li, Z.; Xue, Y.; Li, S.; Qiu, D.; Zhang, L.; Zhou, Y.; Zhou, B. Rock burst risk assessment in deep-buried underground caverns: A novel analysis method. Arab. J. Geosci. 2020, 13, 388. [Google Scholar] [CrossRef]
  22. Peng, T.; Deng, H. Comprehensive evaluation on water resource carrying capacity in karst areas using cloud model with combination weighting method: A case study of Guiyang, southwest China. Environ. Sci. Pollut. Res. 2020, 27, 37057–37073. [Google Scholar] [CrossRef] [PubMed]
  23. Gong, F.; Li, X. Distance discrimination method for rockburst occurrence and intensity classification prediction and its application. Chin. J. Rock Mech. Eng. 2007, 26, 1012–1018. [Google Scholar]
  24. Yang, X.; Pei, Y.; Cheng, H.; Hou, X.; Lu, J. Prediction method of rockburst intensity grade based on SOFM neural network model. Chin. J. Rock Mech. Eng. 2021, 40, 2708–2715. [Google Scholar] [CrossRef]
  25. Li, M.; Li, K.; Qin, Q.; Wu, S.; Liu, Y.; Liu, B. Discussion and selection of machine learning algorithm model for rockburst intensity grade prediction. Chin. J. Rock Mech. Eng. 2021, 40, 2806–2816. [Google Scholar] [CrossRef]
  26. Tang, Z.; Xu, Q. Rockburst prediction based on nine machine learning algorithms. Chin. J. Rock Mech. Eng. 2020, 39, 773–781. [Google Scholar] [CrossRef]
  27. Tian, R.; Meng, H.; Chen, S.; Wang, C.; Zhang, F. Prediction of intensity classification of rockburst based on deep neural network. J. Chin. Coal. Soc. 2020, 45, 191–201. [Google Scholar] [CrossRef]
  28. Jia, Y.; Lu, Q.; Shang, Y. Rockburst prediction using particle swarm optimization and generalized regression neural network. Chin. J. Rock Mech. Eng. 2013, 32, 343–348. [Google Scholar]
  29. Xue, Y.; Bai, C.; Qiu, D.; Kong, F.; Li, Z. Predicting rockburst with database using particle swarm optimization and extreme learning machine. Tunn. Undergr. Space Technol. 2020, 98, 103287. [Google Scholar] [CrossRef]
  30. Zhou, J.; He, Y.; Huang, R.; Ju, N. Weights of slope stability evaluation indexes based on factor analysis method. J. Southwest Jiaotong Univ. 2015, 50, 325–330. [Google Scholar]
  31. Wu, S.; Zhang, C.; Cheng, Z. Prediction of intensity classification of rockburst based on PCA-PNN principle. J. Chin. Coal Soc. 2019, 44, 2767–2776. [Google Scholar] [CrossRef]
  32. Chen, Y.; Liu, Z.; Xiao, C.; Zhao, X.; Li, K.; Pang, L.; Shi, Y.; Li, S. Overlapping Peak Analysis of Soil Heavy Mettal X-Ray Fluorescence Spectra Based on Sparrow Search algorithm. Spectrosc. Spectr. Anal. 2021, 41, 2175–2180. [Google Scholar]
  33. Cheng, B. Research on Transformer Fault Diagnosis Based on the Combination of Rough Set-Probabilistic Neural Network. Master’s Thesis, Guangxi University, Nanning, China, 2008. [Google Scholar]
  34. Du, Z.; Zhao, J.; Li, H.; Zhang, X. Afauit diagnosis method of a plunger pump based on SA-EMD-PNN. J. Shock Vib. 2019, 38, 145–152. [Google Scholar] [CrossRef]
  35. Wang, Y.; Li, W.; Li, Q.; Xu, Y.; Tan, G. Method of fuzzy comprehensive evaluations for rockburst prediction. Chin. J. Rock Mech. Eng. 1998, 17, 493–501. [Google Scholar]
  36. Zhou, J.; Li, X.; Shi, X. Long-term prediction model of rockburst in underground openings using heuristic algorithms and support vector machines. Saf. Sci. 2011, 50, 629–644. [Google Scholar] [CrossRef]
  37. Dong, L.; Li, X.; Peng, K. Prediction of rockburst classifi-cation using Random Forest. Trans. Nonferrous Met. Soc. China 2013, 23, 472–477. [Google Scholar] [CrossRef]
  38. Afraei, S.; Shahriar, K.; Madani, S. Developing intelligent classification models for rock burst prediction after recognizing significant predictor variables, Section 1: Literature review and data preprocessing procedure. Tunn. Undergr. Space Technol. 2019, 83, 324–353. [Google Scholar] [CrossRef]
  39. Wang, J.; Zhou, Z.; Li, K.; Wang, H.; Fu, Z.; Li, X. Evaluation model for the risk grade of rock burst based on the R-type factor analysis and a probabilistic neural network. J. Shock Vib. 2019, 38, 192–203. [Google Scholar] [CrossRef]
Figure 1. Factor analysis flow chart.
Figure 1. Factor analysis flow chart.
Energies 15 05016 g001
Figure 2. Topology of probabilistic neural network.
Figure 2. Topology of probabilistic neural network.
Energies 15 05016 g002
Figure 3. Rockburst actual intensity level distribution.
Figure 3. Rockburst actual intensity level distribution.
Energies 15 05016 g003
Figure 4. Violin diagram of rockburst prediction indicators: (a) σθ distribution; (b) σc distribution; (c) σt distribution; (d) σθc distribution; (e) σc/σt distribution; (f) Wet distribution.
Figure 4. Violin diagram of rockburst prediction indicators: (a) σθ distribution; (b) σc distribution; (c) σt distribution; (d) σθc distribution; (e) σc/σt distribution; (f) Wet distribution.
Energies 15 05016 g004aEnergies 15 05016 g004b
Figure 5. Flow chart of the rockburst prediction model of FA-SSA-PNN.
Figure 5. Flow chart of the rockburst prediction model of FA-SSA-PNN.
Energies 15 05016 g005
Figure 6. Rockburst prediction model test results: (a) PNN model; (b) FA-PNN model; (c) FA-SSA-PNN model; (d) ANN model; (e) SVM model; (f) RF model.
Figure 6. Rockburst prediction model test results: (a) PNN model; (b) FA-PNN model; (c) FA-SSA-PNN model; (d) ANN model; (e) SVM model; (f) RF model.
Energies 15 05016 g006aEnergies 15 05016 g006b
Table 1. Data of some domestic and international rockburst cases [35,36,37,38].
Table 1. Data of some domestic and international rockburst cases [35,36,37,38].
Serial
Number
Primitive Rockburst Prediction IndicatorsComprehensive Rockburst
Prediction Indicators
Actual Level
σθσcσtσθ/σcσc/σtWetCPI1CPI2CPI3
118.81785.70.1131.237.40.5490.4560.964I
296.4118.320.380.1947.931.870.4110.6570.933I
315.253.85.560.2839.681.920.5620.3141.001I
61481201.50.4805.80.6060.9980.746III
6248.751808.30.2721.6950.6340.3200.768III
631051151.50.5576.675.70.5380.8950.486III
6433.94117.484.230.2927.772.370.6440.4970.892II
6514.9611550.1235.70.4980.4031.059I
66157.391.236.920.5813.186.270.3110.0880.317IV
6791.43157.6311.960.5813.186.270.5590.1080.397IV
6813.91244.220.11229.42.040.6670.5381.086I
6938.271.43.40.53213.60.5390.4230.718III
7039.469.22.70.5725.63.80.5370.4780.686III
715217570.3255.20.6150.3680.744III
72105304.2120.90.3514.5610.570.639−0.0940.331IV
7335.82127.934.430.2828.93.670.6080.4850.872II
7469.819822.40.358.844.680.763−0.0620.570II
7555.41767.30.3124.119.30.4520.2900.683III
Note: Groups 1 to 60 are the training sets; Groups 61 to 75 are the test sets.
Table 2. Results of factor analysis method applicability test.
Table 2. Results of factor analysis method applicability test.
Kaiser-Meyer-Olkin testKMO value0.641
Bartlett spherical testchi-squared test value187.075
Sig0.000
Table 3. Applicability test criteria of factor analysis method.
Table 3. Applicability test criteria of factor analysis method.
Test MethodRange of ValuesFactor Analysis Applicability
Kaiser-Meyer-Olkin test>0.9Perfect suitable
0.8~0.9Great suitable
0.7~0.8Relatively suitable
0.6~0.7Suitable
0.5~0.6Barely suitable
<0.5Not suitable
Bartlett spherical testsig ≤ 0.01Suitable
Table 4. Correlation coefficients among prediction evaluation indicators.
Table 4. Correlation coefficients among prediction evaluation indicators.
Indicatorsσθσcσtσθ/σcσc/σtWet
σθ1.000.4110.4490.410−0.1140.541
σc0.4111.000.677−0.089−0.1530.643
σt0.4490.6771.000.142−0.5830.588
σθ/σc0.410−0.0890.1421.00−0.2200.276
σc/σt−0.114−0.153−0.583−0.2201.00−0.174
Wet0.5410.6430.5880.240−0.1741.00
Table 5. Relationship between the number of original variables and the number of main factors.
Table 5. Relationship between the number of original variables and the number of main factors.
Number of original variables578911
Number of principal factors23 456
Table 6. Total variance explained.
Table 6. Total variance explained.
Principal
Factor
Load Sum of SquaresSum of Squared Rotating Loads
Eigen ValueVariance
Contribution
Cumulative Variance ContributionEigen ValueVariance ContributionCumulative Variance Contribution
F12.89748.282%48.282%2.41040.160%40.160%
F21.18619.769%68.051%1.36722.785%62.945%
F31.04917.486%85.538%1.35622.593%85.538%
Table 7. Changes in factor loadings before and after rotation.
Table 7. Changes in factor loadings before and after rotation.
IndicatorsFactor Loading before RotationFactor Loadings after Rotation
F1F2F3F1F2F3
σθ0.874−0.150−0.3150.907−0.130−0.173
σc0.823−0.1000.2810833−0.0720.260
σt0.769−0.5120.1260.704−0.6220.570
σθ/σc0.7120.2780.4230.6280.460−0.606
σc/σt0.3440.8750.123−0.0610.965−0.118
Wet0.489−0.2210.813−0.029−0.1580.934
Table 8. Factor score coefficient matrix.
Table 8. Factor score coefficient matrix.
IndicatorsFactor Score Coefficients
F1F2F3
σθ0.2430.2270.409
σc0.4440.061−0.266
σt0.212−0.376−0.103
σθ/σc−0.166−0.0500.736
σc/σt0.1850.7930.006
Wet0.3630.1360.095
Table 9. Main parameters of FA-SSA-PNN model.
Table 9. Main parameters of FA-SSA-PNN model.
Serial NumberParametersParameter Values
1Number of neurons in the input layer3
2Number of neurons in the pattern layer60
3Number of neurons in summation layer4
4Number of neurons in the output layer4
5Mode layer activation functionGauss function
6Optimization parametersSpread Value
7Number of populations of SSA100
8Maximum number of iterations of SSA20
9Proportion of discoverers70%
10Scout’s ratio20%
11Early warning values0.6
Table 10. Model evaluation indicators.
Table 10. Model evaluation indicators.
Evaluation IndicatorsIntensity LevelPNNFA-PNNSSA-FA-PNNANNSVMRF
Accuracy rateI0.6670.5000.6670.5001.0000.667
II0.4001.0001.0001.0001.0001.000
III0.8001.0001.0000.8570.7780.875
IV1.0001.0001.0001.0001.0000.667
Recall RateI1.0001.0001.0001.0001.0001.000
II0.6670.6671.0000.6670.6670.333
III0.5710.8570.8570.8571.0001.000
IV0.6671.0001.000.8000.6670.667
F1 valueI0.8000.6670.800.6671.0000.800
II0.5000.8001.000.8000.8000.500
III0.6670.9230.9230.8570.8750.933
IV0.801.0001.000.6670.8000.667
Macro average F1 value-0.6920.8810.9310.7810.86.90.725
Accuracy-0.6670.8000.9330.8000.8000.867
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xu, G.; Li, K.; Li, M.; Qin, Q.; Yue, R. Rockburst Intensity Level Prediction Method Based on FA-SSA-PNN Model. Energies 2022, 15, 5016. https://doi.org/10.3390/en15145016

AMA Style

Xu G, Li K, Li M, Qin Q, Yue R. Rockburst Intensity Level Prediction Method Based on FA-SSA-PNN Model. Energies. 2022; 15(14):5016. https://doi.org/10.3390/en15145016

Chicago/Turabian Style

Xu, Gang, Kegang Li, Mingliang Li, Qingci Qin, and Rui Yue. 2022. "Rockburst Intensity Level Prediction Method Based on FA-SSA-PNN Model" Energies 15, no. 14: 5016. https://doi.org/10.3390/en15145016

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop