Next Article in Journal
Energy Efficient Underlaid D2D Communication for 5G Applications
Next Article in Special Issue
China Coastal Bulk (Coal) Freight Index Forecasting Based on an Integrated Model Combining ARMA, GM and BP Model Optimized by GA
Previous Article in Journal
Time-Dependent Prediction of Microblog Propagation Trends Based on Group Features
Previous Article in Special Issue
Abnormal Cockpit Pilot Driving Behavior Detection Using YOLOv4 Fused Attention Mechanism
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Intelligent Identification Approach Using VMD-CMDE and PSO-DBN for Bearing Faults

1
Guoneng Railway Equipment Co., Ltd., Beijing 100120, China
2
Dalian Locomotive & Rolling Stock Co., Ltd., Dalian 116300, China
3
College of Mechanical Engineering, Dalian Jiaotong University, Dalian 116028, China
4
College of Rolling Stock Engineering, Dalian Jiaotong University, Dalian 116028, China
5
School of Electronic Information and Automation, Civil Aviation University of China, Tianjin 300300, China
*
Authors to whom correspondence should be addressed.
Electronics 2022, 11(16), 2582; https://doi.org/10.3390/electronics11162582
Submission received: 18 July 2022 / Revised: 9 August 2022 / Accepted: 9 August 2022 / Published: 18 August 2022
(This article belongs to the Special Issue Advanced Machine Learning Applications in Big Data Analytics)

Abstract

:
In order to improve the fault diagnosis accuracy of bearings, an intelligent fault diagnosis method based on Variational Mode Decomposition (VMD), Composite Multi-scale Dispersion Entropy (CMDE), and Deep Belief Network (DBN) with Particle Swarm Optimization (PSO) algorithm—namely VMD-CMDE-PSO-DBN—is proposed in this paper. The number of modal components decomposed by VMD is determined by the observation center frequency, reconstructed according to the kurtosis, and the composite multi-scale dispersion entropy of the reconstructed signal is calculated to form the training samples and test samples of pattern recognition. Considering that the artificial setting of DBN node parameters cannot achieve the best recognition rate, PSO is used to optimize the parameters of DBN model, and the optimized DBN model is used to identify faults. Through experimental comparison and analysis, we propose that the VMD-CMDE-PSO-DBN method has certain application value in intelligent fault diagnosis.

1. Introduction

Rolling bearing is one of the most commonly used components in rotating machinery. Its working state directly affects the performance of the whole equipment and even the safety of the whole production line [1,2,3,4]. Therefore, research on intelligent fault diagnosis technology of rolling bearing has important theoretical value and practical significance in avoiding accidents. The operating conditions of rolling bearing in engineering applications are complex and changeable [5,6,7,8,9]. The collected fault vibration signal is easily disturbed by uncontrollable factors, and the subsequent diagnosis and prediction accuracy will also be reduced [10,11,12,13,14].
The complex problem of signal noise reduction in practical engineering was studied and analyzed by combining with the characteristics of wavelet packet decomposition, leading to a new signal noise reduction method; experimental results show that the method has good noise reduction ability [15,16,17,18]. A series of analyses on the problem were carried out, revealing that the initial fault feature information of mechanical equipment is affected by strong background noise, and verifying the effectiveness of the new denoising method of the airspace and neighborhood of wavelet packet transforms [19,20,21,22]. In order to solve the problem that the measured vibration signal of the discharge structure is interfered with by noise, the wavelet packet threshold with the optimized empirical mode decomposition was combined, and a new method to eliminate noise interference was proposed [23,24,25,26,27,28]. On the basis of EMD algorithm, many optimization algorithms with good effects have been derived, which also have good performance in engineering applications. However, they are all based on EMD in essence, so the mode aliasing problem is difficult to solve. Konstantin [29] proposed Variational Mode Decomposition (VMD) in 2014; the VMD method not only has good a signal-to-noise separation effect for non-stationary vibration signals, but also the decomposition scale can be preset according to the vibration signal itself. If an appropriate scale can be selected, the occurrence of mode aliasing will be effectively suppressed. Mostafa et al. [30] proposed a new complexity theory, namely Dispersion Entropy (DE), for the defects of slow calculation speed and unreasonable measurement methods of general complexity theory. The entropy of a single scale often cannot show more complete information in feature extraction, which leads to the final classification not having ideal results. More signals are analyzed by multi-scale analysis of complexity theory. For example, Zhang et al. [31] extracted fault features by LMD multi-scale approximate entropy. Wang et al. [32] calculated the gear signal with the Variational Mode Decomposition (VMD) method, and selected four modal components after decomposition to calculate permutation entropy to extract features. Li et al. [33] have significantly improved the fault identification by combining Empirical Wavelet Transform (EWT) with various algorithms of dispersion entropy (DE). In 2006, Hinton et al. [34] published a significant paper. In Science, they told many scholars about the concept of deep learning, and specifically expounded the Deep Belief Network (DBN), which stimulated people’s enthusiasm for deep learning theory research and learning. Lei et al. [35] have found that training mechanical vibration signals of relevant faults through deep learning neural network is more conducive to fault identification and classification. This paper also points out the advantages of using deep learning theory for fault diagnosis, which is mainly reflected in breaking the researchers’ dependence on many types of signal processing technology and fault diagnosis experience. Starting with the statistical characteristics of vibration signals, Shan et al. [36] achieved the simultaneous identification of different types and degrees of bearing faults, and finally obtained a high classification accuracy. It was confirmed that the application of DBN in fault diagnosis has a good effect compared with traditional fault diagnosis. Shi et al. [37], through experimental verification, found that when pattern recognition is carried out on gears, the recognition rate of fault features using Particle Swarm Optimization support vector machine is considerable. Other fault diagnosis methods have also been proposed in recent years [38,39,40,41,42,43,44,45,46,47].
In this paper, the data of the Electrical laboratory of Case Western Reserve University have been used for experiments. Through the noise reduction method of variational mode decomposition, the signals of the four states of normal bearing condition, bearing inner ring fault, rolling body fault, and bearing outer ring fault are decomposed into multiple modal components. The reconstructed signals preprocessed by variational mode decomposition were combined with multi-scale permutation entropy, multi-scale dispersion entropy, and composite multi-scale dispersion entropy, and their method principles were analyzed. The rolling bearing data were used for simulation, and the eigenvalues of the three methods were calculated as the input of the classification model. Three kinds of multi-scale entropy values were used as feature vectors and input into the Deep Belief Network (DBN) model for fault pattern recognition. In order to solve the problem that it is time consuming to debug the network layer structure in a deep belief network (DBN) when it is used for bearing fault diagnosis, a fault identification model of DBN bearing based on Particle Swarm Optimization (PSO) was proposed. The model uses particle swarm optimization (PSO) algorithm to find the optimal solution of hidden layer node parameters, and then compares the function between DBN model and PSO-DBN model and draws a conclusion.

2. Composite Multi-Scale Dispersion Entropy Based on VMD

2.1. Variational Mode Decomposition Algorithm

The essence of the VMD decomposition method is related to selecting the number of components (parameter K) to decompose the original signal   f t into a corresponding number of sub-signal components u k ; these decomposed modal components can ensure the sparsity and reproduce the input signal. In short, the Gaussian smoothing of demodulated signal is used to estimate the bandwidth, and then the constraints are divided into the following:
m i n u k , ω k k | | t δ t + j π t u k t e j w k t 2 2 , s . t . k u k = f
Most of the optimal solutions of constrained models are solved by alternative direction method of multipliers (ADMM), alternately updating u k n + 1 ,     ω k n + 1 , and λ n + 1 to look for a Lagrangian augmented “saddle point”; the specific steps are as follows:
Initialize u k l , ω k l , λ ; n O ; make   n n + 1 for k = 1 : K to update U k :
u ^ k n + 1 ω = f ω i k u ω + λ ω ^ 2 1 + 2 α ω ω k 2
For all   ω 0 , update     u ^ k ; the formula is as follows:
u ^ k n + 1 ω f ^ ω i < k u ^ i n + 1 ω i > k u ^ i n ω + λ ^ n ω 2 1 + 2 α ω ω k n 2 , k 1 , K
Update ω k :
λ ^ n + 1 ω λ ^ n ω + τ f ^ ω k u k n + 1 ω
Repeat (3)~(4) until the following iterative conditions are met:
k n + 1 n u k u k 2 2 / u ^ k n 2 2 < ε
Usually, the u k n + 1 problem is transformed into the minimum problem; the same is true for the solution of center frequency ω k n + 1 :
ω k n + 1 = a r g m i n ω k t δ t + j π t u k t e j ω k t 2 2  

2.2. Composite Multi-Scale Dispersion Entropy

2.2.1. Dispersion Entropy Algorithm

Dispersion Entropy (DE) is an index to measure the complexity of a time series. When it was first proposed, it was mostly applied in the field of biology. The main construction steps and descriptions of DE are described as follows [30]:
Supposing a time series   x = x i , i = 1 , 2 , , N of length N, the normal distribution Function (7) is used to map time series x to y = y j , j = 1 , 2 , , N ,   y j 0 , 1 .
y j = 1 σ 2 π x i e ( t μ ) 2 2 σ 2 d t
where μ is mathematical expectation and σ 2 is variance.
The linear transformation is performed using Formula (8), mapping y to the range of 1 , 2 , , c :
z j c = R c y j + 0.5
where R is an integral function and c is the number of categories.
Calculating the embedded vector z i m , c is as follows:
z i m , c = z i c , z i + d c , , z i + m 1 d c , i = 1 , 2 , , N m 1 d  
where   m is an embedded dimension and d is time delay.
Calculating the probability   p π v v v 1 v m 1 of π v 0 v 1 v m 1 for each dispersion mode is as follows:
p π v 0 v 1 v m 1 = Number π v 0 η 1 v m 1 N m 1 d
where Number   π v 0 v 1 v m 1 represents the number of maps z i m , c to π v 0 v 1 v m 1 .
The DE value of the original signal x is
D E x , m , c , d = π = 1 c m p π v 0 v 1 v m 1 ln p π v 0 v 1 v m 1

2.2.2. Composite Multi-Scale Dispersion Entropy

The calculation method of composite multi-scale dispersion entropy involves optimizing the multi-scale process on the basis of multi-scale dispersion entropy; the steps and instructions are as follows:
For an initial time series u i , i = 1 , 2 , , L , when the time is in the k-th coarsening sequence and the scale factor is τ,   x k τ = x k , 1 τ , x k , 2 τ , can be given by Formula (12):
x k , j τ = 1 τ i = k + τ ( j 1 ) k + j τ 1 u i , 1 j L / τ
where 1 k τ .
The CMDE under each scale factor is defined as
CMDE ( X , m , c , d , τ ) = 1 τ k = 1 τ D E x k τ , m , c , d

2.3. Fault Eigenvalue Based on VMD Composite Multi-Scale Entropy

In this paper, the experimental data of the bearing data center of Case Western Reserve University are selected for the simulation test, and the selection of important parameters is compared and analyzed. The specific data of bearing are as follows: the acquisition frequency is 12,000 Hz; the motor speed is 1797 r/min; and four vibration signals are included, namely an inner ring (IR) fault, outer ring (OR) fault, rolling element (BE) fault, and a local single-point pitting normal state (Norm).

2.3.1. The Process of Fault Eigenvalue Calculation

The specific steps of VMD composite multi-scale dispersion entropy are as follows:
Step 1: Firstly, the original vibration signals (inner and outer ring fault signals, roller fault signals, and normal signals) in the four bearing databases are decomposed and preprocessed by VMD.
Step 2: The kurtosis of the decomposed modal components is calculated and sorted.
Step 3: The first three modal components are selected for signal reconstruction.
Step 4: The composite multi-scale dispersion entropy of the reconstructed four signals is calculated.

2.3.2. Simulation Signal Analysis

In this paper, a vibration signal with a motor speed of 1797r/min in the bearing experiment database of Western Reserve University is decomposed by VMD, where determining the value of modal component K is the primary task. For example, the center frequency of the modal component of the outer ring fault signal is simulated. The value of K in the simulation diagram is reflected in the number of curves in the center frequency diagram of the modal component, and its value is determined by observing the convergence trend of the curve. Selecting K = 4, K = 5, and K = 6, the corresponding center frequency curves are described as follows.
The abscissa in the figure represents the number of iterations, and the ordinate represents the center frequency. The four curves represent the central frequency convergence process of the four modal components, respectively. When K = 4, as shown in Figure 1, the four curves do not overlap, which proves that there is no mode mixing. There are occasional fluctuations in the previous iteration, and the convergence is fast. When the number of components K is 5, the relationship between the center frequency of the modal component and the iteration parameters is as shown in Figure 2. With the increase in the number of abscissa iterations, the center frequencies corresponding to the five modal components converge smoothly and fluctuate less, and there is no curve intersection. When the number of decomposition K = 6 is selected and the same vibration signal is decomposed, the central frequency convergence process of the modal component is as shown in Figure 3 and Figure 4. The abscissa in the figure represents the number of iterations, and the ordinate represents the center frequency. From the curves corresponding to the six modal components, it is obvious that the third, fourth, and fifth curves also correspond to the intersection of the third, fourth, and fifth order modal components, respectively. This proves that there is modal mixing between modal components, and the convergence speed is slow. In summary, in the VMD decomposition preprocessing of this kind of bearing vibration signal, the preset value of the modal component is 5, which is more effective for the signal decomposition effect and helpful for the next feature extraction.
From the calculation formulas of multi-scale dispersion entropy and composite multi-scale dispersion entropy, it can be seen that five parameters need to be selected. They are the length N of the sequence, the embedding dimension m, the number of categories c, the time delay d and the scale factor τ. In this paper, the length n = 1024, the embedding dimension m = 3, the number of categories c = 6, the time delay d = 1, and the scale factor are selected through simulation analysis. Figure 4, Figure 5 and Figure 6 show a random point entropy curve corresponding to scale factors 8, 10, and 12, respectively.
The abscissa in the figure is the number of scale factors, and the ordinate is the composite multi-scale dispersion entropy. Since the selection of basic theory and parameters and the multi-scale dispersion entropy are roughly the same, the curves are roughly the same as a whole. Except for the normal signals, the overall trend of the vibration signals of the other three faults is to decline first and then flatten. During the change of scale factors from 1 to 4, except when they are in the upward trend under normal conditions, the other three fault signals are in the downward trend, and the downward trend is obvious from the instantaneous change rate. When the scale factor ranges from 4 to 8, the overall decline is relatively gentle, with occasional fluctuations, and the decline of the inner ring fault is more obvious. When the scale factor ranges from 8 to 10, the decline is gentle, and the entropy of the fault signal is slowly approaching. The reason why the normal situation is different from the three fault signals is that there is no periodic vibration similar to the fault signal. When the scale factor ranges from 10 to 12, the entropy of the fault signal has a tendency to coincide, and the CMDE value does not change much, but the simulation time is longer with the increase of parameters.
Combined with the above simulation and analysis of the CMDE of the four preprocessed vibration signals, when the scale factor is 10, it can not only ensure that the deep-seated information of the vibration signal is extracted, but also ensure that the time will not be consumed too much. Therefore, the composite multi-scale dispersion entropy scale factor in this paper is 10.

3. Fault Identification Model Based on PSO-DBN

3.1. DBN Network Structure

As one of the typical deep learning algorithms, the Deep Belief Network (DBN) has good development prospects in the field of fault identification. The Deep Belief Network (DBN) is a probabilistic artificial neural network with multiple hidden layers, constructed by stacking multiple Restricted Boltzmann Machines (RBMs). By looking at the Restricted Boltzmann Machine architecture, we can obtain the associated functions as follows:
E ( v , h θ ) = i = 1 n a i v i j = 1 m b i h i i = 1 n j = 1 m v i W i j h j
where
  • θ —node parameters of Restricted Boltzmann Machine and   θ = W i j , a i , b j are all real numbers;
  • a i —offset coefficient of visible unit i ;
  • W i j —weight values of hidden unit j and visible unit i ;
  • b j —offset coefficient of hidden unit j .
When these parameters are constant, based on this function, the joint probability distribution can be obtained, as shown in Formula (15):
P ( v , h θ ) = e E ( v , h θ ) Z ( θ ) , Z ( θ ) = v , h e E ( v , h θ )
where
  • Z θ —partition function (Normalization factor);
  • a i , b i —offset coefficient;
  • h j , v i —state variables for hidden and visible units;
  • W i j —hidden and visible unit weights.
In this energy function, it can be seen from the special structure that there is a connection between the layers of RBM and there is no connection between nodes in layers and star lakes. When the state of the hidden layer is known, the activation states for different visible units are conditionally independent. The probability of visible node activation is shown in Formula (16):
P v i = 1 h , θ = σ ( a i + j W j i h j )
Similarly, the activation probability of the hidden unit is
P h j = 1 v , θ = σ ( b j + i v i W i j )
where   σ x = 1 1 + exp x is the Sigmoid activation function. The complete Deep Belief Network structure is shown in Figure 7.

3.2. PSO-Optimized DBN Model

The particle swarm optimization algorithm is the same as many algorithms; that is, after the system initialization, it starts to iterate through a group of solutions, and constantly looks for the optimal solution in the iterative process. Particles (potential solutions) will follow the best particles in space to explore, so the number of iterations required to reach the best solution is relatively small. In the engineering application in the field of bearing diagnosis, particle swarm optimization can be easily employed because of its simple principle, strong universality, and strong anti-interference. Moreover, the algorithm supports group search and takes a short time. Combined with the above advantages, this paper selects the PSO optimization algorithm to improve the DBN model.
Bengio [48] has performed many experiments to illustrate a problem: the application effect of a multi-layer deep confidence network is often higher than that of a single layer. Larochelle and others [49] have proven through many tests that when the hidden layer of the deep confidence network model is about three layers, the classification accuracy reaches the highest value. Before the number of layers reaches four, the recognition rate is directly proportional to the increase in the number of hidden layers. When the number of hidden layers reaches four or more, the classification accuracy of the model will decline. This paper selects three hidden layers, corresponding to m 1 , m 2 , m 3 neurons. N represents the number of particles, which generally ranges from 10 to 20. In this paper, the number of particles is 10. The maximum iteration number of particle swarm optimization is M. This paper takes 20. The process of the PSO-optimized DBN model is shown in Figure 8.
The specific steps are as follows:
Step 1: Preprocess the original vibration signal of the bearing of Western Reserve University. Because the time and accuracy of training the original vibration signal are directly greatly affected, VMD decomposition is needed to reconstruct the signal according to kurtosis.
Step 2: In order to improve the accuracy of fault identification, the decomposed and reconstructed signals are combined with multi-scale arrangement entropy, multi-scale dispersion entropy, and composite multi-scale dispersion entropy to construct feature vectors.
Step 3: For the test data of four states, 100 samples are taken for each state, and a total of 400 samples are obtained. The fault feature set is P; the 100 samples of each signal in the obtained feature set are randomly divided into 70 training sets, recorded as P1, and 30 test sample sets, recorded as P.
Step 4: Initialize particle swarm velocity V i k = 0 ; initialize the position of the particle swarm X i k = 0 .
Step 5: Calculate the classification error rate of all particles, and find the optimal particles of this round of particle swarm, including the optimal particles that have completed the search before.
Step 6: The velocity and position of each particle are updated by Formulas (18) and (19).
X I k + 1 = X i k + V i k + 1
V i k + 1 = ω V i k + c 1 r 1 X i phest k X i k + c 2 r 2 X i ghest k X i k
where
  • ω —inertia weight;
  • c 1 , c 2 —acceleration parameters;
  • r 1 , r 2 —random value.
Among them, the value range of inertia weight is generally between 0 and 1, and ω = 0.7 is taken in this paper. The acceleration parameters generally range from 0 to 4. Shi et al. have done many tests; it was found that the selection of this parameter will affect the optimization results. In order to make the results not too disturbed by external factors and make the two acceleration parameters equal and have the best effect, parameter c 1 = c 2 = 2 is selected in this paper. Random values generally range from 0 to 1.
Step 7: One of two conditions needs to be met when PSO ends optimization. One is that the classification error rate of experimental data is lower than the pre-set value, or the number of iterations reaches the preset value. If one of the two meets, it can be stopped. Otherwise, go to step 5, increase the number of iterations, and repeat step 6 and step 7 until the discrimination conditions are met.
Step 8: The optimized parameters are substituted into the original DBN model, and the rolling bearing fault classification results are obtained by retraining and retesting the data samples.

4. Experimental Verification

The optimized DBN is applied to the experiment to analyze the data and construct the classifier. Aiming at the problem of rolling bearing fault pattern recognition proposed in this paper, the specific experimental steps and instructions are as follows:
Step 1: For the experimental data of four states, take 100 samples at random, with a total of 400 samples. Calculate the eigenvalues according to the VMD-CMDE composition method, combine them into the eigenvector set, and record them as the fault feature P. A total of 70 groups of eigenvalues are randomly selected from P as the training set and recorded as P1. The remaining 30 sets of eigenvalues are divided into test sets, namely P2.
Step2: Input P1 into DBN for training. In order to more comprehensively verify the reliability of the rolling bearing fault identification model, this paper selects the rolling bearing data of 1797r/min speed for research. Different bearing fault types are replaced by different numbers, as shown in Table 1. Here, 1 represents inner ring fault, 2 represents roller ring fault, 3 represents outer ring fault, and 4 represents normal condition.
Here, the experimental results of the DBN model input by the composite multi-scale scattered entropy eigenvector obtained after the decomposition of the original signal are analyzed. As shown in Figure 9, the recognition rate of each fault type of rolling bearing can be seen. According to the different numbers marked in this paper, they represent different fault types. Number 1 corresponds to the inner ring fault signal, and the recognition rate is 90%. Number 3 represents the outer ring fault signal, and the recognition rate is 100%. Number 2 corresponds to the roller fault signal, and the recognition rate is 73.33%. Number 4 corresponds to the normal bearing signal, and the recognition rate is 100%. After calculation, the overall recognition accuracy reaches 90.33%.
Among them, 27 groups were correctly identified by 30 groups of bearing with inner ring fault, 22 groups were correctly identified by 30 groups of roller fault, 30 groups were correctly identified by 30 groups of bearing with outer ring fault, and 30 groups were correctly identified by 30 groups of bearing under normal conditions. Compared with the previous two models, the overall recognition rate of this group can reach 90.33%, and the roller fault recognition rate has also been greatly improved, but there is still room for improvement. Based on this data, Table 2 is established.
The key parameters of the VMD-CMDE-DBN model are optimized by the particle swarm optimization algorithm to obtain the VMD-CMDE-PSO-DBN model. Through the analysis of the experimental results of the optimized DBN model input by the composite multi-scale dispersion entropy eigenvector obtained after the decomposition of the original signal, as shown in Figure 10, we can see the recognition rate of each fault type of rolling bearing. According to the different numbers marked in this paper, they represent different fault types. Numbers 1, 2, 3, and 4 correspond to inner ring fault signal, roller fault signal, outer ring fault signal, and normal bearing signal, respectively.
According to this data, Table 3 is established. From Table 3, we can clearly see the identification number of each fault type; among them, 30 groups of bearing with inner ring fault are correctly identified, 30 groups of roller fault are correctly identified, 30 groups of bearing with outer ring fault are correctly identified, and 30 groups of bearing under normal conditions are correctly identified.
In order to fully prove the effectiveness of VMD-CMDE-PSO-DBN fault identification model, Multi-scale Permutation Entropy (MPE) and Multi-scale Dispersion Entropy (MDE) are substituted into the DBN model and optimized model in this paper. Observing and compare the recognition rate, the number of samples in the training set and the test set is the same as above; the recognition rate data input into the DBN model is shown in Table 4.
The number of nodes after particle swarm optimization is substituted into the three models, and the same eigenvalues of the three entropy are used as the input of particle swarm optimization DBN model. The recognition rate data are shown in Table 5.

5. The Result Discussion

A total of 70 sets of multi-scale entropy eigenvalues of rolling bearing fault signals were substituted into the DBN model for recognition training. The DBN model was tested with 30 groups of test set data. Through the test, the experimental results show that the recognition accuracy of multi-scale arrangement entropy and DBN is 78.33%, the recognition accuracy of multi-scale dispersion entropy and DBN is 83.33%, and the recognition accuracy of composite multi-scale dispersion entropy and DBN is 90.33%. Each model is not particularly ideal in roller fault recognition. The experimental results show that the recognition accuracy of multi-scale arrangement entropy and optimized DBN is 98.33%, the recognition accuracy of multi-scale dispersion entropy and optimized DBN is 98.33%, and the recognition accuracy of composite multi-scale dispersion entropy and optimized DBN is 100%. Compared vertically, the PSO-DBN classification effect of the DBN model after optimizing parameters by the particle swarm optimization algorithm has been improved in different multi-scale entropy. Compared horizontally, the classification effect of the PSO-DBN model with different multi-scale entropy eigenvectors as input has also been significantly improved. Especially in the identification of roller fault, the three models have been greatly improved.
Through theoretical proof and experimental verification, the combination of VMD, CMDE, DBN, and PSO algorithm is very effective in rolling bearing fault diagnosis and identification. The main conclusions are as follows:
The rolling bearing fault recognition model is established; the eigenvectors are substituted into the DBN and PSO-DBN models, trained and tested; and the final experimental results are obtained. By comparing the recognition accuracy of DBN and PSO-DBN, it can be concluded that the PSO-DBN model has a higher recognition rate than the DBN model. Overall, the recognition rate based on VMD-CMDE-PSO-DBN is the best, which provides new insight for signal pattern recognition.

6. Conclusions

In this paper, an intelligent fault diagnosis method based on Variational Mode Decomposition (VMD), Composite Multi-scale Dispersion Entropy (CMDE), and Deep Belief Network (DBN) with Particle Swarm Optimization (PSO) algorithm—namely VMD-CMDE-PSO-DBN—is proposed. The decomposed number of modal components of VMD is determined by the observation center frequency, reconstructed according to the kurtosis, and the composite multi-scale dispersion entropy of the reconstructed signal is calculated to form the training samples and test samples of pattern recognition.
  • The experimental data used in this paper are manually added faults, which may not fully reflect the diversified faults of rolling bearings, single fault forms, and low bearing speed. Under actual working conditions, bearings are mostly in high-speed operation and the fault forms are complex, so the next step should be to focus on the high-speed operation of rolling bearings and the composite fault state.
  • VMD multi-scale permutation entropy eigenvector, VMD multi-scale dispersion entropy eigenvector, and VMD composite multi-scale dispersion entropy eigenvector is used as the inputs of the Deep Belief Network classification model. The accuracy of VMD decomposition composite multi-scale dispersion entropy is the best.

Author Contributions

Conceptualization, Z.G.; methodology, E.Y. and Y.W.; writing—original draft preparation, E.Y.; writing—review and editing, P.W. and W.D.; Resources, W.D.; software, P.W. and Z.G.; validation, E.Y., Y.W., P.W. and Z.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Department of Education Foundation of Liaoning Province under grant JDL2020013, the Natural Science Foundation of Liaoning Province under grant 2019ZD0112, and the National Natural Science Foundation of China under grant 62001079, the Research Foundation for Civil Aviation University of China under Grant 3122022PT02 and 2020KYQD123.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data, models, and code generated or used during the study appear in the submitted article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. He, Z.; Shao, H.; Wang, P.; Lin, J.; Cheng, J. Deep transfer multi-wavelet auto-encoder for intelligent fault diagnosis of gearbox with few target training samples. Knowl. Based Syst. 2020, 191, 105313. [Google Scholar] [CrossRef]
  2. Li, X.; Zhao, H.; Yu, L.; Chen, H.; Deng, W.; Deng, W. Feature extraction using parameterized multisynchrosqueezing transform. IEEE Sens. J. 2022, 2, 14263–14272. [Google Scholar] [CrossRef]
  3. Xu, G.; Bai, H.; Xing, J.; Luo, T.; Xiong, N.N. SG-PBFT: A secure and highly efficient distributed blockchain PBFT consensus algorithm for intelligent Internet of vehicles. J. Parallel Distrib. Comput. 2022, 164, 1–11. [Google Scholar] [CrossRef]
  4. Zheng, J.J.; Yuan, Y.; Zou, L.; Deng, W.; Guo, C.; Zhao, H. Study on a novel fault diagnosis method based on VMD and BLM. Symmetry 2019, 11, 747. [Google Scholar] [CrossRef]
  5. Wu, D.; Wu, C. Research on the Time-Dependent Split Delivery Green Vehicle Routing Problem for Fresh Agricultural Products with Multiple Time Windows. Agriculture 2022, 12, 793. [Google Scholar] [CrossRef]
  6. Zhou, X.B.; Ma, H.J.; Gu, J.G.; Chen, H.L.; Deng, W. Parameter adaptation-based ant colony optimization with dynamic hybrid mechanism. Eng. Appl. Artif. Intell. 2022, 114, 105139. [Google Scholar] [CrossRef]
  7. Wu, X.; Wang, Z.C.; Wu, T.H.; Bao, X.G. Solving the family traveling salesperson problem in the adleman–lipton model based on DNA computing. IEEE Trans. NanoBioscience 2021, 21, 75–85. [Google Scholar] [CrossRef]
  8. Li, X.; Shao, H.; Lu, S.; Xiang, J.; Cai, B. Highly-efficient fault diagnosis of rotating machinery under time-varying speeds using LSISMM and small infrared thermal images. IEEE Trans. Syst. Man Cybern. Syst. 2022, 50, 1–13. [Google Scholar] [CrossRef]
  9. An, Z.; Wang, X.; Li, B.; Xiang, Z.L.; Zhang, B. Robust visual tracking for UAVs with dynamic feature weight selection. Appl. Intell. 2022. [Google Scholar] [CrossRef]
  10. Cao, H.; Shao, H.; Zhong, X.; Deng, Q.; Yang, X.; Xuan, J. Unsupervised domain-share CNN for machine fault transfer diagnosis from steady speeds to time-varying speeds. J. Manuf. Syst. 2022, 62, 186–198. [Google Scholar] [CrossRef]
  11. Li, T.Y.; Shi, J.Y.; Deng, W.; Hu, Z.D. Pyramid particle swarm optimization with novel strategies of competition and cooperation. Appl. Soft Comput. 2022, 121, 108731. [Google Scholar] [CrossRef]
  12. Deng, W.; Xu, J.; Gao, X.; Zhao, H. An enhanced MSIQDE algorithm with novel multiple strategies for global optimization problems. IEEE Trans. Syst. Man Cybern. Syst. 2022, 52, 1578–1587. [Google Scholar] [CrossRef]
  13. Chen, H.Y.; Miao, F.; Chen, Y.J.; Xiong, Y.J.; Chen, T. A hyperspectral image classification method using multifeature vectors and optimized KELM. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2021, 14, 2781–2795. [Google Scholar] [CrossRef]
  14. Yao, R.; Guo, C.; Deng, W.; Zhao, H.M. A novel mathematical morphology spectrum entropy based on scale-adaptive techniques. ISA Trans. 2022, 126, 691–702. [Google Scholar] [CrossRef]
  15. Deng, W.; Li, Z.; Li, X.; Chen, H.; Zhao, H. Compound fault diagnosis using optimized MCKD and sparse representation for rolling bearings. IEEE Trans. Instrum. Meas. 2022, 71, 3508509. [Google Scholar] [CrossRef]
  16. Tian, C.; Jin, T.; Yang, X.; Liu, Q. Reliability analysis of the uncertain heat conduction model. Comput. Math. Appl. 2022, 119, 131–140. [Google Scholar] [CrossRef]
  17. Zhao, H.M.; Liu, J.; Chen, H.Y.; Chen, J.; Li, Y.; Xu, J.J.; Deng, W. Intelligent diagnosis using continuous wavelet transform and gauss convolutional deep belief network. IEEE Trans. Reliab. 2022, 1–11. [Google Scholar] [CrossRef]
  18. Zhou, Y.; Zhang, J.; Yang, X.; Ling, Y. Optimal reactive power dispatch using water wave optimization algorithm. Oper. Res. 2020, 20, 2537–2553. [Google Scholar] [CrossRef]
  19. Cui, H.; Guan, Y.; Chen, H. Rolling element fault diagnosis based on VMD and sensitivity MCKD. IEEE Access 2021, 9, 120297–120308. [Google Scholar] [CrossRef]
  20. Xu, Y.; Chen, H.; Luo, J.; Zhang, Q.; Jiao, S.; Zhang, X. Enhanced Moth-flame optimizer with mutation strategy for global optimization. Inf. Sci. 2019, 492, 181–203. [Google Scholar] [CrossRef]
  21. Liu, Q.; Jin, T.; Zhu, M.; Tian, C.; Li, F.; Jiang, D. Uncertain currency option pricing based on the fractional differential equation in the Caputo sense. Fractal Fract. 2022, 6, 407. [Google Scholar] [CrossRef]
  22. Li, G.; Li, Y.; Chen, H.; Deng, W. Fractional-order controller for course-keeping of underactuated surface vessels based on frequency domain specification and improved particle swarm optimization algorithm. Appl. Sci. 2022, 12, 3139. [Google Scholar] [CrossRef]
  23. Wei, Y.Y.; Zhou, Y.Q.; Luo, Q.F.; Deng, W. Optimal reactive power dispatch using an improved slime Mould algorithm. Energy Rep. 2021, 7, 8742–8759. [Google Scholar] [CrossRef]
  24. Jin, T.; Xia, H.; Deng, W.; Li, Y.; Chen, H. Uncertain fractional-order multi-objective optimization based on reliability analysis and application to fractional-order circuit with Caputo type. Circ. Syst. Signal Pract. 2021, 40, 5955–5982. [Google Scholar] [CrossRef]
  25. Xu, G.; Dong, W.; Xing, J.; Lei, W.; Liu, J. Delay-CJ: A novel cryptojacking covert attack method based on delayed strategy and its detection. Digit. Commun. Netw. 2022. [Google Scholar] [CrossRef]
  26. Wu, E.Q.; Zhou, M.; Hu, D.; Zhu, L.; Tang, Z. Self-paced dynamic infinite mixture model for fatigue evaluation of pilots’ brains. IEEE Trans. Cybern. 2022, 52, 5623–5638. [Google Scholar] [CrossRef]
  27. Jiang, M.; Yang, H. Secure outsourcing algorithm of BTC feature extraction in cloud computing. IEEE Access 2020, 8, 106958–106967. [Google Scholar] [CrossRef]
  28. Deng, W.; Ni, H.C.; Liu, Y.; Chen, H.L.; Zhao, H.M. An adaptive differential evolution algorithm based on belief space and generalized opposition-based learning for resource allocation. Appl. Soft Comput. 2022. [Google Scholar] [CrossRef]
  29. Zosso, D.; Dragomiretskiy, K. Variational mode decomposition. In IEEE Transactions on Signal Processing: A Publication of the IEEE Signal Processing Society; IEEE: Piscataway, NJ, USA, 2014. [Google Scholar]
  30. Rostaghi, M.; Azami, H. Dispersion Entropy: A measure for time series analysis. IEEE Signal Process. Lett. 2016, 23, 610–614. [Google Scholar] [CrossRef]
  31. Zhang, S.; Sun, G.; Li, L.; Li, X.; Jian, X. Study on mechanical fault diagnosis method based on LMD approximate entropy and fuzzy C-means clustering. Chin. J. Sci. Instrum. 2013, 34, 714–720. [Google Scholar]
  32. Wang, J.; Shuai, C.; Chao, Z. Fault diagnosis method of gear based on VMD and multi-feature fusion. J. Mech. Transm. 2017, 3, 032. [Google Scholar]
  33. Li, C. Research on Rolling Bearing Fault Diagnosis Method Based on Empirical Wavelet Transform and Scattered Entropy; Anhui University of Technology: Anhui, China, 2019. [Google Scholar]
  34. Hinton, G.; Osindero, S.; Teh, Y. A fast learning algorithm for deep belief nets. Neura I Comput. 2006, 18, 1527–1554. [Google Scholar] [CrossRef] [PubMed]
  35. Lei, Y.; Jia, F.; Zhou, X.; Lin, J. A Deep learning-based method for machinery health monitoring with big data. J. Mech. Eng. 2015, 51, 49–56. [Google Scholar] [CrossRef]
  36. Li, W.; Shan, W.; Xu, Z.; Zeng, X. Bearing fault classification and recognition based on deep belief network. J. Vib. Eng. 2015, 29, 152–159. [Google Scholar]
  37. Shi, P.; Liang, K.; Zhao, N. Gear intelligent fault diagnosis based on deep learning feature extraction and particle swarm support vector machine state recognition. China Mech. Eng. 2017, 28, 1056–1061. [Google Scholar]
  38. Wang, W.; Carr, M.; Xu, W.; Kobbacy, K. A model for residual life prediction based on Brownian motion with an adaptive drift. Microelectron. Reliab. 2010, 51, 285–293. [Google Scholar] [CrossRef]
  39. Sun, L.; Tang, X.G.; Zhang, X.H. Study of gearbox residual life prediction based on stochastic filtering model. Mech. Transm. 2011, 35, 56–60. [Google Scholar]
  40. Deng, W.; Liu, H.; Xu, J.; Zhao, H.; Song, Y. An improved quantum-inspired differential evolution algorithm for deep belief network. IEEE Trans. Instrum. Meas. 2020, 69, 7319–7327. [Google Scholar] [CrossRef]
  41. Zhao, H.; Liu, H.; Xu, J.; Guo, C.; Deng, W. Research on a fault diagnosis method of rolling bearings using variation mode decomposition and deep belief network. J. Mech. Sci. Technol. 2019, 33, 4165–4172. [Google Scholar] [CrossRef]
  42. Li, T.; Qian, Z.; Deng, W.; Zhang, D.; Lu, H.; Wang, S. Forecasting crude oil prices based on variational mode decomposition and random sparse Bayesian learning. Appl. Soft Comput. 2021, 113PB, 108032. [Google Scholar] [CrossRef]
  43. Pan, Y.; Chen, J.; Guo, L. Robust bearing performance degradation assessment method based on improved wavelet packet–support vector data description. Mech. Syst. Signal. Process. 2009, 23, 669–681. [Google Scholar] [CrossRef]
  44. Dong, S.; Luo, T. Bearing degradation process prediction based on the PCA and optimized LS-SVM model. Measurement 2013, 46, 3143–3152. [Google Scholar] [CrossRef]
  45. Xue, X.H. Evaluation of concrete compressive strength based on an improved PSO-LSSVM model. Comput. Concr. Int. J. 2018, 21, 505–511. [Google Scholar]
  46. He, Q. Vibration signal classification by wavelet packet energy flow manifold learning. J. Sound Vib. 2013, 332, 1881–1894. [Google Scholar] [CrossRef]
  47. Ishaque, K.; Salam, Z.; Amjad, M.; Mekhilef, S. An improved particle swarm optimization (PSO)–Based MPPT for PV with reduced steady-state oscillation. IEEE Trans. Power Electron. 2012, 27, 3627–3638. [Google Scholar] [CrossRef]
  48. Roux, N.L.; Bengio, Y. Representational Power of Restricted Boltzmann Machines and Deep Belief Networks. Neural Comput. 2008, 20, 1631–1649. [Google Scholar] [CrossRef]
  49. Larochelle, H.; Bengio, Y.; Louradour, J.; Lamblin, P. Exploring Strategies for Training Deep Neural Networks. J. Mach. Learn. Res. 2009, 1, 1–40. [Google Scholar]
Figure 1. Center frequency of the modal component K = 4.
Figure 1. Center frequency of the modal component K = 4.
Electronics 11 02582 g001
Figure 2. Center frequency of the modal component K = 5.
Figure 2. Center frequency of the modal component K = 5.
Electronics 11 02582 g002
Figure 3. Center frequency of the modal component K = 6.
Figure 3. Center frequency of the modal component K = 6.
Electronics 11 02582 g003
Figure 4. VMD-CMDE at τ = 8.
Figure 4. VMD-CMDE at τ = 8.
Electronics 11 02582 g004
Figure 5. VMD-CMDE at τ = 10.
Figure 5. VMD-CMDE at τ = 10.
Electronics 11 02582 g005
Figure 6. VMD-CMDE at τ = 12.
Figure 6. VMD-CMDE at τ = 12.
Electronics 11 02582 g006
Figure 7. DBN model.
Figure 7. DBN model.
Electronics 11 02582 g007
Figure 8. General flow chart of PSO-optimized DBN model.
Figure 8. General flow chart of PSO-optimized DBN model.
Electronics 11 02582 g008
Figure 9. VMD-CMDE-DBN fault recognition rate.
Figure 9. VMD-CMDE-DBN fault recognition rate.
Electronics 11 02582 g009
Figure 10. VMD-CMDE-PSO-DBN fault recognition rate.
Figure 10. VMD-CMDE-PSO-DBN fault recognition rate.
Electronics 11 02582 g010
Table 1. Description of bearing pattern recognition dataset.
Table 1. Description of bearing pattern recognition dataset.
Bearing StatusTraining Sample NumbersTest Sample NumbersCategorization Label
Inner ring fault70301
Roller ring fault70302
Outer ring fault70303
Normal signal70304
Table 2. Accuracy rate of DBN model with VMD-CMDE as input.
Table 2. Accuracy rate of DBN model with VMD-CMDE as input.
Bearing StatusTotal Number of Test Set SamplesCorrect NumberAccuracy
Inner ring fault302790%
Roller ring fault302273.3%
Outer ring fault3030100%
Normal condition3030100%
Whole bearing12010990.33%
Table 3. PSO-DBN model accuracy with VMD-CMDE as input.
Table 3. PSO-DBN model accuracy with VMD-CMDE as input.
Bearing StatusTotal Number of Test Set SamplesCorrect NumberAccuracy
Inner ring fault3030100%
Roller ring fault3030100%
Outer ring fault3030100%
Normal condition3030100%
Whole bearing120120100%
Table 4. DBN model accuracy.
Table 4. DBN model accuracy.
Bearing StatusVMD-MPEVMD-MDEVMD-CMDE
Inner ring fault100%100%90%
Roller ring fault43.33%33.33%73.33%
Outer ring fault70%100%100%
Normal condition100%100%100%
Whole bearing78.33%88.33%90.33%
Table 5. PSO-DBN model accuracy.
Table 5. PSO-DBN model accuracy.
Bearing StatusVMD-MPEVMD-MDEVMD-CMDE
Inner ring fault96.67%100%100%
Roller ring fault96.67%93.33%100%
Outer ring fault100%100%100%
Normal condition100%100%100%
Whole bearing98.33%98.33%100%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yang, E.; Wang, Y.; Wang, P.; Guan, Z.; Deng, W. An Intelligent Identification Approach Using VMD-CMDE and PSO-DBN for Bearing Faults. Electronics 2022, 11, 2582. https://doi.org/10.3390/electronics11162582

AMA Style

Yang E, Wang Y, Wang P, Guan Z, Deng W. An Intelligent Identification Approach Using VMD-CMDE and PSO-DBN for Bearing Faults. Electronics. 2022; 11(16):2582. https://doi.org/10.3390/electronics11162582

Chicago/Turabian Style

Yang, Erbin, Yingchao Wang, Peng Wang, Zheming Guan, and Wu Deng. 2022. "An Intelligent Identification Approach Using VMD-CMDE and PSO-DBN for Bearing Faults" Electronics 11, no. 16: 2582. https://doi.org/10.3390/electronics11162582

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop