Next Article in Journal
Adaptive Weighted Data Fusion for Line Structured Light and Photometric Stereo Measurement System
Previous Article in Journal
Enhancing Lithium-Ion Battery Health Predictions by Hybrid-Grained Graph Modeling
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimal Time Frequency Fusion Symmetric Dot Pattern Bearing Fault Feature Enhancement and Diagnosis

1
Naval Architecture and Shipping College, Guangdong Ocean University, Zhanjiang 524088, China
2
Technical Research Center for Ship Intelligence and Safety Engineering of Guangdong Province, Zhanjiang 524088, China
3
Guangdong Provincial Key Laboratory of Intelligent Equipment for South China Sea Marine Ranching, Zhanjiang 524088, China
*
Authors to whom correspondence should be addressed.
Sensors 2024, 24(13), 4186; https://doi.org/10.3390/s24134186
Submission received: 20 April 2024 / Revised: 17 June 2024 / Accepted: 24 June 2024 / Published: 27 June 2024
(This article belongs to the Section Fault Diagnosis & Sensors)

Abstract

:
Regarding the difficulty of extracting the acquired fault signal features of bearings from a strong background noise vibration signal, coupled with the fact that one-dimensional (1D) signals provide limited fault information, an optimal time frequency fusion symmetric dot pattern (SDP) bearing fault feature enhancement and diagnosis method is proposed. Firstly, the vibration signals are transformed into two-dimensional (2D) features by the time frequency fusion algorithm SDP, which can multi-scale analyze the fluctuations of signals at minor scales, as well as enhance bearing fault features. Secondly, the bat algorithm is employed to optimize the SDP parameters adaptively. It can effectively improve the distinctions between various types of faults. Finally, the fault diagnosis model can be constructed by a deep convolutional neural network (DCNN). To validate the effectiveness of the proposed method, Case Western Reserve University’s (CWRU) bearing fault dataset and bearing fault dataset laboratory experimental platform were used. The experimental results illustrate that the fault diagnosis accuracy of the proposed method is 100%, which proves the feasibility and effectiveness of the proposed method. By comparing with other 2D transformer methods, the experimental results illustrate that the proposed method achieves the highest accuracy in bearing fault diagnosis. It validated the superiority of the proposed methodology.

1. Introduction

Bearings are widely used in industrial production. The primary function of bearings is to support and reduce friction in rotating parts to ensure the regular operation of mechanical systems. In complex severe working environments, bearings often suffer damage that can eventually result in bearing faults [1]. If faults are not detected in a timely manner, it may lead to equipment downtime, production stoppages, or even human casualties and significant economic losses [2]. Timely detection and diagnosis of bearing faults are critical to ensuring equipment safety [3]. Due to the harsh working environment, background noise often submerges bearing fault features, making bearing fault features difficult to extract and reducing the accuracy of bearing fault diagnosis. Therefore, enhancing the fault features of the acquired signals is critical in order to improve the accuracy of bearing fault diagnosis.
Now, numerous studies have been researched by scholars to enhance signal fault features. These studies mainly enhance fault features in the signal or suppress background noise through signal processing [4], machine learning [5,6], deep learning [7], and other methods. Pang et al. [8] proposed an improved empirical Fourier decomposition (IEFD) method. This method can effectively suppress the over-decomposition of noise and faulty pulses; Zhu et al. [9] proposed an enhanced empirical Fourier decomposition method. Lei et al. [10] proposed a rolling bearing fault diagnosis method based on variational modal decomposition and weighted multidimensional feature entropy fusion. The method exhibits good convergence and noise resistance. Mao et al. [11] proposed a method that combines variational mode decomposition (VMD) and K-singular value decomposition (K-SVD) to enhance bearing fault features. Li et al. [12] proposed a method for early weak fault diagnosis in rolling bearings based on a multilayer reconstruction filter. The method has the advantage of reducing the influence of noise and decomposing modal adaptation. Although the above method successfully enhances bearing fault features, 1D signals still have limitations in terms of highlighting critical feature information of complex signals. Transforming 1D signals into 2D images is a beneficial processing method that effectively emphasizes weak fault features [13]. This transformation allows the 1D signal to be intuitively mapped onto a 2D image, making it more conducive to highlighting potential fault features, and providing richer feature information [14]. Youcef et al. [15] proposed a new method that combines convolutional neural network (CNN) and vibration spectral imaging (VSI) to classify bearing faults. This method offers strong generalization and noise resistance. However, a multi-scale signal analysis is needed, which may result in poor performance when identifying complex signals. Wang et al. [16] proposed a rolling bearing fault diagnosis method based on the whale optimization algorithm, variable modal decomposition (VMD), and graph attention network (GAT). The method optimizes the parameters of the variational mode decomposition (VMD) by adaptively selecting the best parameters and choosing signal components with high correlation for reconstruction. Finally, the graph structure data are constructed using the K nearest neighbors (KNN) method and input into the GAT fault diagnosis model for fault diagnosis. The method exhibits strong noise reduction capability, and the fault diagnosis model demonstrates robust stability across various bearing fault states. However, the method has the disadvantage of high computational complexity. Tang et al. [17] proposed a feature ranking method for enhancing bearing fault features based on feature ranking using an optimal class distance ratio (FROCDR). The technique first utilizes multi-scale analysis and variational modal decomposition to process the vibration signals at various scales and frequency bands. Subsequently, it transforms the processed signals into images using the symmetric dot pattern (SDP) transformation method. Finally, the FROCDR method obtains the best feature subset as input for the random forest classifier in bearing fault diagnosis. The method helps extract multi-scale features of the signal, enhances the expression of fault features, and exhibits high stability. However, the method suffers from low computational efficiency in selecting SDP parameters. Li et al. [18] proposed a rolling bearing fault feature enhancement method that combines the adaptive symmetric dot pattern and density-based spatial clustering of noise applications (ASDP-DBSCAN). The method first transforms the vibration signal into a symmetric dot pattern (SDP) and then optimizes the SDP image parameters using the Hill function with a genetic algorithm. Finally, a modified DBSCAN algorithm generates clustering templates to reduce noise interference and enhance fault features. The method offers high noise immunity and adaptive parameter selection. However, it also presents drawbacks, such as high computational complexity and a need for multi-scale analysis of complex signals.
From the above research projects, the 1D to 2D method by SDP is an effective method for enhancing fault features. SDP can directly transform 1D signals into 2D images to display signal features. The computational efficiency is higher compared to many other image transformation methods. However, the traditional SDP method has the disadvantage of difficulty in selecting parameters and fault information is limited. Therefore, this paper proposes an optimal time frequency fusion SDP method for enhancing bearing fault features. Considering that the absence of multi-scale analysis in the SDP image method results in buried signal fault features and decreased diagnostic accuracy, the method employs a time frequency fusion algorithm to analyze signal fluctuations at minor scales across multiple scales. It maps the signal analysis results at various scales onto a 2D image. At the same time, by considering the influence of multiple parameters of SDP on the effectiveness of feature extraction, the optimal SDP parameters are adaptively determined using the bat algorithm, which can amplify the distinctions in the images among various fault states of the bearings, enhance the fault features, and improve diagnostic accuracy. The extracted SDP features are input to the DCNN network to achieve fault diagnosis of bearings. This method resolves difficulties in parameter selection, the lack of multi-scale analysis for complex signals, high computational complexity, and achieves enhanced bearing fault features. The main contributions of this paper are as follows:
  • An optimal time frequency fusion SDP-based signal processing method is designed. The method can effectively display the signal analysis results on various scales, enhance the representation of the signal fault features, and amplify the distinctions between different bearing faults.
  • A new fault feature enhancement technique is proposed. The technique can analyze signal time domain and frequency domain feature information at various scales, achieving the fusion of time-domain and frequency-domain features. which enhances the fault signal features and improves the diagnostic accuracy of the model.
  • A novel framework for diagnosing rolling bearing faults has been established. The bearing fault diagnosis model is established by extracting optimal time frequency fusion-based SDP image feature information using a DCNN.
This study is structured as follows: Section 2 presents the optimal time frequency fusion SDP method. Section 3 details the rolling bearing fault diagnosis framework in this paper. Section 4 demonstrates the feasibility of the method presented in this paper through experiments. Section 5 verifies the effectiveness and superiority of the proposed method through comparison experiments.

2. Optimal Time Frequency Fusion SDP

2.1. SDP Transform Method of Vibration Signals

The symmetric dot pattern (SDP) method is a signal representation method that transforms 1D time-domain signals into 2D polar coordinate images using a formula [19]. Formula (1) represents the acquired vibration signals, which are transformed into points ( r ( i ) , θ ( i ) ) and ( r ( i ) , ( i ) ) in polar coordinates using Formula (2). Figure 1 illustrates the transformation principle.
X = { x 1 , x 2 , , x i , x N }
where X is the 1D vibration signal acquired, x 1 is the first signal data point, and N is the length of the signal.
{ r ( i ) = x i x min x max x min θ ( i ) = β + x i + τ x min x max x min g φ ( i ) = β x i + τ x min x max x min g
where r ( i ) is the polar coordinate radius of the ith signal, x i is the amplitude of the ith data point, x m i n is the smallest amplitude of the 1D signal, x m a x is the largest amplitude of the 1D signal, τ is the time-delay parameter, g is the angular amplification factor, β is the angle of rotation of the mirror symmetry plane, β = 360 n m ,   n = ( 1,2 , , m), m is the number of mirror planes, θ ( i ) is the angle of rotation along the β -clockwise, and ( i ) is the angle of rotation along the β -counterclockwise clockwise.

2.2. Time Frequency Fusion SDP Transformation Method of Vibration Signals

The time frequency fusion SDP analysis method is a fusion transformation technique that combines the time domains and frequency domains of a 1D signal using SDP analysis. (See Figure 2). Firstly, the signal in the time domain is transformed into a signal in the frequency domain using Formula (3) [20].
X ( k ) = n = 0 N 1 x ( n ) e i 2 π N k n
where X is the Fourier transformed coefficient, X (k) is the kth Fourier transformed coefficient, x is the input signal, e i 2 π N k n is the complex term, and x ( n )   i s   t h e   n t h   i n p u t   s i g n a l point.

2.3. Optimal Time Frequency Fusion SDP Transformation Method of Vibration Signals

The selection of τ and g values in SDP image transformation significantly impacts the fault features. This paper proposes an optimization method for SDP image parameter settings based on the adaptive bat algorithm to find the optimal SDP parameters. In SDP image transformation, τ controls the sparseness of the petals, while g controls the degree of opening and closing of the petals. τ takes values in the range 1~10, and g takes values in the range 20 ° ~ 60 ° . If the values of τ and g are too large or too small, it may cause the fault features to be buried and reduce the model identification accuracy. As illustrated in Figure 3, for different τ and g values of SDP image petals, with different parameters, the images are very different. Since the bat algorithm has global and local search capabilities, the τ and g parameters are, therefore, optimized by using the bat optimization algorithm.

2.3.1. Bat Optimization Algorithm

The bat algorithm is an optimization algorithm that simulates the process of an individual bat searching for prey [21]. The algorithm is used first of all to initialize the population of bats, determining individual optimal solutions from each bat’s current position, and then to update the position of the bats. Updating the position and speed can be represented by the mathematical model in Formulas (4)–(6). Subsequently, a random number r 1 in the range [0, 1] is randomly generated, r 1 [ 0 , 1 ] , if r 1 > r i , and a new solution is generated near the optimal solution by Formula (7). If r 1 < r i , generating a random number r 2 , r 2 [ 0 ,   1 ] , if r 2 < A i , the fitness function value is calculated and the fitness function value is less than the fitness function value of the optimal solution, the optimal solution is replaced, and, at the same time, the acoustic loudness A i and frequency r i t + 1 are updated according to Formulas (8) and (9). Eventually, the above steps are repeated to find the optimal solution individual to the space. The specific steps of the bat algorithm are illustrated in Figure 4.
F i = F min + ( F max F min ) β
v i t = v i t 1 + ( x i t X ) F i
x i t = x i t 1 + v i t
x n e w = X * + ε A t
A i t + 1 = α A i t
r i t + 1 = r i 0 [ 1 exp ( γ t ) ]
where F i is the frequency of the sound wave emitted by the ith bat in a population, β is a random number and β [0, 1], X is the current optimum solution, x n e w is the new solution, ε is a random number and ε [0, 1], A t is the average loudness of the bats in the population as a whole, α is the attenuation coefficient and α [0, 1], γ is the impulse enhancement coefficient, and r i 0 is the frequency at the initial time of the ith bat.

2.3.2. Fitness Function

This paper calculates the average similarity between the optimal time frequency fusion SDP images generated under different bearing fault states. The optimal time frequency fusion SDP method is selected based on the image parameter with the lowest average similarity. The specific steps are as follows:
The initial step is to transform the 1D signals of the various states of the bearing into 2D images using the optimal time frequency fusion SDP method. Next, two SDP images ( N and M ) in different states are selected sequentially and digitized. The digital matrix can be represented by Formula (10), and its similarity R ( N , M ) can be determined using Formula (11) [22]. Finally, the similarity between all compared images is counted using Formula (12), and the average similarity value is calculated using Formula (13).
g ( x , y ) = [ f ( 0 , 0 ) f ( 0 , 1 ) f ( 0 , n 1 ) f ( 1 , 0 ) f ( 1 , 1 ) f ( 1 , n 1 ) f ( m 1 , 0 ) f ( m 1 , 1 ) f ( m 1 , n 1 ) ]
where (0,0) is the pixel coordinate origin, (1,0) is the coordinate of the first row of pixels in column zero, and so on for other pixel point coordinates. f ( x , y ) is the pixel value of the pixel point with coordinates ( x , y ) . n × m is the total number of pixel points.
R i , j ( N , M ) = m n ( N m n N ¯ ) ( M m n M ¯ ) [ m n ( N m n N ¯ ) 2 ] [ m n ( M m n M ¯ ) 2 ]
where N is the digital matrix of image N , N ¯ is the average value of pixel points of image N , M is the digital matrix of image M , M ¯ is the average value of pixel points of image M , i is the bearing state i image, and j is the bearing state j image.
R = ( R 1 , 2 ( N 1 , M 2 ) , R 1 , 3 ( N 1 , M 3 ) , R 1 , 4 ( N 1 , M 4 ) , R z 1 , z ( N z 1 , M z ) )
where R 1,2 ( N 1 , M 2 ) is the similarity between the bearing state 1 image and the bearing state 2 image, N 1 ,   M 2 are the digitized matrices for bearing state 1 and bearing state 2, respectively, and z is the bearing state z.
R ¯ = e = 1 z 1 f = e + 1 z R e , f ( N e , M f ) ( z 1 ) × z / 2
where z is the number of bearing states, R e , f ( N , M ) is the similarity between the bearing state e image and the bearing state f image, and R ¯ is the average similarity between all states.

3. The Proposed Method

3.1. Feature Extraction Method

The optimal time frequency fusion SDP method can combine multi-scale signals within 1D signals on the SDP image, enabling the image to capture signal features fully. For example, Figure 5 illustrates the image features of the bearing in four states (inner race fault, roller fault, outer race fault, and normal).
Figure 5 illustrates that the SDP image expresses the signal features of the bearing in different states, such as the sparseness of the petals and the degree of opening and closing. Therefore, the bearing state can be determined from the sparseness of the petals and the degree of opening and closing in the SDP image.

3.2. Deep Convolutional Neural Network Diagnosis Model

A convolutional neural network (CNN) usually consists of a convolution layer, a pooling layer, a fully connected layer, an activation function, etc. [23]. A CNN has powerful feature extraction and learning capabilities, while a deep convolutional neural network (DCNN) learns more complex feature representations and improves the model’s generalization compared to a simple convolutional neural network. Therefore, this paper adopts a DCNN as the diagnostic model. The model is illustrated in Figure 6. The DCNN uses a convolution layer for feature extraction and nonlinear variation through the ReLU activation function [24], as described by Formulas (14) and (15).
X i , j l + 1 = j = 1 L i = 1 m ( X i , j l × w i , j l ) + b
f ( x ) = max ( 0 , x )
where X i , j l + 1 is the j th eigenvalue of the i th eigenmap in the l th layer of the network, L is the convolution kernel, w i , j l is the weight parameter, and b is the bias value.
The pooling layer reduces image dimensions, preserves image feature information, and enhances neural network training speed [25]. Since average pooling averages the features within the window, it may lead to the loss of some important information. The maximum pooling layer is able to preserve the most significant image feature information and discard the unimportant details, thus, improving the model’s training effect. Therefore, the maximum pooling layer is chosen to pool the image. The maximum pooling formula is illustrated in Formula (16).
M a x P o o l i n g ( I ) = max i , j   I ( i , j )
where i and j are denoted as positions within the pooling window and m a x i , j ( I ( i , j ) ) is denoted as the maximum operation on the value of input data I at all positions I i , j .
The role of the fully connected layer in a neural network is to integrate the abstract features output from the convolution and pooling layers and splice them into a 1D vector as input to the network [26]. In addition, by introducing the Softmax function of Formula (17), the fully connected layer can normalize these integrated features so that the network can output a confidence level for each category, enabling effective classification [27].
s o f t max ( Z ) i = e Z i j = 1 K e Z j
where Z i is the ith element of the input vector, e is the base of the natural logarithm, and j = 1 K e Z j refers to the exponential sum of all elements of the input vector species.

3.3. The Proposed Method Framework

This paper proposes using a 1D to 2D optimal time frequency fusion SDP method to enhance bearing fault signal features. This method resolves difficulties in parameter selection, the lack of multi-scale analysis for complex signals, high computational complexity, and achieves enhanced bearing fault features. Figure 7 illustrates the overall architecture based on optimal time frequency fusion SDP bearing fault feature enhancement and diagnosis method. The specific steps are as follows:
  • Vibration signal of normal and fault bearing states are acquired using acceleration sensors.
  • The vibration signal is high-pass filtered, and segmented into samples.
  • The wavelet basis function ‘db1’ is used to decompose these samples six times. The wavelet decomposition high frequency part captures the signal’s fast changes and features, which will be used as the signal input for the optimal time frequency fusion SDP.
  • Adaptively obtain the time-delay parameter and expansion factor of the optimal time frequency fusion SDP image by bat algorithm.
  • The optimal time frequency fusion SDP method is used to transform the sample signal into a 2D image.
  • Divide the 2D images into a training dataset and a testing dataset. Construct a DCNN model and input the training dataset into the model for training.
  • Establish the diagnostic model and input the testing dataset for testing, then, after the training and the testing, obtain the diagnostic results.

4. Experimental Verification

4.1. Case 1: Dataset I

The Case Western Reserve University (CWRU) bearing fault dataset is a publicly available dataset widely used in bearing fault diagnosis. It covers vibration data for bearings in various fault states and under different operating conditions. Figure 8 illustrates the experimental setup used for data collection, which includes a 2 HP motor, torque sensor, dynamometer, control electronics, and bearings [28]. The vibration signals were collected using a 2 Hp motor as the drive system, with bearings mounted both away from and close to the motor drive. Sensors were placed at the drive and fan ends, with a sampling frequency of 12 kHz or 48 kHz. The dataset includes vibration data from the drive end, fan end, and pedestal. The experiments were conducted under various engine load conditions: 0 HP, 1 HP, 2 HP, and 3 HP, corresponding to speeds of 1797 rpm, 1772 rpm, 1750 rpm, and 1730 rpm, respectively. The bearing faults resulting from EDM forming included outer race, roller, and inner race faults, each state having three different fault diameters (0.007 inches, 0.014 inches, and 0.021 inches).

4.1.1. Signal Description and Processing

This paper analyses vibration signals based on 10 types of fault state for rolling bearings collected under working conditions involving a motor load of 0 and a speed of 1797 rpm, as illustrated in Table 1. The dataset comprises 1 normal state and 9 fault states, representing 3 distinct faults: inner race fault, roller fault, and outer race fault, with each state having 3 fault diameters (0.007 inches, 0.014 inches, and 0.021 inches). The signal overlap sampling method for a bearing’s different state data is used in this paper to overcome the insufficient data volume problem, as illustrated in schematic Figure 9. Overlap sampling is first performed with a sample length of 8192 data points, resulting in a total sample length of 100 samples. Similarly, 100 samples are acquired for each bearing state, with the dataset illustrated in Table 1.

4.1.2. Optimal Time Frequency Fusion SDP Parameter Selection Method

The optimal τ and g values are sought by the bat algorithm. The parameters of the bat algorithm are set as follows: g ranges from [ 20 °   t o   60 ° ] , τ ranges from [ 1   t o   10 ] , the number of bats in the bat population is 10, the number of iterations is 100, and the maximum and minimum values of the frequency are set to 2 and 0, respectively. The loudness is 0.5, the pulse rate is 0.5, and the fitness function is referred to in Formulas (6)–(9). Then, 100 iterations are performed. The final outputs are g =  30.165 ° and τ = 9, and the average similarity of comparison between images is 0.608. The fitness function is illustrated in Figure 10.

4.1.3. Optimal Time Frequency Fusion SDP Feature Extraction Method

The vibration signal of bearings in different states was transformed into 2D images using the optimal time frequency fusion SDP method, which combines selected expansion factors and time-delay parameters. Figure 11 illustrates the differences between the optimal time frequency fusion SDP images of bearings in different states. These differences are mainly expressed in the saturation level of the petals and the sparseness of the points on the petals. By transforming optimal time frequency fusion SDP images, the image features of bearings in different states can be visually represented, enhancing the accuracy of fault diagnosis.

4.1.4. Diagnosis Results

The vibration signals from bearings in different states were transformed using optimal time frequency fusion SDP. The training dataset and testing dataset were distributed in the ratio 4:1, that is, 80 samples for each bearing state for the training dataset and 20 samples for the testing dataset. The DCNN model was used to classify the bearing state based on the provided dataset. The model learning rate is set to 0.001 and the iteration is 100. Figure 12 illustrates the change in training accuracy between the training dataset and testing dataset during the experiment. Furthermore, the testing results are illustrated in Figure 13.
Figure 12 illustrates the accuracy change in the training datasets and testing datasets after 100 iterations. Figure 12 illustrates that, during the training process, there are large fluctuations in the accuracy of the training dataset and testing dataset at the initial stage. After approximately the 18th iteration, these fluctuations gradually converge, and the accuracy of the training dataset and testing dataset stabilizes at 99% and eventually reaches 100%. The results demonstrate the strong convergence ability of the proposed method in this paper. In addition, Figure 13 presents the prediction results of the model for ten different states of the bearings. It can be seen that the accuracy of the bearing fault diagnosis model in ten different states is 100%. The results demonstrate the effectiveness of the proposed method in this paper for bearing fault diagnosis.

4.2. Case 2: Dataset II

4.2.1. Signal Description and Processing

The bearing vibration signals from the laboratory experimental device were acquired by an acceleration sensor with a sampling frequency of 100 kHz, while the experimental speed was 1500 rpm. The experimental device consists of a motor, a connection device, a bearing, and a rotor. Its structure is schematically illustrated in Figure 14. To simulate different bearing fault states, three types of bearings with different faults are used: a bearing with an outer race fault, a bearing with an inner race fault, and a bearing with a roller fault. The schematic diagrams of various bearing fault states are depicted in Figure 15.
The experimentally acquired data of different bearing states were processed as follows: firstly, the data from different states of the bearing were sampled. Sampling occurred every 16,384 data points, resulting in 100 samples. Then, these samples were subjected to signal pre-processing. The dataset description is presented in Table 2.

4.2.2. Optimal Time Frequency Fusion SDP Parameter Selection and Feature Extraction Method

The optimal τ and g values are obtained by the bat algorithm. The parameters of the bat algorithm are set as follows: g ranges from [ 20 °   t o   60 ° ] , τ ranges from [ 1   t o   10 ] , the number of bats in the bat population is 10, the number of iterations is 100, the maximum and minimum values of the frequency are set to 2 and 0, respectively, the loudness is 0.5, the pulse rate is 0.5, and the fitness function is referred to in Formulas (6)–(9). Then, 100 iterations are performed. The final outputs are g =  22.310 ° and τ = 6, and the average similarity of comparison between images is 0.577. The fitness function is illustrated in Figure 16.
Figure 17 gives the optimal time frequency fusion SDP method images of four different states of the bearing when g = 22.310 °   a n d   τ = 6. As can be seen from Figure 17, the optimal time frequency fusion SDP images of the different bearing states illustrates obvious differences, mainly in the saturation degree of the petals and the sparseness of the points on the petals. Therefore, by drawing optimal time frequency fusion SDP images, the signal features of the bearings in different states can be intuitively expressed, so as to achieve accurate fault diagnosis.

4.2.3. Diagnosis Results

The experimentally acquired signals of the different bearing states are transformed using the optimal time frequency fusion method for 400 samples. Each bearing state divides the dataset into a training dataset and a testing dataset in the ratio 4:1. The model learning rate is set to 0.001 and the iteration is 100. The dataset is used as an input of the DCNN for fault classification. The variation in training accuracy obtained from the experiment is illustrated in Figure 18, and the diagnostic results of the testing dataset can be illustrated in Figure 19.
Figure 18 illustrates the change in accuracy of the training dataset and testing dataset after 100 iterations. From Figure 18, during the training process, there are significant fluctuations in the accuracy of the training dataset and testing dataset in the early stages. After approximately the 60th iteration, the fluctuation gradually decreases, and the accuracies of the training dataset and testing dataset stabilize. In addition, Figure 19 illustrates the prediction results of the model for four different states of the bearing. Figure 19 illustrates that the model’s prediction accuracy for four different states of the bearing reaches 100%.

5. Comparison Experiment

5.1. Comparison of 1D Signal to 2D Image Transformation Methods

To verify the effectiveness of the method proposed in this paper more comprehensively, the optimal time frequency fusion SDP transformation method is compared with the Markov transition field (MTF) and Gramian angular field (GAF) methods in this section. The specific steps are as follows:
  • The samples acquired from various bearing states were transformed into 2D images using the optimal time frequency fusion SDP method transformation technique, including the Markov transition field (MTF) and Gramian angular field (GAF) methods. Subsequently, they were split into a training dataset and testing dataset in the ratio 4:1. Figure 20 displays the 2D images obtained using various methods, while Table 3 illustrates the dataset operation time of these methods.
  • The 2D image obtained from the transformation of MTF, GAF, and optimal time frequency fusion SDP methods is input into the DCNN. The network performs adaptive learning of image features and classification, with the learning rate set to 0.001 and the number of iterations to 100.
  • The training time of the dataset, training accuracy, etc., for the various image transformation methods are presented in Table 4. The diagnostic accuracy of the different methods is illustrated through a confusion matrix, as illustrated in Figure 21.
As seen in Table 3 and Table 4, the method proposed in this paper outperforms the other two methods in terms of transformation time, accuracy, and epoch of reach of the convergence. Regarding image transformation, the optimal time frequency fusion SDP transformation method produces an image in 0.111 s, which is superior in terms of real-time performance and computational efficiency compared to the other two methods. Training accuracy is improved by 7.5% compared to the MTF method and by 2.5% compared to GAF. In addition, the method described in this paper is significantly superior to the other two methods regarding the epoch number of reach of the convergence. Therefore, under the same conditions, the method proposed in this paper has a shorter training time than GAF and MTF. It enables faster model training and quicker fault diagnosis.
Therefore, the method proposed in this paper is more computationally efficient and better in real-time than the other two methods, further validating its feasibility and superiority.

5.2. Comparison of the Proposed Method with Traditional SDP Methods

To further validate the excellent performance of the proposed method in this paper in terms of signal feature enhancement, the process is compared with the traditional SDP image transformation method and the time frequency fusion SDP method. The specific steps are as follows:
  • Using the methods proposed in this paper, the traditional SDP image transformation method and the time frequency fusion SDP method, the acquired signal of four different states of the bearing are transformed into 2D images, respectively. Then, they are divided into a training dataset and a testing dataset according to the ratio 4:1. Figure 22 illustrates the 2D images obtained using the different methods.
  • The SDP image dataset, the time frequency fusion SDP image dataset, and the optimal time frequency fusion SDP image dataset are input into the DCNN. The network performs adaptive learning of the image features and classification. The network learning rate is set to 0.001, and the number of iterations is set to 100.
  • The diagnostic results of the different SDP methods are presented in Table 5 and the training effect is visualized as a confusion matrix, as illustrated in Figure 23.
As illustrated in Table 5, the method proposed in this paper outperforms the other two methods in terms of accuracy and the number of training rounds. Regarding training accuracy, the accuracy is enhanced by 13.1% compared to the traditional SDP method and 7.5% compared to the time frequency fusion SDP method. In addition, the method described in this paper is significantly superior to the other two methods regarding the number of training epochs needed to achieve the highest accuracy. Therefore, under the same conditions, this paper’s method has a shorter training time than the traditional SDP and the time frequency fusion SDP methods. It enables faster model training and fault diagnosis.

6. Conclusions

Aiming to address the challenges of strong background noise submerging bearing fault features, and the fact of there being limited information in 1D signals from bearings, this paper introduces an optimal time frequency fusion SDP method. This method combines a signal’s time and frequency domains with varying scales on the SDP image to enhance the signal distinctions between different bearing states. This approach enables the precise identification of bearing faults. The experiments were validated using a public dataset and laboratory data. The results illustrate that the fault diagnosis accuracy reached 100%. The validity of the proposed method is also verified through comparative analysis experiments. The method proposed in this paper provides an innovative two-stage model for bearing fault diagnosis that combines offline training and online testing, which is of significant engineering research value.
In addition, the approach investigated in this paper is applicable to six-segment time-domain and six-segment frequency-domain signal inputs. Future research will explore the applicability of this approach to other decomposition algorithms, as well as its effectiveness in rotating machinery fault diagnosis. These aspects will be addressed in subsequent research.

Author Contributions

G.L.: research design, literature retrieval, data collection and analysis, and manuscript writing; X.S.: research design, resources, supervision, verification, and review; Z.L.: research design, data analysis, supervision, and review; and B.J.: verification, resources, supervision, and review. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (52201355, 52071090), the Program for Scientific Research Start-Up Funds of Guangdong Ocean University (060302132304, 060302132101), and the Zhanjiang Non-funded Science and Technology Research Project (2022B01049, 2023B01046).

Data Availability Statement

The CWRU data can be found at https://engineering.case.edu/bearingdatacenter/download-data-file (accessed on 21 April 2024).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Chaoyong, M. A Bearing Fault Diagnosis Method Based on Concise Empirical Wavelet Transform. Int. J. Compr. Eng. 2023, 12, 1–6. [Google Scholar] [CrossRef]
  2. Song, L.; Hao, P.; Zhang, S.; Han, C.; Wang, H. A Semisupervised GCN Framework for Transfer Diagnosis Crossing Different Machines. IEEE Sens. J. 2024, 24, 8326–8336. [Google Scholar] [CrossRef]
  3. Zhang, K.; Xu, Y.; Liao, Z.; Song, L.; Chen, P. A Novel Fast Entrogram and Its Applications in Rolling Bearing Fault Diagnosis. Mech. Syst. Signal Process. 2021, 154, 107582. [Google Scholar] [CrossRef]
  4. Jin, M.; Kosova, G.; Cenedese, M.; Chen, W.; Singh, A.; Jana, D.; Brake, M.R.W.; Schwingshackl, C.W.; Nagarajaiah, S.; Moore, K.J.; et al. Measurement and Identification of the Nonlinear Dynamics of a Jointed Structure Using Full-Field Data; Part II—Nonlinear System Identification. Mech. Syst. Signal Process. 2022, 166, 108402. [Google Scholar] [CrossRef]
  5. Xue, H.; Song, Z.; Wu, M.; Sun, N.; Wang, H. Intelligent Diagnosis Based on Double-Optimized Artificial Hydrocarbon Networks for Mechanical Faults of In-Wheel Motor. Sensors 2022, 22, 6316. [Google Scholar] [CrossRef]
  6. Song, L.; Jin, Y.; Lin, T.; Zhao, S.; Wei, Z.; Wang, H. Remaining Useful Life Prediction Method Based on the Spatiotemporal Graph and GCN Nested Parallel Route Model. IEEE Trans. Instrum. Meas. 2024, 73, 3511912. [Google Scholar] [CrossRef]
  7. Tang, H.-H.; Zhang, K.; Wang, B.; Zu, X.; Li, Y.-Y.; Feng, W.-W.; Jiang, X.; Chen, P.; Li, Q.-A. Early Bearing Fault Diagnosis for Imbalanced Data in Offshore Wind Turbine Using Improved Deep Learning Based on Scaled Minimum Unscented Kalman Filter. Ocean Eng. 2024, 300, 117392. [Google Scholar] [CrossRef]
  8. Pang, B.; Cheng, T.; Wang, B.; Hu, Y.; Qi, X.; Hao, Z.; Xu, Z. An Improved Empirical Fourier Decomposition Method and Its Application in Fault Diagnosis of Rolling Bearing. J. Mech. Sci. Technol. 2024, 38, 1089–1100. [Google Scholar] [CrossRef]
  9. Zhu, D.; Liu, G.; Wu, X.; Yin, B. An Enhanced Empirical Fourier Decomposition Method for Bearing Fault Diagnosis. Struct. Health Monit. 2024, 23, 903–923. [Google Scholar] [CrossRef]
  10. Lei, N.; Huang, F.; Li, C. Rolling Bearing Fault Diagnosis Based on Variational Mode Decomposition and Weighted Multidimensional Feature Entropy Fusion. J. Vibroeng. 2024, 26, 590–614. [Google Scholar] [CrossRef]
  11. Mao, M.; Zeng, K.; Tan, Z.; Zeng, Z.; Hu, Z.; Chen, X.; Qin, C. Adaptive VMD–K-SVD-Based Rolling Bearing Fault Signal Enhancement Study. Sensors 2023, 23, 8629. [Google Scholar] [CrossRef] [PubMed]
  12. Li, Q.; Zhou, Y.; Tang, G.; Xin, C.; Zhang, T. Early Weak Fault Diagnosis of Rolling Bearing Based on Multilayer Reconstruction Filter. Shock Vib. 2021, 2021, 6690966. [Google Scholar] [CrossRef]
  13. Tang, H.; Tang, Y.; Su, Y.; Feng, W.; Wang, B.; Chen, P.; Zuo, D. Feature Extraction of Multi-Sensors for Early Bearing Fault Diagnosis Using Deep Learning Based on Minimum Unscented Kalman Filter. Eng. Appl. Artif. Intell. 2024, 127, 107138. [Google Scholar] [CrossRef]
  14. Jin, M.; Kosova, G.; Cenedese, M.; Chen, W.; Singh, A.; Jana, D.; Brake, M.R.; Schwingshackl, C.W.; Nagarajaiah, S.; Moore, K.J.; et al. Measurement and identification of the nonlinear dynamics of a jointed structure using full-field data, Part I: Measurement of nonlinear dynamics. Mech. Syst. Signal Process. 2022, 166, 108401. [Google Scholar] [CrossRef]
  15. Youcef Khodja, A.; Guersi, N.; Saadi, M.N.; Boutasseta, N. Rolling Element Bearing Fault Diagnosis for Rotating Machinery Using Vibration Spectrum Imaging and Convolutional Neural Networks. Int. J. Adv. Manuf. Technol. 2020, 106, 1737–1751. [Google Scholar] [CrossRef]
  16. Wang, Y.; Zhang, S.; Cao, R.; Xu, D.; Fan, Y. A Rolling Bearing Fault Diagnosis Method Based on the WOA-VMD and the GAT. Entropy 2023, 25, 889. [Google Scholar] [CrossRef] [PubMed]
  17. Tang, G.; Hu, H.; Kong, J.; Liu, H. A Novel Fault Feature Selection and Diagnosis Method for Rotating Machinery with Symmetrized Dot Pattern Representation. IEEE Sens. J. 2023, 23, 1447–1461. [Google Scholar] [CrossRef]
  18. Li, H.; Wang, W.; Huang, P.; Li, Q. Fault Diagnosis of Rolling Bearing Using Symmetrized Dot Pattern and Density-Based Clustering. Measurement 2020, 152, 107293. [Google Scholar] [CrossRef]
  19. WANG, Y.; WANG, L. Fault Diagnosis of Engines Based on SDP Image and Deep Convolutional Neural Network. Noise Vib. Control 2023, 43, 175–180. [Google Scholar]
  20. Qin, Y.; Shi, X. Fault Diagnosis Method for Rolling Bearings Based on Two-Channel CNN under Unbalanced Datasets. Appl. Sci. 2022, 12, 8474. [Google Scholar] [CrossRef]
  21. Yuan, W.; Liu, F.; Gu, H.; Miao, F.; Zhang, F.; Jiang, M. Accuracy-Improved Fault Diagnosis Method for Rolling Bearing Based on Enhanced ESGMD-CC and BA-ELM Model. Shock Vib. 2024, 2024, 8026402. [Google Scholar] [CrossRef]
  22. Cui, W.; Meng, G.; Gou, T.; Wang, A.; Xiao, R.; Zhang, X. Intelligent Rolling Bearing Fault Diagnosis Method Using Symmetrized Dot Pattern Images and CBAM-DRN. Sensors 2022, 22, 9954. [Google Scholar] [CrossRef] [PubMed]
  23. Siddique, M.N.I.; Shafiullah, M.; Mekhilef, S.; Pota, H.; Abido, M.A. Fault Classification and Location of a PMU-Equipped Active Distribution Network Using Deep Convolution Neural Network (CNN). Electr. Power Syst. Res. 2024, 229, 110178. [Google Scholar] [CrossRef]
  24. Shan, S.; Liu, J.; Wu, S.; Shao, Y.; Li, H. A Motor Bearing Fault Voiceprint Recognition Method Based on Mel-CNN Model. Measurement 2023, 207, 112408. [Google Scholar] [CrossRef]
  25. Wang, Q.; Sun, Z.; Zhu, Y.; Song, C.; Li, D. Intelligent Fault Diagnosis Algorithm of Rolling Bearing Based on Optimization Algorithm Fusion Convolutional Neural Network. Math. Biosci. Eng. MBE 2023, 20, 19963–19982. [Google Scholar] [CrossRef] [PubMed]
  26. Chen, J.; Li, W.; Yang, P.; Li, S.; Chen, B. Fault Diagnosis of Electric Submersible Pumps Using a Three-Stage Multiscale Feature Transformation Combined with CNN–SVM. Energy Technol. 2023, 11, 2201033. [Google Scholar] [CrossRef]
  27. Chen, X.; Hu, X.; Wen, T.; Cao, Y. Vibration Signal-Based Fault Diagnosis of Railway Point Machines via Double-Scale CNN. Chin. J. Electron. 2023, 32, 972–981. [Google Scholar] [CrossRef]
  28. Liu, X.; Xia, L.; Shi, J.; Zhang, L.; Wang, S. Fault Diagnosis of Rolling Bearings Based on the Improved Symmetrized Dot Pattern Enhanced Convolutional Neural Networks. J. Vib. Eng. Technol. 2024, 12, 1897–1908. [Google Scholar] [CrossRef]
Figure 1. Principle of vibration signal to SDP transformation.
Figure 1. Principle of vibration signal to SDP transformation.
Sensors 24 04186 g001
Figure 2. Principle of vibration signal to time frequency fusion SDP transformation.
Figure 2. Principle of vibration signal to time frequency fusion SDP transformation.
Sensors 24 04186 g002
Figure 3. SDP image petals for different values of τ and g.
Figure 3. SDP image petals for different values of τ and g.
Sensors 24 04186 g003
Figure 4. Schematic diagram of the bat algorithm.
Figure 4. Schematic diagram of the bat algorithm.
Sensors 24 04186 g004
Figure 5. SDP features of the bearing in four states.
Figure 5. SDP features of the bearing in four states.
Sensors 24 04186 g005
Figure 6. Diagnostic model.
Figure 6. Diagnostic model.
Sensors 24 04186 g006
Figure 7. Proposed method framework.
Figure 7. Proposed method framework.
Sensors 24 04186 g007
Figure 8. Experimental equipment.
Figure 8. Experimental equipment.
Sensors 24 04186 g008
Figure 9. Signal overlap sampling.
Figure 9. Signal overlap sampling.
Sensors 24 04186 g009
Figure 10. Change in average similarity.
Figure 10. Change in average similarity.
Sensors 24 04186 g010
Figure 11. Optimal time frequency fusion SDP transformation results based on dataset I.
Figure 11. Optimal time frequency fusion SDP transformation results based on dataset I.
Sensors 24 04186 g011
Figure 12. Changes in network training accuracy (dataset I).
Figure 12. Changes in network training accuracy (dataset I).
Sensors 24 04186 g012
Figure 13. Confusion matrix (dataset I).
Figure 13. Confusion matrix (dataset I).
Sensors 24 04186 g013
Figure 14. Experimental device.
Figure 14. Experimental device.
Sensors 24 04186 g014
Figure 15. Types of bearing faults: (a) outer race fault, (b) inner race fault, and (c) roller fault.
Figure 15. Types of bearing faults: (a) outer race fault, (b) inner race fault, and (c) roller fault.
Sensors 24 04186 g015
Figure 16. Value of fitness function.
Figure 16. Value of fitness function.
Sensors 24 04186 g016
Figure 17. Optimal time frequency fusion SDP transformation results based on dataset II.
Figure 17. Optimal time frequency fusion SDP transformation results based on dataset II.
Sensors 24 04186 g017
Figure 18. Changes in network training accuracy (dataset II).
Figure 18. Changes in network training accuracy (dataset II).
Sensors 24 04186 g018
Figure 19. Confusion matrix (dataset II).
Figure 19. Confusion matrix (dataset II).
Sensors 24 04186 g019
Figure 20. Transformation results of different methods based on dataset II.
Figure 20. Transformation results of different methods based on dataset II.
Sensors 24 04186 g020
Figure 21. Confusion matrix of different methods’ diagnostic results.
Figure 21. Confusion matrix of different methods’ diagnostic results.
Sensors 24 04186 g021
Figure 22. Transformation results of different SDP methods based on dataset II.
Figure 22. Transformation results of different SDP methods based on dataset II.
Sensors 24 04186 g022
Figure 23. Confusion matrix of different SDP methods’ diagnostic results.
Figure 23. Confusion matrix of different SDP methods’ diagnostic results.
Sensors 24 04186 g023
Table 1. Description of dataset I.
Table 1. Description of dataset I.
Bearing StateFault Diameter
(Inches)
Number of SamplesLabel
Normal-100Normal
Inner Race fault0.007100IR007
Inner Race fault0.014100IR014
Inner Race fault0.021100IR021
Roller fault0.007100B007
Roller fault0.014100B014
Roller fault0.021100B021
Outer Race fault0.007100OR007
Outer Race fault0.014100OR014
Outer Race fault0.021100OR021
Table 2. Description of dataset II.
Table 2. Description of dataset II.
Bearing StateNumber of SamplesLabel
Normal100FN
Outer Race fault100FOB
Inner Race fault100FIN
Roller fault100FEB
Table 3. Dataset production time for different methods.
Table 3. Dataset production time for different methods.
MethodsAverage Image Transformation Time (s)Dataset Operation Time (s)
GAF0.692277.070
MTF0.381152.519
The proposed method0.11144.605
Table 4. Diagnostic results of different methods.
Table 4. Diagnostic results of different methods.
MethodsClassifierAccuracy (%)Train Time (s)Epoch of Reach the Convergence
GAFDCNN97.5132634
MTFDCNN93.8132936
The proposed methodDCNN10026523
Table 5. Diagnostic results of the different SDP methods.
Table 5. Diagnostic results of the different SDP methods.
MethodsClassifierAccuracy (%)Epoch of Reach the Convergence
Time frequency fusion SDPDCNN92.576
SDPDCNN86.984
The proposed methodDCNN10023
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liang, G.; Song, X.; Liao, Z.; Jia, B. Optimal Time Frequency Fusion Symmetric Dot Pattern Bearing Fault Feature Enhancement and Diagnosis. Sensors 2024, 24, 4186. https://doi.org/10.3390/s24134186

AMA Style

Liang G, Song X, Liao Z, Jia B. Optimal Time Frequency Fusion Symmetric Dot Pattern Bearing Fault Feature Enhancement and Diagnosis. Sensors. 2024; 24(13):4186. https://doi.org/10.3390/s24134186

Chicago/Turabian Style

Liang, Guanlong, Xuewei Song, Zhiqiang Liao, and Baozhu Jia. 2024. "Optimal Time Frequency Fusion Symmetric Dot Pattern Bearing Fault Feature Enhancement and Diagnosis" Sensors 24, no. 13: 4186. https://doi.org/10.3390/s24134186

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop