Next Article in Journal
An Enhanced Mobility and Temperature Aware Routing Protocol through Multi-Criteria Decision Making Method in Wireless Body Area Networks
Next Article in Special Issue
Fault Localization by Comparing Memory Updates between Unit and Integration Testing of Automotive Software in an Hardware-in-the-Loop Environment
Previous Article in Journal
A Novel Discriminating and Relative Global Spatial Image Representation with Applications in CBIR
Previous Article in Special Issue
Adaptive Threshold Generation for Fault Detection with High Dependability for Cyber-Physical Systems
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Aircraft Air Compressor Bearing Diagnosis Using Discriminant Analysis and Cooperative Genetic Algorithm and Neural Network Approaches

1
Mathematics and Systems Department, Ecole Royale de l’Air, 40000 Marrakech, Morocco
2
LSET, Department of Applied Physics, Faculty of Science and Technology Gueliz, 40000 Marrakech, Morocco
*
Author to whom correspondence should be addressed.
Appl. Sci. 2018, 8(11), 2243; https://doi.org/10.3390/app8112243
Submission received: 28 September 2018 / Revised: 24 October 2018 / Accepted: 7 November 2018 / Published: 14 November 2018
(This article belongs to the Special Issue Fault Detection and Diagnosis in Mechatronics Systems)

Abstract

:
Monitoring and diagnosis of rotating machines has become an effective and indispensable tool for the efficient and timely detection of defects, avoiding then incidents that can have serious economic and human consequences. Bearings are the most sensitive parts of these machines; this is why special attention must be paid to its monitoring. This paper presents a methodology for diagnosing an aircraft air compressor bearing using neural networks that have been optimized by genetic algorithms. We used in our study a database of vibratory signals that were recorded on a test bench from bearings with different defects. The faults features are extracted from these noisy signals using the estimate of the spectral density. The diagnostic capacity of obtained model has been demonstrated by a comparative study with two other automatic classifiers, which are discriminant analysis and neural networks whose training has been done with the Back-Propagation algorithm. This approach has the advantage of simultaneously ensuring the optimal structure of the neural network and accomplishing its learning. The importance of this study is the construction of a diagnostic tool that is characterized by efficiency, speed of decision making and ease of implementation not only on the computers on the ground, but also on the mounted calculators on aircraft.

1. Introduction

Rotating machines play an important role in industrial and transport applications. They have become more complicated, precise and costly. Thanks to technological progress, fault diagnosis techniques, are increasingly being used. Most rotating machines operate by means of bearings, gears and other rotating parts which can often cause defects. These defects can lead the machine to fail, reducing performance and even causing very serious accidents [1,2,3].
Bearings are the most critical elements parts of rotating machines because they support the dynamic forces of a shaft. Therefore they must be closely monitored to detect and locate defects at an early stage.
By using some vibration signal processing methods, it is possible to obtain decisive diagnostic information. These methods are used to characterize, extract and identify fault signatures. Many conventional techniques such as time domain analysis and Fourier analysis are investigated in recent research and performed in many applications. The method, based on scalar features such as Root Mean Square, Crest Factor, and Kurtosis, can detect the presence of faults and their locations but the diagnosis is still imprecise [4,5]. The second approach is based on the application of the Fast Fourier Transform algorithm. However, the total spectrum of the vibration signal (shaft and bearings) obtained does not exhibit an obvious characteristic frequency generated by the defects. This technique is quite limited and it works efficiently only for periodic signals [6].
The autocorrelation function is a statistical average suitable for characterizing random signals in the time domain. The Fourier transform of the autocorrelation function is the Power Spectral Density (PSD). It gives the power distribution of a signal in the frequency domain and is used to characterize random signals. The Welch power density estimation gives the spectral characteristics of signals characterized as random processes [7,8].
However, continuous monitoring of the damage indicative variables is tedious because it is a procedure that requires a good deal of expertise to successfully apply them. It is therefore necessary to have simpler approaches that enable relatively low-skilled operators to make reliable decisions in the absence of diagnostic experts.
Statistical techniques such as Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA) were the first to be used in this field [9,10,11]. The Random Forest Algorithms are based on the decision trees classifier; it has been considered significantly in development of fault machine diagnostics methods through a powerful method for classification and predictions [12,13,14]. Support Vector Machine (SVM) is also used; it is a very precise classifier, robust to noise and overfitting, but expensive in terms of computation [15,16].
Subsequently, artificial intelligent techniques, such as Genetic Algorithms, Fuzzy Logic, and Artificial Neural Networks, have been applied successfully to automatic detection and to diagnosis [17,18,19,20,21,22,23,24,25,26].
In this paper, we aim to diagnose vibration failure occurring on a bearing mounted on the aircraft air compressor. This study concerns two aspects: we seek first to acquire the vibratory signals and to characterize the defects of the compressor bearing. The chosen signal analysis method is the Welch spectral density estimate for its efficiency on signals embedded in noise. The second part allows building a model which facilitates the monitoring and the diagnosis.
We used neural networks with optimization based on genetic algorithms. The diagnostic results obtained by this approach were compared with two other traditional diagnostic methods.
The first model that has been tried is based on statistical methods. The results obtained motivate the choice of another more efficient approach based on Artificial Neural Network.
Then we used neural networks with the Back-Propagation algorithm to accomplish the training. We had to perform several tests with changing at each time the number of neurons in the hidden layer. This method is tedious and it is not sure to find the optimal architecture and the best performance.
To overcome this problem, genetic algorithms have been used. This optimizer uses all the search space to find the neural network architecture that will give the maximum classification rate. This hybrid method of neural networks and genetic algorithms has the advantage of performing both learning and optimization of the network architecture. The results of the diagnosis were very satisfactory.
This method is distinguished from previous work and research by the efficiency, speed of calculations and the option of being implemented in flight systems.
To address the issues discussed above, this paper is organized as follows: Section 2 describes the case of study, the experimental set-up and the vibration signals processing with the method of Welch spectral density estimation. Section 3 is devoted to a brief description of the Linear Discriminant Analysis, Artificial Neural Networks techniques and Genetic Algorithm. The results of the vibration signal processing and the use of these fault monitoring methods are discussed in Section 4. Finally, the main conclusions of this paper are given in Section 5.

2. Data and Signal Processing

The data used in our investigation were recorded on a test bench of an aircraft turbojet engine. Two accelerometers are used to measure vibration in front and rear bearing housing. We used only the signals acquired at the accelerometer mounted on the front bearing housing since the faults to be considered are located at turbojet air compressor bearing.
The acquisition of the signals was carried out through 348 experiments on healthy bearings and defective bearings. These experiments are classified into 4 groups:
  • 60 were fault-free
  • 96 had inner race bearing fault
  • 96 had outer race bearing fault
  • 96 had ball bearing fault.
All the signals recorded with a sampling frequency equal to 12,000 Hz. To increase the number of elements in each class, we divided each signal into 3 segments. We got 1044 signal overall. An illustration in the time domain of an inner ring faulty bearing signal is illustrated in Figure 1.
Estimating spectral power density is a very important area in the field of digital signal processing. This study explores the Welch estimation method. It is a nonparametric method which provides a consistent estimator of power spectral density [27]. This method consists to subdividing the records, taking modified periodograms for each subdivision and averaging these modified periodograms. In many cases, this method requires less calculation than other methods because it involves transforming the signal into shorter sequences.
For X(n), a second-order stationary random discrete signal of zero mean ( n   =   0 ,   1 ,     2 , ,     N 1 ) , we take overlapping segments of length L. The starting points of these segments are multiples of D as illustrated in Figure 2. We assume that we have K segments, X 1 ( n ) ,   X 2 ( n ) , ,   X K ( n ) and that they cover the entire record, as described in Equation (1).
  ( K 1 )   D   +   L   =   N   X 1 ( n ) = X ( n )   X 2 ( n )   = X ( n + D )   X K ( n )   = X ( n + ( K 1 ) D )  
To obtain the spectral estimation, we calculate first a dependent frequency (f) modified periodogram P ^ m ( i ) for each segment,
  P ^ m ( i ) ( f ) = 1 L V { n = 0 L 1 W S ( n ) X ( n + i D ) exp ( 2 π j n f ) } 2  
where W s ( n ) is the window function and V is defined in (3).
  V = 1 n n = 0 N 1 | W s ( n ) | 2  
The spectral estimate P ^ W S ( f ) is the average of these periodograms as given in (4).
  P ^ W S ( f ) = 1 K i = 0 K 1 P ^ m ( i ) ( f )  
Finally:
  P ^ W S ( f ) =   1 K L V i = 0 K 1 { n = 0 L 1 W S ( n ) X ( n + i D ) exp ( 2 π j n f ) } 2  
Thus, the estimation of the spectrum consists in estimating P ^ W S   ( f ) from a finite number of noisy data. Welch’s method reduces noise at the expense of frequency resolution [28].In our case, we used the hamming window function with a length 100 and an overlap of 30.
The representation of the spectral density of 2 faulty bearings signals are illustrated in Figure 3. (Frequency and Amplitude are normalized).
After analyzing the 1044 available signals, we extracted the 8 most predominant peaks of the power spectral density (pointed out by triangles in Figure 3). Two values were used for each peak: the characteristic frequency and the value of the spectral density, which gave 16 features for each signal. The data were then organized in a matrix of 16 columns and 1044 rows.
If the generated data is used directly without any processing before starting the training phase, the input variables of the highest value may tend to suppress the influence of the most small. Thus, normalized data will be treated with the same priority. We normalized each line of the data matrix. The 16 features of each line were then scaled between −1 and 1.
After this step, the data was then subdivided into two parts to build the LDA model (60% for learning and 40% for testing) and three parts for building the two others models based on neural networks (60% for learning, 20% for validation and 20% for tests).

3. Methodology

To construct a diagnostic model that automatically classifies defects, three techniques were used: Linear Discriminant Analysis and two other different techniques of Artificial Neural Networks.

3.1. Linear Discriminant Analysis (LDA) Method

LDA is a classification method that has been successfully applied in many fields. For a sample of n observations distributed in M groups, the objective of the LDA is to produce a new representation space where we can better distinguish the M groups [29,30]. It uses the between-class scatter matrix S B to evaluate the separability of different classes and within-class scatter matrix S W evaluates the compactness within each class.
Let X = ( x 1 ,   x 2 , ,   x n ) be the training set, each x i xi belongs to a class C l ( l = 1 ,   2 , , M ) .
Between-class scatter matrix S B , within-class scatter matrix   S W , and total-class scatter matrix S are defined by (6), (7) and (8).
  S W = l = 1 M i = 1 n l ( x i μ l ) ( x i μ l )
  S B = l = 1 M ( μ l μ ) ( μ l μ )
  S = S w + S B  
with:
  • n l is the number of data points in class L,
  • μ l : The center of gravity of class L,
  • μ : The center of gravity of all observation.
The principle of LDA is to find vector projection v 1 that maximizes the ratio: between-class/within-class scatter. For this purpose, the objective function of LDA is defined by (9).
  F ( v 1 ) = v 1 S B v 1 v 1 S W v 1  
It can be shown that the optimal vector projection v 1 is the eigenvector corresponding to the largest eigenvalues of S W 1 S B . The projection with maximum class separability information corresponds to the eigenvectors whose eigenvalues are the highest.
We will present in Section 4.1 the bearing fault diagnosis by using LDA approach.

3.2. Back-Propagation Neural Networks

The second method used in our work is based on artificial neural networks (ANN). Their principles mirror the organization and mechanism of the human brain (10 billion neurons) based on learning and memory [31,32]. ANN are composed of a specified number of single processing units called neurons (See Figure 4).
The classical neuron model is described by (10).
  y = σ ( i = 1 n w i u i + b )  
where u i   ( i   =   1 ,   2 , ,   n ) denotes the neuron inputs, b is the bias (threshold), w i denotes the synaptic weight coefficients, σ is the nonlinear activation function such that sigmoid and hyperbolic tangent functions.
The multilayer neural network is a network in which the neurons are grouped into layers. Such a network has an input layer, one or more hidden layers, and an output layer (Figure 5). The fundamental neural data processing is carried out in hidden and output layers.
The neurons constituting each layer are linked to all the neurons of the following layer. For each connection, a weighting coefficient is assigned which is determined according to the tasks that should be solved by this neural network.
The output layer generates the network response vector Y . Non-linear neural computing performed by the network shown in (Figure 5) can be expressed by (11).
  Y = σ 2 { W 2 σ 1 ( W 1 U ) }  
where:
  • σ 1 and σ 1 are vector-valued activation functions which define neural signal transformation through the 1st and output layers;
  • W 1 and W 2 are the matrices of weight coefficients which determine the intensity of connections between neurons in the neighboring layers;
  • U, Y are the input and output vectors, respectively.
One of the fundamental advantages of neural networks is that they have the ability of learning and adapting. The training of a neural network is the determination of weight coefficient values between the neighboring processing units.
The Back-propagation (BP) is a popular feedforward multi-layered network learning algorithms. It optimizes the value of synaptic weights between neurons by minimizing the sum-squared error using the gradient descent method. The modification of the weights is performed according to the Formula (12).
  W ( k + 1 ) = W ( k ) η   J ( W ( k ) )  
where:
  • W ( k ) denotes the weight vector at the discrete time k,
  • η is the learning rate,
  • J ( W ( k ) is sum-squared error:
      J ( W ( k ) ) = | | d k y k | | 2  
y k is the output vector and d k is the desired output vector.
The standard BP has proven its performance in practical applications. But the disadvantage of these methods requires fixing the architecture of the network before starting the learning phase. The diagnosis using the Back-Propagation Neural Network method will be seen in Section 4.2.

3.3. Genetic Algorithm based Neural Network

The first methods that have been implemented to avoid defining in advance the neural network architecture are based on the technique of the extension of geometry. These methods begin the training phase with a limited number of hidden layers and neurons and increase their numbers progressively. But they were used without reaching the optimal architecture [33,34,35].
In this article, we apply genetic algorithms for a dual purpose. Find both the ideal architecture of the neuron network (number of hidden layers) and the good values of the neural weights and thresholds. The principle of the approach is to assign to each layer, during the codification of chromosomes, a value between 0 and 1. The layer will only be activated if this value is greater than a threshold defined in advance (in our case at 0.3).
We will see in the following the general principles of genetic algorithms and how we combined them with neural networks.
GAs were created by analogy with natural phenomena. They simulate the natural evolution of organisms (individuals), generation after generation, respecting heredity phenomena during reproduction by crossover, mutation and replacement. In a population of individuals, these are the best adapted to the environment, who survive and give offspring. Such algorithms were developed in 1950 by biologists, and then these algorithms were adapted for the search of solutions of optimization problems [36,37,38,39].
The GAs are then based on the following phases:
  • Initialization: An initial population of N chromosomes is randomly drawn.
  • Evaluation: Each chromosome is decoded and evaluated.
  • Selection: Creation of a new population of N chromosomes by the use of an appropriate selection method.
  • Reproduction: Possibility of crossover and mutation within the new population.
  • Return to the evaluation phase until the algorithm stops.
After briefly seen the principle of genetic algorithms, we will look closely how to implement it through the coding of individuals and the application of genetic operators.

3.3.1. Initial Population Codification:

With regard to the coding of the elements of a population, it is necessary to represent the different individuals in a usable form for a GA. This form, called the chromosome, is composed of genes that correspond to the different parameters of the solution. In the case of our study, the solution corresponds to the optimal neural network which is coded in the form of a chromosome encompassing all the data necessary for its implementation.
The algorithm used in our research has the particularity of being able to find the optimal number of hidden layers ( N l ) and the optimal number of neurons in each of these layers ( N p ). The same number of neurons in each layer is fixed and it is equal to N p . This method is an improved version of the one proposed by [40].
Let W i and B i respectively the matrices of weights and biases of each layer. (‘i’ is the layer number) To be able to codify neural networks with a constant length chromosome, we have added to each field coding a network layer “i” a number M i . The layer will only be activated if the value of this field is greater than the threshold value M i ≥ 0.3. Regarding the number of neurons in each hidden layer ( N p ), the code is added at the end of the chromosome.
As an example, consider a network with three layers of neurons with two inputs, two neurons in each hidden layers and one neuron in the output layer (Figure 6). We set the maximum number of layers to 3 and the maximum number of neurons in each layer to 2. The length of the chromosome is therefore 19.

3.3.2. Fitness Function

Whenever a new individual has been created, it must be associated with a value (called fitness or evaluation function) that measures the quality of the solution. This value will be used by selection processes to favor the best suited individuals who are the best solutions to the problem. Evaluation therefore represents the performance of the individual in relation to the problem to be solved.
In our case, we try to quantify the ability of an ANN to learn. The individual will have a fitness function value as low as it will be a good solution to the problem of optimization. We choose a fitness function F F in our case that equals the Mean Squared Error expressed by (14) [41].
  F F = i ( d i a i ) 2  
d i and a i are the desired and calculated outputs of a ANN.

3.3.3. Selection Operator

A selection process is necessary to choose the chromosomes that ensure an improvement in the quality of the solutions. Selection is a process of choosing among all individuals in the population those who will participate in the construction of a new generation. This choice is essentially based on the values of the fitness function of each individual. A member with a low value of the fitness function will have a better chance of being selected to participate in the reproduction of the next generation.
There are different techniques to implement selection in Genetic Algorithms. In the case of our study, we chose the Tournament Selection. It consists of a meeting between several individuals randomly selected from the population. The winner of the tournament is the individual of better quality.

3.3.4. Crossover Operator

In general, crossover consists of applying procedures to selected individuals to reproduce one or more children who must inherit certain characteristics of the parents. This operator is used with a certain probability called the crossover rate ( P C   [ 0 , 1 ] ) which represents the proportion of the parent population that will be used for reproduction [42]. The most commonly used rates are in the range [0.45, 0.95].
We can mention some types of crossover operators as: One Point Crossover, Multi Point Crossover, Uniform Crossover, and Whole Arithmetic Recombination. In our case, we used a two-point crossover operator with a rate of 0.7.

3.3.5. Mutation Operator

A mutation can be defined as a small random adjustment in the chromosome, to obtain a new solution [43]. It is used to maintain and introduce diversity into the genetic population and is generally applied with low probability. If the probability is high, the GA is reduced to a random search. The mutation operator allows in other words the exploration of the entire research space. In the case of our study, the mutation operator is applied to 3% of the population at each generation.

3.3.6. Replacement Operator

This last step in the iterative process consists of incorporating new solutions into the current population. New solutions are added to the current population to replace partial old solutions. Generally, the best solutions replace the worst ones; this results in an improvement of the population [43].
Section 4.3 will be devoted to the bearing fault diagnosis by the use of this modified neural networks technique.

4. Vibration Fault Diagnosis

4.1. Linear Discriminant Analysis Based Fault Diagnosis

The purpose of the LDA is to automatically classify the bearings into one of the following 4 categories (Healthy Bearing, Inner Ring Fault, Ball Fault, Outer Ring Fault). For this purpose, we used the data obtained from the analysis of the 1044 available signals: Matrix of 1044 lines and 16 columns including 731 lines for learning and 313 lines for testing. For this model we used only learning and test data.
The global classification rate for training and test data has reached a F1-Score of 96.26% (Table 1 and Table 2). For the test data it can be deduced that the best classification rate is obtained for the inner ring faults with a Recall value which is equal to 96.59% (85 faults from 88 that have been identified). The worst misclassification rate is recorded for outer ring faults with a rate of false discovery equal to 12.20% (10 faults among 82 have not been identified). The F1-score for the test data is equal to 92.33%.
The classification rate obtained by the LDA model remains insufficient for a model that is called to recognize defects on flying systems and whose consequences of a bad diagnosis can cause catastrophic results. Thus, to improve the obtained results, we extend our investigation with another more efficient diagnostic model. The model that will be used is based on Artificial Neural Networks.

4.2. Back-Propagation Neural Network Based Fault Diagnosis

The purpose of this subsection is to classify the bearings in the categories (Healthy bearing, Inner Ring Fault, Ball Fault, Outer Ring Fault) but with a better efficiency. The same database as above was used. It consists of 1044 lines corresponding to the number of signals and 16 columns corresponding to the descriptor extracted from the signal analysis. The data were subdivided as follows: 60% for Training (626 lines), 20% for validation (210 lines), and 20% for the test (210 lines).
We used a neural network with one hidden layer. The number of neurons in the input layer is 16 corresponding to the number of the descriptors. The Back-propagation algorithm has been tested to train the neural network.
The particularity of this network is that it contains 2 neurons in the output layer instead of 4. This choice allows decreasing the number of weights and consequently the calculation will be faster.
The neurons in the output layer will take values 1 or −1 depending on the desired classification decision. The set of possibilities is summarized in Table 3. We used the neural transfer function “tansig” to calculate the outputs of each layer.
Several tests were performed by changing the number of neurons in the hidden layer each time. The optimal neural network is composed of 16 neurons in its hidden layer (Figure 7a). This network converged after 24epochs with Mean Squared Error MSE = 0.0124 (Figure 7b).
As noted above, the data were subdivided to 3 parts. For the training data the F1-Score obtained is 99.04%, the validation data the score is 97.62% and for the test data the score is 96.67% (Table 4, Table 5 and Table 6). It can be seen from the test data that among the 56 cases of ball faults bearing, 3 were misclassified with a rate of false discovery is equal to 5.36%. Regarding the 59 defects of the outer ring, 3 of them were not well predicted. The rate of false discovery is equal to 5.08%.
The tests show a classification rate improvement compared to the LDA method. These results are obtained with a network having 16 neurons in a single hidden layer.
The disadvantage of this approach is that we made several tests by changing each time the number of hidden layers and the number of neurons without being sure to reach the optimal value. To achieve this goal, we have chosen genetic algorithms as a method of optimizing the neural network.

4.3. Cooperative GA-Neural Network Based Fault Diagnosis

Like the two methods previously used, we used the same database with the same repartition of data (626 lines for training, 210 for validation and 210 for testing). We have kept the same goal which is classifying bearings in the four categories mentioned in previous chapters.
As indicated in Section 3.3, we will use modified artificial neural networks to achieve this goal. The number of maximal hidden layers and neurons are respectively set at Nl = 5 and Np = 20. This choice is largely sufficient to build this network.
The optimization method we adopted allowed us to determine not only the structure of the neural network (number of hidden layers and neurons) but also the weights and thresholds values of neurons. According to the coding method adopted, the length of the chromosome will not depend on the architecture of the neural network but only on the maximum numbers of hidden layers and neurons that have been fixed in advance (Nl and Np). This length is equal to 2069 divided according at the Table 7.
The best performances were obtained by gradually increasing the population size and the number of iteration. The Best global GA parameters are shown in Table 8. This optimization allows us to retain the optimal network that consists of 3 hidden layers and 13 neurons in each layer. The algorithm has converged after 25 iteration with Mean Squared Error MSE = 0.076 (Figure 8).
The classification results obtained by this model are as follows: For learning data, the F1-Score is 100% and for validation and test data, the scores are respectively 99.14% and 99.12%. From the test data we can deduce that only one ball bearing defect on 55 has not been identified and only one outer ring bearing fault on 53 has not been identified. For healthy bearings and bearings with inner ring defects, the classification rate is 100% (Table 9, Table 10 and Table 11).
Compared to the LDA and the classical ANN classifiers, the Neural Network based model optimized with Genetic Algorithms was more effective in classifying vibration bearings defects. These results have been validated by test data with a F1-Score of 99.12%. The global score for training, validation and testing data is 99.65%. These results are obtained thanks to this approach which has the capacity to optimize the architecture of the neural network.
All experiments were performed with Matlab R2017b software on a machine having the following characteristics: Intel Core i5 2.4 GHz processor with 4.0 GB of RAM. The execution time of the algorithm is 13 min 15.03 s.
It should be noted that this time which has been calculated is not the diagnosis time, but the time which is necessary for the optimization and the learning of the neural network. This operation is carried out only once to build the model.
In addition to its ability to accurately classify defects, this method provides a quick diagnosis for making decisions in time. This ability is very useful for flight systems which require a high operational safety. This model is validated to ensure an automatic diagnosis of the vibration defects of the aircraft air compressor bearings.

5. Conclusions

In this paper, we present an approach to diagnose vibratory failures of a bearing mounted on an aircraft air compressor. Vibratory signals were acquired on the test bench at the front bearing housing. The Welch spectral power estimate was used efficiently to analyze these signals and extract the characteristic frequencies. The data obtained are grouped into 4 classes (Healthy Bearing, Inner race fault, Ball fault, Outer race fault) and they were used for learning two fault monitoring models.
The first method used is Linear Discriminant Analysis; its classification rate remains insufficient in our case study.
Regarding the second method, the Feed Forward neural network has been tested with the Back-Propagation algorithm for training. Compared to the LDA method, the results have been improved without attaining the maximum rate of classification.
Regarding the third method, we have opted for genetic algorithms to find the optimal neural network architecture to improve classification performance. The classification rate has reached a F1-Score of 99.65. Thus, this model has been validated for the diagnosis of vibratory defects of bearings.
The contribution of this work is to set up a method of diagnosis of vibratory defects based on a modified version of the neural networks. The optimization of ANN by Genetic Algorithms has significantly improved the classification performance of bearing faults.
Moreover, this method is characterized by rapid diagnostic decision making and ease of implementation on ground-based computers or in-flight systems. Its advantage lies in its ability to know the state of the rolling elements without disassembling the turbojets.

Author Contributions

Data curation, A.Y.O.; Investigation, A.Y.O. and M.M; Methodology, A.Y.O. and M.M.; Resources, A.Y.O.; Supervision, M.M., H.A. and A.E.K.; Validation, M.M.; Writing–original draft, A.Y.O.; Writing–review & editing, A.Y.O. and M.M.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yaqub, M.F.; Loparo, K.A. An automated approach for bearing damage detection. J. Vib. Control 2014, 22, 3253–3266. [Google Scholar] [CrossRef]
  2. Gupta, P.; Pradhan, M.K. Fault detection analysis in rolling element bearing: A review. In Proceedings of the 5th International Conference of Materials Processing and Characterization, Materials Today, Hyderabad, India, April 2017; pp. 2085–2094. [Google Scholar] [CrossRef]
  3. Zurita, G.; Sanchez, V.; Cabrera, D. A review of vibration machine diagnostics by using artificial intelligence methods. Investig. Desarro. 2016, 1, 102–114. [Google Scholar] [CrossRef]
  4. Al-Ghamd, A.M.; Mba, D. A comparative experimental study on the use of acoustic emission and vibration analysis for bearing defect identification and estimation of defect size. Mech. Syst. Signal Process. 2006, 20, 1537–1571. [Google Scholar] [CrossRef] [Green Version]
  5. Lakshmi, P.P.; Shanmukha, P.V.; Naidu, V.P.S. Bearing Health Condition Monitoring: Time Domain Analysis. Int. J. Adv. Res. Electr. Electron. Instrum. Eng. 2014, 3, 75–82. [Google Scholar]
  6. Tse, P.W.; Peng, Y.H.; Yam, R. Wavelet Analysis and Envelope Detection For Rolling Element Bearing Fault Diagnosis—Their Effectiveness and Flexibilities. J. Vib. Acoust. 2001, 123, 303–310. [Google Scholar] [CrossRef]
  7. Rahi, P.K.; Mehra, R. Analysis of Power Spectrum Estimation Using Welch Method for Various Window Techniques. Int. J. Sci. Res. Eng. Technol. 2013, 2, 389–392. [Google Scholar]
  8. Proakis, J.G.; Manolakis, D.G. Digital Signal Processing—Principles, Algorithms & Applications, 3rd ed.; Prentice-Hall: Upper Saddle River, NJ, USA, 1998; pp. 911–912. ISBN 0133737624. [Google Scholar]
  9. Zhao, M.; Xiaohang, J.; Zhang, Z.; Li, B. Fault Diagnosis of Rolling Element Bearings via Discriminative Subspace Learning: Visualization and Classification. Expert Syst. Appl. 2014, 41, 3391–3401. [Google Scholar] [CrossRef]
  10. Mjahed, M.; Proriol, J. Taging jets and partons by discriminant analysis. Phys. Lett. B 1989, 217, 560–562. [Google Scholar] [CrossRef]
  11. Mjahed, M. Identification of the quark jet charge, using neural networks and discriminant analysis methods. Nuclear Instrum. Methods Phys. Res. A 2000, 449, 602–608. [Google Scholar] [CrossRef]
  12. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  13. Patel, R.K.; Giri, V.K. Feature selection and classification of mechanical fault of an induction motor using random forest classifier. Perspect. Sci. 2016, 8, 334–337. [Google Scholar] [CrossRef]
  14. Satishkumar, R.; Sugumaran, V. Vibration based Health Assessment of Bearings using Random Forest Classifier. Indian J. Sci. Technol. 2016, 9, 1–6. [Google Scholar] [CrossRef]
  15. Fernández-Francos, D.; Martínez-Rego, D.; Fontenla-Romero, O.; Alonso-Betanzos, A. Automatic bearing fault diagnosis based on one-class ν-SVM. Comput. Ind. Eng. 2013, 64, 357–365. [Google Scholar] [CrossRef]
  16. Rezgui, W.; Mouss, K.N.; Mouss, L.H.; Mouss, M.D.; Amirat, Y.; Benbouzid, M. Optimization of SVM Classifier by k-NN for the Smart Diagnosis of the Short-Circuit and Impedance Faults in a PV Generator. Int. Rev. Model. Simul. 2014, 7, 863–870. [Google Scholar] [CrossRef]
  17. SekharReddy, C.M.; Sekhar, A.S. Application of Artificial Neural Networks for Identification of Unbalance and Looseness in Rotor Bearing Systems. Int. J. Appl. Sci. Eng. 2013, 11, 69–84. [Google Scholar]
  18. Amato, F.; López, A.; Peña-Méndez, E.M.; Vaňhara, P.; Hampl, A.; Havel, J. Artificial neural networks in medical diagnosis. J. Appl. Biomed. 2013, 11, 47–58. [Google Scholar] [CrossRef]
  19. Li, X.; Palazzolo, A.; Wang, Z. Rotating machinery monitoring and fault diagnosis with neural Network enhanced fuzzy logic expert system. In Proceedings of the ASME Turbo Expo 2016: Turbomachinery Technical Conference and Exposition, Seoul, South Korea, 13–17 June 2016. [Google Scholar]
  20. Ashour, M.W.; Khalid, F.; Abdullah, L.L.; Alfian, A.H. Artificial Neural Network-Based Texture Classification Using Reduced Multidirectional Gabor Features. Int. Rev. Comput. Softw. 2014, 9, 1007–1016. [Google Scholar]
  21. Marizan, S.; Tawafan, A.; Zunaidi, I. High Impedance Fault Detection On Power Distribution Feeder. Int. Rev. Model. Simul. 2012, 5, 2197–2204. [Google Scholar]
  22. Monadjemi, S.A.; Moallem, P. Automatic Diagnosis of Particular Diseases Using a Fuzzy-Neural Approach. Int. Rev. Comput. Softw. 2008, 3, 406–411. [Google Scholar]
  23. Devi, S.; Siva Kumar, L. An innovative approach in fault diagnostics of steam turbine performance using ANN and M-SVM algorithms. Int. Rev. Mech. Eng. 2014, 8, 350–359. [Google Scholar]
  24. Hannan, A.M.; Fizazi, H. Metaheuristics and Neural Network for Satellite Images Classification. Int. Rev. Aerosp. Eng. 2016, 9, 113. [Google Scholar] [CrossRef]
  25. Demidova, L.; Sokolova, Y.; Nikulchev, E. Use of Fuzzy Clustering Algorithms Ensemble for SVM Classifier Development. Int. Rev. Model. Simul. 2015, 8, 449–457. [Google Scholar] [CrossRef]
  26. Ben Nasr, M.; Saoud, S.; Cherif, A. Optimization of MLP Using Genetic Algorithms Applied to Arabic Speech Recognition. Int. Rev. Comput. Softw. 2013, 8, 653–659. [Google Scholar]
  27. Rani Gupta, H.; Batan, S.; Mehra, R. Power Spectrum Estimation using Welch Method for various Window Techniques. Int. J. Sci. Res. Eng. Technol. 2013, 2, 389–392. [Google Scholar]
  28. Polat, K.; Güneş, S. Classification of epileptiform EEG using a hybrid system based on decision tree classifier and fast Fourier transform. Appl. Math. Comput. 2007, 187, 1017–1026. [Google Scholar] [CrossRef]
  29. Wang, Z.; Hai, Y.; Shao, L.B.; Li, C.N.; Liu, L.M.; Deng, N.Y. MBLDA: A novel multiple between-class linear discriminant analysis. Inf. Sci. 2016, 369, 199–220. [Google Scholar] [CrossRef]
  30. Chiang, L.H.; Russell, E.L.; Braatz, R.D. Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares and principal component analysis. Chemom. Intell. Lab. Syst. 2000, 50, 243–252. [Google Scholar] [CrossRef]
  31. Patan, K. Artificial Neural Networks for the Modelling and Fault Diagnosis of Technical Processes; Springer: Berlin, Germany, 2008. [Google Scholar]
  32. Beale, M.H.; Hagan, M.T.; Demuth, H.B. Neural Network Toolbox User’s Guide; MathWorksInc.: Natick, MA, USA, 2017. [Google Scholar]
  33. Kohonen, T. Self Organizing Maps, 3rd ed.; Springer: Berlin, Germany, 2001; ISBN 978-3-642-56927-2. [Google Scholar]
  34. Wang, D. Fast Constructive-Coverting Algorithm for neural networks and its implement in classification. Appl. Soft Comput. 2008, 8, 166–173. [Google Scholar] [CrossRef]
  35. Wang, D.; Chaudhari, N.S. A constructive unsupervised learning algorithm for Boolean neural networks based on multi-level geometrical expansion. Neurocomputing 2004, 57, 455–461. [Google Scholar] [CrossRef]
  36. Mukhopadhyay, D.M.; Maricel, O.; Alisherov, F.A. Genetic Algorithm: A Tutorial Review. Int. J. Grid Distrib. Comput. 2009, 2, 25–32. [Google Scholar]
  37. Siti, I.; Mjahed, M.; Ayad, H. New Designing Approaches for Quadricopter PID Controllers Using Reference Model and Genetic Algorithm Techniques. Int. Rev. Autom. Control 2017, 10, 240–248. [Google Scholar]
  38. Mjahed, M. Optimization of Classification Tasks by using Genetic Algorithms. In Proceedings of the Informatics and Systems (INFOS), Cairo, Egypt, 28–30 March 2010; pp. 1–4. [Google Scholar]
  39. Paulinas, M.; Sinskas, U.A. A survey of genetic algorithms applications for image enhancement and segmentation. Inf. Technol. Control 2007, 36, 278–284. [Google Scholar]
  40. Seiffert, U. Multiple Layer Perceptron Training Using Genetic algorithms. In Proceedings of the European Symposium on Artificial Neural Networks, Bruges, Belgium, 25–27 April 2001; pp. 159–164. [Google Scholar]
  41. Belew, R.K.; McInerney, J.; Scharaudolph, N.N. Evolving Networks using the Genetic Algorithms with Connectionist Learning; CSE Technical Report CS90-174; UCSD: San Diego, CA, USA, 1990. [Google Scholar]
  42. Padmavathi, K.; Priyanka, Y. Crossover Operators in Genetic Algorithms: A Review. Int. J. Comput. Appl. 2017, 162, 34–36. [Google Scholar]
  43. Coello, C.A.C.; Lamont, G.B.; Van Veldhuizen, D.A. Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd ed.; Springer: Berlin, Germany, 2007; ISBN 978-0-387-36797-2. [Google Scholar]
Figure 1. Time domain of an inner ring faulty bearing signal.
Figure 1. Time domain of an inner ring faulty bearing signal.
Applsci 08 02243 g001
Figure 2. Illustration of the record segmentation.
Figure 2. Illustration of the record segmentation.
Applsci 08 02243 g002
Figure 3. Spectral density of (a) ball faulty bearing (b) inner ring faulty bearing.
Figure 3. Spectral density of (a) ball faulty bearing (b) inner ring faulty bearing.
Applsci 08 02243 g003
Figure 4. Neuron model.
Figure 4. Neuron model.
Applsci 08 02243 g004
Figure 5. Artificial neural networks (ANN) with one hidden layer.
Figure 5. Artificial neural networks (ANN) with one hidden layer.
Applsci 08 02243 g005
Figure 6. Codification of a Neural Network.
Figure 6. Codification of a Neural Network.
Applsci 08 02243 g006
Figure 7. Training data of Back-Propagation neural network: (a) Classification rate for each experiment (b) Best Validation Performance.
Figure 7. Training data of Back-Propagation neural network: (a) Classification rate for each experiment (b) Best Validation Performance.
Applsci 08 02243 g007
Figure 8. Cooperative Genetic Algorithm-neural network: Best Validation Performance.
Figure 8. Cooperative Genetic Algorithm-neural network: Best Validation Performance.
Applsci 08 02243 g008
Table 1. Classification rate of LDA model (Training data).
Table 1. Classification rate of LDA model (Training data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing11900199.17%
Inner Ring Fault01962298.00%
Ball Fault02200397.56%
Outer Ring Fault12220197.57%
Precision99.17%98.00%204%97.10%
Table 2. Classification rate of LDA model (Test data).
Table 2. Classification rate of LDA model (Test data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing5701295.00%
Inner Ring Fault0852196.59%
Ball Fault1375490.36%
Outer Ring Fault2357287.80%
Precision95.00%93.41%90.36%91.14%
Table 3. Output layer classification.
Table 3. Output layer classification.
FaultOutput 1Output 2
Healthy Bearing11
Inner Ring Fault−11
Ball Fault1−1
Outer Ring Fault−1−1
Table 4. Classification rate for Back-Propagation neural network (Training data).
Table 4. Classification rate for Back-Propagation neural network (Training data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing98000100%
Inner Ring Fault01770199.44%
Ball Fault00171298.84%
Outer Ring Fault00316798.31%
Precision100%100%98.28%98.31%
Table 5. Classification rate for Back-Propagation neural network (Validation data).
Table 5. Classification rate for Back-Propagation neural network (Validation data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing35000100%
Inner Ring Fault0620198.41%
Ball Fault0057296.61%
Outer Ring Fault0115196.23%
Precision100%98.41%98.28%94.44%
Table 6. Classification rate for Back-Propagation neural network (Testing data).
Table 6. Classification rate for Back-Propagation neural network (Testing data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing47000100%
Inner Ring Fault0470197.92%
Ball Fault0053394.64%
Outer Ring Fault0125694.92%
Precision100%97.92%96.36%93.33%
Table 7. Chromosome codification length.
Table 7. Chromosome codification length.
Input LayerHidden LayerOutput LayerLength of Number of Neurons Code
WeightsBiasActivation ThresholdWeightsBiasActivation ThresholdWeightsBiasActivation Threshold
3202011600804400211
Table 8. Genetic Algorithm Parameters.
Table 8. Genetic Algorithm Parameters.
Population Size100Crossover Percentage (Pc)0.7
Numberof Max Iteration1000Mutation Percentage (Pm)0.3
Table 9. Classification rate for Cooperative GA-neural network based Fault Diagnosis (Training data).
Table 9. Classification rate for Cooperative GA-neural network based Fault Diagnosis (Training data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing113000100%
Inner Ring Fault016300100%
Ball Fault001790100%
Outer Ring Fault000171100%
Precision100%100%100%100%
Table 10. Classification rate for Cooperative GA- neural network based Fault Diagnosis (Validation data).
Table 10. Classification rate for Cooperative GA- neural network based Fault Diagnosis (Validation data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing33000100%
Inner Ring Fault05900100%
Ball Fault0053198.15%
Outer Ring Fault0016298.41%
Precision100%100%98.15%98.41%
Table 11. Classification rate for Cooperative GA- neural network based Fault Diagnosis (Test data).
Table 11. Classification rate for Cooperative GA- neural network based Fault Diagnosis (Test data).
Predicted Class
Healthy BearingInner Ring FaultBall FaultOuter Ring FaultRecall
ActualClassHealthy Bearing34000100%
Inner Ring Fault06600100%
Ball Fault0054198.18%
Outer Ring Fault0105398.15%
Precision100%98.51%100%98.15%

Share and Cite

MDPI and ACS Style

Ouadine, A.Y.; Mjahed, M.; Ayad, H.; El Kari, A. Aircraft Air Compressor Bearing Diagnosis Using Discriminant Analysis and Cooperative Genetic Algorithm and Neural Network Approaches. Appl. Sci. 2018, 8, 2243. https://doi.org/10.3390/app8112243

AMA Style

Ouadine AY, Mjahed M, Ayad H, El Kari A. Aircraft Air Compressor Bearing Diagnosis Using Discriminant Analysis and Cooperative Genetic Algorithm and Neural Network Approaches. Applied Sciences. 2018; 8(11):2243. https://doi.org/10.3390/app8112243

Chicago/Turabian Style

Ouadine, Ahmed Youssef, Mostafa Mjahed, Hassan Ayad, and Abdeljalil El Kari. 2018. "Aircraft Air Compressor Bearing Diagnosis Using Discriminant Analysis and Cooperative Genetic Algorithm and Neural Network Approaches" Applied Sciences 8, no. 11: 2243. https://doi.org/10.3390/app8112243

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop