Next Article in Journal
Entropy Analysis of Solar Two-Step Thermochemical Cycles for Water and Carbon Dioxide Splitting
Previous Article in Journal
Increment Entropy as a Measure of Complexity for Time Series
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Long Range Dependence Prognostics for Bearing Vibration Intensity Chaotic Time Series

1
College of Mechanical Engineering, Donghua University, Shanghai 201620, China
2
George W. Woodruff School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA 30332-0560, USA
*
Author to whom correspondence should be addressed.
Entropy 2016, 18(1), 23; https://doi.org/10.3390/e18010023
Submission received: 26 September 2015 / Revised: 23 November 2015 / Accepted: 23 November 2015 / Published: 8 January 2016
(This article belongs to the Section Complexity)

Abstract

:
According to the chaotic features and typical fractional order characteristics of the bearing vibration intensity time series, a forecasting approach based on long range dependence (LRD) is proposed. In order to reveal the internal chaotic properties, vibration intensity time series are reconstructed based on chaos theory in phase-space, the delay time is computed with C-C method and the optimal embedding dimension and saturated correlation dimension are calculated via the Grassberger–Procaccia (G-P) method, respectively, so that the chaotic characteristics of vibration intensity time series can be jointly determined by the largest Lyapunov exponent and phase plane trajectory of vibration intensity time series, meanwhile, the largest Lyapunov exponent is calculated by the Wolf method and phase plane trajectory is illustrated using Duffing-Holmes Oscillator (DHO). The Hurst exponent and long range dependence prediction method are proposed to verify the typical fractional order features and improve the prediction accuracy of bearing vibration intensity time series, respectively. Experience shows that the vibration intensity time series have chaotic properties and the LRD prediction method is better than the other prediction methods (largest Lyapunov, auto regressive moving average (ARMA) and BP neural network (BPNN) model) in prediction accuracy and prediction performance, which provides a new approach for running tendency predictions for rotating machinery and provide some guidance value to the engineering practice.

1. Introduction

Rolling bearings are widely used as the most common and key components in rotating machinery systems. Generally, the working environment of rolling bearings is complex, with high speeds and heavy loads, and various failures such as wear, pitting, cracking and spalling, etc. always appear. Many unexpected failures deteriorate rapidly and may cause catastrophic accidents and financial losses or even personnel casualties [1,2,3]. Therefore, condition prognostics and health management (CPHM) have become a particularly crucial issue and appealing field in mechanical fault diagnosis (MFD).
Vibration intensity time series of bearing systems belongs to a special kind of highly non-stationary and nonlinear data due to bearing systems that are restricted by the complicated operating mode and conditions, hence, modeling and prognostics approaches of time series is a challenge for researchers. Vibration intensity time series are composed of various components such as Gaussian noise, impulse, variation trend, model perturbations and other uncontrolled features, etc., so various traditional statistical methods and prediction models are unsuitable for those time series. In the present paper, recent studies of prediction approaches of time series can be classified into three major categories:
  • Statistical time series modeling approaches.
  • Computational intelligence (CI) approaches.
  • Prediction methods for chaos time series.
The statistical time series modeling approaches include auto regressive (AR), auto regressive moving average (ARMA), auto regressive integrated moving average (ARIMA), and generalized auto regressive conditional heteroskedasticity (GARCH) [4,5,6] methods, however, the use of those models is often restricted by linearity, normality and stationarity characteristics and although they are very well suited to capture short range dependence and stable periodicity, they are not well suited to deal with nonlinearity, thus resulting in poor prediction accuracy.
Computational intelligence (CI) approaches include artificial neural networks (ANNs) (Elman neural networks [7], recurrent neural networks [8], radial basis function neural networks [9], etc.), support vector machines (SVMs) [10,11] and Kalman filter algorithms [12], etc. Artificial neural networks have good nonlinear prediction and self-learning ability, but the network structures of ANNs are hard to determine by experiment and theory, and ANNs is easy to fall into local optima and additionally they suffer from slow convergence speed. SVMs are powerful for problems characterized by small samples, nonlinearity, high dimensionality and local minima, and have high generalization ability, but the key kernel parameters of SVM are difficult to optimize and train. In addition, the main drawbacks of the Kalman filter prediction method are that it requires accurate system models, the statistics properties of the process and observation noise. Unfortunately, vibration intensity time series are very complicated and it is difficult to establish an accurate mathematical model.
Chaos time series prediction methods, such as adaptive prediction and local adaptive prediction, Volterra series method and largest Lyapunov Exponent (LLE) [13,14] are based on the theory of chaos phase space reconstruction, and the weight parameters are regulated automatically, In addition, reference [15] proposed a method for reconstructing dynamical systems based on time-delay embedding and use it on the bearing fault diagnostics, then compares the reconstructed bearing vibration data with a baseline reconstruction from normal bearing data to generate a severity index over time with Wasserstein distance and the earth mover’s distance (EMD), but these studies can't make full use of the advantages of the adaptive algorithm for its inability to adjust the filter parameters owing to the unknown real-value during multi-step prediction.
Despite these preliminary efforts mentioned above, all the statistical models and conventional methods were found to be insufficient to address the characteristics of bearing vibration intensity. One reason for such an inadequacy might be the existence of long range dependence features [16,17,18,19] in bearing vibration intensity time series; another reason might be this time series is a typical fractional order system, so fractional order signal processing (FOSP) [20] techniques are likely to be applicable to this time series and able to predict it accurately. FOSP is based on the knowledge of fractional order differential equations (FODE) and fractional order calculus (FOC), which can analyze fractional order systems such as Short-Range Dependence (SRD), LRD and times series with heavy tailed distributions [21].
This paper discusses the prediction problem of vibration intensity chaotic time series, and the chaotic characteristics of vibration intensity time series is explored and judged first, then in order to overcome the adaptability weaknesses of this chaotic time series and examine the existence of long range dependence and fractional order features, the FOSP technique f-ARIMA is proposed. f-ARIMA (LRD) models can parsimoniously represent LRD through the single parameter d, which is characterized by a slow decay in its autocorrelation function compared to the other models and it avoids excessive complexity and keeps the model solvable. In addition, the f-ARIMA (LRD) model can acquire the corresponding fractional differenced value based on the characteristics of a time series, and fit complex nonlinear time series well, thus it has good generalization ability for different LRD time series. Finally, the suitability of this prediction model of chaotic time series for obtaining more accurate multi-step forecasts will be demonstrated later.
The remainder of the paper is organized as follows: in Section 2, the chaotic characteristics of bearing vibration intensity time series are described with phase space reconstruction, LLE [22] and Duffing-Holmes Oscillator (DHO) [23]. In Section 3, the LRD modeling, Hurst parameter estimation and the prediction steps of LRD are presented. In Section 4, the forecasting results and discussion of LRD and other different previous approaches are given in detail. Section 5 presents the conclusions and a summary.

2. Chaotic Characteristics Analysis of Bearing Vibration Intensity Series

2.1. Phase Space Reconstruction

A chaos attractor can estimate whether a times series is chaotic or stochastic, thus attractor reconstruction is a key step in chaotic time series analyses. Vibration intensity time series should be expanded into a high-dimensional space to reveal its dynamic characteristics, which was proposed by Takens [24]. For a given time series { x ( i ) } , i = 1 , 2 , , N , selecting an optimal delay time τ and an optimal embedding dimension m, the phase space can be expressed as follows:
X ( i ) = [ x ( i ) , x ( i + τ ) , , x ( i + ( m 1 ) τ ) ]
where, i = 1 , 2 , , M ,   M = N ( m 1 ) τ , is the number of elements in the reconstructed phase space, so it is clear that the phase space can be reconstructed for an optimal embedding dimension m and delay time τ.

2.2. The Optimal Delay Time τ

In order to reduce the reconfiguration calculation cost and keep the nonlinear characteristics of the time series, the delay time τ can be computed based on the C-C method [25], which was obtained by statistical results and has a strong ability of resist noise.
For embedding dimension m = 2, 3, 4, 5, radius r i = i × 0.5 ε , t is index lag, i = 1, 2, 3, 4, ε is time series standard deviation, then calculate the following three formulas:
S ¯ ( t ) = 1 16 m = 2 5 i = 1 4 S ( m , r i , t )
Δ S ¯ ( t ) = 1 4 m = 2 5 Δ S ( m , t )
S c o r ( t ) = Δ S ¯ ( t ) + | S ¯ ( t ) |
where, S ¯ ( t ) and Δ S ¯ ( t ) can reflect the correlation of bearing vibration intensity series, and the delay time τ will correspond to the first zero crossings point times of S ¯ ( t ) or the first local minimum value times of Δ S ¯ ( t ) , and the minimum of the quantity S c o r ( t ) , respectively.

2.3. Optimal Embedding Dimension and Saturated Correlation Dimension

The saturated correlation dimension can measure the complexity of the reconstruction attractor in phase space. The saturated correlation dimension D and optimal embedding dimension m are calculated using the Grassberger–Procaccia (G-P) algorithm [26,27]. This algorithm uses the phase space reconstruction of time series in Equation (1), which can be estimated by embedding dimension m through the principle that the correlation dimension increases with the increases of embedding dimension and reaching a saturated state. Given a small values of m0, the correlation integral C ( r , m ) is given by:
C ( r , m ) = 1 N ( N 1 ) i , j H ( r X ( i ) X ( j ) )
where, r is the radius of the sphere centered on X ( i ) or X ( j ) , X ( i ) X ( j ) is calculated as Euclidean norm, N is the length of time series, H(x) is the Heaviside function, defined as follows:
H ( x ) = { 0 , x 0 1 , x > 0
There is a linear relationship between attractor dimension and cumulative distribution function, namely, D ( m ) = | ln C ( r , m ) ln r | , thus the asymptotic curve was established by lnC(r,m)-lnr, then the correlation dimension D and embedding dimension m can be obtained by the formula m 2 D + 1 .

2.4. Largest Lyapunov Exponent (LLE)

Lyapunov exponents generally measure the exponential rates of divergence or convergence of nearby trajectories in phase space, which are calculated to characterize chaotic time series. Given a time series, which is embedded in K-dimensional phase space, and has K Lyapunov exponents ( λ 1 , λ 2 , , λ k ), if the largest LLE is positive, λ > 0 , it means that the time series is chaotic. Similarly, the phase plane trajectory is a chaotic state, which can be obtained by the Duffing-Holmes Oscillator [23]. In this paper, the LLE is calculated by using Wolf’s algorithm [22], which is given as follows: given a initial point of reconstruct phase space X(t0), locate a nearest neighbor point to the initial point X0(t0), and denote the distance between those two points L0. At a later time t1, if the distance outside of the parameters specified ε , that is L 0 ' = | X ( t 1 ) X 0 ( t 1 ) | > ε , then this procedure is repeated by selecting the new neighbor points at the replacement points on the attractor until the fiducial trajectory has traversed the entire data, the Lyapunov exponents λ is given by:
λ = 1 t M t 0 i = 0 M ln L i ' L i
where, L i ' and L i are the Euclidean distances calculated between the two nearest neighboring points on the different trajectories, M is the total number of iteration steps. Therefore m and τ must be selected for the LLE mentioned above first. In addition, the maximum predictable steps (MPS) term is the reciprocal of the largest Lyapunov index, namely, t M P S = 1 / λ .

3. Prognostic Model of Long Range Dependence

3.1. Theory of Long Range Dependence

Long range dependence (LRD) of a process can be defined by an asymptotic power-law decrease of its autocorrelation function (ACF) and power spectral density (PSD) [28]. Let X = ( x t : t = 1 , 2 , 3... ) be a stochastic process with the ACF r x x ( τ ) = E [ x ( t ) x ( t + τ ) ] , then X is called SRD series if r x x ( τ ) is integrable [16,29], that is 0 r x x ( τ ) d τ < , on the other side, X is LRD if r x x ( τ ) is nonintegrable, that is 0 r x x ( τ ) d τ = . Moreover, the autocorrelation function follows asymptotically:
r x x ( τ ) ~ c 1 | τ | β ,   for   ( τ )
where c1 > 0 is a constant and 0 < β < 1.
Equivalently, its two-sided PSD follows asymptotically:
S x ( τ ) ~ c 2 | τ | α ,   for   τ 0   ,   0 < α < 1
where, c2 > 0 is a constant.
The f-ARIMA (p, d, q) [30,31] process arises as a special case of LRD when the differencing parameter d in the range (−0.5,0.5). Let X = ( x t : t = 1 , 2 , 3... ) represent the time series of vibration intensity. Then, LRD for the series can be formulated as:
Φ ( B ) ( 1 B ) d X t = Θ ( B ) ε t
where ε t is white Gaussian noise (WGN), d = ( 0.5 , 0.5 ) , B the backshift operator, defined by B X t = X t 1 , B X 2 t = X t 2 , , Φ ( B ) and Θ ( B ) are polynomial functions of the backshift operator B given by:
Φ ( B ) = 1 ϕ 1 B 1 ϕ 2 B 2 ϕ p B p
Θ ( B ) = 1 θ 1 B 1 θ 2 B 2 θ q B q
and Δ = ( 1 B ) is fractional differencing operator defined by:
Δ d = ( 1 B ) d = k = 0 ( d k ) ( B ) k
where, ( d k ) = Γ ( d + 1 ) Γ ( k + 1 ) Γ ( d k + 1 ) , and Γ is the Gamma function.
Generally, we judge whether a stochastic time series is long-range dependent or not, from the perspective of the definition directly, the discrete integral of the time series is difficult and there might exists trend errors in the result; from another perspective, references [32,33] proposed that LRD exhibits self similarity that is characterized by the parameter H or Hurst parameter H ( 0.5 , 1 ) , thus the degree of self-similarity is expressed by the Hurst parameter. Clearly, fractional parameter d in f-ARIMA (p, d, q) is the indicator of LRD, d can be calculated by the Hurst exponent H. This parameter represents the speed of decay of a process’ autocorrelation function. If 0.5 < H < 1, then the series is consistent with LRD and the closer it is to 1, the stronger the long memory or self-similarity; Otherwise H = 0.5 and 0 < H < 0.5 indicates that the time series is an anti-persistent process (or standard Brownian motion) [32] and SRD, respectively. The Hurst exponent H can be estimated by several methods, in this paper, R/S method is introduced to calculate the parameter H [33].

3.2. Hurst with R/S Method

Given a stochastic sample series X = ( x t : t = 1 , 2 , 3... ) , with the average x ( n ) ¯ and the variance S 2 ( n ) , then R/S method can be expressed by:
R ( n ) S ( n ) = 1 S ( n ) ( max ( 0 , w 1 , w 2 , , w n ) min ( 0 , w 1 , w 2 , , w n ) )
where, w k = ( x 1 + x 2 + + x k ) k x ¯ ( n ) , k = 1 , 2 , 3 , n .
If the sample series satisfy LRD process, then:
E ( R ( n ) S ( n ) ) ~ C n H , n
If the sample series consistent with SRD process, then:
E ( R ( n ) S ( n ) ) ~ C n 0.5 , n
For the formulas above, C > 0 is a constant, and the Hurst exponent H can be obtained by the least squares fitting algorithm for the R/S curve (Log(n)-logRS curve) in the logarithmic coordinates.

3.3. LRD Prediction Steps

The vibration intensity can reflect the overall running trend of the equipment, thus the bearing vibration intensity time series before the predicted point are selected as forecast samples, and the prediction steps of LRD algorithm are given below:
Step 1: By means of abnormal data deletion and zero mean normalization for original time series samples in preprocessing operation in order to improve the prediction precision.
Step 2: The Hurst exponent of vibration intensity series was estimated by the R/S method.
Step 3: Then the differencing parameter d can be calculated by the formula H = d + 0.5 . Then the fractional differencing can be defined as follows:
Y t = Δ d X t = ( 1 z 1 ) d X t = k = 0 ( d k ) ( z 1 ) k X t = k = 0 π k X t k ,   for   π k = Γ ( d + 1 ) Γ ( k + 1 ) Γ ( d k + 1 )
Generally, for fractional differencing, it is the key of the whole prediction process.
Step 4: Process Y = { Y t , t = 1 , 2 , 3 , N } is considered as an ARMA model, and then the model parameters and orders can be determined by the Akaike information criterion (AIC), and the concrete operation process can be stated as follows: first, we determine the AR model parameters [ ϕ 1 , ϕ 2 , , ϕ p ] with the Yule–Walker equation:
( ϕ 1 ϕ 2 ϕ p ) = ( r ( 0 ) , r ( 1 ) , , r ( p 1 ) r ( 1 ) , r ( 0 ) , , r ( p 2 ) r ( p 1 ) , r ( p 2 ) , , r ( 0 ) ) 1 ( r ( 1 ) r ( 2 ) r ( p ) )
where, r ( k ) is autocorrelation function (ACF).
Then, process Y = { Y t , t = 1 , 2 , 3 , N } is filtered by the Finite Impulse Response (FIR) filter Z ( B ) = 1 + i = 1 p ϕ i B k , and treating process Z = { Z t , t = 1 , 2 , 3 , N } as a MA(q) model. Finally, the m orders AR model can be established with Z = { Z t , t = 1 , 2 , 3 , N } , where m > > q , and using this model for linear prediction, that is equivalent to a AR(q), and the [ θ 1 , θ 2 , , θ q ] can be generated by the Yule–Walker equation again.
Step 5: Using ARMA model to predict future time series.
Step 6: The prediction values of finally actual vibration intensity can be acquired by anti-fractional difference from Step 5, and the differential value is –d. The specific forecast process is as shown in Figure 1.
Figure 1. Forecasting process of the long range dependence.
Figure 1. Forecasting process of the long range dependence.
Entropy 18 00023 g001

4. Experimental Verification

4.1. Experimental Setup

The vibration signal was generated by the NSF I/UCR Center for Intelligent Maintenance Systems (Cincinnati, OH, USA; IMS-www.imscenter.net) and the University of Cincinnati [34,35]. Four Rexnord ZA-2115 double row bearings were installed on the shaft as shown in Figure 2. The shaft is driven by an AC motor and coupled by rub belts. Accelerometers were installed on bearing housing. Four thermocouples were attached to the outer race of each bearing to record bearing temperature for the purpose of monitoring the lubrication. Vibration data was collected every 10 min by a NI 6062E DAQ Card. The sampling rate set at 20 kHz and the data length is 20,480 points. Inner race fault vibration signal of bearing 3 was produced by a National Instruments LabVIEW program from 22 October 2003 12:06:24 to 25 November 2003 23:39:56 (from normal to severe fault), that is to say, the overall test data had 2156 sets.
Figure 2. Bearing test rig.
Figure 2. Bearing test rig.
Entropy 18 00023 g002
In this study, vibration intensity was selected as forecast samples instead of the original acceleration signals or another indicator because the vibration fault acceleration signal has potential cyclical and non-stationary characteristics, whereas the vibration intensity time series is highly nonlinear, non-stationary and aperiodic. Therefore the vibration intensity time series is more suitable for the LRD method. The vibration intensity is defined as the root mean square (RMS) value of the vibration velocity ranging from 10 Hz to 1000 Hz, which is integrated and an effective characteristic to reflect the equipment operational condition. Vibration intensity value is the vibration level of the vibration velocity, and it includes the main parameters and features of the vibration signals. Moreover, it reflects the overall operating state of the mechanical equipment, hence the value of vibration intensity was selected as the sensitive factor for the bearing status [36]. Given a discrete vibration velocity signal v ( n ) with N points, the vibration intensity can be expressed as:
V r m s = 1 N 0 N 1 v 2 ( n )
Next, vibration acceleration signals that are captured from each location and direction must be changed into velocity signals. Velocity signals can be obtained from accelerometer signals using numerical integration, however, the velocity signals always contain a trend of errors. Reference [37] proved that the errors trend can be eliminated by a polynomial fitting of the extreme value, thus more precise velocity signals can be acquired from this algorithm, and the vibration intensity can be calculated with Equation (17), thus the equivalent vibration intensity (EVI) is defined as:
v s = ( v x N x ) 2 + ( v y N y ) 2 + ( v z N z ) 2
where, Vx, Vy, Vz are the vibration intensity direction of axis X, Y, Z, and the unit is mm/s; Nx, Ny, Nz are measuring points of axis X, Y, Z, respectively. Therefore, 2156 sets of vibration velocity points of bearing 3 are captured using Equation (18), Figure 3 shows the relationship between the whole accelerated life data and experimental data in this paper. According to equipment vibration international standard ISO-2372 (Class I), the vibration intensity across the fault critical line 7.1 in the last few points (see Figure 3a), and this sudden fault was caused by an artificially increased load in the laboratory. However, in a practical engineering application, incipient bearing faults occur based on the slowly changing characteristics over the whole life. Thus the vibration intensity time series in Figure 3b were selected to investigate the prediction efficiency of the LRD model, which could have some guidance value for engineering practice.
Figure 3. The relationship between the whole accelerated life data and experiment data (vibration intensity time series).
Figure 3. The relationship between the whole accelerated life data and experiment data (vibration intensity time series).
Entropy 18 00023 g003

4.2. Chaotic Characteristic Analysis of Bearing Vibration Intensity Time Series

In this section, the chaotic characteristic can be evaluated based on the proposed 200 sets of bearing vibration intensity time series. S ¯ ( t ) and Δ S ¯ ( t ) curves of vibration intensity time series with C-C method as shown in Figure 4a,b. The result of Figure 4a pointed out that the first zero crossings point times of S ¯ ( t ) is t = 2, similarily, the first local minimum value times of Δ S ¯ ( t ) is t = 2 in Figure 4b, therefore the optimal delay time of vibration intensity time series is τ = 2.
Figure 4. S ¯ ( t ) and Δ S ¯ ( t ) curves for time delay. (a) S ¯ ( t ) curve for time delay; (b) Δ S ¯ ( t ) curve for time delay.
Figure 4. S ¯ ( t ) and Δ S ¯ ( t ) curves for time delay. (a) S ¯ ( t ) curve for time delay; (b) Δ S ¯ ( t ) curve for time delay.
Entropy 18 00023 g004
The curves between lnC(r,m) and lnr according to the G-P method are shown in Figure 5, and Figure 6 presents the relation between the embedding dimension m and the saturated correlation dimension D. Figure 5 and Figure 6 prove that the curve region reaches a saturated state gradually as the embedding dimension m increases. Figure 6 shows that the convergence value of the correlation dimension is 6.5336, hence the embedding dimension of the vibration intensity time series is m = 14 according to the formula m 2 D + 1 , which means that vibration intensity time series can be completely revealed in 14-dimensional space.
Figure 5. Relation curve between lnC(r,m) and lnr.
Figure 5. Relation curve between lnC(r,m) and lnr.
Entropy 18 00023 g005
Figure 6. Saturated correlation dimension method for the embedding dimension.
Figure 6. Saturated correlation dimension method for the embedding dimension.
Entropy 18 00023 g006
Further, the largest Lyapunov exponent of the vibration intensity time series is calculated using the Wolf method, and the result is λ = 0.0316 , that is λ > 0 , which means that the vibration intensity time series is chaotic. In addition, the maximum predictable steps t m p s = 1 / λ = 31.64 , therefore, the maximum prediction time is 31 (point number or steps), and the prediction step is creditable under the condition of t 31 . Figure 7 is the phase plane trajectory of vibration intensity time series with the Duffing-Holmes Oscillator (DHO), which also indicates that the vibration intensity time series belongs to a chaotic sequence.
Figure 7. Phase plane trajectory with Duffing-Holmes Oscillator (x is the signals produced by the D-H system, x' is the derivative of x).
Figure 7. Phase plane trajectory with Duffing-Holmes Oscillator (x is the signals produced by the D-H system, x' is the derivative of x).
Entropy 18 00023 g007

4.3. Prediction Analysis of LRD

The Hurst exponent H is obtained by the R/S method as shown in Figure 8. The resulting H = 0.5933 > 0.5 shows that the vibration intensity chaotic time series is consistent with the LRD property, equivalently, the ACF r x x ( τ ) is nonintegrable, thus the LRD model can be applied to chaotic time series to predict the future running vibration intensity points. Considering the prediction steps obtained above is 31, thus the LRD is applied to predict 30 points vibration intensity ahead, that is 300 min.
Figure 8. Log(n)-logRS curve with R/S method.
Figure 8. Log(n)-logRS curve with R/S method.
Entropy 18 00023 g008
The predicted values of the chaotic time series generated by the LRD model, largest Lyapunov model (L-Lyap), ARMA model and BP neural network (BPNN) are illustrated in Figure 9. From Figure 9, it can be observed that the models are able to reasonably track the vibration intensity variation trend. The quantitative prediction results, prediction absolute error (AE) and relative error (RE) of four models are shown in Appendix. The forecasting errors that differ between actual and predicted values with the proposed models are shown in Figure 10. It is clear that the predicted results using the LRD model have better a match with the actual vibration intensity than the predicted result using other prediction methods, and the LRD method can offer more accurate forecasting result than other methods.
Figure 9. Comparison of the forecasting for chaotic time series using the proposed models.
Figure 9. Comparison of the forecasting for chaotic time series using the proposed models.
Entropy 18 00023 g009
Figure 10. The forecasting errors distribution of vibration intensity.
Figure 10. The forecasting errors distribution of vibration intensity.
Entropy 18 00023 g010
Furthermore, in order to determine quantitatively the better model, the following error criteria are employed for a comprehensive model comparison as shown in Table 1.
Table 1. Different predict error criterions.
Table 1. Different predict error criterions.
Predict Error CriterionsComputational Formula
Mean Absolute Error M A E = 1 N k = 1 N | x ( k ) x ( k ) |
Root-Mean-Square Error R M S E = k = 1 N 1 N 1 [ x ( k ) x ( k ) ] 2
Normalized Mean Square Error N M S E = k = 1 N [ x ( k ) x ) ( k ) ] 2 k = 1 N [ x ( k ) x ( k ) ¯ ] 2
Maximum of Absolute Error M a x A E = max ( | x ( k ) x ( k ) | )
The four models discussed in the paper are applied to vibration intensity chaotic time series, and the performance comparison results are shown in Table 2. It can be observed in all the cases that Mean Absolute Error (MAE), Root-Mean-Square Error (RMSE), Normalized Mean Square Error (NMSE), Maximum of Absolute Error (Max-AE) obtained with the LRD model are considerably lower than those calculated with the other models, which clear shows that the LRD model for chaotic time series has high accuracy, therefore theLRD prediction model provides a new way for predicting the running tendency or remaining useful lifetime of rotating machinery in practical engineering.
Table 2. Performance comparison for vibration intensity chaotic time series.
Table 2. Performance comparison for vibration intensity chaotic time series.
Prediction MethodMAERMSENMSEMax-AE
LRD0.0005920.00331.32741.2703
L-Lyap0.00900.05001.54621.6773
ARMA0.02410.13451.61061.5077
BPNN0.20611.14841.85241.3635

5. Conclusions

In this paper, a chaotic time series prediction approach for bearing vibration intensity based on LRD method is proposed. Results obtained from this research are as follows:
  • The vibration intensity time series have chaotic properties, and the chaotic characteristics of vibration intensity time series can be jointly determined by the largest Lyapunov exponent and phase plane trajectory.
  • Experimental results and analysis demonstrate the unique ability of the f-ARIMA model for chaotic time series. The long range dependence prediction method is powerful for problems characterized by chaotic time series, small samples and nonlinearity. The LRD prediction method is better than other prediction methods in prediction accuracy and prediction performance, thus providing a new approach for the running tendency prediction of rotating machinery and some guidance value for engineering practice. In addition, the Hurst exponent can be calculated by the time series self-feature, instead of a subjective integer difference.
  • High prediction accuracy is the key and critical to CPHM for improving reliability and reducing overall maintenance costs. The significant economic impact of prediction accuracy or prediction errors in rotating machinery status prediction on the mechanical equipment market and the systematic chaotic and self-similarity properties of different rotating machinery prediction models would be meaningful topics for further research.

Acknowledgments

This research was supported by the National Natural Science Foundation of China (Grant No. 51175077) and Natural Science Foundation of Shanghai (Grant No.14ZR1418500). The authors would like grateful to the editors and reviewers for their constructive comments and suggestions.

Author Contributions

Jianguo Yang contributed to the conception of the study; Beizhi Li participated in the discussion and checked the results; Steven Y. Liang helped perform the discussion and language description of this paper; Qing Li designed the research and wrote the paper All authors have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. The prediction results of bearing vibration intensity.
Table A1. The prediction results of bearing vibration intensity.
NORealLRDLRD_AELRD_REL-LyapL-Lyap_AEL-Lyap_REARMAARMA_AEARMA_REBPNNBPNN_AEBPNN_RE
14.55223.9986−0.5536−0.1216124.427−0.1252−0.0275033.5635−0.9887−0.2171924.0736−0.4786−0.105136
23.66493.3793−0.2856−0.0779282.8398−0.8251−0.2251363.1812−0.4837−0.1319823.3158−0.3491−0.095255
33.0363.1990.1630.05368912.7735−0.2625−0.0864622.668−0.368−0.1212123.20620.17020.0560606
43.30384.55511.25130.37874574.34931.04550.31645384.81151.50770.45635334.66731.36350.4127066
52.82032.9480.12770.04527893.02330.2030.07197823.53610.71580.25380283.61860.79830.283055
63.25253.25780.00530.00162953.38530.13280.04083012.9159−0.3366−0.103493.1038−0.1487−0.045719
74.10083.8482−0.2526−0.0615983.2006−0.9002−0.2195184.42960.32880.08017954.12130.02050.004999
83.27723.75830.48110.14680214.68171.40450.42856713.2749−0.0023−0.0007023.58040.30320.092518
92.47983.07030.59050.2381243.37670.89690.36168242.96440.48460.1954193.37070.89090.3592628
103.91293.7449−0.168−0.0429354.55680.64390.16455833.6133−0.2996−0.0765673.94020.02730.0069769
114.58763.5724−1.0152−0.2212924.3291−0.2585−0.0563483.8472−0.7404−0.1613923.8285−0.7591−0.165468
122.46311.8725−0.5906−0.2397793.0390.57590.23381112.82130.35820.14542652.89340.43030.1746986
134.554.2955−0.2545−0.0559342.8727−1.6773−0.3686373.7735−0.7765−0.1706594.067−0.483−0.106154
144.1463.3061−0.8399−0.2025812.8231−1.3229−0.3190793.3848−0.7612−0.1835993.3941−0.7519−0.181356
152.74873.24270.4940.17972133.13110.38240.13912032.5418−0.2069−0.0752722.95920.21050.0765817
163.08653.87320.78670.25488424.10491.01840.3299533.94030.85380.2766244.38311.29660.4200875
174.19983.7001−0.4997−0.1189822.7413−1.4585−0.3472783.5695−0.6303−0.1500793.6615−0.5383−0.128173
183.19883.0906−0.1082−0.0338252.4823−0.7165−0.223993.34570.14690.04592353.70810.50930.159216
193.05693.83890.7820.25581473.48470.42780.13994573.89140.83450.2729894.25521.19830.3919984
203.87193.97990.1080.02789334.59220.72030.18603274.04090.1690.04364783.94450.07260.0187505
213.54292.5529−0.99−0.2794322.6148−0.9281−0.2619612.7855−0.7574−0.213783.0093−0.5336−0.150611
224.45543.5936−0.8618−0.1934283.2339−1.2215−0.2741623.1912−1.2642−0.2837463.9563−0.4991−0.112021
234.21553.1371−1.0784−0.2558183.383−0.8325−0.1974853.0732−1.1423−0.2709763.2859−0.9296−0.22052
242.5212.7880.2670.10591042.3158−0.2052−0.0813962.68540.16440.06521223.06820.54720.2170567
253.23623.76820.5320.16439033.360.12380.03825474.12120.8850.27346894.31221.0760.3324887
263.10593.65850.55260.17791944.04350.93760.30187713.49480.38890.12521333.78540.67950.2187772
272.98393.06170.07780.02607333.63050.64660.21669633.87780.89390.29957443.46730.48340.1620027
282.77854.04881.27030.45718914.10861.33010.47871153.66140.88290.31776144.09781.31930.4748245
293.39183.61530.22350.06589423.71990.32810.09673333.2349−0.1569−0.0462593.54320.15140.0446371
303.00462.8075−0.1971−0.0655992.6517−0.3529−0.1174532.581−0.4236−0.1409843.11220.10760.0358118

References

  1. Hong, S.; Zhou, Z.; Zio, E.; Wang, W. An adaptive method for health trend prediction of rotating bearings. Digit. Signal Process. 2014, 35, 117–123. [Google Scholar] [CrossRef]
  2. Jardine, A.K.S.; Lin, D.; Banjevic, D. A review on machinery diagnostics and prognostics implementing condition-based maintenance. Mech. Syst. Signal Process. 2006, 20, 1483–1510. [Google Scholar] [CrossRef]
  3. Ali, J.B.; Chebel-Morello, B.; Saidi, L.; Malinowski, S.; Fnaiech, F. Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network. Mech. Syst. Signal Process. 2015, 56–57, 150–172. [Google Scholar]
  4. García, F.P.; Pedregal, D.J.; Clive, R. Time series methods applied to failure prediction and detection. Reliab. Eng. Syst. Saf. 2010, 95, 698–703. [Google Scholar] [CrossRef]
  5. Kosasih, B.Y.; Caesarendra, W.; Tieu, K.; Widodo, A.; Moodie, C.A.S.; Tieu, A.K. Degradation trend estimation and prognosis of large low speed slewing bearing lifetime. Appl. Mech. Mater. 2014, 493, 343–348. [Google Scholar] [CrossRef]
  6. Badu, C.N.; Reddy, B.E. Prediction of selected Indian stock using a partitioning—Interpolation based ARIMA–GARCH model. Appl. Comput. Inf. 2015, 11, 130–143. [Google Scholar]
  7. Şeker, S.; Ayaz, E.; Türkcan, E. Elman’s recurrent neural network applications to condition monitoring in nuclear power plant and rotating machinery. Eng. Appl. Artif. Intel. 2003, 16, 647–656. [Google Scholar] [CrossRef]
  8. Malhi, A.; Gao, R.X. Recurrent neural networks for long-term prediction in machine condition monitoring. In Proceedings of the 21st IEEE Instrumentation and Measurement Technology Conference, Como, Italy, 18–20 May 2004; pp. 2048–2053.
  9. Payganeh, G.H.; Khajavi, M.N.; Ebrahimpour, R.; Babaei, E. Machine fault diagnosis using MLPs and RBF Neural Networks. Appl. Mech. Mater. 2011, 110, 5021–5028. [Google Scholar] [CrossRef]
  10. Dong, S.; Luo, T. Bearing degradation process prediction based on the PCA and optimized LS-SVM model. Measurement 2013, 46, 3143–3152. [Google Scholar] [CrossRef]
  11. Kim, H.-E.; Tan, A.C.C.; Mathew, J.; Choi, B.-K. Bearing fault prognosis based on health state probability estimation. Expert Syst. Appl. 2012, 39, 5200–5213. [Google Scholar] [CrossRef]
  12. Lall, P.; Lowe, R.; Goebel, K. Prognostics health management of electronic systems under mechanical shock and vibration using Kalman filter models and metrics. IEEE Trans. Ind. Electron. 2012, 59, 4301–4314. [Google Scholar] [CrossRef]
  13. Dai, F.; Liao, G.H. Chaotic time series adaptive prediction based on volterra series. Adv. Mater. Res. 2014, 945–949, 2495–2498. [Google Scholar] [CrossRef]
  14. Xia, X.T.; Lv, T.M. Dynamic Prediction of Rolling Bearing Friction Torque Using Lyapunov Exponent Method. Appl. Mech. Mater. 2010, 44–47, 1120–1124. [Google Scholar] [CrossRef]
  15. Selina, S.Y.N.; Cabrera, J.; Tse, P.W.T.; Chen, A.H.; Tsui, K.L. Distance-based analysis of dynamical systems reconstructed from vibrations for bearing diagnostics. Nonlinear Dyn. 2015, 80, 147–165. [Google Scholar]
  16. Li, M.; Li, J.-Y. On the predictability of long-range dependent series. Math. Probl. Eng. 2010, 2010, 397454. [Google Scholar] [CrossRef]
  17. Li, M.; Chi, C.-H. A correlation-based computational model for synthesizing long-range dependent data. J. Frankl. Inst. 2004, 340, 503–514. [Google Scholar] [CrossRef]
  18. Gyires, T. Software Agents Architecture for Controlling Long-Range Dependent Network Traffic. Math. Comput. Model. 2003, 38, 839–848. [Google Scholar] [CrossRef]
  19. Vivero, O.; Heath, W.P. A regularised estimator for long-range dependent processes. Automatica 2012, 48, 287–296. [Google Scholar] [CrossRef]
  20. Chen, Y.; Sun, R.; Zhou, A.; Zaveri, N. Fractional order signal processing of electrochemical noises. J. Vib. Control 2008, 14, 1443–1456. [Google Scholar] [CrossRef]
  21. Sheng, H.; Chen, Y.Q. FARIMA with stable innovations model of Great Salt Lake elevation time series. Signal Process. 2011, 91, 553–561. [Google Scholar] [CrossRef]
  22. Wolf, A.; Swift, J.B.; Swinney, H.L.; Vastano, J.A. Determining Lyapunov exponents form a time series. Phys. D 1985, 16, 285–317. [Google Scholar] [CrossRef]
  23. Song, W.Q.; Deng, S.; Yang, J.; Cheng, Q. Tool Wear Detection Based on Duffing-Holmes Oscillator. Math. Probl. Eng. 2008, 2008, 510406. [Google Scholar] [CrossRef]
  24. Takens, F. Detecting Strange Attractors in Turbulence. In Dynamical Systems and Turbulence; Springer: Berlin/Heidelberg, Germany, 1981; pp. 366–381. [Google Scholar]
  25. Kim, H.S.; Eykholt, R.; Salas, J.D. Nonlinear dynamics, delay times, and embedding windows. Phys. D Nonlinear Phenom. 1999, 127, 48–60. [Google Scholar] [CrossRef]
  26. Grassberger, P.; Procaccia, I. Dimensions and entropies of strange attractors from a fluctuating dynamics approach. Phys. D Nonlinear Phenom. 1984, 13, 34–54. [Google Scholar] [CrossRef]
  27. Grassberger, P.; Procaccia, I. Measuring the strangeness of strange attractors. Phys. D Nonlinear Phenom. 1983, 9, 189–208. [Google Scholar] [CrossRef]
  28. Hauer, B.D.; Maciejko, J.; Davis, J.P. Nonlinear power spectral densities for the harmonic oscillator. Ann. Phys. 2015, 361, 148–183. [Google Scholar] [CrossRef]
  29. Beran, J. Statistics for Long-Memory Processes, 1st ed.; Chapman & Hall: London, UK, 1994. [Google Scholar]
  30. Hosking, J.R.M. Fractional differencing. Biometrika 1981, 68, 165–176. [Google Scholar] [CrossRef]
  31. Kavasseri, R.G.; Seetharaman, K. Day-ahead wind speed forecasting using f-ARIMA models. Renew. Energy 2009, 34, 1388–1393. [Google Scholar] [CrossRef]
  32. Rizk, A.; Fidler, M. Non-asymptotic end-to-end performance bounds for networks with long range dependent fBm cross traffic. Comput. Netw. 2012, 56, 127–141. [Google Scholar] [CrossRef]
  33. Hurst, H.E. Long-term storage capacity of reservoirs. Trans. Am. Soc. Civil. Eng. 1951, 116, 770–808. [Google Scholar]
  34. Center for Intelligent Maintenance Systems. Available online: http://www.imscenter.net/ (accessed on 3 December 2015).
  35. Qiu, H.; Lee, J.; Lin, J.; Yu, G. Wavelet Filter-based Weak Signature Detection Method and its Applicationon Roller Bearing Prognostics. J. Sound Vib. 2006, 289, 1066–1090. [Google Scholar] [CrossRef]
  36. Liu, L.-H.; Ma, J.; Xu, X.-L. The Turbine Machine Fault Prediction Based on Kernel Principal Component Analysis. Adv. Mater. Res. 2011, 383, 4787–4791. [Google Scholar]
  37. Chen, W.Z.; Wang, B.W.; Hu, X.Y. Acceleration signal processing by numerical integration. J. Huazhong Univ. Sci. Technol. (Nat. Sci. Ed.) 2010, 38, 1–4. (In Chinese) [Google Scholar]

Share and Cite

MDPI and ACS Style

Li, Q.; Liang, S.Y.; Yang, J.; Li, B. Long Range Dependence Prognostics for Bearing Vibration Intensity Chaotic Time Series. Entropy 2016, 18, 23. https://doi.org/10.3390/e18010023

AMA Style

Li Q, Liang SY, Yang J, Li B. Long Range Dependence Prognostics for Bearing Vibration Intensity Chaotic Time Series. Entropy. 2016; 18(1):23. https://doi.org/10.3390/e18010023

Chicago/Turabian Style

Li, Qing, Steven Y. Liang, Jianguo Yang, and Beizhi Li. 2016. "Long Range Dependence Prognostics for Bearing Vibration Intensity Chaotic Time Series" Entropy 18, no. 1: 23. https://doi.org/10.3390/e18010023

APA Style

Li, Q., Liang, S. Y., Yang, J., & Li, B. (2016). Long Range Dependence Prognostics for Bearing Vibration Intensity Chaotic Time Series. Entropy, 18(1), 23. https://doi.org/10.3390/e18010023

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop