Next Article in Journal
Development of a Hybrid Method to Generate Gravito-Inertial Cues for Motion Platforms in Highly Immersive Environments
Next Article in Special Issue
Fault Detection of Planetary Gears Based on Signal Space Constellations
Previous Article in Journal
Synthetic Generation of Passive Infrared Motion Sensor Data Using a Game Engine
Previous Article in Special Issue
Improved Random Forest Algorithm Based on Decision Paths for Fault Diagnosis of Chemical Process with Incomplete Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Early Fault Diagnosis Method for Batch Process Based on Local Time Window Standardization and Trend Analysis

1
College of Chemistry and Chemical Engineering, Southwest Petroleum University, Chengdu 610500, China
2
School of Chemical Engineering, Sichuan University, Chengdu 610065, China
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(23), 8075; https://doi.org/10.3390/s21238075
Submission received: 7 November 2021 / Revised: 23 November 2021 / Accepted: 30 November 2021 / Published: 2 December 2021
(This article belongs to the Special Issue Cyberphysical Sensing Systems for Fault Detection and Identification)

Abstract

:
The products of a batch process have high economic value. Meanwhile, a batch process involves complex chemicals and equipment. The variability of its operation leads to a high failure rate. Therefore, early fault diagnosis of batch processes is of great significance. Usually, the available information of the sensor data in batch processing is obscured by its noise. The multistage variation of data results in poor diagnostic performance. This paper constructed a standardized method to enlarge fault information as well as a batch fault diagnosis method based on trend analysis. First, an adaptive standardization based on the time window was created; second, utilizing quadratic fitting, we extracted a data trend under the window; third, a new trend recognition method based on the Euclidean distance calculation principle was composed. The method was verified in penicillin fermentation. We constructed two test datasets: one based on an existing batch, and one based on an unknown batch. The average diagnostic rate of each group was 100% and 87.5%; the mean diagnosis time was the same; 0.2083 h. Compared with traditional fault diagnosis methods, this algorithm has better fault diagnosis ability and feature extraction ability.

1. Introduction

Batch processing is extensively utilized in modern production fields such as food, materials, chemicals, and pharmaceuticals [1]. The features between batch data make processes difficult to control, presenting multi-stage characteristics in the time dimension, and a strong correlation in the variable dimension [2]. Introducing fault diagnosis technology into the batch process can effectively guarantee personnel safety and reduce economic loss. Different batches of data differ at the same time due to subtle differences in their environment, human operations, and initial conditions. As a result, the diagnosis performance of traditional fault diagnosis methods decreases. At the same time, noise often covers weak fault information in the early stage of the fault, leading to delayed detection and misdiagnosis problems [3]. So, the research of early fault diagnosis technology in batch processes is crucial for the safe operation of the chemical plant.
Early fault diagnosis methods for batch processes are divided into mechanism-based, knowledge-based, and data-based methods [4,5,6]. It is hard to build diagnostic models based on physical and chemical mechanisms [7], so the research on fault diagnosis methods tends to be the latter two. Data-based fault diagnosis techniques used in batch processing are mainly multivariate statistical methods and deep learning methods [8,9]. The former mainly calculate statistics and thresholds to fault detection. Hoo, K. converted 3D batch data into 2D data for the first time, and then input it into the principal component analysis (PCA) process for batch process fault detection [10]. According to this data conversion method, the multi-way partial least square (MPLS) [11] and other common batch fault detection methods have been successfully developed. However, the traditional multivariate statistical early fault diagnosis method still has the problems of false positives and poor diagnosis timeliness [12]. Peipei Cai et al. [13] proposed the multi-block probability correlation kernel principal component analysis (KPCA) method to measure the change of probability distribution caused by a small offset, reducing the detection time. Yihao Qin et al. [14] combined sliding window technology with traditional statistical detection methods. They used the improved rank-one correction method to perform a recursive calculation of singular value decomposition, reducing the computational complexity and false positive rate. He et al. invented a multivariate statistical method based on the detrending and denoising techniques, increasing the difference between fault trends and reducing the influence of noise [15]. Deep learning belongs to a black-box model [16]. On the premise of the sufficient data, it has a good fault identification effect and feature extraction ability for highly nonlinear processes [17]. Therefore, multiple and multivariate statistical methods are combined to identify fault types; for example, the convolutional neural network (CNN) [18,19], dynamic Bayesian network (DBN) [20,21], long short term memory (LSTM) [22,23], etc.
The data-based fault diagnosis method can automatically mine the data relationship, having certain universality. However, it is difficult to process the data, as it requires intricate theoretical knowledge [24]. Qualitative trend analysis (QTA), a semi-quantitative method, can retain more information by combining qualitative knowledge mining with data relations [25]. In 1990, Cheung and Stephanopoulos defined the qualitative trend language [26,27]. In 1991, Janusz and Venkatasubramanian characterized different trends with the magnitude and sign of first- and second-order differentials [28]. In 1992, Konstantinov and Yoshida used a polynomial fitting method to reason about the temporal shapes of the process variables [29]. In 1994, Bakshi and Stephanopouslos used the decision tree method to match trends [30]. Thus, a complete QTA method with language definition, trend extraction, and trend matching is formed. The traditional QTA method will lose a large amount of useful information because there are only seven basic elements [31]. In addition, the helpful information of industrial data is concealed in the environmental noise. Meanwhile, different fault degrees have diverse noise distributions [32]. So, the original QTA has disadvantages in diagnosis. Early researchers used fuzzy theory to fuzzy match the trend of the knowledge base to reduce the influence of noise [33]. Later, they achieved more robust information base building and matching by bridging different data-driven methods [34,35]. Those methods sacrifice the training and computation time of the algorithm. QTA based on fuzzy theory has an ability to resist noise. However, it performs poor in multi-fault type recognition [33].
To expand the early fault information, improve the effect of trend analysis in batch fault diagnosis, and ensure the smooth operation of the process, the local adaptive standardization method based on time window and QTA with pattern recognition is proposed—called the LAS-QTA method. First, a new sliding window-based local adaptive standardization is constructed to solve the problem where normal conditions cannot be unified due to the differences between different normal batches. Second, the trend representation in the traditional QTA method is improved to obtain more trend information. Then, a new trend matching method based on Euclidean distance was created to avoid the error of trend matching caused by the difference of a few variables. Final, this study constructed a complete framework for early fault diagnosis based on local adaptive standardization (LAS) and trend analysis.
The rest of this paper is organized as follows: Section 2 mainly explains the relevant principles and describes the novel fault diagnosis method designed; Section 3 introduces the application and discussion of this method in a penicillin fermentation process; and Section 4 presents the conclusions and orientations for future research.

2. Methods and Improvements

2.1. Local Adaptive Standardization

Because of the difference in magnitude between variables, some intelligent methods need to standardize the data before being used. Since the traditional standardization method will reduce the separability of data after processing multi-modal data, Ma et al. [36] proposed the local neighborhood standardization (LNS) method to standardize. It calculates the mean and standard deviation in the local domain of data. However, when there is no similar data in the database, the use effect of subsequent algorithms becomes worse. In 2020, Wu et al. [37] proposed a new LNS method based on the time window, achieving good results in multi-batch problems. The formulas are as follows:
z i = x i mean ( w i ) gmstd ( X ) ,
gmstd ( X ) = n 1 ( s t d ( X 1 ) ) 2 + + n p ( s t d ( X p ) ) 2 n 1 + + n p ,
where x i is the sample to be normalized, z i is the sample after normalization, and n i ( i = 1 ~ p ) is the number of samples in mode   i   of the training data set. The mean ( w i ) denotes the mean vector of the sample in the local moving window, and s t d ( X i ) denotes the standard value of the samples in mode i .
In the actual process, normal data under a new schema or a new batch may not exist in the historical database. So, we modified Formulas (1) and (2) to obtain an adaptive local normalization method based on the time window in this paper. The standardized formula is as follows:
z i = x i mean ( w i ) s t d ( w i ) ,
where w i is the time series corresponding to the time window where x i is located. The smaller the length of the time window is, the more the accuracy of the standard deviation will reduce, and the more the impact of noise will amplify. As long as the subsequent fault diagnosis method can reduce the influence of noise, the normalization method can effectively retain useful information and achieve the goal of normalizing the distribution of the same type of data.

2.2. Qualitative Trend Analysis

The QTA methods roughly consists of two steps: trend extraction and trend analysis, and in further detail it consists of three parts: the language to represent trends, the method to extract trends and core information, and the classification method (trend matching) [28]. The first thing is to determine what is the extracted information based on the task. Then, the appropriate trend extraction method needs to be selected according to the data. Next, the method-based QTA needs to analyze the extracted trend data to determine the language representing the trend. Finally, the last step of the method is building the classification method, such as the most commonly QTA method. It extracts the positive and negative of the first and second derivatives of the fitted curve as the trend language through the least square fitting of the data. Then, QTA knowledge bases are built. Finally, it determines the category by comparing the knowledge base, as shown in Figure 1. This approach has difficulties in distinguishing trends that have nuances in angles and positions due to the characteristics of the batch process data, making it less effective in early batch fault diagnosis.
This paper proposed a new language of trend expression and a new trend matching method based on the original QTA idea to solve the problem. The basic principle is shown in Figure 2. The new method carried out the unitary quadratic fitting on the data in the time window, and used the index (a, b, c) in the function to represent the trend, which makes the extracted information larger. Meanwhile, we used the spatial distance to match the trends, reducing the nuances of the same model that have been amplified by the introduction of time windows. For example, in the schematic diagram, the distances between data 1 and historical data in the coordinates are less than the distances between the historical data. So, data 1 is considered to belong to the category of historical data. The data cluster formed by identification data 2 and historical data can be perfectly separated. So, it is not considered to belong to this category. The specific identification method of the distance can be set according to the concrete situation.
Under different normal conditions, the trend of a few variables may differ significantly. We combine the coefficient (a, b, c) of all variables to reduce false positives caused by this difference. Then, the original time window data is converted into the following vector: [ a 1 ,   b 1 ,   c 1 ,   a 2 ,   b 2 ,   c 2 ,   a 3 ,   b 3 ,   c 3 ,     a n ,   b n ,   c n ] . The space of the calculating distance is changed from three dimensions to 3n dimensions. Converting low-dimensional data into a high-dimensional space is easier to cluster and segment. This principle has been proven in the invention and subsequent use of KPCA. So, the fault detection (binary classification) and fault identification (multi-classification) tasks can be accomplished theoretically by combining appropriate pattern recognition way in the proposed method.

2.3. Fault Diagnosis Model

Combined with the theory of the method, a new fault diagnosis method with functions of offline preparation, online diagnosis, and self-learning is proposed, called LAS-QTA. The diagnosis flow chart is shown in Figure 3.

2.3.1. Offline Stage

Step 1: Use Formula (3) to standardize the historical normal data XN.
Step 2: Calculate historical fault deviation data BF by using the historical normal data and historical fault data. The form of historical fault data XF is as follows to ensure that the data in the first window has only one failure data point:
X F = [ x F , t s t a r t , x F , t s t a r t + 1 , , x F , t e n d ] ,
t s t a r t = t i n t r o w t i m e + 1 ,
where t i n t r o is the time of introduction of the fault; w t i m e is the width of the time window; t e n d is the time of fault sampling point. Then, the calculation formula of the historical fault deviation matrix B F is as follows:
B F = X F [ x N , t s t a r t , x N , t s t a r t + 1 , , x N , t e n d ] ,
where x N is the normal sample closest to X F .
Step 3: Use Formula (3) to standardize the historical fault deviation data B F .
Step 4: Optimal fitting of unary quadratic equation is carried out for each data sample under each time window. The principles are as follows:
f k ( x ) = a k x 2 + b k x + c k ,
ε k = i = 1 m [ f ( x i ) y i ] 2 ,
f ( x ) = a x 2 + b x + c ,   = argmin ε k ,
where f ( x ) is the optimal quadratic equation of one variable; f k ( x ) is the k -th quadratic equation of one variable; ε k is the square error corresponding to the kth fitting quadratic equation of one variable; a , b , c are the fitting coefficients of quadratic equations of one variable.
Step 5: Establish the QTA knowledge base for subsequent online diagnosis, and its data structure is as follows:
KNL = [ Knl w 1 , Knl w 2 , , Knl w s ] ,
where Knl w i represents the knowledge base corresponding to the i -th time window, s denotes the number of time windows. Its data form is as follows:
Knl w i = [ T r d w , 1 , T r d w , 2 , ] ,
T r d = [ a , 1 , b , 1 , c , 1 , a , 2 , b , 2 , c , 2 , a , 3 , b , 3 , c , 3 , , a , n , b , n , c , n ] ,
where n is the number of features. The T r d is called the trend information vector. The   a , i , b , i , c , i are the coefficients of the i -th variable of the unitary quadratic equation obtained by Equations (7)–(9) for optimal fitting.
Step 6: Calculate the threshold of the normal QTA knowledge base, the principle is as follows:
δ w = max d w , i , j ,
d w , i , j = T r d w , i · T r d w , j ,
where the i -th normal sample in window w dot the j -th’s. The result is d w , i , j . The max value of the d w , i , j is considered as the threshold of the normal in window w . That is to say that the threshold of the normal QTA knowledge base is a vector.

2.3.2. Online Diagnosis Stage

Step 1: Extract online data, which is in the form of a time window data:
X o = [ x t w t i m e + 1 , x t w t i m e + 2 , , x t ] ,
where X o is the online data; w t i m e is width of time window; x t is the data of t time; x t w t i m e + 2 is the data of t-wtime+2 time. So X o is a matrix composed of data from w t i m e sampling points.
Step 2: Use Formula (3) to standardize the online data. Fit the data to get T r d o , d e .
Step 3: Calculate the Euclidean distance with the historical normal QTA library of the corresponding time window:
d o , d e = min ( T r d o , d e · T r d N , w t , k ) , T r d N , w t , k ϵ Knl N , w t ,
where T r d o , d e is the trend information vector of X o . T r d N , w t , k is the kth trend information vector in w t window of the normal knowledge base.
Compare with δ , if d o , d e δ , then the data is considered as normal and stored in the corresponding historical database. Otherwise, the data is considered as being faulty, and we proceed with the following steps.
Step 4: To obtain online fault deviation data, the calculation method is as follows:
B o , F = X o X N ,
X N = X N , k ,   k = argmin ( T r d o , d e · T r d n , w t , k ) ,
where B o , F is the online fault deviation data; X N is the normal data matrix in the history library closest to the online data. The assessment criteria are the Euclidean distance.
Step 5: Use Formula (3) to preprocess B o , F ; use Formulas (7)–(9) to obtain the recognition trend T r d o , r e .
Step 6: Calculate the Euclidean distance with the different historical fault QTA library in the corresponding time windows d o , r e , j :
d o , r e , j = min ( T r d o , r e · T r d F j , w t , k ) , T r d F j , w t , k ϵ Knl F j , w t ,
where T r d o , r e is the trend information vector of B o , F . T r d F j , w t , k is the kth trend information vector in w t window of fault j knowledge base.
Step 7: Judge the fault type according to the following formula:
j = a r g m i n ( d o , r e , j ) .
Step 8: Report the result.

2.3.3. Self-Study Stage

If d o , d e δ , store the data in a historical database in Step 3 of the online diagnosis; feedback fault type results to the operator for verification and correction, and save the data to the corresponding fault database after correction before processing Step 8. If the result of the manual check is the new fault, expand the history library on top of the original one and run the offline part again.

3. Application to the Fed-Batch Fermentation of Penicillin Process

3.1. Process Description

Penicillin fermentation is the most important process in the production of penicillin, and its technological process is shown in Figure 4.
The main reaction of the process takes place in a fermenter with a stirrer. Two PID controllers—pH and temperature—ensure the stability and efficiency of the reaction. Fully ferment through the sufficient mixed contact of air and fermentation at a set pH and temperature value. The whole fermentation process divides into three stages: thallus growth stage, penicillin synthesis stage, and thallus autolysis stage. The data of the penicillin synthesis stage are highly nonlinear, which is the stage most prone to fault. The used data in this paper came from PenSim V2.0 software. PenSim2.0 is the software developed by the Cinar research group to simulate the penicillin fermentation process [38]. It is the main simulation software for batch processing due to its close degree of data to the real situation and simple operation. The software can simulate the following fault types: aeration rate step increasing, aeration rate step decreasing, agitator power step increasing, agitator power step decreasing, substrate feed rate step increasing, and substrate feed rate step decreasing. There are 17 variables in the model. We select the following variables as diagnostic objects: the flow of air, dissolved oxygen concentration, real volume of fermentation liquid, carbon dioxide concentration, pH value, and cold water flow, which are denoted by A, B, C, D, E, and F, respectively.
In this paper, the simulation time of each batch is 400 h and the sampling interval is 0.1 h. The initial set values of the normal batches used are shown in the Table 1. Batches 1 to 3 are used for offline preparation. The diagnostic variables trend of normal batch 1 is shown in Figure 5. The historical fault samples are mainly the fault data with 50% amplitude deviation ending at 400 h when normal batch 2 runs under set conditions for 70 h.
The test set of this paper has 24 groups of fault batches. They were obtained by running the software based on the settings of Batches 1 and 4. Each type of fault has four groups of samples with different amplitude. The specific situation is shown in Table 2 and Table 3.

3.2. Results and Discussion

The LAS-QTA fault diagnosis program was completed according to the steps of Section 2.3. The used data was generated from PenSim based on Table 1, Table 2 and Table 3. The diagnosis results are shown in Table 3. The table shows that when the corresponding normal condition is batch 4, samples 11, 12, and 17 were identified as other categories. It indicates that the method has the following disadvantages in fault identification: If there is no corresponding normal sample in the history database, the fault identification effect will be reduced. However, the proposed method has the same fault detection performance in two data sets.
The detection time distribution of different fault type samples is not equal in Table 4. Analysis of the reasons shows that faults 2, 3, 5, and 6 do not directly affect the collected sensor data, but rather indirectly. Additionally, the variable change caused by the fault is much smaller than other faults and there is a time lag problem. Therefore, the detection time of batches of fault types 1 and 4 is much shorter than that of other types of fault data. In conclusion, the established QTA method has certain adaptability and stronger fault diagnosis ability.
There may be a time dislocation between the detection time and the optimal diagnosis time. Therefore, this paper judged the fault type of the data in 10 time windows after the corresponding time when the fault was detected. We use the fault identification accuracy rate (FDA) as the evaluation index. Its calculation formula is as follows:
FDA = The   number   of   data   identify   correctly   Total   count   of   test   data .
The relationship between the average diagnostic rate of different samples in 10 time windows under different normal conditions is shown in Figure 6. The relationship between the average diagnosis rate under different normal conditions in each time window is shown in Figure 7.
Figure 6 shows that the robustness of this method is poor in the case that there is no corresponding normal batch in the historical QTA database. This indicates that the fault identification ability based on the proposed method is insufficient and needs to be improved in the future.
Figure 7 illustrates that the effectiveness of the method for fault identification changes over time. At the same time, when there is no corresponding normal sample in the history database, the diagnostic robustness in time is lower. There are two main reasons why the diagnosis rate of Batch 1 starts to decrease at 8-time points: first, the range of fault samples in the fault history database is 50%, and the diversity is low. Second, there is the problem that the trend difference degree of the error matrix of different faults will weaken over time. The randomness of the Batch 4 diagnosis rate curve is mainly related to the following reasons: the time of fault detection is the first time that the system considers that there is an unacceptable deviation from the normal situation. If this time lag exists in nature, then the fault deviation matrix of subsequent time does not match the corresponding deviation matrix. That is, the data difference between the formed fault deviation matrix and the real deviation matrix will change irregularly with the backward moving of the window.
Combining the two figures, it can be found that when there is a corresponding normal batch in the history database, the fault identification ability will change because of the proportion of the fault data in the time window. However, the average diagnosis rate of 10 windows corresponding to the samples of faults 1 and 4 was lower than 1, and the four samples of fault 1 were diagnosed as fault 2 in the last window. The reason may be that as time goes on, the process variables become more and more affected by the failure, leading to the gradual narrowing of differences between failure types.
In order to compare the differences with other methods, the multiway dynamic kernel principal component analysis (MDKPCA) method commonly used for online inspection of the batch process is constructed in this paper to train and test the same data. The fault detection time (FDT) and false alarm rate (FPR) are calculated according the follow formulas:
FDT = T i d e T i n t r o ,
FPR = F N T P ,
where Tide is the time that the fault has been detected; Tintro is the time of fault introduction; FN is the number of normal data that has been detected as fault; TP is the number of normal data.
The FDT and FPR results between LAS-QTA and MDKPCA are shown in Table 5. FDT of MDKPCA is higher than LAS-QTA’s according to the table. The reason is that MDKPCA cannot amplify local information based on its calculation method. It calculates the statistical parameters for the entire normal batch, and standardizes the same, which masks the minor changes of the early fault introduction. The higher false positive rate of MDKPCA may be due to the fact that the threshold of the algorithm itself is a unique value. In conclusion, this method has a better comprehensive effect in early fault detection than MDKPCA.

4. Conclusions

Early fault diagnosis technologies of batch processes ensure smooth operation of the chemical plant, reducing unnecessary losses. However, the data-based fault diagnosis method makes it difficult to mine the data information with a high mechanism, which can easily deviate from reality. Meanwhile, the traditional semi-quantitative method—the trend analysis method—has some problems, such as difficulties in expressing different trends and being easily affected by noise. Therefore, we proposed a new trend analysis method, based on time window adaptive standardization and Euclidean distance to extract incipient fault signal and improve the fault diagnosis result of batch processing. Adaptive normalization based on the time window enables time segments with the same trend but different values to be transformed into the same category. The data difference under the time window is enlarged. The new trend analysis also includes the function coefficients fitted by the least square method as trend information, reducing the effect of noise. In addition, the study used the different distances between classes in space to find an appropriate trend matching method referring to the basic principle of pattern recognition. Additionally, we constructed matching criteria and method. Finally, penicillin fermentation proved to be valid. To study the scalability and robustness of the method, we set the two groups of test data for fault diagnosis analysis according to whether there was corresponding normal batch data in the history database. The results show that the method is scalable. The average fault diagnosis rate is 100% and 87%, respectively. Compared with the traditional batch early fault diagnosis method MDKPCA, the fault detection time is shortened by 46 sampling points, and the false positive rate is lower than MDKPCA.
Compared with the traditional QTA method, this method can carry out online diagnosis, but compared with other data-driven methods, there is still a certain distance in fault identification. The results show that when the historical database does not contain the corresponding historical data, the robustness of the system is poor. In addition, the characteristics of batch data also include the unequal length of time between batches, which also affects the self-learning and scalability of the method, which will be the author’s next research direction. At the same time, different clustering methods for fault identification will improve the overall fault diagnosis effect. Selecting the appropriate method that combines well with LAS-QTA is another direction of future research.

Author Contributions

Conceptualization, Y.Y.; methodology, Y.Y.; software, Y.Y.; validation, Y.Y., W.L. and Y.D.; investigation, Y.Y.; writing—original draft preparation, Y.Y.; writing—review and editing, W.L. and Y.D.; visualization, Y.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (21706220) and Sichuan Province Science and Technology Support Program (2021YFS0301).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The study did not report any data.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Nomikos, P.; Macgregor, J.F. Monitoring batch processes using multiway principal component analysis. AIChE J. 1994, 40, 1361–1375. [Google Scholar] [CrossRef]
  2. Md Nor, N.; Che Hassan, C.R.; Hussain, M.A. A review of data-driven fault detection and diagnosis methods: Applications in chemical process systems. Rev. Chem. Eng. 2020, 36, 513–553. [Google Scholar] [CrossRef]
  3. Shang, J.; Chen, M.; Ji, H.; Zhou, D. Recursive transformed component statistical analysis for incipient fault detection. Automatica 2017, 80, 313–327. [Google Scholar] [CrossRef]
  4. Venkatasubramanian, V.; Rengaswamy, R.; Yin, K.; Kavuri, S.N. A review of process fault detection and diagnosis: Part I: Quantitative model-based methods. Comput. Chem. Eng. 2003, 27, 293–311. [Google Scholar] [CrossRef]
  5. Venkatasubramanian, V.; Rengaswamy, R.; Kavuri, S.N. A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies. Comput. Chem. Eng. 2003, 27, 313–326. [Google Scholar] [CrossRef]
  6. Venkatasubramanian, V.; Rengaswamy, R.; Kavuri, S.N.; Yin, K. A review of process fault detection and diagnosis: Part III: Process history based methods. Comput. Chem. Eng. 2003, 27, 327–346. [Google Scholar] [CrossRef]
  7. Venkatasubramanian, V. The promise of artificial intelligence in chemical engineering: Is it here, finally? AIChE J. 2019, 65, 466–478. [Google Scholar] [CrossRef]
  8. Alauddin, M.; Khan, F.; Imtiaz, S.; Ahmed, S. A Bibliometric Review and Analysis of Data-Driven Fault Detection and Diagnosis Methods for Process Systems. Ind. Eng. Chem. Res. 2018, 57, 10719–10735. [Google Scholar] [CrossRef]
  9. Yang, M.; Wang, J.; Zhang, Y.; Bai, X.; Xu, Z.; Xia, X.; Fan, L. Fault Detection and Diagnosis for Plasticizing Process of Single-Base Gun Propellant Using Mutual Information Weighted MPCA under Limited Batch Samples Modelling. Machines 2021, 9, 166. [Google Scholar] [CrossRef]
  10. Hoo, K.; Piovoso, M.; Dahl, K.S.; MacGregor, J.F.; Nomikos, P. MultiWay PCA Applied to an Industrial Batch Process. In Proceedings of the 1994 American Control Conference-ACC’94, Baltimore, MD, USA, 29 June–1 July 1994; Volume 94, pp. 1294–1298. [Google Scholar]
  11. Nomikos, P.; MacGregor, J. Multi-Way Partial Least Squares in Monitoring Batch Processes. Chemom. Intell. Lab. Syst. 1995, 30, 97–108. [Google Scholar] [CrossRef]
  12. Zhang, J.; Luo, W.; Dai, Y. Integrated Diagnostic Framework for Process and Sensor Faults in Chemical Industry. Sensors 2021, 21, 822. [Google Scholar] [CrossRef] [PubMed]
  13. Cai, P.; Deng, X. Incipient fault detection for nonlinear processes based on dynamic multi-block probability related kernel principal component analysis. ISA Trans. 2020, 105, 210–220. [Google Scholar] [CrossRef] [PubMed]
  14. Qin, Y.; Yan, Y.; Ji, H.; Wang, Y. Recursive Correlative Statistical Analysis Method with Sliding Windows for Incipient Fault Detection. IEEE Trans. Ind. Electron. 2021, 1. [Google Scholar] [CrossRef]
  15. He, Z.; Shardt, Y.; Wang, D.; Hou, B.; Zhou, H.; Wang, J. An incipient fault detection approach via detrending and denoising. Control Eng. Pract. 2018, 74, 1–12. [Google Scholar] [CrossRef]
  16. Jiang, P.; Hu, Z.; Liu, J.; Yu, S.; Wu, F. Fault Diagnosis Based on Chemical Sensor Data with an Active Deep Neural Network. Sensors 2016, 16, 1695. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Li, S.; Liu, G.; Tang, X.; Lu, J.; Hu, J. An Ensemble Deep Convolutional Neural Network Model with Improved D-S Evidence Fusion for Bearing Fault Diagnosis. Sensors 2017, 17, 1729. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Wu, H.; Zhao, J.S. Deep convolutional neural network model based chemical process fault diagnosis. Comput. Chem. Eng. 2018, 115, 185–197. [Google Scholar] [CrossRef]
  19. Gong, W.; Chen, H.; Zhang, Z.; Zhang, M.; Wang, R.; Guan, C.; Wang, Q. A Novel Deep Learning Method for Intelligent Fault Diagnosis of Rotating Machinery Based on Improved CNN-SVM and Multichannel Data Fusion. Sensors 2019, 19, 1693. [Google Scholar] [CrossRef] [Green Version]
  20. Wang, Y.; Jiang, Q. Data-Driven Nonlinear Chemical Process Fault Diagnosis Based on Hierarchical Representation Learning. Can. J. Chem. Eng. 2020, 98, 2150–2165. [Google Scholar] [CrossRef]
  21. Zhang, T.F.; Li, Z.; Deng, Z.H.; Hu, B. Hybrid Data Fusion DBN for Intelligent Fault Diagnosis of Vehicle Reducers. Sensors 2019, 19, 2504. [Google Scholar] [CrossRef] [Green Version]
  22. Park, P.; Marco, P.D.; Shin, H.; Bang, J. Fault Detection and Diagnosis Using Combined Autoencoder and Long Short-Term Memory Network. Sensors 2019, 19, 4612. [Google Scholar] [CrossRef] [Green Version]
  23. Mallak, A.; Fathi, M. Sensor and Component Fault Detection and Diagnosis for Hydraulic Machinery Integrating LSTM Autoencoder Detector and Diagnostic Classifiers. Sensors 2021, 21, 433. [Google Scholar] [CrossRef]
  24. Jimenez, D.G.; Larraaga, J.; Poza, J.; Garramiola, F.; Madina, P. Data-Driven Fault Diagnosis for Electric Drives: A Review. Sensors 2021, 21, 4024. [Google Scholar] [CrossRef]
  25. Zhou, B.; Ye, H.; Zhang, H.; Li, M. A new qualitative trend analysis algorithm based on global polynomial fit. AIChE J. 2017, 63, 3374–3383. [Google Scholar] [CrossRef]
  26. Cheung, T.Y.; Stephanopoulos, G. Representation of Process Trends—Part I. A Formal Representation Framework. Comput. Chem. Eng. 1990, 14, 495–510. [Google Scholar] [CrossRef]
  27. Cheung, T.Y.; Stephanopoulos, G. Representation of Process Trends—Part II. The Problem of Scale and Qualitative Scaling. Comput. Chem. Eng. 1990, 14, 511–539. [Google Scholar] [CrossRef]
  28. Janusz, M.E.; Venkatasubramanian, V. Automatic generation of qualitative descriptions of process trends for fault detection and diagnosis. Eng. Appl. Artif. Intell. 1991, 4, 329–339. [Google Scholar] [CrossRef]
  29. Konstantinov, K.B.; Yoshida, T. Real-time qualitative analysis of the temporal shapes of (bio) process variables. AIChE J. 1992, 38, 1703–1715. [Google Scholar] [CrossRef]
  30. Bakshi, B.R.; Stephanopoulos, G. Representation of process trends—III. Multiscale extraction of trends from process data. Comput. Chem. Eng. 1994, 18, 267–302. [Google Scholar] [CrossRef]
  31. Guo, Q.; Li, S.; Gong, Y.; Wang, F.; Yu, G. Application of qualitative trend analysis in fault diagnosis of entrained-flow coal-water slurry gasifier. Control Eng. Pract. 2021, 112, 104835. [Google Scholar] [CrossRef]
  32. Zhou, X.; Mao, S.; Li, M. A Novel Anti-Noise Fault Diagnosis Approach for Rolling Bearings Based on Convolutional Neural Network Fusing Frequency Domain Feature Matching Algorithm. Sensors 2021, 21, 5532. [Google Scholar] [CrossRef] [PubMed]
  33. Dash, S.; Rengaswamy, R.; Venkatasubramanian, V. Fuzzy-logic based trend classification for fault diagnosis of chemical processes. Comput. Chem. Eng. 2003, 27, 347–362. [Google Scholar] [CrossRef]
  34. Bonet-Solà, D.; Alsina-Pagès, R. A Comparative Survey of Feature Extraction and Machine Learning Methods in Diverse Acoustic Environments. Sensors 2021, 21, 1274. [Google Scholar] [CrossRef]
  35. da Silva, P.R.N.; Gabbar, H.A.; Junior, P.V.; da Costa Junior, C.T. A new methodology for multiple incipient fault diagnosis in transmission lines using QTA and Nave Bayes classifier. Int. J. Electr. Power Energy Syst. 2018, 103, 326–346. [Google Scholar] [CrossRef]
  36. Ma, H.; Hu, Y.; Shi, H. A novel local neighborhood standardization strategy and its application in fault detection of multimode processe. Chemom. Intell. Lab. Syst. 2012, 118, 287–300. [Google Scholar] [CrossRef]
  37. Wu, H.; Zhao, J. Self-adaptive deep learning for multimode process monitoring. Comput. Chem. Eng. 2020, 141, 107024. [Google Scholar] [CrossRef]
  38. Birol, G.; Ündey, C.; Inar, A. A modular simulation package for fed-batch fermentation: Penicillin production. Comput. Chem. Eng. 2002, 26, 1553–1565. [Google Scholar] [CrossRef]
Figure 1. QTA knowledge base based on derivative. A~G are seven different primitives derived from the relationship between the derivatives and zero.
Figure 1. QTA knowledge base based on derivative. A~G are seven different primitives derived from the relationship between the derivatives and zero.
Sensors 21 08075 g001
Figure 2. The basic principle of the proposed method.
Figure 2. The basic principle of the proposed method.
Sensors 21 08075 g002
Figure 3. The fault diagnosis framework based on QTA and LAS.
Figure 3. The fault diagnosis framework based on QTA and LAS.
Sensors 21 08075 g003
Figure 4. The process of penicillin fermentation.
Figure 4. The process of penicillin fermentation.
Sensors 21 08075 g004
Figure 5. The diagnostic variables trend of a normal sample obtained by running PenSim based on the settings of batch 1. A: the flow of air; B: dissolved oxygen concentration; C: real volume of fermentation liquid; D: carbon dioxide concentration; E: pH value; F: cold water flow.
Figure 5. The diagnostic variables trend of a normal sample obtained by running PenSim based on the settings of batch 1. A: the flow of air; B: dissolved oxygen concentration; C: real volume of fermentation liquid; D: carbon dioxide concentration; E: pH value; F: cold water flow.
Sensors 21 08075 g005
Figure 6. The relationship of the average diagnostic rate in 10 time windows under different normal conditions.
Figure 6. The relationship of the average diagnostic rate in 10 time windows under different normal conditions.
Sensors 21 08075 g006
Figure 7. The relationship between the average diagnosis rate under different normal conditions in each time window.
Figure 7. The relationship between the average diagnosis rate under different normal conditions in each time window.
Sensors 21 08075 g007
Table 1. The initial set values of the normal batches.
Table 1. The initial set values of the normal batches.
Variable NameUnitSet Value
Batch 1Batch 2Batch 3Batch 4
substrate conc.g∙L−115141614
dissolved oxygen% saturation1.161.001.201.02
carbon conc. mol∙L−10.00050.00050.00060.00052
culture volumeL100100100100
temperatureK298298298298
penicillin conc.g∙L−10000
pH -5.04.85.14.8
biomass conc.g∙L−10.10.10.10.1
Table 2. The details of test samples 1~12.
Table 2. The details of test samples 1~12.
Variable NameUnitSet Value
S1S2S3S4S5S6S7S8S9S10S11S12
fault type aeration rate step increasingagitator power step increasingsubstrate feed rate step increasing
magnitude%103060801530557015305060
occurrence momenth80901001101119015065809070105
Table 3. The details of test samples 13~24.
Table 3. The details of test samples 13~24.
Variable NameUnitSet Value
S13S14S15S16S17S18S19S20S21S22S23S24
fault type aeration rate step decreasingagitator power step decreasingsubstrate feed rate step decreasing
magnitude%253045651530507015324575
occurrence momenth689013010090788070100180150111
Table 4. The fault diagnosis result of LAS-QTA method.
Table 4. The fault diagnosis result of LAS-QTA method.
Sample No.Occurrence Moment (h)Detect Moment (h)ResultActual Fault Type
Batch 1Batch 4Batch 1Batch 4
1808080111
290909011
310010010011
411011011011
5111111.1111.1222
69090.590.522
7150150.3150.322
86565.565.522
98080.480.4333
109090.590.533
117070.870.835
12105105.1105.135
13686868444
149090.190.144
1513013013044
1610010010044
179090.790.7535
187878.178.155
198080.180.155
207070.270.255
21100100.2100.2666
22180180.1180.166
23150150.2150.266
24111111.1111.166
Table 5. The compared result between LAS-QTA and MDKPCA.
Table 5. The compared result between LAS-QTA and MDKPCA.
Sample No.FDT (h)FPR
LAS-QTAMDKPCALAS-QTAMDKPCA
10.06.90.00000.1708
20.05.20.00000.2011
30.00.90.00000.2051
40.02.00.00000.2312
50.11.00.00000.2218
60.55.20.00000.1932
70.33.10.00000.2308
80.514.50.00000.2281
90.41.00.00000.2139
100.55.20.00000.2281
110.816.90.00000.2869
120.13.60.00000.3182
130.011.40.00000.2045
140.15.20.00000.1876
150.02.20.00000.2248
160.00.90.00000.2010
170.75.20.00000.2079
180.11.50.00000.1883
190.16.90.00000.1848
200.29.40.00000.2000
210.20.20.00000.1485
220.13.20.00000.2106
230.23.10.00000.1953
240.11.50.00000.1518
mean0.20834.80420.00000.2098
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yao, Y.; Dai, Y.; Luo, W. Early Fault Diagnosis Method for Batch Process Based on Local Time Window Standardization and Trend Analysis. Sensors 2021, 21, 8075. https://doi.org/10.3390/s21238075

AMA Style

Yao Y, Dai Y, Luo W. Early Fault Diagnosis Method for Batch Process Based on Local Time Window Standardization and Trend Analysis. Sensors. 2021; 21(23):8075. https://doi.org/10.3390/s21238075

Chicago/Turabian Style

Yao, Yuman, Yiyang Dai, and Wenjia Luo. 2021. "Early Fault Diagnosis Method for Batch Process Based on Local Time Window Standardization and Trend Analysis" Sensors 21, no. 23: 8075. https://doi.org/10.3390/s21238075

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop