Next Article in Journal
Three-Dimensional ResNeXt Network Using Feature Fusion and Label Smoothing for Hyperspectral Image Classification
Next Article in Special Issue
Testing Sensitivity of A-Type Residual Current Devices to Earth Fault Currents with Harmonics
Previous Article in Journal
Low Dose CT Image Reconstruction Based on Structure Tensor Total Variation Using Accelerated Fast Iterative Shrinkage Thresholding Algorithm
Previous Article in Special Issue
Probability-Based Algorithm for Bearing Diagnosis with Untrained Spall Sizes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Consistency Index-Based Sensor Fault Detection System for Nuclear Power Plant Emergency Situations Using an LSTM Network

Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulju-gun, Ulsan 44919, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(6), 1651; https://doi.org/10.3390/s20061651
Submission received: 21 February 2020 / Revised: 12 March 2020 / Accepted: 14 March 2020 / Published: 16 March 2020
(This article belongs to the Special Issue Sensors for Fault Diagnosis)

Abstract

:
A nuclear power plant (NPP) consists of an enormous number of components with complex interconnections. Various techniques to detect sensor errors have been developed to monitor the state of the sensors during normal NPP operation, but not for emergency situations. In an emergency situation with a reactor trip, all the plant parameters undergo drastic changes following the sudden decrease in core reactivity. In this paper, a machine learning model adopting a consistency index is suggested for sensor error detection during NPP emergency situations. The proposed consistency index refers to the soundness of the sensors based on their measurement accuracy. The application of consistency index labeling makes it possible to detect sensor error immediately and specify the particular sensor where the error occurred. From a compact nuclear simulator, selected plant parameters were extracted during typical emergency situations, and artificial sensor errors were injected into the raw data. The trained system successfully generated output that gave both sensor error states and error-free states.

1. Introduction

The state awareness of complex systems such as aircraft systems, oil and gas facilities, and nuclear power plants (NPPs) comes from a myriad of sensors installed at desired locations. The sensors receive external stimuli from connected components and transport the signals to system users or other related systems. In an NPP, over 10,000 sensors and detectors are equipped to monitor the condition of all components [1]. To maintain the safety and stability of an NPP operation, instrumentation and control systems are employed that collect plant parameters from the sensors and process the data. These processed data are then presented to the operators in the main control room via measurement values or alarms. The operators monitor the plant state and cope with any abnormal situation depending on the given information [2]. In this flow of information, faults in the sensors can lead to operator misunderstanding, which could result in critical human error.
The Three Mile Island (TMI-2) accident, a severe accident that caused a partial meltdown of an NPP reactor core, is an example of how sensor error can contribute to exacerbating accident consequences. The TMI-2 accident started from a mechanical malfunction in feedwater pumps; during the accident sequence, one indicator showed the wrong information to the field operator, which led to a critical human error that worsened the accident [3]. Such a consequential example makes it clear that errors in sensors or indicators can have significant effects on accident situations.
In the nuclear field, online monitoring (OLM) techniques have been developed to be the representative faulty sensor detection method. However, these techniques are inappropriate to cover NPP emergency situations that include complex and nonlinear changes of plant parameters because they have been developed to extend the calibration period in steady operations only [4,5,6]. To overcome this limitation of existing methods, this paper proposes a novel consistency index and applies it to a machine learning model. The consistency index is a measure to quantify deviations of sensor values from the real values. The machine learning model is first trained with error and error-free data with consistency index labels. Then, the trained model produces a consistency output by taking typical emergency situation data as input, and then classifies the state of the sensors by the established logic. The suggested sensor fault detection system enables the monitoring of all parameters included as inputs of the system. It is believed that this system could prevent certain types of critical human error such as resulting from sensor error, and could also contribute to a practical background for data-driven methods or operator support systems based on plant parameters in NPPs [7].

2. Related Research and Research Purpose

2.1. Sensor Fault Detection and Identification

Sensor failure events can occur in diverse ways because there are various types of sensor networks [8]. Sensor fault detection is classified by the existence of redundant sensors that measure the same process parameters over a similar operating range. For physically redundant sensors, hardware redundancy approaches are applied such that sensor errors can be detected from simple mathematical models, for example, averaging. If physically redundant sensors are not installed, analytical redundancy approaches are applied that estimate sensor error from the relation between a range of different target sensors. These approaches can be classified into model-based [9,10], knowledge-based [11,12,13], and data-driven methods [14,15,16,17] depending on the understanding of the depth of the system and the available amount of data. Jiang et al. (2011) demonstrated this classification of general sensor fault detection [18]. In recent industrial research, fault detection and monitoring methods for industrial cyber-physical systems have been suggested using novel principle component regression methods and other data-driven approaches [19,20]. Additionally, statistical pattern recognition methods have been applied to the monitoring and fault detection of industrial bearings [21,22].

2.2. Online Monitoring (OLM) Techniques and the Proposed Model

In 1995, a US Nuclear Regulatory Commission (NRC) report concluded that OLM techniques are able to monitor field sensors and signals [23]. These techniques are designed to monitor the performance of instrument channels so as to extend the calibration intervals required by technical specifications. Instrument conditions are tracked by OLM via the application of hardware redundancy approaches and data-driven methods. Applications of the developed OLM techniques include the auto-associative neural network [24], nonlinear partial least squares [25], the multivariate state estimation technique [26], and auto-associative kernel regression [27]. In more recent research, principle component analysis, deep belief networks [28], and singular vector decomposition [29] have been adopted for OLM. Previous data-driven methods only considered the steady-state condition with small uncertainty in the calibration of target sensors [4,5,6]. Their general process was to reconstruct sensor signals and perform a residual analysis in which the estimated signals were compared to measured parameters [30].
Methods that reconstruct sensor signals and calculate the residuals from the measurements have advantages in both error detection and sensor value estimation under normal operating conditions; however, these methods are not suitable for emergency situations in nuclear plants because a reactor trip and subsequent actuation of safety systems result in highly unstable plant parameters. In this context, this research aims to construct a framework for detecting faulty sensors during NPP emergency situations. Using a deep neural network with a consistency index, the model monitors for sensor error during rapid changes of all plant parameters following a reactor trip by considering multivariate inputs, or in other words, a large number of sensor conditions. The model is trained with numerous time series data, namely the uncertain and complex variables of the early reactor trip phase. The sensor error detection model, in this work, aims to monitor the soundness of target sensors as expressed by a consistency index of the sensors. While the system does not estimate plant parameters, it directly displays the current state of the sensors during NPP emergency situations. The output mainly focuses on whether or not the measured sensor values deviate from the real values.

3. Operator Actions in Emergency Situations

To ensure NPP safety, reactor trips are initiated in response to the detection of plant parameters deviating outside of predetermined set points. Control rods are immediately inserted into the reactor, leading to a rapid decrease of reactivity. This is connected to a decrease in reactor thermal power and rapid changes in all plant components [31], for example, turbine trips, valve openings and closings, and the actuation of safety systems, among many others. The irregular situations that cause reactor trips are called emergency situations in the nuclear field. After the indication of a reactor trip, operators in the main control room perform emergency operating procedures to mitigate the accident consequences that caused the plant parameters to exceed the reactor protection system set points or engineered safety feature set points, or other established limits [32]. According to the relevant emergency operating procedure, operators cope with the symptoms of the early trip phase and diagnose the accident.
Here, accident diagnosis depends on the process parameter values or their trends [33]. In terms of the time required for accident diagnosis, a safety report published by the International Atomic Energy Agency recommends that operators complete the diagnosis of an accident within 15 min after the first indication of the accident [34]. From the diagnosis results, operators select the appropriate optimal response procedure (ORP), which contains the tasks required to mitigate the specific accident based on the current symptoms. Typical ORPs cover a reactor trip, loss of coolant accident (LOCA), steam generator tube rupture (SGTR), excess steam demand event (ESDE), loss of all feedwater (LOAF), loss of forced circulation, loss of off-site power, and station blackout [35].
Because each ORP includes contextual tasks, a misdiagnosis of the accident could result in a critical omission of the appropriate mitigation action or an error of commission. Considering the lesson from the TMI-2 accident, wrong displays of plant parameters during an accident sequence bring a high risk of human error, which will result in even bigger consequences following the diagnosis steps. In some specific circumstances, even a single sensor parameter can be a critical factor to diagnose the accident, for example, an increase in secondary system radiation is a strong indicator of SGTR. Therefore, an error in such a critical sensor during an emergency situation can possibly lead to misdiagnosis. Lee et al. (2009) showed that indicator failure is one of the factors influencing misdiagnosis error [36].

4. Method

An overview of the data processing involved in the developed system is shown in Figure 1. Raw data matrices from a compact nuclear simulator (CNS) are processed by injecting errors, and the consistency index is labeled on every time series sensor parameter. Then, the labeled data are used to train the machine learning model, here a long short-term memory (LSTM) network. The trained model generates consistency values for every sensor in response to the test data. The following subsections describe the related elements in detail.

4.1. Consistency Index

In this study, a consistency index that expresses the soundness of measurements is suggested. At first, the consistency index has values of 0 or 1, representing faulty and sound sensors, respectively. But such a binary classification of sensor states can result in a lowering of the threshold that judges sensor failure, because machine learning models can easily regard a normal sensor (with no error) as a faulty sensor in response to small deviations from, for example, sensor oscillation [37] or untrained sensor values. Therefore, a separate evaluation of sensor measurements is needed to avoid false detection of sensor error for measurements near the real value. In this case, the consistency index value is measured based on relative measurement accuracy; within about a 10% error, the consistency index is calculated from the square of the relative measurement accuracy. It has previously been shown that relative measurement error or accuracy can be used to quantify the performance of instrumentation or the quality of data [38]. Equations (1) and (2) give the relative measurement error ( ε ) and the consistency index (C), respectively, as:
ε = A ˜ A A ,
C i , t = 1 ε i , t 2 = 1 A ˜ i , t A i , t A i , t 2   ,       0 ε i , t 0.1 0                                 ,                         ε i , t > 0.1 ,
where à and A are the measured and real values, respectively, i is the parameter number, and t is time. As seen in Equation (2), the consistency index C derives from the relative measurement error ε.
The consistency index is labeled on every time series parameter. All normal data and sensor error-injected data during the emergency situation are processed as inputs, with the trained model generating consistency output from the sensor parameter inputs. Without accident information, the model estimates the sensor states considering the analytical relation between other sensors and the temporal relation between early reactor trip sequences. Normal sensor trends are trained with the normal data, and parameter deviations are trained with the error-injected data. The system directly lowers the consistency index for anticipated sensor errors and accidents, and high computing power makes it possible to use a large number of parameter inputs and train for complex changes. Consequently, the consistency index value output of the suggested model replaces parameter reconstruction and residual analysis with a simpler process.

4.2. Sensor Error Modes

Sensor failures or uncertainties can occur from external or internal environmental causes. In previous applications of OLM techniques, typical sources of uncertainty were considered to establish the allowance of channel uncertainties. Examples of these sources include temperature and pressure (external), and systematic structure and sensor type (internal) [12]. From industrial data, there are several types of sensor errors according to the source of uncertainty. Sensor error modes are classified into three types, i.e., delay, offset, and stuck. Delay errors refer to the delayed availability of sensor data, offset errors include sporadic offset, stochastic offset, and permanent offset including drift error, and stuck errors such as stuck at constant and stuck at zero refer to a series of measurements with inaccurate constant values. These error modes are mainly caused by deviation from real values, as well as the occurrence of oscillation. All errors can lead to critical, negative effects in NPPs, such as a malfunction of an autonomous safety system or a wrong alarm.
Among the above possible error modes, the following two modes are selected here considering their influence on human error during diagnosis tasks: (1) drift error which is a time-correlated permanent offset error and (2) stuck at constant error. Accident diagnosis is mainly determined by checking the parameter trends or whether the parameters have exceeded their thresholds; as the drift and stuck at constant errors exhibit similar behaviors as error-free operation, they are selected here as the main target errors to be detected. Other error modes are excluded from the analysis because, for example, the stochastic offset and stuck at zero error modes can be easily known by operators because of their discrepancy from real trends.
For implementation of the selected error modes, a uniform method of error injection is applied to all sensors regardless of the type or environment of the sensor. First, the stuck at constant error is implemented by fixing the sensor value at the error injection point. Second, the drift error is divided into slow and rapid drift according to the slope of the change. Each drift is implemented with rates of change of two and five times from the real trends. In cases with no changes of the real values, each drift is implemented with 0.4% and 4% of the fixed values. Additionally, each drift is also split into upward and downward drift by the drift direction. In sum, the injected errors in this work are (1) stuck at constant, (2) slow upward drift, (3) slow downward drift, (4) rapid upward drift, and (5) rapid downward drift. Figure 2 plots examples of the injected error data against the normal parameter trend.

4.3. Data Preprocessing

For efficient training of the LSTM network, two data preprocessing steps are performed. The first is a Gaussian smoothing of the time series parameters. Parameter oscillation is typically observed in LOCA data, estimated to derive from the vaporization of coolant, and such oscillation can cause the false detection of sensor error. Therefore, a one-dimensional Gaussian smoothing filter is applied, in which the Gaussian distribution function used for smoothing is given by:
G x = 1 σ 2 π exp x 2 2 σ 2
Following the value of the standard deviation σ , the width of the Gaussian distribution, or in other words the effect of the smoothing, is determined [39]. Gaussian smoothing with σ = 100 is applied to the oscillating parameters. As shown in Figure 3, this step eliminates the oscillations while maintaining the parameter trend.
The second preprocessing step is a min-max normalization of all parameters. As seen in Table 1, various parameter scales are used for training the LSTM network. In order to reflect all plant parameters, normalization is needed. Minimum and maximum parameter values along the entire accident sequence are collected and used for the normalization as follows:
x n o r m = x x m i n x m a x x m i n .

4.4. Long-Short Term Memory Network

Recurrent neural networks (RNNs) have special structural connections between nodes and each node has memory to process inputs from the present state as well as from connected nodes. This structure enables the system to consider the temporal context of data [40,41,42]. However, RNNs contain the vanishing gradient problem, meaning they cannot learn the long-term dependencies of the data [43]. To solve this, a particular RNN structure called the long-short term memory (LSTM) network was suggested [44]. The LSTM network has a hidden cell state that is controlled by three gate functions, i.e., input, forget, and output gate functions, as shown in Figure 4. The functions are computed by Equations (5) to (10) as below:
i t = σ W i [ x t , h t 1 ] + b i ,
f t = σ W f [ x t , h t 1 ] + b f ,
o t = σ x t U o + h t 1 W o ,
C ˜ t = t a n   h W C [ x t , h t 1 ] + b C ,
C t = σ f t * C t 1 + i t * C ˜ t ,
h t = t a n   h C t * o t ,
where 𝑊 is the weight matrix of each gate and b is the bias. At the forget gate ( f t ), information is kept or discarded according to the previous output and the present value. The input gate vector ( i t ) determines the updates to the cell state vector ( C t ) with candidate values ( C ˜ t ). The output vector of the current block ( h t ) is determined by an activation vector ( o t ) and the cell state vector. With such a setup, short-term characteristics are reflected in the output vector, and long-term dependencies are reflected in the cell state vector. In our system, the LSTM network consists of an input layer, two hidden layers, and an output layer. The input layer receives time series data as input x, which is multiple sensor data in our model. Following the time steps, information transfer occurs to train the contextual information with the three gate functions. The network generates output at every time step. The estimated output, which is the consistency index in our model, is compared to the real consistency index, which is the correct answer of the output. To reflect estimation error, the network back propagates (in the reverse direction of time) to update the weights for more accurate estimation. Training and validation with related datasets are done iteratively. Ultimately, the LSTM model gains the ability to generate consistency index values for times series input data.
In terms of the model selection, a pilot study was conducted that also tested a deep multilayer perceptron model [45] and a convolutional neural network model [46]; both neural network models were excluded from the present analysis due to poor performance as compared with the LSTM network. Likewise, Bae et al. (2019) recently compared multilayer perceptron and LSTM networks for plant parameter prediction in nuclear emergency situations and showed much more accurate results with the LSTM network [47].

5. Applications

5.1. Data Extraction

Since NPP emergency situations occur at rare intervals, related process parameter data from plant experience is insufficient. Therefore, a CNS developed by the Korea Atomic Energy Research Institute was employed to generate accident data. A CNS is a compact-scale NPP simulator implementing a three-loop pressurized water reactor from Westinghouse. It is based on the SMABRE thermal-hydraulic system code that was developed for analyzing small-break loss of coolant accidents or leak transient. The SMABRE code is a one-dimensional model with simplified assumptions and experimental data. It cannot reflect all possible phenomena or events in real emergency accident situations. Nonetheless, it has advantages of good accessibility and fast calculation for the production of large amounts of accident data [48,49,50,51].
Among the emergency situations covered by the ORPs, the following four accidents were selected: LOCA, SGTR, ESDE, and LOAF accidents. Reactor trips with no specific symptoms or accidents from power loss were excluded from analysis due to a lack of distinguishable symptoms in the CNS. After the related malfunctions of the selected accidents were injected to normal CNS operation, a reactor trip occurred by an autonomous signal. From the reactor trip, time series data of certain plant parameters were collected for 15 min, corresponding to the recommended time limit for accident diagnosis [34]. Twenty-one plant parameters were selected based on the diagnosis procedure and their importance to accident estimation. The time interval of data collection was 1 s, and thus 900 time points were collected per dataset. For data variation, nine break sizes and three break locations were considered in creating LOCA, SGTR, and ESDE accident data.
For the purpose of validating the proposed system, the following target sensors were chosen considering their importance in diagnosis: sensors monitoring pressurizer pressure; containment radiation; secondary system radiation; steam generator #1, #2, #3 pressure and water level; reactor vessel water level, cold-leg #1 temperature, hot-leg #1 temperature, and core outlet temperature. Pressurizer pressure is a parameter affected by all types of accidents, and, accordingly, it is used by operators for a rough diagnosis of an accident; the other 13 parameters are important to diagnose or estimate LOCA, SGTR, ESDE, and LOAF. The injected errors had six time points at the early phase of reactor trip with 60 s intervals for training and validation datasets. The test set also had the same time interval with three different time points. For the training of each single failure of the target sensors, 7488 training sets, 2223 validation sets, and 3159 test sets were used.

5.2. Application Results

Examples of the consistency trend output are shown in Figure 5. The yellow lines depict the real consistency trends of the target sensor, obtained by labeling both normal and error-injected raw data with consistency values, and the blue lines show the estimated consistency values of the target sensor from the LSTM network test output. In the best case with a normal sensor, as shown in Figure 5a the estimated result clearly shows the soundness of the sensor. The estimated consistency also effectively follows the drop of the real consistency value, as shown in Figure 5b, with detection of the injected error. However, the estimated consistency, as shown in Figure 5c, has a dip in the early phase of the reactor trip; this is because drastic changes of all parameters, as well as the error injection are all located at the front of the accident sequence. In the worst case with error-injected data, as shown in Figure 5d, consistency decreases slowly. As each parameter has various rates of change and trends, the consistency trends also vary. Nevertheless, in this case, the estimation drops in the latter part, following the real consistency value.

5.2.1. Error Criteria

Test error datasets in which the real consistency index label did not drop to zero were excluded from results analysis because they are not perceived as faulty sensors in our system. Likewise, for all test data, sensor success and fault criteria need to be identified. Setting higher criteria results in the quick detection of sensor error; however, this can be accompanied by increases in the false detection of sensor error. Table 2 lists the number of datasets in terms of the minimum consistency index location from trained LSTM test outputs. The results clearly discriminate the consistency between normal and error cases. In the normal case with no sensor errors, 97.49% of the data maintained an index value of over 0.9, while the other 0.79% and 1.72% of the data were over 0.7 and 0.8 during the accident sequence. In the error case, 72.77% of error data were distributed under the 0.1 index, 27.10% between 0.1 and 0.2, and 0.13% between 0.2 and 0.3. Error criteria should be decided based on the ability to distinguish between normal and error states of the sensor; therefore, according to the results, the error criteria should be set between 0.3 and 0.7. In accordance with the steady output of the normal case, a higher error criterion of 0.7 was chosen for sensor error detection.

5.2.2. Error Detection Time Analysis

The average time to reach all consistency indexes in the error test data was collected, as shown in Table 3. The average time for all error data was 116.11 s. The decrease of consistency accelerates after reaching the consistency value of 0.8.
Table 4 and Table 5 contain the average times for the sensor error detection in the present application. Note that in all the normal cases, the system succeeded to produce output with the true value; the results from normal data can, therefore, be classified as “success” or “failure” by whether the index value was maintained above the error criteria over all time steps or not, and thus all the normal cases were classified as “success”. Among the stuck-at-constant error cases, some test data had no meaningful results (as marked with dashes) because the real values also remained constant during the accident sequences. The detection time varied according to the type of accident, error modes, and target sensors because the trend or features of the parameters were completely different in each accident. Rapid drifts were detected earlier than the other errors, but the stuck and slow drift error showed unstable results. Errors in containment radiation and secondary radiation accidents were detected within a relatively short time as compared with the other errors. This result came from the related simple parameter trends along with the characteristic of being clearly distinguished from other parameters.
The results of Table 2 present the performance of the model to distinguish between normal and error data for all test sets. As previously mentioned, the error criteria value was determined based on the observed uncertainty of these results; using this criterion (0.7), the system demonstrated successful performance. However, accumulation of training data and incorporating more accident types can increase the degree of peak points that can lead to false detection. The possibility for false detection of sensor error is identified as a potential negative effect of the error detection model. If a false case is observed, more logics to determine the sensor error can be added to prevent recurrence. Possible methods for this include the application of a cumulative function or a downward adjustment of the error criteria.

6. Conclusions

A framework for a sensor error detection system designed for nuclear power plant emergency situations using a machine learning model has been presented. The performance of the system was tested with emergency situation simulation data with a single sensor failure. The proposed system is differentiated from previous approaches, such as OLM techniques that are based on signal reconstruction, as the developed system generates consistency index values to express the soundness of the sensors, thereby allowing the reliability of the sensors to be quantified during typical emergency sequences. To handle the complex combinations of systems in NPPs, a LSTM network was applied with successful results obtained. Ultimately, this study shows the applicability of the sensor error detection system to NPP emergency situations.
Recently in the nuclear field, data-driven methods to support accident response are being actively studied with the advancement of computing power. Such methods include the prediction of plant parameters, the diagnosis of accidents, and autonomous operation during an accident [52,53,54]. The monitoring of sensor soundness can support the practical application of these incoming technologies.
In this study, the sensor error modes that can result in possible human error were selected and artificially implemented as simulation data. As mentioned in Section 4.1, however, there are various types of sensor error depending on the sensor type and cause. For application of the system to a real plant, some future works need to be performed. First, the sensor error detection system should cover all possible errors, requiring the training and testing of more error modes. Second, a comparative evaluation of different machine learning models should be performed to determine whether more accurate and quick detection of sensor error is possible. Third, operator action and simultaneous sensor errors should also be considered.

Author Contributions

Conceptualization, J.C. and S.J.L.; methodology J.C. and S.J.L.; review and editing J.C. and S.J.L.; visualization J.C.; supervisions S.J.L.; project administration S.J.L., funding acquisition S.J.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was financially supported by the Human Resources Program in Energy Technology (no. 20174030201430) of the Korea Institute of Energy Technology Evaluation and Planning (KETEP), funded by the Ministry of Trade Industry and Energy (MOTIE), Republic of Korea.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. “Instrumentation and Control (I&C) Systems in Nuclear Power Plants: A Time of Transition ”. Available online: https://www-legacy.iaea.org/About/Policy/GC/GC52/GC52InfDocuments/English/gc52inf-3-att5_en.pdf (accessed on 15 March 2020).
  2. Lee, S.J.; Kim, J.; Jang, S.-C. Human error mode identification for NPP main control room operations using soft controls. J. Nucl. Sci. Technol. 2011, 48, 902–910. [Google Scholar] [CrossRef]
  3. Norman, D.A. Errors in human performance. California Univ San Diego LA JOLLA Center For Human Information Processing. Tech. Rep. 1980. [Google Scholar]
  4. Coble, J.B.; Meyer, R.M.; Ramuhalli, P.; Bond, L.J.; Hash, H.; Brent, S.; Dara, C. A Review of Sensor Calibration Monitoring for Calibration Interval Extension in Nuclear Power Plants; Pacific Northwest National Lab. (PNNL): Richland, WA, USA, 2012. [Google Scholar]
  5. Shaheryar, A.; Yin, X.-C.; Hao, H.-W.; Ali, H.; Iqbal, K. A denoising based autoassociative model for robust sensor monitoring in nuclear power plants. Sci. Tech. Nucl. Installations 2016, 2016, 17. [Google Scholar] [CrossRef] [Green Version]
  6. Hines, J.W.; Garvey, D.; Seibert, R.; Usynin, A. Theoretical issues. In Technical Review of On-Line Monitoring Techniques for Performance Assessment; NUREG/CR-6895, ORNL/TM-2007/188; U.S. NRC: Washington, DC, USA, 2006. [Google Scholar]
  7. Lee, S.J.; Seong, P.H. Design of an integrated operator support system for advanced NPP MCRs: issues and perspectives. In Progress of Nuclear Safety for Symbiosis and Sustainability; Springer: Tokyo, Japan, 2014; pp. 11–26. [Google Scholar]
  8. Zug, S.; Dietrich, A.; Kaiser, J. Fault-handling in networked sensor systems. Available online: https://www.researchgate.net/profile/Sebastian_Zug/publication/233970315_Fault-Handling_in_Networked_Sensor_Systems/links/09e4150d97da96b852000000/Fault-Handling-in-Networked-Sensor-Systems.pdf (accessed on 15 March 2020).
  9. Agarwal, D.; Singh, C.K. Model-Based Fault Detection on Modern Automotive Engines. In Advanced Engine Diagnostics; Springer: Singapore, 2019; pp. 167–204. [Google Scholar]
  10. López-Estrada, F.R.; Theilliol, D.; Astorga-Zaragoza, C.M.; Ponsart, J.C.; Valencia-Palomo, G.; Camas-Anzueto, J. Fault diagnosis observer for descriptor Takagi-Sugeno systems. Neurocomputing 2019, 331, 10–17. [Google Scholar] [CrossRef]
  11. Nan, C.; Khan, F.; Iqbal, M.T. Real-time fault diagnosis using knowledge-based expert system. Process Saf. Environ. Prot. 2008, 86, 55–71. [Google Scholar] [CrossRef]
  12. Chen, Y.; Chen, R.; Pei, L.; Kröger, T.; Kuusniemi, H.; Liu, J. Knowledge-based error detection and correction method of a multi-sensor multi-network positioning platform for pedestrian indoor navigation. In Proceedings of the IEEE/ION Position, Location and Navigation Symposium, Indian Wells, CA, USA, 4–6 May 2010; pp. 873–879. [Google Scholar]
  13. Lunderstaedt, R.A.; Hillemann, T. Knowledge based sensor fault detection for gas turbines under consideration of model based methods. In Artificial Intelligence in Real-Time Control, Proceedings of the IFAC/IFIP/IMACS Symposium, Delft, the Netherlands, 16–18 June 1992; Elsevier: Amsterdam, The Netherlands, 1993; pp. 287–292. [Google Scholar] [CrossRef]
  14. Jin, B.; Li, D.; Srinivasan, S.; Ng, S.K.; Poolla, K.; Sangiovanni-Vincentelli, A. Detecting and diagnosing incipient building faults using uncertainty information from deep neural networks. In Proceedings of the 2019 IEEE International Conference on Prognostics and Health Management (ICPHM), San Francisco, CA, USA, 17–20 June 2019; pp. 1–8. [Google Scholar]
  15. Zheng, H.; Wang, R.; Yang, Y.; Li, Y.; Xu, M. Intelligent Fault Identification Based on Multisource Domain Generalization Towards Actual Diagnosis Scenario. IEEE Trans. Ind. Electron. 2019, 67, 1293–1304. [Google Scholar] [CrossRef]
  16. de los Santos-Ruiz, I.; López-Estrada, F.R.; Puig, V.; Pérez-Pérez, E.J.; Mina-Antonio, J.D.; G. Valencia-Palomo, G. Diagnosis of fluid leaks in pipelines using dynamic PCA. IFAC-Papers OnLine 2018, 51, 373–380. [Google Scholar] [CrossRef]
  17. Valtierra-Rodriguez, M.; Pablo Amezquita-Sanchez, J.P.; Garcia-Perez, A.; Camarena-Martinez, D. Complete ensemble empirical mode decomposition on FPGA for condition monitoring of broken bars in induction motors. Mathematics 2019, 7, 783. [Google Scholar] [CrossRef] [Green Version]
  18. Jiang, L. Sensor Fault Detection and Isolation Using System Dynamics Identification Techniques. PhD Thesis, University of Michigan, Ann Arbor, MI, USA, 2011. [Google Scholar]
  19. Jiang, Y.; Yin, S.; Kaynak, O. Data-driven monitoring and safety control of industrial cyber-physical systems: Basics and beyond. IEEE Access 2018, 6, 47374–47384. [Google Scholar] [CrossRef]
  20. Jiang, Y.; Yin, S. Recursive total principle component regression based fault detection and its application to vehicular cyber-physical systems. IEEE Trans. Ind. Inf. 2017, 14, 1415–1423. [Google Scholar] [CrossRef]
  21. Brkovic, A.; Gajic, D.; Gligorijevic, J.; Savic-Gajic, I.; Georgieva, O.; Di Gennaro, S. Early fault detection and diagnosis in bearings for more efficient operation of rotating machinery. Energy 2017, 136, 63–71. [Google Scholar] [CrossRef]
  22. Gligorijevic, J.; Gajic, D.; Brkovic, A.; Savic-Gajic, I.; Georgierva, O.; Di Gennaro, S. Online condition monitoring of bearings to support total productive maintenance in the packaging materials industry. Sensors 2016, 16, 316. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Hines, J.W.; Garvey, D.; Seibert, R.; Usynin, A. On-Line Monitoring for Calibration Extension: An Overview and Introduction to NUREG/CR-6895, Technical Review of On-Line Monitoring Techniques for Performance Assessmen; NRC: Washington, DC, USA, 2006. [Google Scholar]
  24. Simani, S.; Marangon, F.; Fantuzzi, C. Fault diagnosis in a power plant using artificial neural networks: analysis and comparison. In Proceedings of the 1999 European Control Conference (ECC), Karlsruhe, Germany, 31 August–3 September 1999; pp. 2270–2275. [Google Scholar]
  25. Fantoni, P.F.; Hoffmann, M.; HTNES, W.; RASMUSSEN, B.; Kirschner, A. The use of non linear partial least square methods for on-line process monitoring as an alternative to artificial neural networks. In Machine Intelligence: Quo Vadis? Sinčák, P., Vaščák, J., Hirota, K., Eds.; World Scientific: Danvers, MA, USA, 2004; pp. 283–298. [Google Scholar] [CrossRef]
  26. Zavaljevski, N.; Gross, K.C. Sensor Fault Detection in Nuclear Power Plants using Multivariate State Estimation Technique and Support Vector Machines; Argonne National Lab.: Argonne, IL, USA, 2000. [Google Scholar]
  27. Garvey, J.; Garvey, D.; Seibert, R.; Hines, J.W. Validation of on-line monitoring techniques to nuclear plant data. Nucl. Eng. Technol. 2007, 39, 133–142. [Google Scholar] [CrossRef] [Green Version]
  28. Tamilselvan, P.; Wang, P.; Youn, B.D. Multi-sensor health diagnosis using deep belief network based state classification. In Proceedings of the ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Washington, DC, USA, 18–31 August 2011; pp. 749–758. [Google Scholar]
  29. Rocco, S.; Claudio, M.; Zio, E. A support vector machine integrated system for the classification of operation anomalies in nuclear components and systems. Reliab. Eng. Syst. Saf. 2007, 92, 593–600. [Google Scholar] [CrossRef]
  30. Baraldi, P.; Di Maio, F.; Genini, D.; Zio, E. Comparison of data-driven reconstruction methods for fault detection. IEEE Trans. Reliab. 2015, 64, 852–860. [Google Scholar] [CrossRef] [Green Version]
  31. Pressurized Water Reactor Simulator; Training Course Series No. 22; International Atomic Energy Agency: Vienna, Austria, 2003.
  32. Choi, J.-G.; Lee, D.-Y. Development of RPS trip logic based on PLD technology. Nucl. Eng. Technol. 2012, 44, 697–708. [Google Scholar] [CrossRef] [Green Version]
  33. Kim, Y.; Choi, J.; Park, J.; Jung, W.; Lee S., J. Estimating Diagnosis Time of Emergency Situations in Digitalized Control Rooms. In Proceedings of the International Conference on Applied Human Factors and Ergonomics, Orlando, FL, USA, 22–26 July 2018. [Google Scholar]
  34. Accident Analysis for Nuclear Power Plants; Safety Reports Series No. 23; International Atomic Energy Agency: Vienna, Austria, 2002.
  35. Development and Review of Plant Specific Emergency Operating Procedures; Safety Reports Series No. 48; International Atomic Energy Agency: Vienna, Austria, 2006.
  36. Lee, S.J.; Kim, J.; Jang, S.-C.; Shin, Y.C. Modeling of a dependence between human operators in advanced main control rooms. J. Nucl. Sci. Technol. 2009, 46, 424–435. [Google Scholar] [CrossRef]
  37. Hashemian, H.M. Aging management of instrumentation & control sensors in nuclear power plants. Nucl. Eng. Des. 2010, 240, 3781–3790. [Google Scholar]
  38. Rabinovich, S.G.; Rabinovich, M. Evaluating Measurement Accuracy; Springer: New York, NY, USA, 2010. [Google Scholar]
  39. Ito, K.; Xiong, K. Gaussian filters for nonlinear filtering problems. IEEE Trans. Autom. Control 2000, 45, 910–927. [Google Scholar] [CrossRef] [Green Version]
  40. Mikolov, T.; Karafiat, M.; Burget, L.; Cernocky, J.; Khudanpur, S. Recurrent neural network based language model. In In Proceedings of the Eleventh annual conference of the international speech communication associatio, Chiba, Japan, 26–30 September 2010. [Google Scholar]
  41. Boden, M. A guide to recurrent neural networks and backpropagation; SICS TECHNICAL REPORT T2002:03; The Dallas Project: Dallas, TX, USA, 2002. [Google Scholar]
  42. Kawakami, K. Supervised sequence labelling with recurrent neural networks. Ph. D. Thesis, Carnegie Mellon University, Pittsburgh, PA, USA, 2008. [Google Scholar]
  43. Hochreiter, S. The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int. J. Uncertainty Fuzziness Knowledge Based Syst. 1998, 6, 107–116. [Google Scholar] [CrossRef] [Green Version]
  44. Hochreiter, S.; Schmidhuber, J. Long short-term memory. Neural computation 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [PubMed]
  45. Murtagh, F. Multilayer perceptrons for classification and regression. Neurocomputing 1991, 2, 183–197. [Google Scholar] [CrossRef]
  46. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems Conference, Lake Tahoe, NV, USA, 3−6 December 2012; pp. 1097–1105. [Google Scholar]
  47. Bae, J.; Ahn, J.; Lee, S.J. Comparison of Multilayer Perceptron and Long Short-Term Memory for Plant Parameter Trend Prediction. Nucl. Technol. 2019, 1–11. [Google Scholar] [CrossRef]
  48. Park, J.-C. Equipment and Performance Upgrade of Compact Nuclear Simulator; KAERI/RR-1967/1999; KAERI: Daejeon, Korea, 1999. [Google Scholar]
  49. Kwon, K.-C.; Park, J.-C.; Jung, C.-H.; Lee, J.-S.; Kim, J.-Y. Compact nuclear simulator and its upgrade plan. In Proceedings of the IAEA specialists’ meeting on training simulators in nuclear power plants: experience, programme design and assessment methodology, Essen, Germany, 17–19 November 1997. [Google Scholar]
  50. Miettinen, J.; Tuomisto, H.; Kantee, H.; Kervinen, T. Oscillations of single-phase natural circulation during overcooling transients. In Anticipated and Abnormal Transients in Nuclear Power Plants; American Nuclear Society: Atlanta, GA, USA, 1987. [Google Scholar]
  51. Miettinen, J. Development and assessment of the SBLOCA code SMABRE. In Proceedings of the CSNI Specialists’ Meeting on Small Break LOCA Analyses in LWRs, Pisa, Italy, 23–27 June 1985; pp. 481–495. [Google Scholar]
  52. Lee, D.; Seong, P.H.; Kim, J. Autonomous operation algorithm for safety systems of nuclear power plants by using long-short term memory and function-based hierarchical framework. Ann. Nucl. Energy 2018, 119, 287–299. [Google Scholar] [CrossRef]
  53. Yang, J.; Kim, J. An accident diagnosis algorithm using long short-term memory. Nucl. Eng. Technol. 2018, 50, 582–588. [Google Scholar] [CrossRef]
  54. No, Y.G.; Lee, C.; Seong, P.H. Development of a prediction method for SAMG entry time in NPPs using the extended group method of data handling (GMDH) model. Ann. Nucl. Energy 2018, 121, 552–566. [Google Scholar] [CrossRef]
Figure 1. Data processing overview for sensor error detection.
Figure 1. Data processing overview for sensor error detection.
Sensors 20 01651 g001
Figure 2. Examples of error injection. (a) Normal; (b) Stuck at constant; (c) Slow drift (upward); and (d) Slow drift (downward) sensor error during a loss of coolant accident.
Figure 2. Examples of error injection. (a) Normal; (b) Stuck at constant; (c) Slow drift (upward); and (d) Slow drift (downward) sensor error during a loss of coolant accident.
Sensors 20 01651 g002
Figure 3. Example parameter oscillation (left) and smoothing result (right).
Figure 3. Example parameter oscillation (left) and smoothing result (right).
Sensors 20 01651 g003
Figure 4. Long short-term memory (LSTM) network scheme.
Figure 4. Long short-term memory (LSTM) network scheme.
Sensors 20 01651 g004
Figure 5. (ad) Consistency trends of the best and worst cases from normal and error-injected tests.
Figure 5. (ad) Consistency trends of the best and worst cases from normal and error-injected tests.
Sensors 20 01651 g005
Table 1. Selected plant parameters from the compact nuclear simulator.
Table 1. Selected plant parameters from the compact nuclear simulator.
Plant Parameter (Units)
1PRESSURIZER LEVEL (m)
2REACTOR VESSEL WATER LEVEL (m)
3CONTAINMENT RADIATION. (mRem/hr)
4COLD-LEG #1 TEMPERATURE (°C)
5HOT-LEG #1 TEMPERATURE (°C)
6CORE OUTLET TEMPERATURE. (°C)
7STEAM GENERATOR #1 LEVEL, WIDE RANGE (m)
8STEAM GENERATOR #2 LEVEL, WIDE RANGE (m)
9STEAM GENERATOR #3 LEVEL, WIDE RANGE (m)
10SECONDARY SYSTEM RADIATION (mRem/hr)
11STEAM GENERATOR #1 PRESSURE (Pa)
12STEAM GENERATOR #2 PRESSURE (Pa)
13STEAM GENERATOR #3 PRESSURE (Pa)
14PRESSURIZER PRESSURE (Pa)
15FEED WATER LINE 1 FLOW (kg/sec)
16FEED WATER LINE 2 FLOW (kg/sec)
17FEED WATER LINE 3 FLOW (kg/sec)
18CONTAINMENT SUMP WATER LEVEL (m)
19STEAM LINE 1 FLOW (kg/sec)
20STEAM LINE 2 FLOW (kg/sec)
21STEAM LINE 3 FLOW (kg/sec)
Table 2. Location of minimum consistency index.
Table 2. Location of minimum consistency index.
C Index<0.10.1–0.20.2–0.30.3–0.70.7–0.80.8–0.9>0.9Total
Normal000017(0.79%)37(1.72%)2098(97.49%)2152
Error6751(72.77%)2514(27.10%)12(0.13%)00009277
Table 3. Average time to reach the C index in the error test data.
Table 3. Average time to reach the C index in the error test data.
C index0.90.80.70.60.50.40.30.20.10
Detection Time (s)60.20 98.52 116.11 130.13 132.14 134.02 135.58 137.55 140.01 670.31
Table 4. Average sensor error detection time (1) (units, sec).
Table 4. Average sensor error detection time (1) (units, sec).
AccidentError ModePressurizer PressureContainment RadiationSecondary RadiationSG #1 PressureSG #1 LevelSG #2 PressureSG #2 Level
LOCANormalsuccesssuccesssuccesssuccesssuccesssuccesssuccess
Stuck71.56 16.26 218.02 15.17 236.11 138.85
Slow drift69.89 41.72 11.15 85.03 21.16 195.33 14.26
Rapid drift53.45 23.63 7.93 56.24 13.73 110.09 8.83
SGTRNormalsuccesssuccesssuccesssuccesssuccesssuccesssuccess
Stuck46.80 206.35 58.67 60.69 15.36 91.83
Slow drift45.64 6.70 151.74 112.17 18.45 218.41 19.24
Rapid drift34.88 4.63 125.18 86.46 13.13 121.22 11.40
ESDENormalsuccesssuccesssuccesssuccesssuccesssuccesssuccess
Stuck99.71 173.48 60.17 85.40 118.27
Slow drift81.35 5.98 10.34 90.69 81.36 103.10 45.85
Rapid drift52.59 4.17 7.98 54.59 39.78 71.03 36.37
LOAFNormalsuccesssuccesssuccesssuccesssuccesssuccesssuccess
Stuck24.33 63.00 13.00 112.00 9.50
Slow drift17.83 4.00 11.50 56.00 9.83 119.50 11.92
Rapid drift16.17 2.50 8.50 45.17 5.00 80.00 5.58
Table 5. Average sensor error detection time (2) (units, sec).
Table 5. Average sensor error detection time (2) (units, sec).
AccidentError ModeSG #3 PressureSG #3 LevelReactor Vessel Water LevelCold-Leg #1 TemperatureHot-Leg #1 Temperature Outlet Temperature
LOCANormalsuccesssuccesssuccesssuccesssuccesssuccess
Stuck220.25 15.39 140.09 343.00 338.00
Slow drift82.35 21.72 129.30 342.67 334.41 355.51
Rapid drift15.29 13.79 92.38 128.00 134.72 135.52
SGTRNormalsuccesssuccesssuccesssuccesssuccesssuccess
Stuck17.27 116.30 246.11 319.50
Slow drift125.59 19.54 21.63 311.11 294.01 282.58
Rapid drift64.83 14.07 14.06 168.56 175.07 175.45
ESDENormalsuccesssuccesssuccesssuccesssuccesssuccess
Stuck77.38 149.75 10.00 161.41 320.50 192.28
Slow drift111.77 64.55 66.46 221.59 286.41 246.61
Rapid drift63.98 40.41 3.37 97.10 178.28 117.52
LOAFNormalsuccesssuccesssuccesssuccesssuccesssuccess
Stuck110.00 12.67 279.00 296.00 296.50
Slow drift117.50 12.33 66.67 179.33 138.33 139.67
Rapid drift79.00 7.00 3.67 77.33 85.00 83.67

Share and Cite

MDPI and ACS Style

Choi, J.; Lee, S.J. Consistency Index-Based Sensor Fault Detection System for Nuclear Power Plant Emergency Situations Using an LSTM Network. Sensors 2020, 20, 1651. https://doi.org/10.3390/s20061651

AMA Style

Choi J, Lee SJ. Consistency Index-Based Sensor Fault Detection System for Nuclear Power Plant Emergency Situations Using an LSTM Network. Sensors. 2020; 20(6):1651. https://doi.org/10.3390/s20061651

Chicago/Turabian Style

Choi, Jeonghun, and Seung Jun Lee. 2020. "Consistency Index-Based Sensor Fault Detection System for Nuclear Power Plant Emergency Situations Using an LSTM Network" Sensors 20, no. 6: 1651. https://doi.org/10.3390/s20061651

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop