Next Article in Journal
Can We Quantify Aging-Associated Postural Changes Using Photogrammetry? A Systematic Review
Next Article in Special Issue
Smart Dimmable LED Lighting Systems
Previous Article in Journal
Development and Calibration of a Low-Cost, Piezoelectric Rainfall Sensor through Machine Learning
Previous Article in Special Issue
Non-Intrusive Load Monitoring of Buildings Using Spectral Clustering
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Appliance-Level Anomaly Detection by Using Control Charts and Artificial Neural Networks with Power Profiles

by
Hanife Apaydin-Özkan
Department of Electrical and Electronics Engineering, Eskisehir Technical University, 26555 Eskisehir, Turkey
Sensors 2022, 22(17), 6639; https://doi.org/10.3390/s22176639
Submission received: 28 June 2022 / Revised: 29 August 2022 / Accepted: 30 August 2022 / Published: 2 September 2022
(This article belongs to the Special Issue Smart Homes: A Prospective of Sensing, Communication, and Automation)

Abstract

:
Nowadays, the development of the Internet of Things (IoT) concept has increased the interest in some technologies, one of which is the detection of anomalies in home appliances before they occur. In this work, in order to contribute to the works that use appliance power profiles for anomaly detection, a novel Appliance Monitoring and Anomaly Detection System (AM-ADS) is presented. AM-ADS consists of a main controller, a database, IoT-based communication units, home appliances, and power measurement units (smart plugs or special measurement equipments) mounted on appliances. In AM-ADS, a new Control Chart (CC) based method, for the cases that a limited number of historical power profiles are available; and a new Artificial Neural Network (ANN) based method, for the cases that a sufficient number of historical power profiles of each anomaly free and anomalous situations are available, are used according to the developed rule-based AM-ADS procedure to maximize the advantages and to eliminate the disadvantages of these methods as much as possible. According to the AM-ADS procedure, power consumptions of appliances, which provide meaningful information about the health of appliances, are measured during their operations and the corresponding power profiles are created. Active power, power factor, and operation duration features of power profiles are considered as decisive control parameters and different characteristics of these parameters are used as inputs for CC and ANN-based methods. The efficiency and performance of AM-ADS are validated by application case studies, where the ability to detect anomalies varies between 94.56% and 99.03% when a limited number of historical data is available; and the ability to detect and classify anomalies varies between 96.34% and 99.45% when a sufficient number of historical data is available.

1. Introduction

In recent years, parallel to the development of internet and sensor technologies, the concept of the Internet of Things (IoT) has entered our lives. Within the IoT concept, many appliances, that we use in our daily lives, have become communicable with each other and with other internet-connected devices, as well as some appliances acquire information about their environment and usage situations. Moreover, appliances gain features that can update their status information by communicating with people. Hence, people gain opportunities to observe and control them from anywhere, anytime. These opportunities have brought many technologies to increase energy management, safety, and user comfort, that make human life easier. One of these technologies still being studied is the detection of anomalies in appliances before they occur.
Because misuse and aging effects in appliances may cause some anomalies that increase power consumption and decrease durability as well as create serious safety problems such as fire and electric shock that will endanger human life. Early detection of anomalies in appliances can help to avoid these undesirable situations and to reduce after-sale expenses for both users and manufacturers, and also provides improvements in energy efficiency. Therefore, anomaly detection in appliances has been given increasing attention.
Many studies propose to use power profiles of appliances for detecting anomalies. In some of these studies, power consumption is monitored at the aggregated level by a common meter located on the home’s main supply. But, it is difficult to associate an anomaly with an appliance as common power monitoring is performed. Therefore, appliance level power monitoring, thus the meters are located at the plug level and the power consumption of each appliance is monitored individually, is more widely used for anomaly detection of appliances.
Appliance-level power monitoring based works in the literature are composed of supervised and unsupervised anomaly detection methods. Unsupervised methods detect anomalies by labeling power profiles as anomaly free or anomalous according to certain rules and methods without the need for much historical data [1]; while supervised methods use machine learning classifiers for detection and classification of appliance anomalies when there exist sufficient numbers of historical anomaly free and anomalous power profile data.
In this work, in order to contribute to the works in the direction of appliance level power monitoring for anomaly detection and classification, a novel Appliance Monitoring and Anomaly Detection System (AM-ADS) using both a supervised method and an unsupervised method according to a rule-based procedure is presented.
In this work, for detecting anomalies, an unsupervised method based on the Control Chart (CC) which is the most effective tool of Statistical Process Control (SPC) to monitor and detect unusual fluctuations that arise in the outputs, is developed to be used in AM-ADS for the cases that a limited number of historical data is available.
In the developed CC-based anomaly detection method, upper and lower limits, namely control limits, and the corresponding control intervals of decisive features of power profiles are determined from the anomaly-free historical power profiles of appliances. CCs of decisive properties of each appliance are constructed according to its control intervals. Anomaly detection of an appliance is performed by placing and checking decisive features of the present power profile at the corresponding CC. In the CC-based method, only appliances’ anomaly-free power profiles are stored in a database and only these data are used to determine the control limits of decisive features. Hence, this method can be used even when few historical data is available. To the best of the author’s knowledge, a CC-based method is used for anomaly detection of appliances for the first time in the literature.
In this work, for both detecting and classifying anomalies, a supervised method based on Artificial Neural Networks (ANNs) is developed to be used in AM-ADS for the cases that a sufficient number of historical data is available. The relationship between the power profiles of appliances and their anomalies, which AM-ADS uses basically, has a complex and non-linear structure. ANNs can learn and model the relationships in that structure. Besides, ANNs do not impose any constraints on input variables (like how they should be distributed) as different from the other classification methods. For these scientific reasons, in AM-ADS, the use of ANN is preferred for anomaly detection and classification.
In the developed ANN-based anomaly detection and classification method, the ANN model of each appliance is specifically designed. However, every configuration is feedforward and with a single hidden layer trained by backpropagation. Input layers of constructed ANNs consist of features extracted from power profiles, while the output layers present the anomaly-free situation and the anomalous situations defined for the belonging appliance. Hidden layers are designed experimentally due to the training performance of ANNs. The developed ANN-based method provides a much more diverse and comprehensive anomaly classification compared to similar works in the literature as it can detect not only user usage anomalies but also component anomalies.
The proposed AM-ADS in this work consists of a main controller, a database, IoT-based communication units, home appliances, and power measurement units (smart plugs or special measurement equipments) mounted on appliances. As described above, AM-ADS in this work uses both CC and ANN-based methods according to the developed rule-based AM-ADS procedure to maximize the advantages and eliminate the disadvantages of these methods as much as possible.
According to the AM-ADS procedure, power consumptions of appliances are measured during their operations and sent to the main controller in predefined small time intervals. The main controller creates corresponding power profiles and stores them in a database as historical power profiles. In AM-ADS, active power, power factor, and operation duration features are extracted from the power profiles of appliances and considered as decisive control parameters for anomaly detection. ANN-based method of AM-ADS uses maximum, minimum, and mean values of these parameters as inputs. CC-based method of AM-ADS defines upper-lower control limits and the corresponding control intervals of these parameters to construct the control chart.
At the end of the AM-ADS procedure, if no anomaly is detected at the current operation, the power profile is labeled as anomaly free; otherwise, it is labeled as anomalous with the type of anomaly (if it is known). The labeled power profile is stored in the database, and the relevant decisive parameters are updated according to the newly added data. The efficiency and performance of AM-ADS are validated by application case studies.
The main contributions of AM-ADS to the literature can be summed up as follows:
  • AM-ADS is a realistic method since it is based on real power profiles of appliances.
  • AM-ADS is usable independent of the number of historical power profiles.
  • To the best knowledge of the author, a CC-based method is used for anomaly detection of appliances for the first time in the literature.
  • Developed ANN-based method provides a much more diverse and comprehensive anomaly classification compared to similar works in the literature as it can detect not only user usage anomalies but also component anomalies.
  • AM-ADS provides very high accurate results; such that, the CC-based method (used when a limited number of historical data is available) detects anomalies between 94.56% and 99.03% accuracy; while the ANN-based method (used when sufficient numbers of historical power profiles of each anomaly free and anomalous situations are available) detects and classifies anomaly between 96.34% and 99.45% accuracy.
  • Every appliance regardless of its brand and type can be included in AM-ADS simply with only a smart plug connection without making any mechanical changes in the appliance itself.

2. Literature Survey

Studies on anomaly detection in appliances have gained acceleration in recent years. Many studies use power profiles of appliances for detecting anomalies. These power profiles are obtained by monitoring power consumptions at the aggregated level or at the appliance level.
In the works using aggregated level monitoring, anomaly detection is performed by various methods such as presenting a hierarchical probabilistic model [2], an online learning-based intelligent algorithm [3], a classification algorithm [4], a fuzzy rule-based intelligent identification method [5], a fast event detection algorithm [6] and a K-means clustering algorithm [7]. Furthermore, in [8] a method is proposed to save energy by detecting AC faults in advance, while abnormal energy use of the refrigerator and air conditioner is tracked for anomaly detection in [9]. However, it is difficult to associate an anomaly with an appliance by using aggregated level monitoring. Therefore, the appliance-level power monitoring approach is more preferred for anomaly detection of appliances. Note that, this method is used in many different applications besides anomaly detection: in [10], a near-real-time plug load identification method is developed for several office plug loads, while another device identification method based on the information obtained from the plug-meter is introduced in [11]. Appliance level power monitoring is also used for detecting occupancy, occupant movement and user-appliance interaction [12,13].
In the literature, appliance-level power monitoring for anomaly detection consists of supervised and unsupervised procedures.
Unsupervised procedures use several methods, such as k-means clustering [14], fuzzy clustering [15] and one class-neural network [16] etc. Furthermore, in [17], a graphical visualization tool is proposed for supporting the detection of power consumption anomalies using a rule-based approach, while a waveform feature extraction model for anomaly detection in power profiles is proposed in [18]. For the same purpose, ref. [19] proposes a rule-based model comparing actual energy consumption and the predicted one. In these studies, it is possible to detect the anomaly in the appliance without the need for much historical data, but the anomaly can not be classified. Note that, in this work, a CC-based method is proposed as an unsupervised procedure. Although this method is used for anomaly detection of appliances for the first time in the literature, it has been widely used in industrial applications and production processes. For example, in [20], authors use the CC method to control the production parameters of machine production, while this method is used for service request management of a help desk in [21] and for controlling the resistance-layer thickness of integrated circuits in [22]. In [23,24], different dimensions of various mechanical parts are evaluated and the production parameters of the machine that produces these parts are tried to be kept under control via CCs.
On the other hand, numerous works in the literature present supervised procedures using machine learning classifiers for anomaly detection and classification of appliances. The deep convolutional neural network component introduced in [25] identifies the nonperiodicity of electricity theft and the periodicity of normal electricity usage. In [26], anomaly detection is performed by using linear and non-linear regression methods by using artificial neural networks and an autoregressive integrated moving average model. The study [27] proposes deep learning algorithms that have the capability of removing seasonality and trend from the power profile data, while [28] proposes a model to identify and localize the detected anomalies by using a combination of neural network and K-means algorithms. In another study [29], a hybrid model using recurrent neural networks and quantitative regression is introduced to predict and detect abnormal power consumption. These methods detect anomalies as well as classify them with high accuracy, but a sufficient number of anomalous and anomaly-free power consumption data are needed for these methods.
As different from the literature, in AM-ADS, both unsupervised and supervised procedures based on CC and ANN methods are used for anomaly detection and/or classification. The advantages of AM-ADS compared to the studies in the literature are explained in the Introduction section.

3. Appliances

A typical living environment contains many home appliances. These appliances consist of active (motor, fan, etc.) and passive (heater, etc.) components. Each appliance may have several program modes offering different functionality and features, such as operation durations, energy consumptions, and more. They perform their functions by activating one or more of these components [30,31]. As a result, the power consumption of an appliance at any given moment is the aggregated consumption of all these currently activated components.
In AM-ADS, the set of appliances is represented by L and the set of program modes of an appliance a is represented by M a = { 1 , 2 , . . . | M a | } ( | M a | 1 ), while the operation duration of a program mode j M a of an appliance a is indicated by n a j which is discretized into prescribed uniform internal time slots, i.e, t ^ D a j = { 1 , 2 , , . . . , d a j } . Here, d a j = n a j Δ t where Δ t represents the length of each internal time slot t ^ . A power profile of an appliance a for a program mode j, i.e.,  P a j R d a j × 1 , is obtained as the view of its power consumption in the course of the operation. The set of appliances L can be divided into two subsets: variable power appliances (thus, P a j ( t ^ ) is time-varying) the set of which is represented by L v and fixed power appliances (thus, P a j ( t ^ ) has negligible variations in time) the set of which is represented by L f ). Note that, L = L f L v .
Note that, the power profiles of appliances with cooling and/or heating functions (washing machine, dishwasher, refrigerator, air conditioner and etc.) may be affected by environmental conditions (ambient, water temperature, etc.). For the rest, power profiles of a program mode of an appliance are similar at every operation. Any considerable difference in power profiles is considered as an early sign of an anomaly within an electrical component of the considered appliance or anomalous user usage.
Some of the most used household appliances and their most seen anomalies considered in this work are described below.

3.1. Refrigerator and Air Conditioner

Refrigerator (Ref) and Air Conditioner (AC) are multi-functional and variable power appliances with several electrical components, i.e., Ref, AC L v . Basic electrical components of Ref are the compressor, freezer fan, fresh food fan, and defrost heater, while those of AC are the compressor, outer unit fan, inside unit fan, and defrost heater. Power profiles of these appliances are dominated by the compressor since its power consumption is much more than that of other components. The compressor switches between on-off states periodically during the operation of the appliance. Hence, these compressor-containing appliances have periodic power profiles.
The most common component anomalies in Ref and AC are compressor anomalies and fan anomalies which affect power profiles of these appliances. As an example, power profiles of a Ref for anomaly-free and fresh food fan anomalous situations are given in Figure 1. As it is clear from the figure, the power consumption increases and becomes unstable in the anomaly situation.
On the other hand, Ref and AC may be subject to anomalous user usage. The most common user usage anomalies of AC are open room window and blocking filter anomalies, while those of Ref are open-door for a long time and overloading anomalies which affect the power profiles of these appliances. For example, high power consumption duration increases in the open-door anomaly situation since the compressor runs longer to cool inside when the door is open.

3.2. Washing Machine and Dishwasher

Washing Machine (WM) and DishWasher (DW) are also multi-functional and variable power appliances with several electrical components, i.e., WM, DW L v . Basic electrical components of WM are the heater, drum motor, and drain pump; while those of DW are the heater, circulation pump, and drain pump. Each of these components has significantly different power consumptions. Besides, these appliances have different program modes (such as long, express, regular and etc.) due to the laundry or dish to be washed. Therefore, power profiles of these appliances depend on activated program modes [30].
The most common component anomalies in WM and DW are heating element, drain pump, rotating part (for WM), and circulation motor (for DW) anomalies. The power profile of the long program mode of WM for anomaly-free and rotating part anomaly situations are given in Figure 2. As it is clear from the figure, the power consumption during the motor rotation (while the drain shaft is operating) increases due to the increase in mechanical losses (See Figure 3 for enlarged view).
On the other hand, WM and DW may be subject to user usage anomalies. The most common user usage anomalies of WM and DW are overloading and underloading. When WM is overloaded, the power consumption increases since the washer adds extra stress to the motor and the tub bearings.

3.3. Iron, Kettle, and Lamp

Iron, Kettle, and Lamp are single-functional (e.g., kettle, lighting, etc.) and fixed power appliances with a single active electrical component, i.e., Iron, Kettle, Lamp L f . In these appliances, belonging electrical components can have anomaly or long time operation can lead to anomalous situation. Power profiles of a Lamp for the anomaly-free situation and anomalous situation (some LEDs are broken) are given in Figure 4. As it is clear from the figure, power consumption of the Lamp decreases in the anomalous situation due to broken LEDs.

4. Technical Background

In this study, two different appliance anomaly detection methods based on Control Chart and Artificial Neural Networks are used for anomaly detection and/or classification. The background of these techniques will be explained in this section.

4.1. Statistical Process Control-Control Chart

Statistical Process Control (SPC) which is widely used in industrial applications and production processes, is a technique that uses statistical tools to analyze a process or its outputs to control, manage, and improve the quality of the output or the capability of the process [21]. Control Chart (CC) (or Shewhart chart) is the most effective tool of SPC to monitor the performance of the process and to detect unusual fluctuations that arise in the process [32].
In CC, measurements are taken regarding the parameter to be monitored and controlled in the process and the corresponding CC of these measurement data is created.
The most common statistically determined control limits for a data set X = { x 1 , x 2 , . . . , x n } used in CC are lower limit l c l i m x and upper limit u c l i m x which are calculated as follows [22]:
l c l i m X = μ X 3 σ X u c l i m X = μ X + 3 σ X
Here μ X is the mean and σ X is the standard deviation of X. The corresponding control interval of the data set X is determined as follows:
Δ c X = [ l c l i m X u c l i m X ]
If one member of a data set X is out of the determined control interval it is labeled as anomalous. According to the statistical knowledge [33], the probability of the output of an ordinary process falling outside this control interval is 0.27%.
As an example, in Figure 5, the output (colored blue) of a process, with its CC is represented. One output point of the process is out of the control interval, thus anomalous. Hence the health of the process must be examined.

4.2. Artificial Neural Network

Artificial Neural Network (ANN) which is a soft-computing tool that can learn patterns and predict, is applied to many engineering problems effectively because of its capability to provide fast, reliable, and accurate solutions to nonlinear problems easily.
ANN is organized in layers; such as an input layer, a number of hidden layer(s), and an output layer. These layers are made up of a number of interconnected nodes, namely neurons. The number of hidden layers and neurons in the layers may vary according to the problem studied. A typical feed-forward multilayered neural network, which consists of three layers such as an input layer (with n input nodes), one hidden layer (with m hidden nodes), and an output layer (with k output nodes), is given in Figure 6.
ANNs are trained by using training data sets until a predefined terminating condition is met for the error. Then the accuracy and performance of the trained ANN can be estimated by testing the data set.
BackPropagation Algorithm (BPA) is the most commonly used training algorithm for feed-forward multilayered ANNs. It is based on propagating the input in the forward direction and backpropagating the output in the backward direction by updating the weights correspondingly until a predefined terminating condition is met for the error. Detailed information about BPA can be found in [35,36].

5. Appliance Monitoring and Anomaly Detection System

In this study, an Appliance Monitoring and Anomaly Detection System (AM-ADS), which provides early detection and classification of anomalies in household appliances by utilizing both a new CC-based method and a new ANN-based method according to a rule-based procedure, is proposed. AM-ADS consists of the Main Controller (MC), a database, IoT-based communication units, home appliances, and power measurement units (smart plugs or special measurement equipments) mounted on appliances.
AM-ADS is based on the fact that for an appliance any anomaly in any component or anomalous user usage affects the power consumption characteristics of the considered appliance. Within this context, active power, power factor, and operation duration features of power profiles of appliances are considered as decisive control parameters in AM-ADS. CC-based method of AM-ADS uses upper-lower control limits and the corresponding control intervals of these parameters for detecting anomalies, while the ANN-based method of AM-ADS uses maximum, minimum, and mean values of these parameters for detecting and classifying anomalies.
AM-ADS procedure, whose flowchart is given in Figure 7, consists of data acquisition, working mode detection, power profile creation, program mode detection, data classification, and anomaly detection steps respectively. The general procedure applied to an appliance a is explained below.
Data acquisition: Power consumption of the appliance a is monitored during its operation and the smart plug connected to the appliance measures its active power ( p a ( t ^ ) ), voltage ( v a ( t ^ ) ), current ( i a ( t ^ ) ) and power factor ( p f a ( t ^ ) ), and sends these data to MC at each internal time slot t ^ .
Working Mode Detection: MC detects the working mode, i.e., on (operating), standby and off, of an appliance a due to the following rule:
W M o d e ( t ^ ) = O n , i f p a ( t ^ ) p s t d a , S t a n d b y , i f p a ( t ^ ) > 0 p a ( t ^ ) < p s t d a , O f f , i f p a ( t ^ ) = 0 ,
Here, p s t d a is the maximum stand-by power of appliance a.
Power profile creation: If a is operating, MC creates the power profile P a R d a × 1 and power factor vector P F a R d a × 1 of the appliance a for its operation duration d a , as follows
P a ( t ^ ) = p a ( t ^ ) t ^ { 0 , . . . , d a }
P F a ( t ^ ) = p f a ( t ^ ) t ^ { 0 , . . . , d a }
Note that, operation durations of some appliances (i.e., TV, lamp, kettle, iron and etc.) depend on user preferences, while that of some (i.e., WM, DW and etc.) depends on the running program mode. For example, active power evaluation of a Ref during a day is given in Figure 8.
Program Mode Detection: MC determines the program mode m a M a of the appliance by comparing the minimum and maximum values of the duration of its program modes with the present operation duration (length of the power profile).
m a = 1 , i f d a < = d m a x a 1 + d m i n a 2 2 , 2 , i f d a > d m a x a 1 + d m i n a 2 2 d a < d m a x a 2 + d m i n a 3 2 ; . . . . . . n , i f d a > = d m a x a n 1 + d m i n a n 2 ,
Here, d m a x a j and d m i n a j are the maximum and minimum operation durations of a program mode j M a , respectively.
Data classification: In AM-ADS, in order to make a precise analysis, members of power profiles of appliances are divided into parts, namely power modes, according to their values. The set of power modes of an appliance a is represented by P m a .
Variable power appliances a L v have three power modes such as l o w , m e d , h i g h , i.e.,  P m a = { l o w , m e d , h i g h } , while fixed power appliances a L f has only f i x power mode, i.e.,  P m a = { f i x }
For power mode i P m a and program mode j M a of a variable power appliance a L v , the power profile set, i.e.,  P i a j , the power factor set, i.e.,  P F i a j , and the duration parameter, i.e.,  d i a j , are constructed as follows:
P l o w a j = P a j ( i ) | min i P a j < P a j ( i ) < μ P a j + min i P a j 2 P F l o w a j = P F a j ( i ) | P a j ( i ) P l o w a j , i { 1 , 2 , . . , | P a j | }
with the size of d l o w a j =   | P l o w a j |   = | P F l o w a j | .
P m e d a j = P a j ( i ) | μ P a j + min i P a j 2 < P a j ( i ) < μ P a j + max i P a j 2 P F m e d a j = P F a j ( i ) | P a j ( i ) P m e d a j , i { 1 , 2 , . . , | P a j | }
with the size of d m e d a j =   | P m e d a j |   = | P F m e d a j | .
P h i g h a j = P a j ( i ) | μ P a j + max i P a j 2 < P a j ( i ) < max i P a j P F h i g h a j = P F a j ( i ) | P a j ( i ) P h i g h a j , i { 1 , 2 , . . , | P a j | }
with the size of d h i g h a j =   | P h i g h a j |   = | P F h i g h a j | .
For a fixed power appliance a L f , corresponding sets of program mode j M a are as follows:
P f i x a j = P f i x a j = P a j P F f i x a j = P F a j d f i x a j = d a j
For example, classified power profile of a Ref, whose power profile is given in Figure 8, is represented in Figure 9.
Anomaly detection: AM-ADS consists of two methods for detection and/or classification of anomalies: CC-based method that can detect anomalies when a limited number of historical power profiles is available and ANN-based method that can detect and classify anomalies when sufficient numbers of historical power profiles of each anomaly free and anomalous situations are available.
  • Control Chart method for Anomaly Detection (CC-AD):
    Anomaly control parameters considered in CC-AD are active power, power factor, and operation duration of power profiles. In this work, control intervals of these parameters are calculated according to Equation (2) for each power mode by using the historical anomaly-free power profiles.
    For program mode j M a and power mode i P m a of an appliance a L , control intervals of decisive parameters are defined as follows:
    Δ c P i a j : = [ l c l i m P i a j u c l i m P i a j ] is the power control interval where l c l i m P i a j / u c l i m P i a j represents lower/upper power control limit
    Δ c P F i a j : = [ l c l i m P F i a j u c l i m P F i a j ] is the power factor control interval where l c l i m P F i a j / u c l i m P F i a j represents lower/upper power factor control limit,
    Δ c D i a j : = [ l c l i m d i a j u c l i m d i a j ] is duration control interval where l c l i m d i a j / u c l i m d i a j represents lower/upper control limit of duration.
    If an appliance a L is anomaly-free, control parameters of its operation outputs satisfy the following three conditions by 99.7 % j M a and i P m a :
    i
    Each power value at each power mode of the present power profile is in the corresponding control interval:
    P i a j ( t ^ ) Δ c P i a j t ^ D i a j
    ii
    Each power factor value at each power mode of the present power profile is in the corresponding control interval:
    P F i a j ( t ^ ) Δ c P F i a j t ^ D i a j
    iii
    Duration of operation at each power mode of the present power profile is in the corresponding control interval:
    d i a j Δ c D i a j
    For the present operation of an appliance, if any control parameter of the corresponding power profile is out of the corresponding control interval, this means an anomalous situation.
    For example, CCs for m e d power mode of Ref, whose classified power profile is given in Figure 9, is given in Figure 10. As seen in the figure, some points of m e d power mode are out of the control interval of this mode. This indicates that there is an anomaly with one of the active components in this power mode.
  • ANN Method for Anomaly Detection and Classification (ANN-ADC):
    In ANN-ADC, feedforward ANNs with a single hidden layer trained by BPA are used for every appliance; however, the ANN of each appliance is specifically designed and has a different configuration. Configured appliance ANNs are trained by historical power profiles of anomaly-free and anomalous situations. Hence, for training, a sufficient number of historical power profiles of each situation must be available in the database to apply ANN-ADC.
    For each power mode, maximum, minimum, and mean values of active power, as well as power factor and the operation duration are fixed inputs of appliance ANNs. Thus, the input layer of ANN of each appliance a L has | M a | number of input nodes for representing the active program mode j ^ M a and also has | P m a | × 7 number of input nodes assigned to the 7 characteristics of the output of the operation for every power mode i P m a of the present program mode j ^ . That is, maximum amplitude in P i a j ^ ( P i m a x a j ^ ), mean amplitude of P i a j ^ ( P i m e a n a j ^ ), minimum amplitude in P i a j ^ ( P i m i n a j ^ ), maximum amplitude in P F i a j ^ ( P F i m a x a j ^ ), mean amplitude of P F i a j ^ , ( P F i m e a n a j ^ ), minimum amplitude in P F i a j ^ ( P F i m i n a j ^ ) and the operation duration d i a j ^ . Hence, every ANN has | P m a | × 7 + M a number of unchanged input nodes. If the power profile of a is affected by the season (i.e., Ref, AC, kettle, WM, DW), its ANN model has 1 more input node, such as | P m a | × 7 + M a + 1 .
    The output layer of appliance ANNs presents anomaly types of the corresponding appliance by 1 and 0 which specify whether the corresponding anomaly has occurred or not, respectively. The number of output nodes of an ANN depends on the anomaly types defined for the appliance it belongs to. Hidden layers of appliances are designed experimentally due to the training performance of designed ANNs.
    For example, the lamp is a fixed power appliance (i.e., it has only one power mode) and its power profile is independent of the season, therefore ANN model of lamp (lamp-ANN) has seven input nodes ( P m a x l a m p , P m i n l a m p , P m e a n l a m p , P F m a x l a m p , P F m i n l a m p , P F m e a n l a m p , d l a m p ). On the other hand, the lamp has two anomaly types, such as, led element and long time operation anomalies. Consequently, the lamp-ANN configuration consists of three output nodes representing long-time operation and component anomalous situations and anomaly-free situation. The hidden layer of this ANN is configured with 6 hidden neurons due to the training performance.
    As another example, the ANN of Ref (Ref-ANN) has 22 input nodes, since Ref has 3 power modes and its power profile is affected by the season, and has 6 output nodes since 5 types of anomaly are considered for Ref. It is configured with 20 hidden nodes due to the training performance. When the extracted features of the power profile given in Figure 1 are applied, the ANN results in a Fresh Food Fan anomaly as expected.
    In Table 1, anomaly types and the corresponding ANN configurations are given for the most used appliances.
  • Result evaluation: If an anomaly is detected by the CC-AD method or detected and classified by the ANN-ADC method, it is reported to the home user and also technical service and/or energy provider (depending on the type of anomaly). If no anomaly is detected at the considered power profile, it is stored in the database as a historical anomaly-free power profile, and the corresponding control intervals are updated accordingly; otherwise, it is stored as an anomalous power profile with its anomaly type if it is known.
The corresponding algorithm of the AM-ADS procedure is given as the AM-ADS algorithm (Algorithm 1) which calls the CC-AD Algorithm (Algorithm 2) if a limited number of historical power profiles are available and ANN-ADC Algorithm (Algorithm 3) when sufficient numbers of historical anomalous and anomaly free power profiles are available.
Algorithm 1: AM-ADS Algorithm
Data: a, P a , P F a , s e a s o n
Result: Normal operation or detected anomaly
Sensors 22 06639 i001
Algorithm 2: CC-AD Algorithm
Input: a, P a , P F a , P i a , P F i a , s e a s o n , P m i n , P m e a n , P m a x , P F m i n , P F m e a n , P F m a x , P i a m i n , P i a m e a n , P i a m a x , P F i a m i n , P F i a m e a n , P F i a m a x , D a , D i a ,x, x i , i { l o w , m e d i u m , h i g h } ;
Output: Normal operation or detected anomaly
Sensors 22 06639 i002
Algorithm 3: ANN-ADC Algorithm
Input: a, s e a s o n , P m i n , P m e a n , P m a x , P F m i n , P F m e a n , P F m a x , P i a m i n , P i a m e a n , P i a m a x , P F i a m i n , P F i a m e a n , P F i a m a x , D a , D i a , x, x i , P M j a , i { l o w , m e d i u m , h i g h } ;
Output: Normal operation or detected anomaly
Sensors 22 06639 i003

6. Case Study and Discussion

For analysing the reliability and performance of the proposed AM-ADS system, several experiments and simulation studies were carried out. In the experiments, the most common home appliances (i.e., Ref, AC, WM, DW, kettle, lamp, and iron) with their most common anomaly types are considered (see Table 1).
In order to generate the power profiles of appliances for experiments, various anomalies were created in the laboratory environment. Power profiles of component-based anomalies were created by intervening in the mechanics or structure of the components, such that distorting the shaft eccentricity, blocking the fan blades, blocking the drain pipe and etc. User usage anomalies were created by realizing anomalous user usage, such that opening the door for a long time, blocking the filter of AC, overloading Ref, WM, DW and etc.
For appliances with multiple program modes (such as WM and DW), anomalous and anomaly-free operations were repeated for each program mode. For appliances that are affected by environmental factors (Ref, AC, WM, DW, and kettle) these operations were carried out repeatedly in both summer and winter seasons as well.
In order to demonstrate the performance of applied methods, an appropriate diagnostic test is applied to the results of experiments. Although the detection of anomalies in the appliances has previously stopped a minor issue from becoming overwhelming, the first goal of an anomaly testing system is to correctly diagnose the anomalous event. Therefore, the accuracy metrics to be used are important in evaluating the results of anomaly detection. The metrics to be used in this study are given below.
  • a c c u r a c y represents the percentage of correctly detecting the values and is calculated as follows:
    a c c u r a c y = t p + t n t p + f p + t n + f n
    Here, t p describes true positives (number of correct detection of anomalous cycles), f p explains false positives (number of false detection of a normal cycle as anomalous), t n defines true negatives (number of true detection of normal cycles), and f n expresses false negatives (number of false detection of an anomalous cycle as normal).
  • s p e c i f i c i t y refers to the probability of a negative test.
    s p e c i f i c i t y = t n t n + f p
  • F 1 s c o r e is specific to anomaly detection methods and varies in the range [0 1]. The higher the score, the better the performance of the algorithm. The per-class value of F 1 - s c o r e is
    F 1 s c o r e = 2 × p r e c i s i o n × r e c a l l p r e c i s i o n + r e c a l l
    where p r e c i s i o n = t p t p + f p and r e c a l l = t p t p + f n
In the case of multi-class classification, averaging techniques are applied to F 1 s c o r e calculation, resulting in different averaged scores as macro, weighted and micro averaged F 1 s c o r e s [37,38,39].
  • Macro-Averaging: The macro-averaged F 1 s c o r e is calculated by Equation (12) while p r e c i s i o n = i = 1 m t p i t p i + f p i m and r e c a l l = i = 1 m t p i t p i + f n i m . Here, m is the number of classes; t p i , f p i and f n i are the number of true positives, false positives and false negatives of class i respectively. So, the macro-averaged F 1 s c o r e is the arithmetic mean of all the per-class F 1 s c o r e .
  • Weighted-Averaging: The weighted-averaged F 1 s c o r e is calculated by Equation (12) while p r e c i s i o n = i = 1 m κ i × t p i t p i + f p i and r e c a l l = i = 1 m κ i × t p i t p i + f n i . Here, κ i = n i n is the weighting coefficient, where n i is the number of individual samples labeled by i t h class, n is the total number of samples. So, the weighted-averaged F 1 s c o r e takes the mean of all per-class F 1 s c o r e while considering the number of actual occurrences of the class in the dataset.
  • Micro-Averaging: The micro-averaged F 1 s c o r e is calculated by Equation (12) while p r e c i s i o n = i = 1 m ( t p i ) i = 1 m ( t p i + f p i ) , r e c a l l = i = 1 m ( t p i ) i = 1 m ( t p i + f n i ) . So, the micro-averaged F 1 s c o r e computes a global average F 1 s c o r e by counting the sums of the true positives, false negatives, and false positives.
Note that, in the case of an imbalanced dataset where all classes are equally important, it is wise to use macro-averaged F 1 s c o r e . Hence, in the proposed AM-ADS that treats all classes equally, macro-averaged F 1 - s c o r e is considered for performance evaluation.
Let we consider WM experiments in detail. A 7 kg front-load WM with 3 basic program modes; such as, M W M = { r e g u l a r ( 1 ) , l o n g ( 2 ) , e x p r e s s ( 3 ) } , are used in these experiments. The power profile of the anomaly-free WM operating at program mode 2 is given in Figure 11a and its CC is given in Figure 11b.
For the CC-AD method, CC parameters of program mode 2 of WM for winter are given in Table 2. In winter, parameters of normally operating WM at program mode 2, P i W M 2 , P F i W M 2 , D i W M 2 vary within the control intervals Δ c P i W M 2 Δ c P F i W M 2 Δ c D i W M 2 i P m a during its operation.
The power profile of an anomalous WM operating at the long program mode is represented in Figure 12a and its CC is given in Figure 12b. As seen in the figure, some power values measured in the m e d power mode are out of the control interval which indicates anomalous operation.
The confusion matrix of the CC-AD method obtained by 80 WM experiments is given in Figure 13a. According to this matrix, a c c u r a c y is 95.00%, s p e c i f i c i t y is 1.00, p r e c i s i o n is 0.94, and r e c a l l is 0.96 and F 1 s c o r e is 94.79% in WM experiments using CC-AD method. s p e c i f i c i t y = 1 means that WM would not be erroneously classified as anomalous.
When it comes to the ANN-ADC method, the input layer of WM-ANN (Figure 14) has M W M = 3 number of input nodes for representing the active program mode and has | P m W M | × 7 = 21 number of input nodes assigned to the 7 characteristics of the power profile for every power mode P m W M , and 1 input node representing the season (0 or 1 representing winter or summer). The output layer of WM-ANN has 6 nodes representing anomaly-free situations and Heater (Anomaly 1), Rotating part (Anomaly 2), Drain pump (Anomaly 3), Underloading (Anomaly 4), and Overloading (Anomaly 5) anomalies.
For the experiments of the ANN-ADC method, about 75% of the created power profiles in a laboratory environment are used for training while about 25% of them are used for testing.
The confusion matrix of the ANN-ADC method obtained by 240 experiments is given in Figure 13b. By using this confusion matrix, a c c u r a c y , p r e c i s i o n , r e c a l l and F 1 s c o r e values of each anomaly class are calculated and given in Table 3. The overall accuracy of detecting the anomalies of WM by using the ANN-ADC method is 98.89%. The proposed method can detect component-related anomalies without error. F 1 s c o r e s of anomaly classes vary in 89.50%–100%. The averaged F 1 s c o r e s are between 96.67% and 96.93%, while the macro-avg. F 1 s c o r e , which we took into account, is found to be 96.93%. As seen in the table, Anomaly 4 of WM has the lowest F 1 s c o r e (89.50%). Because some power profiles with Anomaly 4 are very similar to those of an anomaly-free WM, AM-ADS is more likely to classify them as anomaly free.
In order to evaluate the performance of AM-ADS, CC-AD and ANN-ADC methods are performed both separately and as a hybrid. In the hybrid case, only anomaly detection is performed, such that both ANN-ADC and CC-ADC methods are examined for each power profile, and the results are labeled as anomaly and anomaly-free regardless of the anomaly class determined by the ANN-ADC method.
In Table 4, a c c u r a c y and F 1 s c o r e values of CC-AD, ANN-ADC, and hybrid methods are given for all appliances. As seen from the table, the CC-AD method, which is examined with a limited number (40 to 70) of power profiles, provides F 1 s c o r e s between 93.45% and 98.79% for anomaly detection of appliances; the ANN-ADC method, which is examined with a numerous number of power profiles (200 to 280) provides F 1 s c o r e s in between 95.65% and 99.15% for anomaly detection and classification; while the hybrid approach provides F 1 s c o r e s between 94.22% and 98.92% for anomaly detection when the same power profiles as in ANN-ADC experiments are used. According to these results, as it is expected, anomaly detection performance of the hybrid method is better than the anomaly detection performance of CC-AD and worse than the anomaly classification performance of ANN-ADC.

7. Conclusions

Contemporary advancements in IoT technology increased the number of works on many new technologies that facilitate daily human life. One of these technologies still being studied is the early detection of appliance anomalies. In this work, a novel and realistic Appliance Monitoring and Anomaly Detection System, namely AM-ADS, based on appliance level power monitoring for anomaly detection and classification is presented.
In AM-ADS, active power, power factor, and operation duration features are extracted from power profiles of appliances and they are considered as decisive control parameters for anomaly detection and/or classification and analyzed by using two newly developed methods, thus CC-AD method and ANN-ADC method, according to the rule-based AM-ADS procedure.
CC-AD method is used for the cases that a limited number of historical power profile data is available and defines upper-lower control limits and the corresponding control intervals of these parameters to detect an anomaly. To the best of the author’s knowledge, a CC-based method is used for anomaly detection of appliances for the first time in the literature.
ANN-based anomaly detection and classification method is used for the cases that a sufficient number of historical power profiles of each anomaly-free and anomalous situations are available. In this method, the ANN model of each appliance is specifically designed, and the maximum, minimum and mean values of decisive control parameters are defined as the inputs of the ANN models to detect and also classify anomalies. ANN-ADC method provides a much more diverse and comprehensive anomaly classification compared to similar works in the literature as it can detect not only user usage anomalies but also component anomalies.
The major advantage of AM-ADS is detecting anomalies regardless of the number of historical power profile data since both supervised and unsupervised methods are used according to the circumstances. AM-ADS provides very high accurate results; such that, the CC-AD method used when a limited number of historical data is available detects anomaly with 94.56%–99.03% accuracy; while the ANN-ADC method used when a sufficient number of historical power profiles is available detects and classifies anomaly with 96.34%–99.45% accuracy. On the other hand, since AM-ADS uses decisive parameters of power profiles of appliances for detecting and/or classifying anomalies, every appliance, whose power profile can be monitored, can be included in AM-ADS. By foreseeing faults in appliances before they occur, AM-ADS can help to avoid increased power consumption, decreased durability, and serious safety problems. AM-ADS can also act as a useful tool for manufacturers and service organizations for the assessment of the durability of home appliances. Moreover, integrating AM-ADS in manufacturers’ R&D activities can support the potential implementations contributing to the prevention of premature obsolescence of home appliances.
As future directions of this work, different learning methods (i.e., k-means, density-based spatial clustering ) and devices other than home appliances will be integrated into AM-ADS. Furthermore, it is planned to design a rule-based control system that interferes (via interrupting or stopping) with the operation of appliances according to some specific criteria depending on the nature of the detected anomaly and the safety problems it may cause.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author, Hanife Apaydin-Özkan, upon reasonable request.

Acknowledgments

The author would like to thank Zedrive Elektronik Motor San ve Tic A.S for the loan of measurement equipments and preparing anomolous home appliances.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
aappliance
ACAir conditioner
AM-ADSAppliance Monitoring and Anomaly Detection System
ANNArtificial Neural Networks
ANN-ADCANN Method for Anomaly Detection and Classification
BPABackPropagation Algorithm
CCControl Chart
CC-ADControl Chart method for Anomaly Detection
d m a x a j maximum operation duration of the program mode j of appliance a
d m i n a j minimum operation duration of the program mode j of appliance a
D a j operation duration of program mode j of the appliance a
DWDishwasher
IoTInternet of Things
L set of appliances
L f set of fixed power appliances
L v set of variable power appliances
l c l i m P i a j lower control limit of P a j
l c l i m P F i a j lower control limit of P F a j
l c l i m d i a j lower control limit of d i a j
M a set of program modes of the appliance a
MCMain Controller
P a j ( t ^ ) power consumption of j t h program mode of the appliance a at t ^
P i a j set of power profiles of power mode i of j t h program mode of the appliance a
p s t d a maximum stand-by power of the appliance a
P F i a j set of power factors of power mode i of j t h program mode of the appliance a
P m a set of power modes of the appliance a
RefRefrigerator
SPCStatistical Process Control
u c l i m P i a j upper power control limit for CC of P i a j
u c l i m P F i a j upper power factor control limit for CC of P F i a j
u c l i m d i a j upper control limit of duration for CC of d i a j
WMWashing machine
t ^ internal time slot
Δ c D i a j duration control interval of D a j
Δ c P i a j power control interval of P i a j
Δ c P F i a j power factor control interval of P F i a j

References

  1. Himeur, Y.; Ghanem, K.; Alsalemi, A.; Bensaali, F.; Amira, A. Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives. Appl. Energy 2021, 287, 116601. [Google Scholar] [CrossRef]
  2. Ul Alam, M.A.; Roy, N.; Petruska, M.; Zemp, A. Smart-energy group anomaly based behavioral abnormality detection. In Proceedings of the 2016 IEEE Wireless Health (WH), Bethesda, MD, USA, 25–27 October 2016; pp. 1–8. [Google Scholar] [CrossRef]
  3. Zhou, Z.; Xiang, Y.; Xu, H.; Yi, Z.; Shi, D.; Wang, Z. A Novel Transfer Learning-Based Intelligent Nonintrusive Load-Monitoring With Limited Measurements. IEEE Trans. Instrum. Meas. 2021, 70, 1–8. [Google Scholar] [CrossRef]
  4. Azizi, E.; Beheshti, M.T.H.; Bolouki, S. Event Matching Classification Method for Non-Intrusive Load Monitoring. Sustainability 2021, 13, 693. [Google Scholar] [CrossRef]
  5. Ghosh, S.; Chatterjee, A.; Chatterjee, D. An Improved Load Feature Extraction Technique for Smart Homes Using Fuzzy-Based NILM. IEEE Trans. Instrum. Meas. 2021, 70, 1–9. [Google Scholar] [CrossRef]
  6. Rehman, A.U.; Lie, T.T.; Vallès, B.; Tito, S.R. Event-Detection Algorithms for Low Sampling Nonintrusive Load Monitoring Systems Based on Low Complexity Statistical Features. IEEE Trans. Instrum. Meas. 2020, 69, 751–759. [Google Scholar] [CrossRef]
  7. Rashid, H.; Singh, P. Energy Disaggregation for Identifying Anomalous Appliance. In Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments (BuildSys ’17), Delft, The Netherlands, 8–9 November 2017; Association for Computing Machinery: New York, NY, USA, 2017. [Google Scholar] [CrossRef]
  8. Lai, Y.H.; Tsai, I.J.; Chiu, C.Y.; Lai, C.F. Non-Intrusive Load Monitoring applied in energy efficiency of the smart manufacturing industry: A case of air-conditioner. In Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE), New Taipei, Taiwan, 18–22 August 2014; pp. 1127–1132. [Google Scholar] [CrossRef]
  9. Batra, N.; Singh, A.; Whitehouse, K. If You Measure It, Can You Improve It? Exploring The Value of Energy Disaggregation. In Proceedings of the 2nd ACM International Conference on Embedded Systems for Energy-Efficient Built Environments (BuildSys ’15), Seoul, Korea, 4–5 November 2015; Association for Computing Machinery: New York, NY, USA, 2015; pp. 191–200. [Google Scholar] [CrossRef]
  10. Tekler, Z.D.; Low, R.; Zhou, Y.; Yuen, C.; Blessing, L.; Spanos, C. Near-real-time plug load identification using low-frequency power data in office spaces: Experiments and applications. Appl. Energy 2020, 275, 115391. [Google Scholar] [CrossRef]
  11. Gao, J.; Kara, E.C.; Giri, S.; Bergés, M. A feasibility study of automated plug-load identification from high-frequency measurements. In Proceedings of the 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP), Orlando, FL, USA, 14–16 December 2015; pp. 220–224. [Google Scholar] [CrossRef]
  12. Abubakar, I.; Khalid, S.; Mustafa, M.; Shareef, H.; Mustapha, M. Application of load monitoring in appliances’ energy management—A review. Renew. Sustain. Energy Rev. 2017, 67, 235–245. [Google Scholar] [CrossRef]
  13. Tekler, Z.D.; Low, R.; Blessing, L. Using smart technologies to identify occupancy and plug-in appliance interaction patterns in an office environment. IOP Conf. Ser. Mater. Sci. Eng. 2019, 609, 062010. [Google Scholar] [CrossRef]
  14. Yeckle, J.; Tang, B. Detection of Electricity Theft in Customer Consumption Using Outlier Detection Algorithms. In Proceedings of the 2018 1st International Conference on Data Intelligence and Security (ICDIS), South Padre Island, TX, USA, 8–10 April 2018; pp. 135–140. [Google Scholar] [CrossRef]
  15. Izakian, H.; Pedrycz, W. Anomaly detection in time series data using a fuzzy c-means clustering. In Proceedings of the 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS), Edmonton, AB, Canada, 24–28 June 2013; pp. 1513–1518. [Google Scholar] [CrossRef]
  16. Chalapathy, R.; Menon, A.K.; Chawla, S. Anomaly Detection using One-Class Neural Networks. arXiv 2018, arXiv:1802.06360. [Google Scholar]
  17. Capozzoli, A.; Piscitelli, M.S.; Brandi, S.; Grassi, D.; Chicco, G. Automated load pattern learning and anomaly detection for enhancing energy management in smart buildings. Energy 2018, 157, 336–352. [Google Scholar] [CrossRef]
  18. Yijia, T.; Hang, G. Anomaly detection of power Consumption based on waveform feature recognition. In Proceedings of the 2016 11th International Conference on Computer Science Education (ICCSE), Nagoya, Japan, 23–25 August 2016; pp. 587–591. [Google Scholar] [CrossRef]
  19. Rashid, H.; Batra, N.; Singh, P. Rimor: Towards Identifying Anomalous Appliances in Buildings. In Proceedings of the 5th Conference on Systems for Built Environments (BuildSys ’18), Shenzen, China, 7–8 November 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 33–42. [Google Scholar] [CrossRef]
  20. Zhang, C.; Song, D.; Chen, Y.; Feng, X.; Lumezanu, C.; Cheng, W.; Ni, J.; Zong, B.; Chen, H.; Chawla, N.V. A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data. Proc. AAAI Conf. Artif. Intell. 2019, 33, 1409–1416. [Google Scholar] [CrossRef]
  21. Ng, J.J. Statistical Process Control Chart as a Project Management Tool. IEEE Eng. Manag. Rev. 2018, 46, 26–28. [Google Scholar] [CrossRef]
  22. Wild, C.; Seber, G. Chance Encounters: A First Course in Data Analysis and Inference; Wiley: Hoboken, NJ, USA, 1999. [Google Scholar]
  23. Colosimo, B.M.; Pacella, M. A comparison study of control charts for statistical monitoring of functional data. Int. J. Prod. Res. 2010, 48, 1575–1601. [Google Scholar] [CrossRef]
  24. Wu, Z.; Shamsuzzaman, M. Design and application of integrated control charts for monitoring process mean and variance. J. Manuf. Syst. 2005, 24, 302–314. [Google Scholar] [CrossRef]
  25. Zheng, Z.; Yang, Y.; Niu, X.; Dai, H.N.; Zhou, Y. Wide and Deep Convolutional Neural Networks for Electricity-Theft Detection to Secure Smart Grids. IEEE Trans. Ind. Inform. 2018, 14, 1606–1615. [Google Scholar] [CrossRef]
  26. Wang, X.; Ahn, S.H. Real-time prediction and anomaly detection of electrical load in a residential community. Appl. Energy 2020, 259, 114145. [Google Scholar] [CrossRef]
  27. Hollingsworth, K.; Rouse, K.; Cho, J.; Harris, A.; Sartipi, M.; Sozer, S.; Enevoldson, B. Energy Anomaly Detection with Forecasting and Deep Learning. In Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA, 10–13 December 2018; pp. 4921–4925. [Google Scholar] [CrossRef]
  28. Chahla, C.; Snoussi, H.; Merghem-Boulahia, L.; Esseghir, M. A Novel Approach for Anomaly Detection in Power Consumption Data. In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods, Seattle, WA, USA, 10–13 December 2018. [Google Scholar] [CrossRef]
  29. Xu, C.; Chen, H. Abnormal energy consumption detection for GSHP system based on ensemble deep learning and statistical modeling method. Int. J. Refrig. 2020, 114, 106–117. [Google Scholar] [CrossRef]
  30. Özkan, H.A. Appliance based control for Home Power Management Systems. Energy 2016, 114, 693–707. [Google Scholar] [CrossRef]
  31. Izmitligil, H.; Özkan, H.A. A home power management system using mixed integer linear programming for scheduling appliances and power resources. In Proceedings of the 2016 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe), Ljubljana, Slovenia, 9–12 October 2016; pp. 1–6. [Google Scholar] [CrossRef]
  32. Aykroyd, R.G.; Leiva, V.; Ruggeri, F. Recent developments of control charts, identification of big data sources and future trends of current research. Technol. Forecast. Soc. Chang. 2019, 144, 221–232. [Google Scholar] [CrossRef]
  33. Gomes, I.C.; Mingoti, S.A.; Oliveira, C.D.L. A novel experience in the use of control charts for the detection of nosocomial infection outbreaks. Clinics 2011, 66, 1681–1689. [Google Scholar] [CrossRef] [PubMed]
  34. Rakuša, S. Business Process Improvement Using Lean Six Sigma: An Example of Improving the Onboarding Process. Ph.D. Dissertation, Faculty of Social Sciences, University of Ljubljana, Ljubljana, Slovenia, 2016. [Google Scholar]
  35. Okut, H. Bayesian regularized neural networks for small n big p data. In Artificial Neural Networks: Models and Applications; InTechOpen: London, UK, 2016; pp. 28–48. [Google Scholar]
  36. da Silva, I.N.; Spatti, D.H.; Flauzino, R.A.; Liboni, L.H.B.; Franco, S. Artificial Neural Networks, A Practical Course; Springer: Berlin/Heidelberg, Germany, 2017. [Google Scholar]
  37. Haixiang, G.; Yijing, L.; Shang, J.; Mingyun, G.; Yuanyue, H.; Bing, G. Learning from class-imbalanced data: Review of methods and applications. Expert Syst. Appl. 2017, 73, 220–239. [Google Scholar] [CrossRef]
  38. Low, R.; Cheah, L.; You, L. Commercial Vehicle Activity Prediction With Imbalanced Class Distribution Using a Hybrid Sampling and Gradient Boosting Approach. IEEE Trans. Intell. Transp. Syst. 2021, 22, 1401–1410. [Google Scholar] [CrossRef]
  39. Fernández, A.; García, S.; Galar, M.; Prati, R.C.; Krawczyk, B.; Herrera, F. Imbalanced Classification with Multiple Classes. In Learning from Imbalanced Data Sets; Springer International Publishing: Cham, Switzerland, 2018; pp. 197–226. [Google Scholar] [CrossRef]
Figure 1. Power profiles of Ref with /without anomaly.
Figure 1. Power profiles of Ref with /without anomaly.
Sensors 22 06639 g001
Figure 2. Power profiles of WM with/without anomaly.
Figure 2. Power profiles of WM with/without anomaly.
Sensors 22 06639 g002
Figure 3. Enlarged view of power profiles of WM with/without anomaly.
Figure 3. Enlarged view of power profiles of WM with/without anomaly.
Sensors 22 06639 g003
Figure 4. Power profiles of a lamp for anomalous and anomaly-free situations.
Figure 4. Power profiles of a lamp for anomalous and anomaly-free situations.
Sensors 22 06639 g004
Figure 5. CC of the output of a process [34].
Figure 5. CC of the output of a process [34].
Sensors 22 06639 g005
Figure 6. ANN-General.
Figure 6. ANN-General.
Sensors 22 06639 g006
Figure 7. The flowchart of AM-ADS procedure.
Figure 7. The flowchart of AM-ADS procedure.
Sensors 22 06639 g007
Figure 8. Power profile of a Ref.
Figure 8. Power profile of a Ref.
Sensors 22 06639 g008
Figure 9. The classified power profile of a Ref.
Figure 9. The classified power profile of a Ref.
Sensors 22 06639 g009
Figure 10. Control limits of a Ref for m e d power mode.
Figure 10. Control limits of a Ref for m e d power mode.
Sensors 22 06639 g010
Figure 11. Power profile and CC of an anomaly-free WM.
Figure 11. Power profile and CC of an anomaly-free WM.
Sensors 22 06639 g011
Figure 12. Power profiles and CC of an overloaded WM.
Figure 12. Power profiles and CC of an overloaded WM.
Sensors 22 06639 g012
Figure 13. Confusion matrix of WM experiments (a) via CC-AD/(b) via ANN-ADC.
Figure 13. Confusion matrix of WM experiments (a) via CC-AD/(b) via ANN-ADC.
Sensors 22 06639 g013
Figure 14. WM-ANN model.
Figure 14. WM-ANN model.
Sensors 22 06639 g014
Table 1. Anomaly types and the ANN configurations of some appliances.
Table 1. Anomaly types and the ANN configurations of some appliances.
ApplianceComponent AnomaliesUser Usage Anomalies n i - n h - n o
WMHeaterRotating partsDrain pumpUnderloadOverload25-22-6
DWHeaterCirculation motorDrain pumpUnderloadOverload25-22-6
RefCompressorFRFFFFOpen doorOverload22-20-6
ACCompressorInterior fanOuter fanOpen window/doorBlocking filter22-20-6
KettleHeater/Thermostat Long time operation 7-6-3
LampLed Long time operation 7-6-3
Table 2. Control intervals of CC-AD method for program mode 2 of WM
Table 2. Control intervals of CC-AD method for program mode 2 of WM
Low power mode control intervals for program mode 2
Δ c P l o w W M 2 = [ l c l i m P l o w W M 2 u c l i m P l o w W M 2 ] [0.69   10.16]
Δ c P F l o w W M 2 = [ l c l i m P F l o w W M 2 u c l i m P F l o w W M 2 ] [0.4646   0.5851]
Δ c d l o w W M 2 = [ l c l i m d l o w W M 2 u c l i m d l o w W M 2 ] [36.88   39.54]
Medium power mode control intervals for program mode 2
Δ c P m e d W M 2 = [ l c l i m P m e d W M 2 u c l i m P m e d W M 2 ] [95.86   235.24]
Δ c P F m e d W M 2 = [ l c l i m P F m e d W M 2 u c l i m P F m e d W M 2 ] [0.6446   0.7525]
Δ c d m e d W M 2 = [ l c l i m d m e d W M 2 u c l i m d m e d W M 2 ] [71.93   74.57]
High power mode control intervals for program mode 2
Δ c P h i g h W M 2 = [ l c l i m P h i g h W M 2 u c l i m P h i g h W M 2 ] [1661.80   2029.00]
Δ c P F h i g h W M 2 = [ l c l i m P F h i g h W M 2 u c l i m P F h i g h W M 2 ] [0.9701   0.9999]
Δ c d h i g h W M 2 = [ l c l i m d h i g h W M 2 u c l i m d h i g h W M 2 ] [30.85   33.73]
Table 3. Performance metrics of WM-ANN.
Table 3. Performance metrics of WM-ANN.
Class Accuracy Precision Recall F 1 Score
Anomaly free96.67%0.881.0093.75%
Anomaly 1100.00%1.001.00100.00%
Anomaly 2100.00%1.001.00100.00%
Anomaly 399.58%1.000.9798.59%
Anomaly 497.08%1.000.8189.50%
Anomaly 5100.00%1.001.00100.00%
Micro-avg.98.89%0.96670.966796.67%
Macro-avg.98.89%0.98040.963096.93%
Weighted-avg.98.89%0.97060.966796.86%
Table 4. Performance metrics of all appliances.
Table 4. Performance metrics of all appliances.
Appliance Accuracy Accuracy F 1 Score F 1 Score F 1 Score
CC-ADANN-ADCCC-ADANN-ADCHybrid
Washing machine95.00%98.89%94.79%96.93%95.53%
Dishwasher97.12%98.97%95.65%97.10%96.04%
Refrigerator96.25%99.09%96.78%98.14%97.29%
Air conditioner94.56%96.34%93.45%95.65%94.22%
Kettle97.98%98.14%97.30%97.45%97.42%
Lamp99.03%99.45%98.79%99.15%98.92%
Overall97.14%98.34%96.21%97.40%96.74%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Apaydin-Özkan, H. Appliance-Level Anomaly Detection by Using Control Charts and Artificial Neural Networks with Power Profiles. Sensors 2022, 22, 6639. https://doi.org/10.3390/s22176639

AMA Style

Apaydin-Özkan H. Appliance-Level Anomaly Detection by Using Control Charts and Artificial Neural Networks with Power Profiles. Sensors. 2022; 22(17):6639. https://doi.org/10.3390/s22176639

Chicago/Turabian Style

Apaydin-Özkan, Hanife. 2022. "Appliance-Level Anomaly Detection by Using Control Charts and Artificial Neural Networks with Power Profiles" Sensors 22, no. 17: 6639. https://doi.org/10.3390/s22176639

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop