1. Introduction
During the last decade, the development of smart grids (SGs) has increased exponentially empowered by the benefits of renewable energy resources [
1]. Control and optimization strategies, together with communication systems integrated to the conventional electrical distribution systems, represent the cornerstone for the adoption of the SG concept [
2]. One of the new desired functionalities and requirements of SG is the implementation of demand-side management programs such as Demand Response (DR), which basically consist of the incorporation of distribution system automation techniques for load control, allowing the reduction of energy consumption during critical operating times. This benefits not only the final user, by reducing its energy costs, but also the Local Distribution Companies (LDCs), by reducing the peak load, reshaping load profiles, and increasing system sustainability [
3]. Furthermore, an additional indirect benefit of DR programs is the deferral of investments in both the transmission and distribution systems expansion and the construction of new generating plants.
DR allows end users to actively participate in the electricity markets by offering their load reductions in response to signals sent by the LDCs requesting load management. Traditionally, these requests were focused on the industrial and commercial sectors because of the magnitude of their loads; nevertheless, owing to the full deployment of the advanced metering infrastructure in some countries, residential users have emerged as new DR service providers and the LCDs are now searching for new tools, programs, or incentives to increase their responsiveness. The main challenge at this point is to develop “smart” control devices, deployed at the residential end-user premises, with embedded software capable of receiving, interpreting, and analyzing different types of input signals with the purpose of performing appropriate control actions over a set of predefined controllable loads, requiring little or no human intervention. These devices, commonly termed to as energy management systems or Home Energy Management Systems (HEMS), must be able to produce win-win scenarios for both the end users and the LDCs in terms of cost, comfort, and system reliability. However, there are important factors that must be considered: (1) electricity prices are not the only drivers affecting DR participation rates, e.g., residential customers do not want to spend time acquiring the necessary expertise to analyze consumption patterns and control decisions to micromanage household devices to save money [
4]; (2) the HEMS are time-restricted for producing the necessary operational decisions; (3) the on-site renewable energy availability; (4) the users preferences and their activity inside the house; etc.
In this context, several approaches have proposed the development of a variety of such devices embedding a diversity of control strategies for load management. A useful and comprehensive review of the modeling approaches and the complexity of previously proposed HEMS is presented in [
5]. Emphasis is given to the most important factors that influence HEMS operations and outcomes such as tariff structure offered by the LCDs, controllable devices, uncertainties, multi-objective nature and the associated solution methods, on-site renewable energy generation (PV/Wind), and battery/energy storage devices. Similarly, the significance of embedding renewables into HEMS is exposed in [
6] when analyzing the trends of the development of renewable residential resources and the satisfactory results that have been reported, motivating the continuous research in this field. For instance, a model for cost minimization considering the price to sell local generation energy, models of appliances, and a thermal model of the house is presented in [
7]. Results reported highlight the advantages of the on-site generation. The economics of providing peak shaving with DR using various storage technologies is evaluated in [
8]. Based on the favorable results in all cases, it is shown how end users will significantly benefit when installing storage devices to shave load peaks under a Time-of-Use (TOU) tariff scenario.
It is noted in [
5] that most of the optimization problems associated with HEMS have been solved using traditional optimization algorithms such as linear programming, non-linear programming, and dynamic programming. However, their drawbacks when dealing with ON/OFF decisions (integer variables) have generated a demand for other types of algorithms such as heuristic optimization approaches [
5,
9]. Examples of approaches applying these types of optimization approaches are given in [
10,
11], where two HEMS reducing the energy costs and peak demand are proposed. The former proposes an algorithm where the household appliances are modeled by their energy consumption level only; the latter proposes a binary backtracking search algorithm for the optimal dispatch of the heating, ventilation, and air conditioning system (HVAC), water heater, refrigerator, smart outlets, and washing machine. However, no results about solution times are reported in these proposals, which is an important factor to be considered since heuristic algorithms may take too long to converge to a solution or even may diverge. Furthermore, based on the multi-objective nature of the optimization problems associated with the HEMS, there could exist several solutions satisfying the objective functions and the final user should select the best one based on its preferences and needs, even though end users may not want to spend time selecting the appropriate solution over a vast set of solutions. For this reason, some approaches have proposed to reduce the set of solutions by obtaining the Pareto front of solutions associated with the multi-objective optimization problem making the controller easier to manage. For instance, Pareto front algorithms to optimally schedule the energy consumption are developed in [
12,
13]. However, the first algorithm is designed for energy management entities with high computing capabilities because of the high computational times reported, and the second does not consider explicit models of the renewable energy generation units, making not possible to evaluate the energy availability in the household.
The Non-dominated Sorting Genetic Algorithm II (NSGA-II) is applied in [
14,
15] to generate more economic usage profiles for controllable appliances. A drawback of the former is that it cannot be applied to household appliances with fixed operating times, limiting its applicability, whereas the latter does not consider renewable energy generation and uses simplistic models of the household appliances. The NSGA-II algorithm is also used in [
16], where a set of microgrids sent their corresponding load curve to an operating center for flattening purposes, then, dynamic appliance scheduling was carried out by sequentially solving two optimization problems: one for the non-flexible loads and one for the flexible loads; a Pareto front is generated based on the minimization of a load flattening function and the delay to supply the household appliances; a PV generation is also considered using a simplified model of negative load power. Just recently, fuzzy logic combined with optimization techniques and supervisory control strategies have been applied for cost, energy consumption, and peak-to-average ratio reduction [
17,
18]. However, they do not account for the renewable energy generation. Also, preliminary results of the parallelization of a control algorithm is presented in [
19]. Finally, it is emphasized in [
20] that the HEMS incorporation with transactive energy controls would improve the performance and efficiency of these systems, a topic which is currently being addressed by several researchers around the world.
From this review, it can be noticed that few approaches consider the determination of a Pareto front of solutions of the multi-objective problem associated with the HEMS. Even more important, none of them determine the Pareto front considering the renewable energy availability, the user preferences, and its activity inside the house, which has a direct impact on the energy consumption, to optimally dispatch the set of household appliances. Furthermore, the resulting Pareto set may contain a variety of solutions that still require the selection of the end user. For these reasons, the scope of this proposal is the development of a heuristic-based algorithm for the optimal management of the electric energy. The novelty of the proposed algorithm called Home Electric Energy Management System (HEEMS) resides in the fact that solutions of the Pareto front, minimizing the energy consumption and cost, are obtained by a Genetic Algorithm (GA) considering both the renewable energy availability (including batteries as energy storage device) and an index proposed in [
21] for the user activity level (AL) inside the house, representing an advantage over previously proposed approaches. The extensive solutions search characteristic of the GAs is exploited to select an optimal solution with the best fitness from a set of non-dominated solutions in the sense of Pareto, i.e., at each iteration of the GA, Pareto front solutions are obtained and a solution with the best fitness is added to a reduced set of solutions; once iterations have finished, a new Pareto test and fitness evaluation is performed to the reduced set of solutions to obtain the best solution, reducing to one the number of solutions available to the user, and as consequence the computational time, which are two of the main goals of the proposal. Moreover, the proposed approach takes advantage of the good results reported in [
21,
22] to adapt the models of the household appliances, PV/wind energy generation and energy storage units (batteries).
It is important to mention that this work is limited to the electric energy management considering a set of the most common household devices and two types of renewable energy generation units. However, and as will be pointed out in the next sections, other types of devices can be considered without affecting the performance of the algorithm. Even though the energy availability is considered when dispatching the electric loads, the sale of surplus energy is not considered. Finally, an overall cost analysis including a variety of factors such as optimal sizing of the system´s components, components’ lifespan and cost, manufacturers, and deployment and maintenance costs is not the objective of this proposal. Instead, evaluations of savings are considered on a daily basis.
The rest of the paper is organized as follows:
Section 2 presents the optimization model, models of the main household devices, and renewable energy generation and storage units, which constitute the operational constraints. Additionally, the end-user AL is also described in that section. The GA used to solve the multi-objective optimization problem is presented in
Section 3. Results of the experimental test are discussed in
Section 4. Finally, the main conclusions and contributions of this research are highlighted in
Section 5.
2. Optimization Model
The nomenclature used to formulate the proposed optimization model, such as indices, sets, subscripts, and variables are defined in
Table 1, whereas the set of parameters is defined in
Table 2.
The optimization model proposed in this paper minimizes both the energy consumption and costs by optimally scheduling the household appliances, considering the energy availability generated by the on-site renewable resources, subject to devices’ operational constraints. The general form of the multi-objective optimization model may be written as follows:
where
f1 and
f2 stand for the energy consumption and costs functions, respectively, and are defined by:
This model is solved by a GA with the purpose to obtain solutions of the Pareto front and then select the one with the best fitness, as explained in the next section. The traditional scheduling horizon
T considered in optimization models for load management in the residential sector is used in this work and is set to 24 h [
5].
2.1. Devices’ Operational Constraints
The load scheduling must consider the devices’ operational constraints and user preferences. Furthermore, when considering on-site renewable generation units, the generated power should be optimally managed to exploit their benefits and to reduce energy waste. The operative constraints of devices whose operating mode is defined by operative windows such as
cd,
dw,
es,
pp, and
wm are formulated as:
Equation (4) specifies the ON/OFF decisions of device i according to the time during which it may operate, Equation (5) defines the scheduling window where the user considers the device’s task should be finished, and Equation (6) enforces the operative cycle di is met as defined by the user. It is worth noting that ti,start, ti,end, and di are specified by the user according to its needs, e.g., a user may desire to have its clothes clean at 6:00 a.m. when put the load at 12:00 a.m. selecting one washing cycle of one hour, for this case ti,start = 0, ti,end = 6, and di =1 over a time horizon of 24 h. In this way, the optimization model will try to optimally move the operating cycle di of one hour of duration over a 6 hours window to minimize energy costs. Note that for these appliances, the energy consumption will not change since they are requested to operate for fixed time periods, opposite to the case of the HVAC system where the operation intervals will depend on thermal interactions of the air masses inside the house.
2.1.1. Heating, Ventilation, and Air Conditioning System
One of the devices consuming the major energy within a house is the HVAC system. For this reason, proper management of its demand will produce important energy and cost savings. However, an important factor that must be considered for the successful management of the device is the end-user comfort. In this paper, the HVAC model proposed in [
21] is used since considers factors such as indoor and outdoor temperatures, thermal characteristics of the house, as well as the end-user AL represented by an index. The model is defined as:
Equation (4) ensures the HVAC system is in operation for the time interval defined by the user, although in this paper is considered an operation interval of 24 h, this equation allows the user to operate the device according to its preferences; Equations (7)–(9) turn the device ON/OFF when the temperature is outside/inside the predefined limits; equation (10) is defined to ensure that the air conditioner and furnace do not operate simultaneously; Equations (11) and (12) drive the indoor temperature.
αac/ht represents the thermal effect of an ON state of the HVAC system on the indoor temperature,
βac/ht accounts for the effect of the AL on the indoor temperature increase, and
ρac/ht represents the net effect of heat transfer between the outdoor and indoor temperatures differences. Calculation of these parameters is described in [
23]. Details about the AL calculation are given in the next subsection. It is worth noting that to consider other devices with thermal energy storage capacity such as fridge, water heater, and hot tub water heater, the same set of constraints defined by Equations (7)–(12) can be used since these devices should maintain their respective temperatures within user-specified ranges, i.e. Equations (7)–(11) are used for the case of the fridge and Equations (7)–(10) and (12) are used for the case of the water heater and the hot tub water heater. The only difference between these models is in their parameter settings such as average hot water usage, temperature settings, operational time, and associated coefficients that may have different values [
21,
24].
Equations (11) and (12) are used to calculate parameters
αac/ht,
βac/ht, and
ρac/ht as follows: given as inputs measurements of the inside temperature (
θin,meas), the status of the
i-th device (
Si(t)), ambient temperature, and the AL, the following least square absolute error minimization problem is solved:
As a result, the associated parameters are adjusted minimizing deviations between calculated and measured values of the inside temperature.
2.1.2. Wind Turbine
A simplified wind turbine model proposed in [
22] is adopted in the present work. The model focuses on the operative behavior of the wind turbine in terms of the generated active power exclusively dependent on the incoming wind profiles. The model is written as:
Three operative conditions are defined in Equation (14): the first condition suppresses the power output of the wind turbine when the wind speed is above or below of the cut out and cut in wind speeds, respectively; the second condition defines the output power as a quadratic equation describing the behavior of the wind turbine when the wind speed is into operative values, values of
a,
b and
c are calculated as shown in [
25]; the third condition set the maximum power contribution of the device when the wind speed is between rated and maximum values.
2.1.3. Solar PV Panel
A model of the solar PV panel proposed in [
26] is implemented in this proposal. It accounts for environmental factors such as ambient temperature changes and irradiance profiles. The model is written as:
The model considers losses due to the temperature of the panel taking 25 °C as a base temperature.
2.1.4. Energy Storage Unit
The inclusion of storage units arises from the need to take full advantage of the renewable energy resources installed in the house allowing more energy independence. To properly model the operative behavior of this device, two scenarios need to be considered: the first scenario is when the house load level is lower than the energy produced by renewables such that the energy is not fully exploited and is supplied to the electric distribution system; the second scenario is the opposite case, the surplus demand needs to be fed with energy coming from the distribution system. In the former case, if energy storage units are available, the surplus energy generated by renewables is stored to be used when necessary; in the latter case, instead of drawing energy from the grid, energy storage units are used to feed the surplus load. A model for the energy storage unit considering not only these scenarios but also its self-discharge characteristic and efficiencies of the inverter and rectifier is proposed in [
22]. This model has been adapted in terms of active power to be properly considered in the objective functions defined by Equations (2) and (3). Furthermore, constraints regarding the charge and discharge states have been included to account for the energy availability produced by the renewable generation units. The model, written by all
t ∈
T, is described by the following equations:
Equations (16) and (17) set the charge/discharge modes when the power consumed by the household loads is lower/higher than the power generated by the renewable generation units; Equation (18) maintains the power of the unit between prespecified limits; Equation (19) guarantees the charge and discharge modes are not simultaneously activated; Equations (20) and (21) account for the unit capacity to charge and discharge; finally, Equation (22) represents the active power of the unit at interval t + 1. It is important to mention that the multi-objective nature of GAs allows the inclusion of new objective functions and constraints without modifying the algorithm structure. For instance, cost functions associated with the lifespan of the household devices and system components could be considered as objective functions, as well as new operative constraints that could result from a refinement of the household devices operation.
2.2. End-User Activity Level
Since the household occupancy and activity inside a house depend on the hour of the day, the day of the week, and the season of the year, they have a major impact on the energy consumption. For this reason, it is necessary to have a measure of such an activity in order to be included to some of the appliance models to reflect the human activity in the devices’ operation patterns. To consider the effect of household occupancy on energy consumption patterns, an index termed to as AL proposed in [
21,
24] is used. This index is a normalized value of the ratio between the energy consumed at each interval and the total energy consumption of the day. It uses historical measurements of energy consumption patterns provided by smart meters installed in each house. The good results showed have motivated authors to use this index to account for the human activity inside a house. Details of its calculation are provided in [
21,
24].
An electricity consumption and occupancy data set available at [
27] was used to obtain the AL values used in the simulations presented in this work. The open-source data set for load monitoring and occupancy detection research was collected in six Swiss pilot houses over a period of eight months, containing measurements of the main electrical parameters and occupancy inside each house at time intervals of 1 s. An example of the AL calculated of one of the houses for the hottest day of summer of 2012 is presented in
Figure 1. Temperature profiles were obtained from [
28].
In this figure, the AL is normalized w.r.t. the total energy consumption of the day, which is assumed to be 100%. The AL is included in the model of the HVAC as described in the previous subsection.
3. Multi-Objective Genetic Algorithm
GAs, well-known techniques for solving a wide type of optimization problems, are search algorithms imitating the biological processes of reproduction and natural selection [
29]. Have shown wide applicability to successfully solve mixed-integer linear and nonlinear optimization problems. In general terms, a GA takes an initial population containing a number of individuals, each representing a possible solution to the optimization problem, encoded by a particular genotype or chromosome; each individual is evaluated by a fitness function to determine its performance or phenotype. On the basis of this evaluation, the population is subjected to a selection mechanism, which takes a group of individuals to be the origin of a new population where, just as in nature, natural selection is the determining factor of which individuals are the aptest to evolve. A key part of GAs is the implementation of two basic operators: sexual recombination or crossing and mutation. The crossing operator consists of taking a pair of individuals to form a new one, where its chromosome will contain parts of each selected parent chromosomes. The mutation operator establishes a probability for the modification of a chromosome, allowing the introduction of new solutions to the population under study. The introduction of these operators allows the generation of a new population that can partially or completely replace the previous generation, depending on certain policies of elitism. It is worth noting that in the context of this work, each chromosome is composed of individual structures called genes, where each gen is a binary string representing the activation status (ON/OFF decisions) of all devices at time t. Hence, a chromosome will have as many genes as time intervals considered in the scheduling horizon. Generally, the stopping criteria established for GAs is based on the maximum number of iterations under the premise that, after several cycles of evolution, the population must contain the fittest individuals.
In this work, the extensive solutions search characteristic of the GAs is seized to first obtain an optimal solution in the Pareto and fitness senses at each iteration; then from the resulting set, a new Pareto dominance test is performed and the non-dominated solution with the best fitness is selected. Therefore, the modification of the GA presented in this work shows that it is possible to obtain a simple optimal solution which is optimal in the Pareto sense with the best fitness between the non-dominated set. The modification of the GA proposed is described as follows: as a first step, at each iteration of the GA, individuals of the new population are evaluated to determine whether are optimal in the Pareto sense; when solutions are found that may compose the Pareto set, their fitnesses are evaluated and only the fittest solution is selected, recalling that even though two solutions are optimal in the Pareto sense, they have different fitnesses. In the second step, a similar procedure is performed as in the final part of the first step: the resulting set of “best” solutions is evaluated again to determine optimality in the Pareto sense and the non-dominated solution with the best fitness is selected. With this proposed modification, the obtention of several Pareto set solutions is avoided, improving considerably the performance of the algorithm. A basic outline of both the GA and the Pareto and fitness selection algorithm implemented in this proposal are presented in Algorithm 1 and 2, respectively. It is worth noting that at the end of the first step of Algorithm 1, a set Sφ of solutions is obtained.
Algorithm 1. GA basic outline. |
// | First step |
1: | P ← InitPopulation |
2: | EvalFitness(P) |
3: | ← FittestSolution(P) |
4: | fork = 1tonum_iterdo |
| P′ ← 0 |
5: | for i = N/2 do |
6: | Q ← ParentSelection(P) |
7: | if rand[0,1) ≤ then |
8: | Q ← Crossover(Q) |
9: | end if |
10: | if rand[0,1) ≤ then |
11: | Q ← Mutation(Q) |
12: | end if |
13: | P′ ← AddNewSolution(Q) |
14: | end for |
| SelectSolution(P′) |
15: | P ← ReplacePopulation(P′) |
| k = k + 1 |
17: | end for |
// | Second step |
18: | P′ ← Sφ |
19: | SelectSolution(P′) |
Algorithm 2. SelectSolution function: Pareto and fitness selection algorithm. |
1: | fori = 1toSize(P′)do |
2: | for j = 1 to Size(P′) do |
3: | if (P′(i).objectives < P′(j).objectives) then |
4: | P′(i).NonDominated = true |
5: | else |
6: | P′(i).NonDominated = false |
7: | end if |
8: | end for |
9: | end for |
10: | EvalFitness(P′(i).NonDominated = true) |
11: | Sφ ← FittestSolution(P′(i).NonDominated = true) |
The crossing operator used in the present work is the so-called “tournament selection” [
30], where a group of individuals is randomly selected and then a dispute for the position of father and mother is performed to select the fittest for crossing.
Pcross defines the relation between the number of children produced in each generation and the size of the population. A high value of cross probability allows greater and better exploration of the space of solutions. On the other hand,
Pmut controls the percentage in which the introduction of new solutions in the population is allowed; if it is very low, many solutions that could have been produced are never tested; if it is very high, there would be a lot of random disturbance, and the children will begin to lose their kinship causing the algorithm lose its ability to learn from the search history. The percentage ranges of
Pcross and
Pmut recommended by [
31] are [75%, 95%] and [5%, 10%], respectively. Finally, it is worth noting that a repairing function is considered in this proposal. The repair functions can be used to bring back to the solution space invalid solutions that are generated due to the randomness of the heuristic problems with restrictions. A simple way to reintroduce an invalid gene into the feasible space of solutions consists of analyzing the genotype in search of bits outside the operational restrictions, applying a force operator to return the bits generated outside these limits within the allowed limits.
Thus, Algorithms 1 and 2 describe the procedure followed by the proposed GA to obtain the optimal solution in the Pareto sense with the best fitness, and are basically used to represent the steps the solutions follow to adjust their chromosomes by crossing and mutation to minimize the objective functions. As each individual is a solution of the optimization problem, the candidate solution is given as input to the objective functions to obtain values representing its fitness. In this evaluation, all input parameters are used by the corresponding objective functions and constraints. Hence, the output of the GA is a simple individual whose chromosome will contain the optimal ON/OFF decisions of all devices for the considered scheduling horizon.