2. Related Works
In recent years, the exploitation of the flexibility of EVs to supply services to the power grid has shown an increasing interest in the scientific community. Regulation capabilities, scheduler architecture and optimization strategies to approach the scheduling problem are all topics widely debated today.
The capability of EVs to manage unidirectional or bidirectional power flows deeply affects the performance during the service provision to the power system. In unidirectional grid-to-vehicle (hereinafter V1G), EVs can be considered as a flexible load, since the power can flow only from the grid to the vehicle [
8], whilst the bidirectional grid to vehicle (V2G) enables EVs both to absorb or inject electric power from/into the grid. As concluded in [
9], the bidirectional configuration has higher performances than V1G, but battery degradation, charging infrastructure and control logics are still crucial problems [
10].
From the point of view of the scheduler architecture, in the centralized control, the operator managing the regulation of EVs and offering their flexibility services on the market (in the following, also called Aggregator) collects all the information about the connected EVs, determines the optimal charging scheduling and coordinates the fleet’s power exchanges with the grid to obtain the services settled on the market. The opposite of this approach is the decentralized control logic, where each EV is capable to determine its charging parameters. Most of the literature focuses on the centralized logic [
11,
12], since it allows usually reaching better coordination and provides a higher amount of services to the power system. However, the centralized approach could show severe scalability limits [
13], since the EV scheduling is a dynamic optimization problem [
14], therefore, the solution shall be available in a few seconds to start the EV charging and reiterate the procedure for the next time steps. It is not surprising that to face this issue, in most of the works adopting a centralized architecture, the size of EVs’ fleet is very limited [
15]. To address the scalability issues of centralized architectures, recently, Meta-Heuristic optimization techniques have met an increasing interest. Genetic Algorithms, Particle Swarm Optimization and Artificial Bee Colony (ABC) have been extensively applied to solve EV charging scheduling problems [
16,
17,
18].
In this work, an innovative hybridization of the ABC algorithm is provided to dynamically schedule the charging requests of a large carsharing fleet, modeling stochastically the EVs’ behavior and the ASM. Actually, ABC is suitable for challenging optimization problems since it systematically incorporates exploration and exploitation mechanisms [
19]. Nevertheless, in literature, it is a common practice to overcome the disadvantages of ABC by hybridization techniques [
20]: most of the works proposing changes to the ABC algorithm focus on the procedure for setting the initial populations [
16] or on the local research process [
21]. Starting from these considerations, the proposed approach (h-ABC) aims to efficiently solve the scheduling problem, by improving both the population initialization and the local research process compared to the standard ABC.
In this regard, in studies [
7,
22], the authors presented a preliminary architecture to enable the e-mobility participation in the market for the AS provision, focusing also on the undesirable effects caused to the distribution grid. However, neither the details of the implemented optimization algorithm nor the approach adopted to simulate EV usage have been reported. These aspects are described in detail in this work, also proving the effectiveness of the proposed method by comprehensive techno-economic analyses.
4. Optimization Problem
The CCA deals with a dynamic scheduling optimization problem, because the EVs’ charging requests and the relevant characteristics at the arrival are not known in advance. Therefore, at each time step (
), the CCA shall perform an optimization based on its best knowledge of the problem. In this work, to improve the capability of the CCA to find the optimal scheduling, a forecast is implemented to predict the charging requests in the upcoming time steps (
) and to plan consequently the EVs’ charging in the next future. The optimal solution found in the current time step (
) depends also on the forecasted future events (i.e., charging requests). Hence, during each optimization process, performed at the time
, a moving time window is considered, including the present time and the time steps in the next hour (
):
The number of EVs expected connecting in upcoming time steps (()) and the relevant characteristics (SoC, rated power, etc.) are predicted based on historical data, while the same information for EVs already connected at the time is known. Finally, in each time step , the instance is defined, including the set of all EVs (predicted or already connected) whose charging time should be optimized.
The optimization problem aims at minimizing, in each time step (
), the costs for the Aggregator:
The first term,
, models the imbalance fees applied to the Aggregator in the considered time window (
) in case of mismatches between the actual power absorbed from the network and the power schedule resulting from the participation in DAM and ASM sessions:
Imbalance costs are assumed proportional to the amount of energy imbalance, therefore,
is a unitary imbalance fee (EUR/MWh) and the function
is a hyper-parameter that weighs the foreseen imbalances with respect to the current one, having
= 1 and
< 1 for
>
. Finally,
is the Power Request Schedule defined in Equation (2) and
is the power absorbed by the CSs, calculated using:
where
is the power absorbed by the
ev-th vehicle and
is the total number of EVs scheduled to charge in time step
. For the sake of simplicity, a constant charging power is assumed (hypothesis usually true for the slow charging strategy commonly adopted for low-cost carsharing EVs).
The second term of the objective function (Equation (6)) is addressed to preserve the quality of the carsharing service. It assumes that the carsharing operator’s loss of profit is proportional to the reduction of the EVs’ range autonomy caused by an incomplete battery charging:
with
where
is the cost associated with a unitary (15 min) postponement of the charging, which results in a reduction of the SoC at the CS disconnection.
is a parameter different from zero if the proposed initial charging time (
) does not allow reaching the maximum SoC expected before the disconnection in the time step
. The charging duration (
) is calculated with Equation (11), where
is the battery capacity and
and
are, respectively, the SoC to achieve during the charging (i.e., assumed equal to 1) and the battery SoC when the vehicle is plugged into the CS, obtained by means of the carsharing model described in
Section 3.
It is worth noting that the adoption of the moving time windows technique in the optimization process allows obtaining a solution (optimal EVs’ charging schedule) which is a function of the future events (i.e., power variations due to AS requests in the imminent future).
The optimization problem, formulated as follows, should be solved in all time steps (
), updating at each step the EVs’ data and the Power Request Schedule:
subject to
The objective function in Equation (12) should be minimized by optimizing the initial charging time () of each EV in the considered instance . Constraint in Equation (13) specifies the lower and upper bounds of the charging time for each EV, while constraint in Equation (14) defines the power absorbed by the Aggregator during the considered time window (). Equations (15) and (16) determine, respectively, the Power Request Schedule in the current time step () and in the upcoming ones (). Finally, the constraint in Equation (17) models the physical limits of the EV’s battery.
To solve the described optimization problem, in this paper, a hybridization of the ABC algorithm (h-ABC), is proposed.
6. Case Study
In this work, the participation of a carsharing operator, acting as an Aggregator by selling the EVs’ flexibility on the Ancillary Service Market, has been reproduced through the historical data collected on the Italian ASM in 2018. To this purpose, all the bids submitted to the ASM by three conventional Power Units for balancing and tertiary reserve have been considered in terms of offered and awarded power and prices. Data have been processed to remove periods without offers (maintenance stops, etc.) and scaled to match the EVs aggregate’s rated power. Finally, to generalize the market requests delivered to the Aggregator, the pool of AS requests has been extended by sampling the historical market data in groups of 7 consecutive days and randomly combining them together.
For the evaluation of the economic flows deriving from the market participation, the following scheme is adopted. In the case of imbalances between the Power Request Schedule and actual absorbed power (), an imbalance penalty is applied to the Aggregator. If , the power surplus (not declared in the DAM) is paid by the Aggregator , where is the price cleared in the DAM and is the imbalance fee. Vice versa, if , the power not absorbed by EVs is refunded to the Aggregator at price . Therefore, in each time step in which the power schedule () is not fully respected, the Aggregator is subject to an imbalance cost () calculated as . For the sake of simplicity, and are taken constant and respectively equal to 50 EUR/MWh and 80% of ( = 40 EUR/MWh).
Concerning the AS provision, in the case of upward regulation (i.e., reduction of the power absorbed), the Aggregator is paid
, to refund the energy purchased in the DAM not absorbed and to remunerate the AS supplied (
). For downward regulations (i.e., load increase), the Aggregator pays
, the difference between the cost related to the energy absorbed but not declared in the DAM
and the AS remuneration (
). Hence, the net revenues for the Aggregator from the AS provision (
) are calculated as a product between energy awarded in the ASM and its unitary reward (
). Assuming the economic neutrality of the TSO, the AS remuneration (
) has been set equal to
, since, as general principle, the imbalance fees applied to users should reflect the costs covered by the system to purchase on the market the ASs required to correct the mismatches between expected and actual power exchanges [
29].
The usage of each EV in the carsharing fleet is simulated considering the stochastic model described in
Section 3. The statistical parameters adopted are based on the real data of carsharing usage in Milan collected during the weekdays of 2018, shown in
Figure 2 and
Table 1. EVs involved in the fleet are assumed to having
,
and
respectively equal to 7 kW, 40 kWh and 0.2 kWh/km [
25]. These hypotheses are coherent with the scenario under analysis: a carsharing fleet composed, for technical and economic reasons, by low-cost EVs having similar characteristics.
The profitability of the CCA is evaluated by a holistic approach, taking into account also the possible detrimental effects on the carsharing service’s quality. According to data collected about the real carsharing usage in Milan, the distance covered between two charging stops is, in 99% of cases, lower than 100 km (
). To ensure this autonomy, considering the technical characteristics previously presented, the EVs shall leave the CSs with a SoC ≥ 0.5. Assuming that the carsharing operator revenues are proportional to the distance traveled by each EV, it is possible to conclude that each time an EV with an autonomy (
) lower than the minimum autonomy (
) is rented, the Aggregator has a loss of profit
, where
is the operator’s net profit per kilometer covered by the customer. This fee is estimated by subtracting from the carsharing tariff
, set equal to 0.28 EUR/min [
30], the operator’s costs (i.e., electric bill, taxes, maintenance costs, etc.). As gross estimate,
is set equal to 0.3·
. A similar approach has been applied to define
in Equation (9). In
Section 8, a sensitivity analysis on
and
is presented to evaluate the impact of these parameters on the Aggregator’s profits.
7. ABC/h-ABC Comparison
The ABC and h-ABC algorithms require a preliminary tuning to set the value of the optimization’s parameters (i.e.,
,
,
), considering the trade-off between quality of the solution reached and time required to find it [
27]. To this purpose, an upper limit of 60 s has been adopted for the computational time, since in real-life when an EV is connected to a CS, its charging can start only after that the optimal schedule has been identified by the CCA. The optimal parameters for the two algorithms, obtained in output to the tuning process, are shown in
Table 2.
To test the effectiveness of the hybridizations proposed in the h-ABC, a comparison with the standard ABC approach is performed. To this purpose, the participation in the ASM of a carsharing fleet, composed of 1600 EVs, is simulated over a 3-month period. During the test, the performance of the two algorithms in finding the optimum is evaluated on almost 9000 optimization runs, using the parameters shown previously. For the comparison, in each time step, the value assumed by the objective function Equation (6) has been normalized with respect to the value obtained in the same time step at the end of the optimization process by the best performing algorithm (ABC or h-ABC). Finally, the average value of the objective function evaluated on all the populations for the two algorithms in each time interval has been calculated.
According to
Figure 3, despite the lower number of initial populations (
), the h-ABC algorithm is capable to initialize solutions having objective function, on average, 98% lower than ABC method, thanks to the dispatching rules and the tournament selection procedure implemented. Additionally, regarding the value reached by the objective function for the optimal solution, the h-ABC outperforms the standard ABC, since the former is able to approach the optimal value much faster than the latter and, on average, the best value found by h-ABC is almost 50 times lower than with ABC. The effectiveness of h-ABC approach is also proved through a statistical analysis of the minimum value of the objective function reached in each instance by the two algorithms. Firstly, a Shapiro–Wilk test is performed to confirm the non-normality of the data, then, a paired Wilcoxon signed rank test is applied to evaluate whether the proposed approach performs better than the standard ABC. Adopting a Wilcoxon test with a confidence level of 1%, the resulting
p-value is lower than 1 × 10
−30. Hence, it is possible to conclude, with high statistical confidence, that the proposed methodology outperforms the standard ABC.
In order to better appreciate the complexity of the proposed charging scheduling and the number of variables involved during each optimization process, an example of charging profile optimized by h-ABC is shown in
Figure 4. Each rectangle represents an EV in charge: therefore, the power absorbed in each time step is the total height of the rectangles, while the Power Request Schedule is the black dotted line. As one can observe, the power requested is almost always overlapped with the absorbed one, therefore, the imbalances experienced are nearly negligible. The black rectangles represent EVs not reaching the maximum SoC within the deadline set by the carsharing operator. It is important to point out that, even if these EVs are not fully charged, the SoC achieved is usually enough to cover the distance required by carsharing users. A further investigation on the performances obtainable by the h-ABC is provided in the next section.
8. Numerical Results
Once having proved the better performance of h-ABC approach compared to ABC, in this section, the techno-economic feasibility of the proposed scheduler is evaluated by simulating the behavior of a carsharing fleet with 1600 EVs over a 30-day period. Simulations are repeated 18 times, randomly changing the EVs’ usage and AS requests, therefore obtaining a total of 540 simulated days and 51.840 optimization runs. The scenario with the CCA (in the following, Sch scenario) is compared to the scenario currently in place for the e-mobility (No Sch scenario), in which EVs are charged as soon as they reach the CS, without neither charging scheduling nor provision of ASs to the grid. To make the No Sch and Sch scenarios fully comparable, the same EVs’ behavior is applied in both cases. Thus, the average energy absorbed is the same and equal to 7.94 MWh. The comparison is performed according to three aspects: (i) imbalances; (ii) AS supplied; (iii) carsharing service quality.
Concerning the first quantity,
Figure 5 presents the distribution of the normalized daily imbalance,
, defined in the two scenarios using Equation (21):
The numerator of Equation (21) represents the total imbalance in the day D, while the denominator,
, is the total daily energy absorbed by the aggregate. As shown in
Figure 5, the CCA allows drastically cutting down the imbalance, obtaining
1% in the 64% of simulated days and reducing the average imbalance from 17.3 to 1.3% (see dotted vertical lines in
Figure 5).
Figure 6 shows the comparison between the Power Schedule and the powers absorbed in the
Sch and
No Sch scenarios. The data refer to 2 days in August. Despite the uncertainties that characterize the EV’s charging requests, the proposed architecture is capable of avoiding power imbalances, exchanging with the grid the power declared in the DAM (Power Request Schedule).
The statistical distributions of simulated AS requests are presented in
Figure 7 and
Figure 8. On average, ASs are requested to the Aggregator in 40.6% of time steps and in 79.2% of cases these are downward requests.
Figure 7 reports the PDF of the ratio between the requested power variation due to the AS and the average power absorbed (
) by the aggregate (0.33 MW), while
Figure 8 shows the PDF of the duration of dispatching orders (in hours). The ASs activated by the TSO during 3 days in August are depicted in
Figure 9. It is possible to notice long upward activations (up to 8 consecutive hours) and large power variations (up to 26% of
).
To prove the capability of the proposed CCA to supply ASs, the amount of imbalance that occurred in time steps when the Aggregator is selected for AS provision () has been also analyzed. On average, in 85.4% of cases, a zero imbalance is registered during the AS provision (median value equal to 94%) and, for the remaining time, the imbalance is higher than 5% of the corresponding AS requests ( 0.05) only in 10% of cases, with a median value equal to 6%. This result has been achieved thanks to the implementation of the approach based on Equation (7), which allows to schedule the EVs’ charging also according to the AS requests expected in the upcoming time steps.
The effects of EVs’ scheduling on the quality of the carsharing service must be also evaluated, because an excessive postponement of the recharge could cause that the vehicles are rented before a full SoC is achieved, resulting in a lower autonomy.
Table 3 reports the percentage of vehicles leaving the CS fully charged or with SoC (
) lower than a given threshold. It can be noticed that the CCA affects almost negligibly the quality of the carsharing service offered, since the probability to rent a vehicle with SoC < 0.5 (corresponding to the minimum autonomy threshold presented in
Section 5) is only marginally increased by the scheduling.
The loss of profit on day D for the carsharing operator can be calculated by Equation (22), where
collects the EVs scheduled in the day D:
Finally, it is possible to calculate the daily electricity bill (
) as the product between the total energy absorbed by the EVs (
) and the energy price (
). Concerning the imbalance cost (
) and the revenues from the AS provision (
), they are computed as presented in
Section 6.
Table 4 reports the economic outcomes for the two scenarios, normalized with respect to the mean daily total cost for the Aggregator obtained without the CCA (
), on average equal to 454.5 EUR/day. In the
No Sch scenario, the loss of profit due to the decrease in EV autonomy (
) and the AS remuneration are equal to zero. In the
Sch scenario, the proposed architecture allows reducing the total daily cost by about 14.3%, thanks to the reduction of imbalance cost (56.1 EUR/day in the
No Sch scenario and 4.14 EUR/day in the
Sch one) and the AS revenues, roughly equal to 15 EUR/day (on average, −3.3% of
). Moreover, analyzing the impact of the CCA on the carsharing service, it is possible to conclude that it is negligibly affected, because the corresponding costs (
) are increased only by 0.4%.
The tests are then repeated in two other case studies, characterized by different sizes of the carsharing fleet, respectively equal to 800 and 3200 EVs. The simulations were run on a computer equipped with an Intel Core i7-8700, 16 GiB of RAM, a Windows 10 operating system and MATLAB R2020a. The techno-economic profitability of h-ABC is once again evaluated, assuming as a strict requirement reaching the optimal scheduling in less than 60 s. On average, the h-ABC process took, respectively, in the two scenarios, 22.88 and 44.83 s to find the optimal schedule.
The objective function evaluation and the heuristic research (described in Algorithm 2) are the most impacting procedures in terms of both number of operations to be performed and computational times required. In the proposed h-ABC, similarly to other swarm-based optimization methods, the number of objective function evaluations tends to be high: on average 11,500 for each time step. However, this value does not grow considerably with the increase of the fleet size (10,020 in 800 EVs case study and 14,030 in 3200 EVs case study), while the heuristic research procedure is executed, on average, 3200 times for each time step, regardless of the case study analyzed. These results motivate the limited increment in computational times observed in the case studies analyzed in this paper, where the fleet size is increased by a factor of 4 (from 800 to 3200 EVs).
In the case characterized by a fleet of 3200 EVs, the higher number of optimization variables (on average 250 in each run) caused reaching the upper limit for the computational time (60 s) in 14.6% of the runs. In these runs, even if the convergence is not achieved by the h-ABC algorithm, the solution found can be considered very near to the optimal one: as highlighted by results reported in the next paragraph, obtained by considering also these suboptimal runs, the h-ABC performance in the 3200 EVs case study is still very promising.
In the
No Sch scenario, the average normalized daily imbalance (
amounts, respectively, to 22.6% and 11.8% of the total absorbed energy, while with the CCA, they are reduced to 1.4% in both cases. Comparing the quality of the carsharing service offered to the users, it does not significantly change; the mean percentage of vehicles that leave the CSs with SoC < 0.5 is equal, in both cases, only to 0.17%. The economic outcomes are reported in
Table 5, normalized with respect to the average daily cost obtained without the scheduler (237.2 EUR/day in the 800 EVs case study and 883.3 EUR/day in the 3200 EVs case study). The provision of AS allows saving, respectively, 3.1% and 3.6% of
. Additionally, imbalance costs, which respectively account for 16.0% and 9.7% of total costs in the scenario without CCA, are reduced to 0.5% and 1% by the scheduling. Despite a slight increase of the loss of profit (
) in both the scenarios equal to +0.3%, the scheduler permits a reduction of the total costs incurred by the carsharing operator of about 17.7% and 12.1% (i.e., 42.0 and 106.8 EUR/day).
Finally, in order to evaluate the profitability of the e-mobility scheduling under different economic conditions, a sensitivity analysis of the coefficients of the objective function is performed. In particular, both the values of
and
used in the objective function and in Equations (7) and (9) are varied in a range of ±25% with respect to the reference value previously applied (i.e.,
= 0.28 EUR/min and
= 40 EUR/MWh). In particular, the following steps are considered: [−25%; −15%; 0%; +15%; +25%], therefore obtaining a total of 16 different combinations. For the sake of the sensitivity analysis, a fleet composed of 1600 EVs is simulated over 200 days. The simulated days have been obtained by changing randomly the AS market requests and carsharing users’ behavior. Subsequently, an economic assessment is performed according to the procedure presented in
Section 6, comparing the total costs for the carsharing operator in the
Sch and
No Sch scenarios: to this purpose, the quantity
is calculated as the difference between the costs in the scheduling scenario and the base case, given by the electricity bill (
), the imbalances fee (
), the loss of profit related to the worsening of carsharing service quality (
), minus the revenues from the ASM participation (
).
Figure 10 shows that the proposed h-ABC scheduling, in all the case studies, is able to effectively reduce the costs compared to the
No Sch scenario, allowing for savings between 8.5% and 16% of the costs without the scheduler. It is worth noting that these results marginally depend on the cost of the carsharing rent (
); actually, as one can observe in
Figure 10, assuming a given imbalance cost, the economic profitability of the h-ABC scheduler reduces only by about 2%, even when assuming a rent’s unitary cost increase of 50% (e.g., with
equal to 40 EUR/MWh, by increasing the rent cost from 0.22 EUR/min to 0.34 EUR/min, the cost reduction changes from 13% to 11.2%). Another interesting result is related to the dependence of the economic profitability (i.e.,
) on the unitary imbalance cost: an increase of
allows the proposed CCA to be more profitable, even if the rent cost is kept unchanged. This fact, combined with the capability of the proposed algorithm to manage a large EV fleet, highlights how the h-ABC scheduling method could provide even more interesting results in the future, when the penetration of non-controllable renewable energy sources is expected to increase and, consequently, an increase of AS remuneration and imbalance costs is also expected, pushed by greater requests of the Ancillary Services needed to guarantee the power balance on the grid [
31].