1. Introduction
Short-term electricity load forecasting refers to predicting the power demand for the coming days [
1,
2]. With the rapid economic development in our country, electricity demand has surged dramatically, and the distribution network, directly interfacing with users, faces integration challenges from new elements such as distributed renewable energy and electric vehicles. These changes have significantly altered the load characteristics of the distribution system, presenting substantial challenges to the safe and efficient operation of the power system. Accurate short-term load forecasting enables power departments to effectively formulate supply plans, optimize scheduling, and arrange electricity trading, thus ensuring a system balance and stability [
3,
4]. Therefore, there is an urgent need for more effective methods to analyze and predict the behavioral characteristics of the new distribution system.
Due to the influences of seasonal changes, day–night alternation, and social activity patterns, the characteristics of electricity load at different times vary significantly, showing multiple periodicities and random fluctuations over time [
5]. Current short-term load forecasting methods mainly include traditional mathematical statistical methods and modern machine learning methods. Traditional methods include time series methods [
6], multiple linear regression [
7], and exponential smoothing [
8]. These methods have simple modeling, fast computation, and a solid theoretical foundation, making them suitable for processing relatively stable data with obvious periodicity. However, they often fall short in terms of accuracy when handling real-time, dynamically changing data due to complex internal nonlinear relationships. Modern machine learning methods, such as support vector machines [
9], random forests [
10], extreme learning machine [
11], traditional artificial neural networks [
12], and deep learning neural networks [
13], can handle complex nonlinear relationships and generally offer high prediction accuracy and strong feature extraction capabilities, especially suitable for big data and dynamically changing data. However, support vector machines, random forests, extreme learning machines, and traditional artificial neural networks struggle to capture long-term dependencies and intrinsic sequences in time series data, weakening the continuity of load sequences over time.
Traditional forecasting methods have significant shortcomings in handling complex nonlinear relationships and long-term dependencies, failing to meet the needs of modern power systems. In recent years, deep learning neural networks have become a research hotspot in load forecasting due to their powerful data processing and feature extraction capabilities. Convolutional neural networks (CNNs) [
14] can capture local patterns well through convolution and pooling operations but have limitations in dealing with long-term dependencies. Recurrent neural networks (RNNs) [
15], like typical deep learning models, effectively capture time dependencies in time series data. However, RNNs tend to suffer from gradient vanishing and exploding problems when handling long time sequences. To address this issue, the long short-term memory network (LSTM) [
16] was introduced. By incorporating input, forget, and output gates, LSTMs effectively mitigate gradient problems and significantly improve the ability to capture long-term dependencies. LSTMs can remember and forget information, thus better handling complex time series data. Although the LSTM performs well in many applications, its complex structure leads to longer training times. The gated recurrent unit (GRU) [
17] neural network merges some gating mechanisms, reducing the number of parameters and improving computational efficiency. However, its simpler structure weakens the ability to capture dependencies among loads. The literature [
18,
19] suggests that bidirectional long short-term memory network (BiLSTMs) can more comprehensively capture time dependencies and complex features through the bidirectional processing of sequence data, improving prediction accuracy and stability. However, BiLSTMs can incur significant computational and storage overhead when processing very long sequences, potentially leading to redundant information processing and unnecessary complexity. The temporal convolutional network (TCN), as an emerging deep learning model, has gradually started to gain attention. The literature [
20] suggests that TCNs, through their causal convolution and dilated convolution structures, can effectively capture long-term dependencies in time series data. By employing convolutional operations instead of recursive ones, TCNs overcome the gradient vanishing problem associated with handling long sequences. However, since convolutional operations primarily focus on local patterns, TCNs may exhibit limitations in capturing global contextual information.
To better explore and capture complex temporal features in load data, sequence decomposition techniques like empirical mode decomposition (EMD) [
21] and variational mode decomposition (VMD) [
22] have been introduced in recent years. EMD, a data-driven decomposition method, can decompose complex time series into several intrinsic mode functions (IMFs). VMD, an improvement upon EMD, decomposes signals into a set of sub-signals with finite bandwidth through a variational framework, enhancing decomposition robustness and stability. The literature [
23] has found that VMD excels in noise suppression and mode mixing reduction, but its parameter selection is complex and requires repeated tuning for optimal decomposition results. Some research has utilized the advantage of CNNs in capturing local features to establish CNN–RNN combined forecasting models. The literature [
24,
25] uses CNNs to extract local features and RNNs to capture temporal dependencies, thus improving prediction accuracy. However, excessive convolution operations can reduce model efficiency in handling long-term dependencies, significantly increasing computational complexity and training time.
Despite the advancements made by modern load forecasting methods in handling nonlinear relationships, challenges remain in capturing temporal continuity. The literature [
26] suggests that while deep learning methods perform well in many applications, their complex model architectures still limit their comprehensive utilization of temporal information, particularly in effectively capturing the inherent multiple periodicities and stochastic fluctuations of the data. The literature [
27] further points out that the long-term dependencies and evolving trends in load sequences are crucial for the stable operation of power systems. Therefore, how to more effectively capture and utilize the temporal continuity in load data remains a key focus and challenge in current research.
Addressing the issue of weakened temporal continuity in electricity load, this paper proposes a short-term electricity load forecasting method based on SBOA-optimized SVMD and TCN–BiLSTM, integrating deeply mined load temporal features into the forecasting model.
The contributions of this paper are as follows:
- (1)
A load sequence decomposition method based on SBOA-optimized SVMD is proposed to obtain more predictable load components while avoiding mode mixing;
- (2)
A load multi-component sequence forecasting method based on TCN temporal feature extraction and BiLSTM is introduced to extract temporal features of load sequences.
4. Combined Prediction Model Based on SVMD-SBOA-TCN-BiLSTM
In this paper, the electrical load is decomposed using SVMD optimized by SBOA, and the TCN–BiLSTM combined model is used for prediction. The model flowchart is shown in
Figure 8. The specific steps are as follows:
- (1)
A novel swarm intelligence optimization algorithm, SBOA, is used to optimize the key parameter of SVMD.
- (2)
The electrical load sequence is decomposed into multiple IMFs over different time scales using SVMD.
- (3)
The decomposed IMFs are used as basic units and input into the TCN for feature extraction, outputting feature vectors containing rich information.
- (4)
These feature vectors are then used as inputs to the BiLSTM for prediction, resulting in the forecasted values for each IMFs.
- (5)
The final prediction result is obtained by integrating the predicted values of different IMFs.
The proposed model combines the precise decomposition capability of SVMD, the optimization advantages of SBOA, the feature extraction efficiency of TCN, and the bidirectional sequential modeling capability of BiLSTM to significantly improve the extraction and prediction accuracy of the power load sequence’s temporal features. SVMD accurately decomposes power load data, allowing each IMF component to independently reflect specific fluctuation characteristics within the load data. These components better capture the data’s non-linearity and non-stationarity. The SBOA-optimized SVMD parameters further enhance the decomposition accuracy, making each IMF component more representative. When processing these IMF components, TCN efficiently extracts complex patterns and long short-term dependencies from the time series through its convolutional structure, enhancing the feature vector’s expressive capability. BiLSTM, with its bidirectional network structure, comprehensively understands the time series data, capturing the temporal relationships both forward and backward, thereby further improving prediction performance. This multi-layered composite model not only enhances the accuracy of power load forecasting but also demonstrates advantages in handling complex temporal data.
5. Experimental Analysis
5.1. Data Preparation
The raw power load dataset selected for this study is sourced from a region in Belgium. The data collection spans from 1 January 2018 to 31 December 2018, with a sampling frequency of every 15 min, resulting in a total of 35,040 data points. The data are split into a training set and a test set in a ratio of 5:1. A day-ahead forecasting method is adopted, with the original dataset segmented into daily sequences of 96 data points each. Data from the first 10 months are used as the training set, while the remaining data are used for testing. During the model training, an Adam optimizer is used, and training is executed on a GPU to accelerate the process. The trained model is applied for day-ahead forecasting, with each day’s forecast based on the previous day’s data. The prediction results are denormalized and aggregated daily to produce a forecast curve for the next two months, which is then compared with actual measured data to evaluate the model performance. The laboratory hardware configuration includes a computer with an Intel Core i9-13900HX CPU, 16 GB of memory, and an NVIDIA GeForce RTX 4070 GPU for acceleration. The experiments are programmed using Matlab2024a.
To address issues such as missing data and abnormal fluctuations in the original power load dataset, this study employs the quartile method to detect outliers and convert them to missing data, which are then filled using an interpolation function for upsampling. Additionally, since the load IMFs obtained from SVMD decomposition have significant numerical differences, directly using these decomposed data for prediction could adversely affect the overall mapping effect of the network. Therefore, it is necessary to normalize the input sequence to prevent the problem of dimensional explosion during training. The normalization method scales the data to the range of [0, 1] to improve the efficiency and stability of model training. The normalization equation used in this study is as follows:
In the equation,
and
represent the minimum and maximum values of the input data matrix
. The normalized data
ensure that the input features are on the same scale, which helps to accelerate the convergence speed of the model. To restore the normalized data to the original scale after prediction, the inverse normalization equation is used as follows:
5.2. Parameter Settings and Evaluation Metrics
To obtain the optimal structure of the deep learning model, this study configures the TCN with 10 convolutional filters and a filter size of 2. Additionally, one residual block is incorporated to mitigate the vanishing gradient problem and ensure the training stability of the deep network. To prevent overfitting, a dropout layer with a dropout rate of 0.02 is introduced in the TCN. The BiLSTM layer is configured with 60 hidden units, a maximum of 100 epochs, and the ReLU activation function. To further enhance the model’s performance, the initial learning rate is set to 0.005 and is halved every 2 epochs through an automatic adjustment callback function. The training process utilizes the Adam optimizer. These parameter settings, determined through iterative experimentation and optimization, aim to improve the model’s prediction accuracy and generalization ability. The choices of these settings have undergone multiple adjustments to ensure the model can effectively extract local features from the time series data and perform excellently in practical applications.
Table 1 shows the parameter settings for SVMD and SBOA.
To evaluate the prediction accuracy of the SBOA–SVMD–TCN–BiLSTM prediction model, this paper utilizes MAE, RMSE, and goodness of fit
as evaluation metrics. The calculation formulas are as follows:
In the equation, represents the predicted power load at time , represents the actual power load at time , and represents the average predicted power load. The smaller the MAE and RMSE, the better the model’s prediction performance. The closer is to 1, the better the fit of the prediction model.
5.3. Power Load Sequence Decomposition
In this study, normalized load data were decomposed using the SVMD method optimized by SBOA. The data were selected from a region in Belgium, covering the first two months of spring and autumn, as well as the first three months of summer and winter in 2018. For each of these months, data from the first seven days were selected at 15-min intervals, resulting in a total of 6720 data points. The decomposition results are shown in
Figure 9.
The original power load sequence is decomposed into four single-frequency IMF components: IMF1 to IMF4. Each IMF component has clear features and corresponds to different central frequencies:
IMF1: Exhibits weak volatility and does not cross the zero point, approximately representing the trend of the original power load.
IMF2: Has a relatively low frequency with evident periodicity, reflecting the regularity of the power load to some extent.
IMF3 to IMF4: These components have relatively higher frequencies and weaker periodicity, representing both the regularity and the anomalies or sudden events in the power load.
Each IMF component can represent the characteristics of the power load to a certain extent. This decomposition effectively solves the modal aliasing issue seen in other algorithms, ensures the integrity of the decomposed signal, and enhances the accuracy of the model’s prediction.
In this study, the mode compactness parameter in SVMD is adjusted, using permutation entropy as a metric to reflect the effectiveness of SVMD parameter optimization in controlling the complexity of the sequence. Permutation entropy is a key indicator of sequence complexity, with values ranging from 0 to 1. A lower permutation entropy indicates lower complexity and higher predictability of the sequence, while values closer to 1 suggest higher complexity and increased difficulty in prediction [
30,
31].
Table 2 presents the different mode compactness parameters in SVMD and their corresponding permutation entropy values. It is evident that the optimized SVMD parameters achieved the lowest permutation entropy, indicating that the SVMD parameters optimized by SBOA significantly reduced sequence complexity, thereby enhancing prediction performance.
5.4. Comparison of Different Optimization Algorithms
To verify the effectiveness and superiority of the proposed SBOA, we compared it with the sparrow search algorithm (SSA) and the grey wolf optimizer (GWO). In each iteration, the minimum permutation entropy of the decomposed sequences was used as the objective function. The performance of different optimization algorithms was evaluated by comparing the average permutation entropy after optimization. To ensure the fairness of the experiments, the population size for each algorithm was set to 30, with a maximum of 60 iterations. The optimization fitness curves of the different algorithms are shown in
Figure 10.
In
Figure 10, by comparing the fitness of SBOA, SSA, and GWO, it is evident that SBOA achieves a significantly lower fitness value upon convergence compared to GWO and SSA. Moreover, the fitness value stabilizes thereafter, indicating that SBOA effectively avoids over-searching and does not fall into local optima, demonstrating stability in the later stages of optimization. In contrast, SSA shows a steep decline in the first few iterations but has a slower convergence rate and exhibits some fluctuations, making it less stable than SBOA. Meanwhile, GWO’s fitness curve remains relatively stable throughout the iterations, showing some global search capability, but its fitness value does not reach the level achieved by SBOA and SSA in the later stages.
5.5. Comparison of Different Sequence Decomposition Algorithms
To validate the superiority of the SVMD sequence decomposition algorithm used in this study, comparative models were established with CEEMDAN and ICEEMDAN decomposition methods. The parameter settings for these two methods are consistent, as shown in
Table 3. The last week of the test set was selected for analysis, and the comparison of prediction results for a specific day of that week is shown in
Figure 11.
As shown in
Figure 11, the load prediction result curve of the proposed model is the closest to the actual load curve, indicating the best load prediction performance. A detailed comparison of load prediction errors is presented in
Table 4.
As shown in
Table 4, the prediction errors of the SBOA–SVMD–TCN–BiLSTM model, in terms of MAE and RMSE, are reduced by 29.01% and 17.76%, 23.16% and 16.32%, respectively, compared to the other two models, with an improvement in metric
as well. This indicates that the SVMD algorithm used in this study outperforms other decomposition algorithms in terms of prediction accuracy and model fitting. In contrast, the CEEMDAN and ICEEMDAN decomposition algorithms suffer from severe mode mixing, resulting in frequency components that lack clear periodicity and distinct features, thereby increasing prediction errors. Additionally, the increase in the number of decomposition components further amplifies errors. The SVMD algorithm effectively reduces mode mixing and accurately extracts different characteristic components of the load series, leading to more precise prediction results.
5.6. Comparison of Predictive Model Performance
To validate the necessity of SBOA–SVMD, the forecasting results of the proposed model are compared with those of the TCN–BiLSTM model. In the proposed model, the IMFs obtained from SBOA-SVMD decomposition are used as inputs for the TCN–BiLSTM model, while in the comparison experiment, the processed raw load data is directly used as input for the TCN–BiLSTM model. The analysis focuses on the forecasting results from the last two weeks of the test set, with the comparison of results for a specific day shown in
Figure 12.
As shown in
Figure 12, the proposed prediction model is closer to the actual values, demonstrating the effectiveness and necessity of the SBOA–SVMD approach. The prediction errors are listed in
Table 5.
As shown in
Table 5, compared to the TCN–BiLSTM model, the prediction errors MAE and RMSE of the proposed model are reduced by 34.89% and 33.49%, respectively, while
is improved by 11.1%, further confirming the necessity of introducing the SBOA–SVMD optimization decomposition method.
To further verify the predictive accuracy of the SBOA–SVMD–TCN–BiLSTM model, this paper uses the IMFs obtained from the SBOA–SVMD decomposition as inputs and introduces traditional prediction models such as ELM, LSTM, and BiLSTM for comparison. The experimental results are shown in
Figure 13.
Figure 13 compares the prediction results of different models for three randomly selected days from the test set. By comparing the model predictions with actual measured data, it can be observed that the TCN–BiLSTM model’s predictions closely match the measured data, especially in peak and trough regions, showing high prediction accuracy. This model not only accurately predicts the load curve’s changing pattern but also captures abrupt changes in the load curve effectively. The ELM model, while reflecting the overall trend of the power load, shows significant deviations in regions with large load changes due to its limited ability to handle long-term dependencies, resulting in predictions that are generally lower than the actual data. The LSTM model’s overall prediction performance is poor, struggling with long-term dependencies and sensitivity to noise, leading to low accuracy in areas with rapid fluctuations, particularly at load peaks and troughs. The BiLSTM model performs relatively well; its bidirectional structure accounts for both forward and backward time dependencies, resulting in predictions that are mostly consistent with actual data. However, it still shows some deviations in regions with drastic load changes, indicating room for improvement in predicting high-frequency fluctuations. The TCN–BiLSTM model exhibits the best prediction performance. The model leverages multi-scale feature extraction in the TCN layer and bidirectional dependency capture in the BiLSTM layer, significantly enhancing prediction accuracy. The predictions are highly consistent with actual measurements, effectively capturing subtle load variations and validating the TCN–BiLSTM model’s high precision in both high-frequency fluctuations and complex load patterns.
Table 6 shows the comparison of evaluation metrics for different models. From
Table 6, it can be observed that the TCN–BiLSTM model significantly outperforms the LSTM, ELM, and BiLSTM models. Specifically, the TCN–BiLSTM model reduces the MAE by 47.8%, 32.8%, and 11.5%, respectively, compared to the LSTM, ELM, and BiLSTM models. Similarly, the RMSE is reduced by 42.9%, 39.2%, and 11.3%, and the
value is significantly higher. It can be seen that the proposed model outperforms other models in terms of MAE, RMSE, and
metrics. Compared to BiLSTM, the proposed model introduces TCN, a deep learning model with spatial feature extraction capabilities. TCN effectively captures useful information from signals through multi-layer convolutions that extract features at different time scales. Simultaneously, BiLSTM captures more information by considering bidirectional dependencies in time series data. This combination enhances the model’s ability to handle complex time series data, thereby improving the model’s stability and accuracy. Additionally, the validation shows that single prediction models have poor prediction capabilities and larger errors, further verifying the high prediction accuracy of the proposed model.
Table 7 shows the training and prediction times of the proposed model for different IMFs.
This study utilizes an offline training and online prediction approach. The total training time is recorded as 355.17 s, and the total testing time is recorded as 0.89 s. Although the training time is relatively long, the model’s testing time is very short. In practical applications, the model can generate predictions quickly, so it will not be significantly impacted by data latency or computational resource constraints during actual deployment.
5.7. Comparison of Prediction Accuracy across Different Seasons
Considering the impact of seasonal factors, the data for each season in the dataset was processed and divided into training and testing sets at a 5:1 ratio. Different methods were used for load forecasting, with the prediction errors shown in
Table 8.
Table 8 shows the load forecasting accuracy results of various methods for a specific day in each of the four seasons, with the error distribution shown in
Figure 14. It can be observed from
Table 8 that the proposed method achieves the lowest average prediction error compared to the other three methods. Specifically, the average MAE is improved by 63.2%, 47.97%, and 41%, respectively, compared to the other three methods, while the RMSE is reduced by 62.15%, 46.38%, and 38.19%, respectively. The significant improvements in both MAE and RMSE metrics indicate that the proposed short-term power load forecasting model greatly enhances overall prediction accuracy and model performance.
By observing the distribution of prediction errors for different models, it can be seen that the proposed model primarily has relative errors within 200 MW during the spring and autumn seasons, whereas the errors for LSTM, ELM, and BiLSTM models are more concentrated in the range above 200 MW. In the summer and winter seasons, the prediction performance of all the models declines. Although the proposed model also exhibits high error distribution, the proportion of high errors is significantly lower compared to other models.
To evaluate the model’s performance under extreme scenarios, this study considers the error during peak load periods. The time intervals from 7:00 to 9:00 and 13:00 to 15:00 on the selected four days were analyzed. The error results are presented in
Table 9.
Based on
Table 9, it can be observed that during the peak period from 7:00 to 9:00 a.m., the MAE and RMSE values for all seasons are generally low, indicating high prediction accuracy of the model during this time. Among the seasons, the errors are smallest in summer and autumn, while spring and winter show relatively higher errors, with winter having significantly higher errors than the other seasons. In contrast, during the peak period from 1:00 to 3:00 p.m., the MAE and RMSE values for all seasons increase, with winter showing a significantly higher increase compared to the other seasons.
7. Conclusions
This paper addresses the non-stationary and highly random characteristics of power load, aiming to improve the accuracy of short-term power load forecasting. Based on the decomposition–prediction–reconstruction framework, it deeply explores the temporal characteristics of power load sequences. By combining optimization algorithms, feature decomposition techniques, and deep learning models, a short-term power load forecasting method based on SBOA–SVMD–TCN–BiLSTM is proposed. The conclusions are as follows:
The SBOA optimizes the key parameters of SVMD. The optimization fitness comparison experiment shows that SBOA can achieve the global optimum without falling into local optima. The decomposed IMF components can more accurately reflect the complex fluctuation characteristics of power load, effectively improving the accuracy and efficiency of decomposition.
The decomposed IMF components are input into the TCN neural network according to the time window method, fully leveraging the TCN model’s advantage in extracting potential data features, which enhances the accuracy and stability of power load forecasting.
The feature vectors processed by TCN are used as inputs for the BiLSTM network model. By capturing the bidirectional dependencies through BiLSTM, the temporal and complex nonlinear relationships of power load data can be well analyzed.
The model comparison experiment results show that the MAE of the TCN–BiLSTM model is reduced by 47.8%, 32.8%, and 11.5% compared to the LSTM, ELM, and BiLSTM models, respectively. The RMSE is reduced by 42.9%, 39.2%, and 11.3%, and the R2 value is significantly higher. Therefore, compared to traditional single prediction models, the proposed model effectively enhances the accuracy and fitting performance of load forecasting.