1. Introduction
There has been significant attention on green energy because of the issues of ecological environmental balance and the wastefulness of traditional energy. Therefore, world interest has been directed towards green and renewable energy such as wind power [
1]. However, it is difficult to control wind turbines and their operating systems. There are great challenges facing wind farm generation [
2,
3]. Therefore, excellent forecasting models are required to apply these systems properly. These models include production and repair scheduling, security evaluation, and energy transactions [
4]. As a result, there are many prediction approaches that forecast wind energy. These approaches include statistical approaches, physical approaches, artificial intelligence (AI) approaches, and hybrid approaches [
5,
6]. These approaches show highly efficient long-term prediction, especially physical forecasting approaches, such as weather prediction [
7].
In fact, the atmospheric information required adds significant computation complexity to solving wind speed prediction problems [
8]. Statistical approaches, which include, for example, auto-regression and the autoregressive integrated moving average, are not complicated and can have accuracy better than other short-term prediction methods [
9,
10]. Unfortunately, these methods cannot effectively predict the non-linear and non-stationary wind speed because of the nature of statistical methods [
11,
12,
13,
14].
Intelligence models are effective and are extensively used to accurately forecast wind energy. This can be seen clearly in least squares support vector machines (SVMs) and neural networks. The most popular non-linear systems are artificial neural networks (ANNs), which are able to extract unclear functional relationships from historical time series. ANNs can develop themselves to be robust tools to predict wind energy [
15,
16]. Li and Shi [
17], for example, produced a complete comparison on the study of the prediction performance of different ANNs. This study was based on data taken every hour in the state of North Dakota (USA).
Ping and Zhenkun [
18] introduced a new approach based on ANNs. Their model is a hybrid model called NCFM that can measure short-term wind speed. It features the first patent data pretreatment technique adopted to decompose initial wind speed data. Then, the model analyzes the data to reconstitute it. It is an effective model because it can perform predictions against the varying wind speed series. Hao et al. [
19] presented a hybrid wind power prediction approach where they extract the characteristics of every subseries using a two-layer decomposition method. Both layers are based on decomposition; the first layer, called EMD, is used to decompose wind power speed time series. The second layer, called VMD, is applied to decompose the IMF1 created by the EMD layer with more detailed coefficients.
Pei et al. [
20] also tried to develop an accurate hybrid model with several stages. First, they applied an improved complete model for decomposition with adaptive noise techniques. This technique is based on eliminating noise and easily obtaining original data. Then, they built and used a wavelet neural network with the optimization method to achieve high accuracy. Finally, four examples and eighteen comparison models were used to test the abilities of the models. Jiaojiao et al. [
21] presented a new hybrid model for wind speed forecasting. Firstly, they use complete ensemble empirical decomposition to separate wind power time series and obtain multiple components. These components were extracted using an optimized SVM. Then, they introduced a wind speed forecasting model using a modified CNN. Finally, they compared the proposed method with other models using real data on wind power to show how the validity of their method. Huang and Wang [
22] proposed a wind energy forecasting model using an optimized LSTM model based on an improved version of the particle swarm optimization algorithm. They found that the improved PSO had a significant impact on the performance of the LSTM. In [
23], the authors developed a multistep Informer model for adding meteorological parameters to wind energy generation prediction. This model was compared to the original Informer network and recorded better results. In [
24], the authors applied the gradient boosting machine model combined with nonparametric regression and the mutual information coefficient to build a wind power estimation model. This combined method was successfully employed for short-term forecasting problems. In [
25], an optimization method called the Optuna optimization framework was applied to optimize LSTM hyperparameters to improve the forecasting ability of an LSTM. They compared the optimized LSTM model to ARIMA and the original LSTM, concluding that the optimized LSTM model recorded the best wind power prediction results. Dendritic neural regression (DNR) has also been employed for wind power estimation and prediction. For example, in [
26], an optimized DNR was applied for wind forecasting. The authors used states of matter search (SMS) to optimize DNR. Thus, the application of the SMS method improved DNR forecasting capability. In [
27], the authors evaluated the dendritic neuron model for wind speed forecasting. They used the L-SHADE optimization algorithm to train the dendritic model to boost its prediction performance. In [
28], an optimization method called the artificial immune system was used to train a dendritic neural model. This optimized model was applied for wind speed forecasting and showed competitive performance compared to other models.
Motivation and Contributions
Artificial neural networks are utilized in different research and engineering domains, including time series forecasting and prediction. Spiking neural networks (SNNs) are the third generation of ANNs, but they suffer from several critical issues, such as lacking effective training methods, meaning that they face problems in real-world applications. Furthermore, the encoding mechanisms of SNRs are not understood. Additionally, they have high computation costs [
29,
30]. To address these challenges, a new model, called the dynamic dendritic structure, was proposed by [
31,
32]. It was the initial structure of the current dendritic neuron model. Its main structure is comprised of a cell body and several layers called the synaptic, dendritic, and membrane layers. In recent years, the dendritic neuron model has been adopted in various applications, especially in time series forecasting and prediction such as economic tourism prediction [
33], stock price prediction [
34], PM2.5 concentration prediction [
35], and COVID-19 pandemic prediction [
36].
However, the dendritic neuron model faces certain limitations in the parameter configuration process. To this end, in recent years, advances in metaheuristic (MH) optimization algorithms have been adopted to boost the performance of the dendritic neuron model by training and optimizing its parameters, as in the genetic algorithm [
34], the cuckoo search (CS) algorithm [
37], and particle swarm optimization [
38].
Following this concept, in this study, we present an efficient MH optimization method to train and optimize the parameters of a dendritic neuron model based on two algorithms: the seagull optimization algorithm (SOA) and the Aquila optimizer (AO). Hybrid metaheuristic optimization approaches aim to overcome the limitations of stand-alone MH optimization algorithms. To this end, we leveraged the advantages of the combination of SOA and AO to avoid their individual shortcomings. The SOA was proposed by [
39] as a new bio-inspired MH optimization technique. It was inspired based on the natural behavior (i.e., attacking and migration) of a seagull. It has been utilized in different applications due to its good performance, such as in COVID-19 prediction [
40], parameter estimation of photovoltaic models [
41], dynamic optimization problems [
42], routing problems in wireless sensor networks (WSN) [
43], engineering design problems [
44], and different optimization problems [
45,
46,
47,
48,
49]. The AO is also a new natural-inspired MH optimization method. It was inspired by the natural behaviors of Aquila in attacking and hunting [
50]. It received significant attention in recent years in solving different problems such as time series forecasting [
51], medical image processing, feature selection for human activity recognition [
52], feature selection for intrusion detection systems [
53], wind power forecasting [
54], and other optimization and engineering problems [
55,
56].
In this study, a new combined method, called the SOAAO optimization technique, is developed by combining the proprieties of the traditional SOA and AO. The main idea is to use the search parameters of the AO as a local search in the traditional SOA. Then, the developed SOAAO is utilized to train and optimize the parameters of the dendritic neuron model. The optimized dendritic neuron model is applied to forecast wind power using real-world datasets collected over three years (2017–2020) from four turbines in France. Additionally, we compared the performance of the new optimized model to the traditional dendritic neuron model, as well as to several optimized dendritic neuron schemes using well-known optimization methods, including the conventional versions of the AO and SOA algorithms.
The main contributions of this study are summarized as follows:
A new time series forecasting model for wind power is presented using an optimized dendritic neuron model;
A new optimization method is proposed based on the combination of SOA and AO algorithms. The combined method, called SOAAO, is utilized for training and optimizing the parameters of the dendritic neuron model to boost its forecasting ability;
Several MH optimization algorithms for training dendritic neuron models are compared to the proposed SOAAO algorithm;
Extensive comparisons and evaluations are conducted using real-world wind power datasets to verify the performance of the optimized dendritic neuron model and the developed SOAAO algorithm compared to the traditional SOA and AOA, as well as to other optimization algorithms.
Section 2 introduces the basics of the SOA, AO, and the dendritic neuron model.
Section 3 shows the steps of the proposed method.
Section 4 shows the evaluation and comparisons. Conclusions and future suggested research are presented in
Section 5.
3. Proposed Method
This study works to optimize DNR using an enhanced version of the SOA to produce a method called SOAAO. The workflow of the proposed method is presented in
Figure 1. In the SOAAO method, the operators of the AO are used to improve the original SOA.
In detail, the AO operators are applied as a local search of the SOA to increase its ability to solve different optimization problems. This modification adds more flexibility to the SOAAO to explore the search domain and improve diversity. Then, the SOAAO is used to train the DNR method by optimizing its weight.
The SOAAO starts by declaring all the parameters, generating the initial solutions, and reading the dataset to prepare for the experiment steps. Then, the first stage of the SOA method searches for the best DNR weight; this weight is evaluated by mean square error (MSE) (see Equation (
26)) to check its equality. This step is run to collect the initial fitness function values.
The next optimization steps update and evaluate all generated solutions. Here, the first 30% of iterations apply the operators of the AO (Equation (
11)) to help the proposed method explore the search space. Then, in the remaining iterations, the SOA is employed to update the rest of the solution agents.
This sequence is repeated for the population until it reaches the stop criteria. Then, the best weight within the optimization process is selected and saved to obtain the final results.
in which
and
are the real and target data, respectively.
N is the data size. The MSE equation measures the main square error between the target and output data to select the best weights based on the smallest value. Algorithm 1 shows the pseudo-code of the proposed method.
Algorithm 1 SOAAO-DNR pseudo-code. |
- 1:
Declare all the parameters used in the experiment. - 2:
Initialize the population randomly. - 3:
Compute the initial objective values. - 4:
Select the best solution among the population. - 5:
Initialize the iteration - 6:
while (i < max iteration) do - 7:
Update the parameters of the optimization process such as random and control parameters. - 8:
if first 30% of the iteration then - 9:
Update the solution using parameters of the AO algorithm - 10:
else - 11:
Update the solution using parameters of the SOA algorithm. - 12:
end if - 13:
Pass the solution to train the DNR model. - 14:
Compute the objective value. - 15:
Save the best value. - 16:
- 17:
end while - 18:
Return the best DNR parameters.
|
5. Conclusions
In recent years, green power technologies have received wide attention. One of the most important green power resources is wind power. Thus, the estimation and prediction of wind power are necessary to plan effectively. To this end, this paper presented an alternative wind power time series prediction approach using an optimized dendritic neural regression (DNR) model. We utilized the recent developments of metaheuristics to train and optimize the traditional DNR model to enhance its forecasting capability. We proposed a new version of the seagull optimization algorithm (SOA) by employing the operators of the Aquila optimizer. The developed method, called SOAAO, was applied to train and optimize the parameters of a DNR model. We evaluated the DNR-SOAAO approach using four open-source datasets collected from real wind turbines located in France. To assess the quality of the SOAAO, we comparing it to other optimization algorithms to verify its performance using different evaluation indicators. Overall, the evaluation outcomes verified the competitive and efficient performance of the SOAAO compared to the original versions of the AO and SOA, as well as other well-known optimization algorithms. For instance, the SOAAO achieved the highest outcomes, of 0.95, 0.96, 0.95, and 0.91, for the four datasets. In future works, the SOAAO optimizer could be utilized for other applications, for example, image segmentation, data clustering, global optimization, and other optimization problems.