Short-Term Multi-Step Wind Direction Prediction Based on OVMD Quadratic Decomposition and LSTM
Abstract
:1. Introduction
1.1. Research Background
1.2. Relevance of Wind Direction Prediction Research and Sustainability
1.3. Literature Review
1.4. Contribution to the Current Literature
2. Methodology
2.1. Trend and Seasonality Feature Extraction Based on STL
2.2. Optimal Variational Mode Decomposition
2.3. Long Short-Term Memory Neural Network
2.4. Overall Structure of STL–OVMD–LSTM Model
- (1)
- The quadratic decomposition stage. According to the seasonal and trend characteristics of wind direction data, the original series data are decomposed by the STL method, and the seasonal and trend sub-series are separated, as well as the remainder sub-series containing the remainder characteristic information. However, there is still some effective information of the original sequence data in the remainder subsequence; therefore, the OVMD method is utilized to decompose the remainder subsequence to further mine the potential features, and several different subsequences are obtained.
- (2)
- The forecasting stage. Each component obtained after the quadratic decomposition is input into the LSTM model for prediction, and then the predicted results of each component are linearly added to obtain the final predicted value of the original sequence data of wind direction.
3. Cases Studies
3.1. Analysis of Wind Direction Sequence Data
3.2. Experimental Design
3.3. Evaluation Criteria
3.4. Experimental Results
3.4.1. Data Decomposition Result
3.4.2. Comparison Model and Prediction Result Analysis
- (1)
- The original wind direction data manifests obvious mutability and complexity, and the seasonality and trend characteristics are not readily apparent. Comparing the error values of the prediction results from each model reveals that the decomposed prediction model outperformed the single model. Given that wind direction data is influenced by various inherent characteristics, an appropriate decomposition method can effectively improve the prediction effect of the model on the complex original data. In the one-step prediction, the error values of all the decomposed prediction models are smaller than the single prediction model. In the multi-step prediction, each error value of the decomposed prediction model based on STL is still smaller than that of all the single prediction models. This not only proves that the beneficial application of the decomposition methods for enhancing the prediction performance of the model in one-step prediction, but also highlights the advantage of the STL method on various decomposition methods. These findings have significant implications for the accuracy and reliability of wind direction prediction models.
- (2)
- The quadratic decomposition technique extracts additional meaningful information from the wind direction data, thereby enhancing the prediction accuracy of the model. Despite the STL decomposition, the remainder subsequence retains some valuable information that requires further processing. From the one-step prediction results of the single decomposition prediction model, it is evident that the OVMD–LSTM method has the least error. Consequently, for one-step prediction accuracy alone, the OVMD technique is the most effective decomposition method. However, once the trend and seasonality attributes of the original sequence are removed, the remainder subsequence becomes more complex and unpredictable. Therefore, a powerful decomposition method for complex sequences is necessary. Accordingly, the OVMD method was selected as the secondary decomposition method.
- (3)
- Furthermore, it can be observed that although OVMD-LSTM and the proposed STL–OVMD–LSTM have similar errors in one-step prediction, STL–OVMD–LSTM exhibits superior performance in subsequent 3-step and 5-step predictions, with significantly smaller growth rates and absolute error values compared to OVMD–LSTM. It can be seen in Figure 8 that in the multi-step prediction, STL–OVMD–LSTM consistently achieves the lowest prediction error among all the models, while the errors of the other models increase with the number of prediction steps. Even in the OVMD–LSTM, which has the most similar error to STL–OVMDLSTM in one-step prediction, shows weaker performance in multi-step prediction. It could be concluded that STL–OVMD–LSTM combines the high accuracy of OVMD in single-step prediction and the stability of STL in multi-step prediction, leading to an overall improved prediction performance. These results provide strong evidence supporting the superiority of STL–OVMD–LSTM over other models in multi-step prediction tasks.
- (4)
- In addition, we performed a comparative experiment to determine the mode number by the center frequency in OVMD. As previously established, the optimal value of K is 5. Therefore, K was varied from 3 to 7 to decompose the remainder into different subsequence groups. Then, the subsequence groups were tested under the same prediction model, STL–OVMD–LSTM. The prediction results of the different mode numbers are displayed in Figure 10. As K increased from 3, the prediction error decreased continuously. When K climbed to 5, the error dropped to the minimum, and then the error started to become larger when K continued to rise. Therefore, when K = 5, the RMSE, MAE and MAPE are the smallest, thereby validating the theory presented in Section 2.2.
- (5)
- Finally, based on the different decomposition numbers and LSTM parameters in OVMD, the findings can be summarized as follows: In the process of OVMD decomposition, based on the center frequency observation method, it was also observed that the mode separation effect is better when the decomposition number is 10 to 12; however, considering the algorithm complexity and prediction accuracy, 5, which has the most obvious mode separation characteristics, was chosen as the best decomposition number. This is because the complexity and amount of computation required by the algorithm when the decomposition number is 5 is much smaller than when the decomposition number is 12, and the prediction accuracy is higher. In addition, for the selection of LSTM parameters for three different sequences, we have attempted to develop three models that use the same learning rate, but the trend sequence is easy to overfit, and the periodic sequence is easy to underfit. This is due to the different characteristics of the different sequences; if the appropriate parameters are not selected, not only can the amount of calculation required by the model increase, but it is also difficult to achieve better prediction accuracy.
4. Conclusions and Future Studies
- In the error evaluation indexes of RMSE, MAE and MAPE, OVMD–LSTM has the highest prediction accuracy in the first decomposition model of single-step prediction, followed by STL–LSTM and EMD–LSTM. However, when it comes to the subsequent multi-step prediction, STL–LSTM is the most accurate in the first decomposition model. This shows that STL–LSTM is the best model for comprehensive accuracy and stability.
- The quadratic decomposition model is 81.7%, 73% and 75% higher than the LSTM model, and 17.3%, 33% and 31.3% higher than the single decomposition model OVMD–LSTM, respectively. It can be seen that the accuracy of the subsequent prediction model can be effectively improved after data decomposition. At the same time, choosing an appropriate method for the second decomposition of the first time series can further improve the accuracy of the prediction model.
- To solve the problem of high complexity and mutability of the original wind direction sequence data, the STL method was used to decompose the original wind direction sequence, which has the obvious effect of stabilizing the sequence and can effectively separate the trend and period in the original sequence. Moreover, in multi-step prediction, STL decomposition of the sequence data can maintain a stable prediction accuracy.
- OVMD based on the center frequency observation method and REI formula method can determine important parameters k and t quickly and efficiently and has the highest accuracy in single-step prediction of a decomposition model. OVMD can effectively improve the prediction accuracy of the model.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Yu, S.W.; Sun, Y.F.; Hu, X. Reserchers on the Improvements of China’S Renewable Energy Policy System under the Dual Carbon Goals. J. Beijing Inst. Technol. 2022, 24, 93–102. [Google Scholar]
- Zou, C.N.; Chen, Y.P.; Xiong, B.; Liu, H.L. Mission of New Energy Under Carbon Neutrality Goal in China. Bull. Chin. Acad. Sci. 2023, 38, 48–58. [Google Scholar]
- Shen, Y.X.; Yang, X.F.; Zhao, Z.P. Sensor Fault Diagnoisis for Wind Turbine System. Control. Theory Appl. 2017, 34, 321–328. [Google Scholar]
- Zhang, J.; Chen, W.; Li, G.J.; Xiao, L.Y. Regional High-Voltage Direct Current Power Grids Will Be Built. Bull. Chin. Acad. Sci. 2013, 28, 635–636. [Google Scholar]
- Huo, Z.T. China Leads the World in Renewable Energy Development. Ecol. Econ. 2022, 38, 9–12. [Google Scholar]
- Alejandro, J.; Carlos, J.; Carbajal, A.; Toledano, M. Shape Morphing Mechanism for Improving Wind Turbines Performance. J. Energy Resour. Technol. 2017, 139, 051214. [Google Scholar] [CrossRef]
- Castillo, A.D.; Jauregui-Correa, J.C.; Herbert, F.K.; Castillo-Villar, K.; Franco, J.A.; Hernandez-Escobedo, Q.; Perea-Moreno, A.-J.; Alcayde, A. The Effect of a Flexible Blade for Load Alleviation in Wind Turbines. Energies 2021, 14, 4988. [Google Scholar] [CrossRef]
- Xiao, Y.; Feng, Z.W.; Yu, Z.P.; Yang, X.B. A Novel Yaw Control Method for Wind Turbines Based on Predicted Wind Directions. Acta Energiae Solaris Sin. 2021, 42, 144–149. [Google Scholar]
- Tang, Z.H.; Zhao, G.N.; Cao, S.X.; OuYang, T.H. Two-Phase Deep Learning Model for Short-Term Wind Direction Forecasting. Renew. Energy 2021, 173, 1005–1016. [Google Scholar] [CrossRef]
- Dong, W.C.; Sun, H.X.; Tan, J.X.; Li, Z.; Zhang, J.X.; Yang, H.F. Multi-degree-of-freedom high-efficiency wind power generation system and its optimal regulation based on short-term wind forecasting. Energy Convers. Manag. 2021, 249, 114829. [Google Scholar] [CrossRef]
- Hu, S.; Xiang, Y.; Huo, D.; Jawad, S.; Liu, J.Y. An improved deep belief network based hybrid forecasting method for wind power. Energy 2021, 224, 120185. [Google Scholar] [CrossRef]
- Zhen, H.; Niu, D.; Yu, M.; Wang, K.; Liang, Y.; Xu, X. A Hybrid Deep Learning Model and Comparison for Wind Power Forecasting Considering Temporal-Spatial Feature Extraction. Sustainability 2020, 12, 9490. [Google Scholar] [CrossRef]
- Li, H.L.; Li, H.T.; Li, Z. Air passenger demand forecasting based on strategy of dual decomposition and reconstruction. J. Comput. Appl. 2022, 42, 3931–3940. [Google Scholar]
- Hu, H.L.; Wang, L.; Tao, R. Wind speed forecasting based on variational mode decomposition and improved echo state network. Renew. Energy 2021, 164, 729–751. [Google Scholar] [CrossRef]
- Hu, Y.H.; Guo, Y.S.; Rui, F. A novel wind speed forecasting combined model using variational mode decomposition, sparse auto-encoder and optimized fuzzy cognitive mapping network. Energy 2023, 278 Pt A, 127926. [Google Scholar] [CrossRef]
- Erick, N.; Talison, M.; Davidson, M. A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy. Energy 2023, 278, 127678. [Google Scholar]
- Lu, W.C.; Duan, J.D.; Wang, P.; Ma, W.T.; Fang, S. Short-term Wind Power Forecasting Using the Hybrid Model of Improved Variational Mode Decomposition and Maximum Mixture Correntropy Long Short-term Memory Neural Network. Int. J. Electr. Power Energy Syst. 2023, 144, 108552. [Google Scholar] [CrossRef]
- Gao, X.Z.; Wang, G.; Mei, C.X.; Sha, J.D.; Guo, Y.J.; Sun, H.X. Short-term wind power forecasting based on SSA-VMD-LSTM. Energy Rep. 2023, 9 (Suppl. 10), 335–344. [Google Scholar] [CrossRef]
- Yıldırım, A.; Kamil, D.Ü. A univariate time series methodology based on sequence-to-sequence learning for short to midterm wind power production. Renew. Energy 2022, 200, 832–844. [Google Scholar]
- Jiang, Z.Y.; Che, J.X.; Wang, L.N. Ultra-short-term wind speed forecasting based on EMD-VAR model and spatial correlation. Energy Convers. Manag. 2021, 250, 114919. [Google Scholar] [CrossRef]
- Tian, Z.D.; Chen, H. A novel decomposition-ensemble prediction model for ultra-short-term wind speed. Energy Convers. Manag. 2021, 248, 114775. [Google Scholar] [CrossRef]
- Huang, Y.; Liu, S.; Yang, L. Wind Speed Forecasting Method Using EEMD and the Combination Forecasting Method Based on GPR and LSTM. Sustainability 2018, 10, 3693. [Google Scholar] [CrossRef] [Green Version]
- Li, D.; Jiang, F.X.; Chen, M.; Qian, T. Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks. Energy 2022, 238, 121981. [Google Scholar] [CrossRef]
- Tang, Z.H.; Zhao, G.N.; Cao, S.X.; Zhao, B. Very Short-term Wind Direction Prediction Via Self-tuning Wavelet Long-short Term Memory Neural Network. Proc. CSEE 2019, 39, 4459–4468. [Google Scholar]
- Cleveland, R.B.; Cleveland, W.S.; McRae, J.E.; Terpenning, I. STL: A seasonal-trend decomposition procedure based on loess. J. Off. Stat. 1990, 6, 3–73. [Google Scholar]
- Niu, D.X.; Ji, Z.S.; Li, W.Y.; Xu, X.M.; Liu, D. Research and application of a hybrid model for mid-term power demand forecasting based on quadratic decomposition and interval optimization. Energy 2021, 234, 121145. [Google Scholar] [CrossRef]
- Wang, S.; Liu, C.; Liang, K.; Cheng, Z.; Kong, X.; Gao, S. Wind Speed Prediction Model Based on Improved VMD and Sudden Change of Wind Speed. Sustainability 2022, 14, 8705. [Google Scholar] [CrossRef]
- Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: Mathematical. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
- Xiang, L.; Li, J.X.; Wang, P.H.; Ye, F.; Hu, A.J. Multi-step interval prediction of wind speed based on VMD-FIG and parameter optimization GRU. Acta Energiae Solaris Sin. 2021, 42, 237–242. [Google Scholar]
- Tang, Z.H.; Zhao, G.N.; Cao, S.X.; OuYang, T.H.; Mou, Z.H.; Pang, X.Y. A Data Analystic Based Hybrid Wind Direction Prediction Algorithm. Acta Energiae Solaris Sin. 2021, 42, 349–356. [Google Scholar]
- Zeng, L.; Lei, S.M.; Wang, S.S.; Chang, Y.F. Ultra-short-term Wind Power Prediction Based on OVMD-SSA-DELM-GM Model. Power Syst. Technol. 2021, 45, 4701–4712. [Google Scholar]
- Hochreiter, S.; Schmidhuber, J. Long Short-Term Memory. Neural Comput. 1997, 9, 1735–1780. [Google Scholar] [CrossRef] [PubMed]
- Fu, W.L.; Zhou, J.Z.; Zhang, C.Y.; Zheng, Y. Vibration trend prediction of hydroelectric generating unit based on OVMD and SVR. J. Vib. Shock. 2016, 35, 36–40. [Google Scholar]
- Chen, Y.R.; Wang, Y.; Dong, Z.K.; Su, J.; Han, Z.L.; Zhou, D.; Zhao, Y.S.; Bao, Y. 2-D Regional Short-Term Wind Speed Forecast Based on CNN-LSTM Deep Learning Model. Energy Convers. Manag. 2021, 244, 114451. [Google Scholar] [CrossRef]
- Peng, X.S.; Wang, H.Y.; Lang, J.X.; Li, W.Z.; Xu, Q.Y.; Zhang, Z.W.; Cai, T.; Duan, S.X.; Liu, F.J.; Li, C.S. A EALSTM-QR: Interval Wind-Power Prediction Model Based on Numerical Weather Prediction And Deep Learning. Energy 2021, 220, 119692. [Google Scholar] [CrossRef]
- Xiao, Z.; Tang, F.; Wang, M. Wind Power Short-Term Forecasting Method Based on LSTM and Multiple Error Correction. Sustainability 2023, 15, 3798. [Google Scholar] [CrossRef]
- Wang, K.; Ye, Z.; Wang, Z.; Liu, B.; Feng, T. MACLA-LSTM: A Novel Approach for Forecasting Water Demand. Sustainability 2023, 15, 3628. [Google Scholar] [CrossRef]
Mode Number | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
---|---|---|---|---|---|---|---|
K = 2 | 0.0216 | 0.1728 | |||||
K = 3 | 0.0201 | 0.1146 | 0.3098 | ||||
K = 4 | 0.0195 | 0.1073 | 0.2013 | 0.3692 | |||
K = 5 | 0.0191 | 0.104 | 0.1764 | 0.2904 | 0.3863 | ||
K = 6 | 0.0158 | 0.0999 | 0.1208 | 0.1971 | 0.3227 | 0.3993 | |
K = 7 | 0.0184 | 0.0865 | 0.1136 | 0.1789 | 0.2724 | 0.3575 | 0.4249 |
Model | One-Step | Three-Step | Five-Step | ||||||
---|---|---|---|---|---|---|---|---|---|
RMSE | MAE | MAPE | RMSE | MAE | MAPE | RMSE | MAE | MAPE | |
LSTM | 0.0679 | 0.0356 | 0.0469 | 0.4617 | 0.4598 | 1.1665 | 0.6335 | 0.6314 | 2.8592 |
EMD-LSTM | 0.0543 | 0.0242 | 0.0750 | 2.6828 | 2.5946 | 1.0398 | 4.4542 | 3.7371 | 3.7675 |
CEEMDAN-LSTM | 0.1380 | 0.1271 | 0.2073 | 1.8222 | 1.6466 | 1.7563 | 2.5248 | 2.1232 | 1.2991 |
STL-LSTM | 0.0616 | 0.0276 | 0.0344 | 0.4545 | 0.4389 | 1.1521 | 0.8900 | 0.8189 | 3.3971 |
OVMD-LSTM | 0.0150 | 0.0144 | 0.0169 | 1.3774 | 1.1473 | 1.5867 | 1.6681 | 1.3498 | 1.5519 |
STL-OVMD-LSTM | 0.0124 | 0.0096 | 0.0116 | 0.0617 | 0.0327 | 0.0613 | 0.3925 | 0.3065 | 0.9162 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, B.; Xie, Y.; Wang, K.; Yu, L.; Zhou, Y.; Lv, X. Short-Term Multi-Step Wind Direction Prediction Based on OVMD Quadratic Decomposition and LSTM. Sustainability 2023, 15, 11746. https://doi.org/10.3390/su151511746
Liu B, Xie Y, Wang K, Yu L, Zhou Y, Lv X. Short-Term Multi-Step Wind Direction Prediction Based on OVMD Quadratic Decomposition and LSTM. Sustainability. 2023; 15(15):11746. https://doi.org/10.3390/su151511746
Chicago/Turabian StyleLiu, Banteng, Yangqing Xie, Ke Wang, Lizhe Yu, Ying Zhou, and Xiaowen Lv. 2023. "Short-Term Multi-Step Wind Direction Prediction Based on OVMD Quadratic Decomposition and LSTM" Sustainability 15, no. 15: 11746. https://doi.org/10.3390/su151511746
APA StyleLiu, B., Xie, Y., Wang, K., Yu, L., Zhou, Y., & Lv, X. (2023). Short-Term Multi-Step Wind Direction Prediction Based on OVMD Quadratic Decomposition and LSTM. Sustainability, 15(15), 11746. https://doi.org/10.3390/su151511746