Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention
Abstract
:1. Introduction
- To address the complex energy consumption data of large public buildings, the CEEMDAN method is employed to decompose the data, resulting in decomposed IMF components and residuals and effectively decoupling the energy consumption data of large public buildings.
- A combined feature screening method, MIC-FCBF, is proposed, ranking the regression feature importance for each decomposed IMF component and residual. Simultaneously, the BiLSTMAM model is utilized to predict each component and residual.
- The accuracy and robustness of the model are validated using data from a large public building in Xi’an, Shaanxi Province, China. The application of the model is discussed, and its superiority is verified through comparisons with multiple benchmark methods.
2. Methodology
2.1. MIC-FCBF Combined Feature Screening
2.1.1. Maximum Mutual Information Coefficient
2.1.2. Fast Correlation-Based Filter Algorithm
2.2. Development of Integrated Energy Consumption Prediction Model
2.2.1. CEEMDAN Signal Decomposition Method
2.2.2. Bilstm-Attention Method
2.3. Algorithm Framework
3. Case Study
3.1. Building Information
3.2. Input Data and Data Collection
4. Result and Discussion
4.1. Evaluation Metrics of the Model
4.2. Energy Consumption Data CEEMDAN Signal Decomposition
4.3. Feature Analysis
4.4. Performance Validation of the Model
- (1)
- The CEEMDAN-MIC-FCBF-BiLSTMAM model outperforms other models in all accuracy evaluation metrics, exhibiting the smallest MAE, MSE, RMSE, and MAPE and the highest R2 and RPD values. This indicates that the CEEMDAN-MIC-FCBF-BiLSTMAM model excels in the accuracy and stability of energy consumption prediction for large public buildings.
- (2)
- Both the CEEMDAN-MIC-FCBF-BiLSTMAM model and the CEEMDAN-BiLSTMAM model outperform the BiLSTM model in various evaluation metrics, showing an improvement in model performance. This suggests that CEEMDAN signal decomposition and the incorporation of AM (Attention Mechanism) in BiLSTM contribute to enhanced prediction accuracy, especially in scenarios with complex feature coupling for energy consumption prediction in large public buildings.
- (3)
- The RMSE of CEEMDAN-MIC-FCBF-BiLSTMAM is 11.9, demonstrating a 57.23% improvement compared to CEEMDAN-FCBF-BiLSTMAM without MIC value screening and a 67.21% improvement compared to CEEMDAN-BiLSTMAM without feature selection. This indicates that the MIC-FCBF combined feature selection method can significantly improve the model’s prediction accuracy. The RMSE is 65.65% lower compared to CNN-BiLSTM, highlighting the effectiveness of feature extraction through CNN for improving prediction accuracy.
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Gao, L.; Liu, T.; Cao, T.; Hwang, Y.; Radermacher, R. Comparing deep learning models for multi energy vectors prediction on multiple types of building. Appl. Energy 2021, 301, 117486. [Google Scholar] [CrossRef]
- Yang, Y.; Chen, Y.; Wang, Y.; Li, C.; Li, L. Modelling a combined method based on ANFIS and neural network improved by DE algorithm: A case study for short-term electricity demand forecasting. Appl. Soft Comput. 2016, 49, 663–675. [Google Scholar] [CrossRef]
- Gassar, A.A.A.; Cha, S.H. Energy prediction techniques for large-scale buildings towards a sustainable built environment: A review. Energy Build. 2020, 224, 110238. [Google Scholar] [CrossRef]
- Cristino, T.M.; Neto, A.F.; Wurtz, F.; Delinchant, B. The Evolution of Knowledge and Trends within the Building Energy Efficiency Field of Knowledge. Energies 2022, 15, 691. [Google Scholar] [CrossRef]
- Zhang, L.; Wen, J.; Li, Y.; Chen, J.; Ye, Y.; Fu, Y.; Livingood, W. A review of machine learning in building load prediction. Appl. Energy 2021, 285, 116452. [Google Scholar] [CrossRef]
- Wang, Z.; Srinivasan, R.S. A review of artificial intelligence based building energy use prediction: Contrasting the capabilities of single and ensemble prediction models. Renew. Sustain. Energy Rev. 2017, 75, 796–808. [Google Scholar] [CrossRef]
- Ye, Y.; Zuo, W.; Wang, G. A comprehensive review of energy-related data for U.S. commercial buildings. Energy Build. 2019, 186, 126–137. [Google Scholar] [CrossRef]
- Dagdougui, H.; Bagheri, F.; Le, H.; Dessaint, L. Neural network model for short-term and very-short-term load forecasting in district buildings. Energy Build. 2019, 203, 109408. [Google Scholar] [CrossRef]
- Gao, Z.; Yu, J.; Zhao, A.; Hu, Q.; Yang, S. A hybrid method of cooling load forecasting for large commercial building based on extreme learning machine. Energy 2022, 238, 122073. [Google Scholar] [CrossRef]
- Ekonomou, L. Greek long-term energy consumption prediction using artificial neural networks. Energy 2010, 35, 512–517. [Google Scholar] [CrossRef]
- Zhao, H.; Magoulès, F. A review on the prediction of building energy consumption. Renew Sustain. Energy Rev. 2012, 16, 3586–3592. [Google Scholar] [CrossRef]
- Wang, Z.; Wang, Y.; Zeng, R.; Srinivasan, R.S.; Ahrentzen, S. Random Forest based hourly building energy prediction. Energy Build. 2018, 171, 11–25. [Google Scholar] [CrossRef]
- Wu, X.; Kumar, V.; Ross Quinlan, J.; Ghosh, J.; Yang, Q.; Motoda, H.; McLachlan, J.G.; Ng, A.; Liu, B.; Yu, P.S.; et al. Top 10 algorithms in data mining. Knowl. Inf. Syst. 2008, 14, 1–37. [Google Scholar] [CrossRef]
- Wang, Z.; Srinivasan, R.S. A review of artificial intelligence based building energy prediction with a focus on ensemble prediction models. In Proceedings of the 2015 Winter Simulation Conference (WSC), Huntington Beach, CA, USA, 6–9 December 2016; pp. 3438–3448. [Google Scholar]
- Catalina, T.; Iordache, V.; Caracaleanu, B. Multiple regression model for fast prediction of the heating energy demand. Energy Build. 2013, 57, 302–312. [Google Scholar] [CrossRef]
- Ji, P.; Xiong, D.; Wang, P.; Chen, J. A Study on Exponential Smoothing Model for Load Forecasting. In Proceedings of the 2012 Asia-Pacific Power and Energy Engineering Conference, Shanghai, China, 27–29 March 2012; pp. 1–4. [Google Scholar]
- Domingos, P. A few useful things to know about machine learning. Commun. ACM 2012, 55, 78–87. [Google Scholar] [CrossRef]
- Chen, Y.; Huang, M.; Tao, Y. Density-based clustering multiple linear regression model of energy consumption for electric vehicles. Sustain. Energy Technol. Assess. 2022, 53, 102614. [Google Scholar] [CrossRef]
- Ma, M.; Wang, Z. Prediction of the Energy Consumption Variation Trend in South Africa based on ARIMA, NGM and NGM-ARIMA Models. Energies 2019, 13, 10. [Google Scholar] [CrossRef]
- Hu, J.; Zheng, W.; Zhang, S.; Li, H.; Liu, Z.; Zhang, G.; Yang, X. Thermal load prediction and operation optimization of office building with a zone-level artificial neural network and rule-based control. Appl. Energy 2021, 300, 117429. [Google Scholar] [CrossRef]
- Edwards, R.E.; New, J.; Parker, L.E. Predicting future hourly residential electrical consumption: A machine learning case study. Energy Build. 2012, 49, 591–603. [Google Scholar] [CrossRef]
- Zhao, H.X.; Magoulès, F. Parallel Support Vector Machines Applied to the Prediction of Multiple Buildings Energy Consumption. J. Algorithms Comput. Technol. 2010, 4, 231–249. [Google Scholar] [CrossRef]
- Bui, D.K.; Nguyen, T.N.; Ngo, T.D.; Nguyen-Xuan, H. An artificial neural network (ANN) expert system enhanced with the electromagnetism-based firefly algorithm (EFA) for predicting the energy consumption in buildings. Energy 2020, 190, 116370. [Google Scholar] [CrossRef]
- Etemad, A.; Shafaat, A.; Bahman, A.M. Data-driven performance analysis of a residential building applying artificial neural network (ANN) and multi-objective genetic algorithm (GA). Build. Environ. 2022, 225, 109633. [Google Scholar]
- Zhang, X.-R.; Lei, M.-Y.; Li, Y. An amplitudes-perturbation data augmentation method in convolutional neural networks for EEG decoding. In Proceedings of the 2018 5th International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS), Hangzhou, China, 16–19 August 2018; pp. 231–235. [Google Scholar]
- Somu, N.; MR, G.R.; Ramamritham, K. A deep learning framework for building energy consumption forecast. Renew. Sustain. Energy Rev. 2021, 137, 110591. [Google Scholar] [CrossRef]
- Cao, W.; Yu, J.; Chao, M.; Wang, J.; Yang, S.; Zhou, M.; Wang, M. Short-Term Energy Consumption Prediction Method for Educational Buildings Based on Model Integration. Energy 2023, 283, 128580. [Google Scholar] [CrossRef]
- Kong, W.; Dong, Z.Y.; Jia, Y.; Hill, D.J.; Xu, Y.; Zhang, Y. Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network. IEEE Trans. Smart Grid. C 2019, 10, 841–851. [Google Scholar] [CrossRef]
- Karijadi, I.; Chou, S.-Y. A hybrid RF-LSTM based on CEEMDAN for improving the accuracy of building energy consumption prediction. Energy Build. 2022, 259, 111908. [Google Scholar] [CrossRef]
- Kilinc, H.C.; Yurtsever, A. Short-term streamflow forecasting using hybrid deep learning model based on grey wolf algorithm for hydrological time series. Sustainability 2022, 14, 3352. [Google Scholar] [CrossRef]
- Zheng, H.; Yuan, J.; Chen, L. Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation. Energies 2017, 10, 1168. [Google Scholar] [CrossRef]
- Tao, Q.-Y.; Yu, C.-J.; Li, Y.-L. Wind speed prediction in bridge site area based on empirical value decomposition and Elman neural network. Disaster Sci. 2017, 32, 85–89. [Google Scholar]
- Mao, Y.; Yu, J.; Zhang, N.; Dong, F.; Wang, M.; Li, X. A Hybrid Model of Commercial Building Cooling Load Prediction Based on the Improved NCHHO-FENN Algorithm. J. Build. Eng. 2023, 78, 107660. [Google Scholar] [CrossRef]
- Torres, M.E.; Colominas, M.A.; Schlotthauer, G.; Flandrin, P. A complete ensemble empirical mode decomposition with adaptive noise. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 22–27 May 2011; pp. 4144–4147. [Google Scholar]
- Lin, Z. Short-Term Prediction of Building Sub-Item Energy Consumption Based on the CEEMDAN-BiLSTM Method. Front. Energy Res. 2022, 10, 908544. [Google Scholar] [CrossRef]
- Xu, H.; Liu, Y.; Li, J.; Yu, H.; An, X.; Ma, K.; Liang, Y.; Hu, X.; Zhang, H. Study on the Influence of High and Low Temperature Environment on the Energy Consumption of Battery Electric Vehicles. Energy Rep. 2023, 9, 835–842. [Google Scholar] [CrossRef]
- Zhang, Y.; Zhang, Y.; He, W.; Yu, S.; Zhao, S. Improved Feature Size Customized Fast Correlation-Based Filter for Naive Bayes Text Classification. J. Intell. Fuzzy Syst. 2020, 38, 3117–3127. [Google Scholar] [CrossRef]
- Ruiz, R.; Riquelme, J.C.; Aguilar-Ruiz, J.S.; García-Torres, M. Fast Feature Selection Aimed at High-Dimensional Data via Hybrid-Sequential-Ranked Searches. Expert Syst. Appl. 2012, 39, 11094–11102. [Google Scholar] [CrossRef]
- Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Yen, N.C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
- Wu, Z.; Huang, N.E. Ensemble empirical mode decomposition: A noise-assisted data analysis method. Adv. Adapt. Data Anal. 2011, 1, 1–41. [Google Scholar] [CrossRef]
- Mao, Q.; Fang, X.; Hu, Y.; Li, G. Chiller sensor fault detection based on empirical mode decomposition threshold denoising and principal component analysis. Appl. Therm. Eng. 2018, 144, 21–30. [Google Scholar] [CrossRef]
- Jia, Y.; Li, G.; Dong, X.; He, K. A novel denoising method for vibration signal of hob spindle based on EEMD and grey theory. Measurement 2021, 169, 108490. [Google Scholar] [CrossRef]
- Lei, L.; Shao, S.; Liang, L. An evolutionary deep learning model based on EWKM, random forest algorithm, SSA and BiLSTM for building energy consumption prediction. Energy 2024, 288, 129795. [Google Scholar] [CrossRef]
- Song, Y.; Xie, H.; Zhu, Z.; Ji, R. Predicting Energy Consumption of Chiller Plant Using WOA-BiLSTM Hybrid Prediction Model: A Case Study for a Hospital Building. Energy Build. 2023, 300, 113642. [Google Scholar] [CrossRef]
- Zhang, D.; Chen, B.; Zhu, H.; Goh, H.H.; Dong, Y.; Wu, T. Short-term wind power prediction based on two-layer decomposition and BiTCN-BiLSTM-attention model. Energy 2023, 285, 128762. [Google Scholar] [CrossRef]
- Guo, J.; Liu, M.; Luo, P.; Chen, X.; Yu, H.; Wei, X. Attention-based BILSTM for the degradation trend prediction of lithium battery. Energy Rep. 2023, 9, 655–664. [Google Scholar] [CrossRef]
Feature | Abbreviation | Type | Unit |
---|---|---|---|
Date | Day | Independent | 1, 2, 3, …, 31 |
Time | Time | Independent | 1, 2, 3, …, 24 |
Type of weekday | WT | Independent | Weekday and weekend |
Day of the week | DT | Independent | Sunday, Monday, Saturday |
Air temperature | AT | Continuous | °C |
Air humidity | AH | Continuous | % |
Barometric pressure | BP | Continuous | hPa |
Wind speed | WS | Continuous | m/s |
Cloud cover | CC | Continuous | 0–10 percent |
Total solar irradiance at the previous moment | RP | Continuous | W/m2 |
Total solar irradiance | TR | Continuous | W/m2 |
Energy consumption at the previous moment | ECP | Continuous | kWh |
Model | MAE | MSE | RMSE | R2 | RPD | MAPE |
---|---|---|---|---|---|---|
CEEMDAN-MIC-FCBF-BiLSTMAM | 8.41 | 141.21 | 11.92 | 0.996 | 15.54 | 0.011 |
CEEMDAN-FCBF-BiLSTMAM | 19.62 | 771.92 | 27.83 | 0.975 | 6.33 | 0.027 |
CEEMDAN-BiLSTMAM | 27.24 | 1313.12 | 36.25 | 0.957 | 5.85 | 0.034 |
CEEMDAN-CNN-BiLSTM | 22.55 | 1196.53 | 34.67 | 0.961 | 5.12 | 0.032 |
CNN-BiGRU | 28.37 | 1310.38 | 36.25 | 0.957 | 5.21 | 0.038 |
BiLSTM | 50.84 | 4604.14 | 67.94 | 0.851 | 2.67 | 0.066 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tian, Z.; Chen, D.; Zhao, L. Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention. Appl. Sci. 2024, 14, 2137. https://doi.org/10.3390/app14052137
Tian Z, Chen D, Zhao L. Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention. Applied Sciences. 2024; 14(5):2137. https://doi.org/10.3390/app14052137
Chicago/Turabian StyleTian, Zeqin, Dengfeng Chen, and Liang Zhao. 2024. "Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention" Applied Sciences 14, no. 5: 2137. https://doi.org/10.3390/app14052137
APA StyleTian, Z., Chen, D., & Zhao, L. (2024). Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention. Applied Sciences, 14(5), 2137. https://doi.org/10.3390/app14052137