Chaotic billiards optimized hybrid transformer and XGBoost model for robust and sustainable time series forecasting

混沌台球优化混合Transformer和XGBoost模型用于稳健且可持续的时间序列预测

阅读:2

Abstract

Accurate wind speed forecasting plays a key role in supporting renewable energy systems, improving flight safety, and enhancing weather prediction. However, the variability and non-stationary nature of wind patterns make reliable forecasting a difficult task. To address these issues, this research proposes a hybrid approach that combines Wavelet Transform (WT) decomposition, an Encoder-Decoder Transformer, and XGBoost in an ensemble setup. To fine-tune model parameters efficiently, the method incorporates the Chaotic Billiards Optimizer (CBO) alongside the Adam optimizer. In this framework, WT helps break down wind speed signals into different frequency bands, capturing both short-term changes and long-term behavior. The Transformer model focuses on learning complex time-based dependencies, while XGBoost adds robustness to the final predictions by reducing overfitting and improving generalization. The model forecasts wind speed values on an hourly basis, up to 24 h ahead. The use of CBO ensures efficient convergence with minimal parameter tuning, making the model suitable for large-scale datasets compared to conventional optimizers, including Adam, Particle Swarm Optimization (PSO) and Genetic Algorithms (GA). When tested on real wind speed data collected from Egypt via the Open-Meteo platform, the proposed model showed strong performance. It achieved a Mean Absolute Error (MAE) of 0.0218, Mean Squared Error (MSE) of 0.0008, and Root Mean Squared Error (RMSE) of 0.0290, along with an R² score of 0.9625, MAPE of 11.97%, and an Explained Variance Score (EVS) of 0.9521. These results were better than those from models like Linear Regression, SVR, LSTM, and even standalone Transformer and XGBoost. Overall, this hybrid method provides a reliable and efficient solution for wind speed forecasting in the context of sustainable energy planning. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1038/s41598-025-10641-7.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。