Addressing the data imbalance issue in machine learning modeling of rare and disruptive outage events

解决机器学习建模中罕见且破坏性极强的故障事件的数据不平衡问题

阅读:1

Abstract

Rare natural hazards-such as severe storms, flooding, and wildfires-are difficult to model due to scarcity of high-quality observational data. This scarcity results in an imbalance within the dataset, where high-impact events are severely underrepresented, reducing the effectiveness of machine learning (ML) models. In this study, we propose a framework using stable diffusion to generate physical consistent synthetic storm events for data enrichment. Our method generates paired input-output samples, ensuring that synthetic meteorological fields are meaningfully aligned with their corresponding impact. A variational autoencoder compresses 19-channel storm fields into latent space, where a cluster-conditioned diffusion model generates events aligned with outage severity. Synthetic events are filtered using evaluation metrics that assess distributional similarity and physical consistency. Enrichment with screened synthetic events significantly improved ML-based outage prediction modeling, which consequently boosted overall prediction accuracy-reducing CRMSE by 39%, increasing R(2) by 11%, and NSE by over 200%.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。