Novel GSIP: GAN-based sperm-inspired pixel imputation for robust energy image reconstruction

新型GSIP:基于GAN的精子启发式像素插补,用于稳健的能量图像重建

阅读:1

Abstract

Missing pixel imputation is a critical task in image processing, where the presence of high percentages of missing pixels can significantly degrade the performance of downstream tasks such as image segmentation and object detection. This paper introduces a novel approach for missing pixel imputation based on Generative Adversarial Networks (GANs). We propose a new GAN architecture incorporating an identity module and a sperm motility-inspired heuristic during filtration to optimize the selection of pixels used in reconstructing missing data. The intelligent sperm motility heuristic navigates the image's pixel space, identifying the most influential neighboring pixels for accurate imputation. Our approach includes three essential modifications: (1) integration of an identity module within the GAN architecture to mitigate the vanishing gradient problem; (2) introduction of a metaheuristic algorithm based on sperm motility to select the top 10 pixels that most effectively contribute to the generation of the missing pixel; and (3) the implementation of an adaptive interval mechanism between the discriminator's actual value and the weighted average of the selected pixels, enhancing the generator's efficiency and ensuring the coherence of the imputed pixels with the surrounding image context. We evaluate the proposed method on three distinct datasets (Energy Images, NREL Solar Images, and NREL Wind Turbine Dataset), demonstrating its superior performance in maintaining pixel integrity during the imputation process. Our experiments also confirm the approach's effectiveness in addressing everyday challenges in GANs, such as mode collapse and vanishing gradients, across various GAN architectures.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。