A Deep Learning-Based Two-Branch Generative Adversarial Network for Image De-Raining

基于深度学习的双分支生成对抗网络图像去雨

阅读:1

Abstract

Raindrops can scatter and absorb light, causing images to become blurry or distorted. To improve image quality by reducing the impact of raindrops, this paper proposes a novel generative adversarial network for image de-raining. The network comprises two parts: a generative network and an adversarial network. The generative network performs image de-raining. The adversarial network determines whether the input image is rain-free or de-rained. The generative network comprises two branches: the A branch, which follows a traditional convolutional network structure, and the U branch, which utilizes a U-Net architecture. The A branch includes a multi-scale module for extracting information at different scales and a residual attention module to reduce redundant information interference. The U branch contains an encoder module designed to address the loss of details and local information caused by conventional down-sampling. To improve the performance of the generative network in image de-raining, this paper employs a relative discriminator incorporating a mean squared error loss. This discriminator better measures the differences between rainy and rain-free images while effectively preventing the occurrence of gradient vanishing. Finally, this study performs visual and quantitative comparisons of the proposed method and existing methods on three established rain image datasets. In the quantitative experiments, the proposed method outperforms existing methods regarding PSNR, SSIM, and VIF metrics. Specifically, our method achieves an average PSNR, SSIM, and VIF of approximately 5%, 3%, and 4% higher than the MFAA-GAN method, respectively. These results indicate that the de-rained images generated via the proposed method are closer to rain-free images.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。