L-WaveBlock: A Novel Feature Extractor Leveraging Wavelets for Generative Adversarial Networks

GenAI GANs CV Backbone SR and Denoising
2023年11月09日
本文介绍了一种新颖而稳健的特征提取器L-WaveBlock,它利用离散小波变换(DWT)和深度学习方法,旨在加快GAN生成器的收敛速度,同时提高其性能。通过使用DWT,L-WaveBlock能够高效地捕捉结构和纹理细节,并将特征图分成多个尺度的正交子带,同时保留重要信息。实验结果表明,L-WaveBlock在三个数据集上都表现出了显著的实用性,包括道路卫星图像数据集、CelebA数据集和GoPro数据集。使用L-WaveBlock不仅能够加快收敛速度,还能在每个数据集上获得有竞争力的结果。在地图数据集上,所提出的方法实现了3.6959的Inception分数和0.4261的结构相似性指数;在CelebA数据集上,实现了29.05的峰值信噪比和0.874的结构相似性指数。虽然在图像去噪数据集上表现不如现有技术,但仍比传统方法更快地收敛。因此,L-WaveBlock成为一种强大而高效的工具,可以提高基于GAN的图像生成的性能,展现出在图像分辨率、图像生成和图像去噪等多个数据集上具有优越的收敛速度和竞争性能。
Generative Adversarial Networks (GANs) have risen to prominence in the field of deep learning, facilitating the generation of realistic data from random noise. The effectiveness of GANs often depends on the quality of feature extraction, a critical aspect of their architecture. This paper introduces L-WaveBlock, a novel and robust feature extractor that leverages the capabilities of the Discrete Wavelet Transform (DWT) with deep learning methodologies. L-WaveBlock is catered to quicken the convergence of GAN generators while simultaneously enhancing their performance. The paper demonstrates the remarkable utility of L-WaveBlock across three datasets, a road satellite imagery dataset, the CelebA dataset and the GoPro dataset, showcasing its ability to ease feature extraction and make it more efficient. By utilizing DWT, L-WaveBlock efficiently captures the intricate details of both structural and textural details, and further partitions feature maps into orthogonal subbands across multiple scales while preserving essential information at the same time. Not only does it lead to faster convergence, but also gives competent results on every dataset by employing the L-WaveBlock. The proposed method achieves an Inception Score of 3.6959 and a Structural Similarity Index of 0.4261 on the maps dataset, a Peak Signal-to-Noise Ratio of 29.05 and a Structural Similarity Index of 0.874 on the CelebA dataset. The proposed method performs competently to the state-of-the-art for the image denoising dataset, albeit not better, but still leads to faster convergence than conventional methods. With this, L-WaveBlock emerges as a robust and efficient tool for enhancing GAN-based image generation, demonstrating superior convergence speed and competitive performance across multiple datasets for image resolution, image generation and image denoising.
许愿