用拉普拉斯金字塔和反复缩放增强图像超分辨细节。
Detail Loss in Super-Resolution Models Based on the Laplacian Pyramid and Repeated Upscaling and Downscaling Process
- 引入拉普拉斯金字塔细节损失,分离控制图像与细节生成。
- 反复缩放放大低分辨率特征多样性,提升细节表现力。
- 适用于各类模型,尤其改善注意力机制结构的细节还原。
随着人工智能发展,图像处理受到广泛关注。图像超分辨技术在现实应用中至关重要,可提升现有图像质量。由于增强细微细节对超分辨任务至关重要,需强调贡献于高频信息的像素。本文提出两种方法:基于拉普拉斯金字塔的细节损失,以及反复上采样与下采样过程。结合该细节损失的总损失函数,引导模型分别生成并控制超分辨图像与细节图像,使模型更专注高频成分,从而提升图像质量。此外,反复缩放通过从多组低分辨率特征中提取多样化信息,增强细节损失效果。我们设计了基于CNN的模型并验证其性能,结果达到当前最优,超越多数基于CNN甚至部分基于注意力的模型。同时,将本方法应用于现有注意力模型的小规模实验中,所有模型均较原版有性能提升。这些结果表明,所提方法在不同模型结构中均有效提升超分辨图像质量。
原文摘要 · Abstract (English)
With advances in artificial intelligence, image processing has gained significant interest. Image super-resolution is a vital technology closely related to real-world applications, as it enhances the quality of existing images. Since enhancing fine details is crucial for the super-resolution task, pixels that contribute to high-frequency information should be emphasized. This paper proposes two methods to enhance high-frequency details in super-resolution images: a Laplacian pyramid-based detail loss and a repeated upscaling and downscaling process. Total loss with our detail loss guides a model by separately generating and controlling super-resolution and detail images. This approach allows the model to focus more effectively on high-frequency components, resulting in improved super-resolution images. Additionally, repeated upscaling and downscaling amplify the effectiveness of the detail loss by extracting diverse information from multiple low-resolution features. We conduct two types of experiments. First, we design a CNN-based model incorporating our methods. This model achieves state-of-the-art results, surpassing all currently available CNN-based and even some attention-based models. Second, we apply our methods to existing attention-based models on a small scale. In all our experiments, attention-based models adding our detail loss show improvements compared to the originals. These results demonstrate our approaches effectively enhance super-resolution images across different model structures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。