从真实低清图像中学习退化模式,重建高质量超分辨率图像。
Unsupervised Image Super-Resolution Reconstruction Based on Real-World Degradation Patterns
- 设计三阶段GAN框架,分步逼近真实退化特征。
- 在RealSR和DRealSR上提升重建质量,避免过度平滑。
- 适合需要真实场景超分的视觉任务开发者使用。
真实世界超分辨率重建模型的训练依赖于反映实际退化特性的数据集。仅用真实低分辨率(LR)图像提取并建模退化模式仍具挑战性。纯合成数据难以同时捕捉模糊、多样噪声及隐含退化(如色域偏移)。单纯域迁移因合成与真实数据间存在显著退化差异,无法准确模拟真实模糊特性。为此,提出TripleGAN框架:FirstGAN用于缩小模糊特性的域差距;SecondGAN实现域内转换以逼近目标域模糊属性并学习额外退化模式;ThirdGAN在FirstGAN与SecondGAN生成的伪真实数据上训练,用于重建真实低清图像。在RealSR和DRealSR数据集上的大量实验表明,该方法在定量指标上表现更优,且重建结果清晰锐利,无过平滑伪影。框架能有效从低清观测中学习真实退化模式,并生成具有对应退化特征的对齐数据集,使网络在真实低清输入下实现更优的高保真超分辨率重建。
原文摘要 · Abstract (English)
The training of real-world super-resolution reconstruction models heavily relies on datasets that reflect real-world degradation patterns. Extracting and modeling degradation patterns for super-resolution reconstruction using only real-world low-resolution (LR) images remains a challenging task. When synthesizing datasets to simulate real-world degradation, relying solely on degradation extraction methods fails to capture both blur and diverse noise characteristics across varying LR distributions, as well as more implicit degradations such as color gamut shifts. Conversely, domain translation alone cannot accurately approximate real-world blur characteristics due to the significant degradation domain gap between synthetic and real data. To address these challenges, we propose a novel TripleGAN framework comprising two strategically designed components: The FirstGAN primarily focuses on narrowing the domain gap in blur characteristics, while the SecondGAN performs domain-specific translation to approximate target-domain blur properties and learn additional degradation patterns. The ThirdGAN is trained on pseudo-real data generated by the FirstGAN and SecondGAN to reconstruct real-world LR images. Extensive experiments on the RealSR and DRealSR datasets demonstrate that our method exhibits clear advantages in quantitative metrics while maintaining sharp reconstructions without over-smoothing artifacts. The proposed framework effectively learns real-world degradation patterns from LR observations and synthesizes aligned datasets with corresponding degradation characteristics, thereby enabling the trained network to achieve superior performance in reconstructing high-quality SR images from real-world LR inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。