用频域混合增强真实图像监督信号,提升修复质量。
Beyond the Ground Truth: Enhanced Supervision for Image Restoration
- 通过自适应频域掩码融合原图与超分结果,生成更优真值图像。
- 在真实退化数据集上,显著提升修复图像的感知质量与保真度。
- 轻量级后处理网络可无缝接入现有模型,适合实际应用部署。
基于深度学习的图像修复已取得显著进展,但在处理真实世界退化时,模型性能受限于数据集中真值图像的质量。为此,我们提出一种新框架,通过超分辨率结合自适应频率掩码生成更高质量的真值图像,以增强监督信号。该掩码由条件频率掩码生成器学习,指导原真值与超分版本在频域中的最优融合,保留语义一致性的同时选择性增强感知细节,避免幻觉伪影影响保真度。使用这些增强后的真值图像训练一个轻量级输出优化网络,可无缝集成至现有修复模型中。大量实验表明,该方法显著提升了修复图像质量。用户研究进一步验证了监督增强与输出优化的有效性。
原文摘要 · Abstract (English)
Deep learning-based image restoration has achieved significant success. However, when addressing real-world degradations, model performance is limited by the quality of groundtruth images in datasets due to practical constraints in data acquisition. To address this limitation, we propose a novel framework that enhances existing ground truth images to provide higher-quality supervision for real-world restoration. Our framework generates perceptually enhanced ground truth images using super-resolution by incorporating adaptive frequency masks, which are learned by a conditional frequency mask generator. These masks guide the optimal fusion of frequency components from the original ground truth and its super-resolved variants, yielding enhanced ground truth images. This frequency-domain mixup preserves the semantic consistency of the original content while selectively enriching perceptual details, preventing hallucinated artifacts that could compromise fidelity. The enhanced ground truth images are used to train a lightweight output refinement network that can be seamlessly integrated with existing restoration models. Extensive experiments demonstrate that our approach improves the quality of restored images. We further validate the effectiveness of both supervision enhancement and output refinement through user studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。