提出可调控保真与真实感平衡的图像超分方法
CTSR: Controllable Fidelity-Realness Trade-off Distillation for Real-World Image Super Resolution
- 用多教师模型几何分解保真与真实感进行知识蒸馏
- 在多个真实场景数据集上同时提升保真度与视觉真实感
- 支持灵活调节保真与真实感权重,适合实际应用需求
真实世界图像超分辨率是一项关键图像处理任务,其核心评价指标为结果对原图的保真度和视觉真实感。现有基于扩散模型的方法虽能生成高真实感图像,但难以在保真度与真实感之间取得良好平衡。初步实验发现,多个模型线性组合优于单一模型,由此启发我们提出一种基于知识蒸馏的方法,通过几何分解保真与真实感,并利用多教师模型的优势,实现更优的权衡。此外,我们探索了该权衡的可调控性,构建了可控的超分辨率框架CTSR(Controllable Trade-off Super-Resolution)。在多个真实世界图像超分辨率基准上的实验表明,该方法超越现有最先进方法,在保真度与真实感双指标上均取得更好表现。
原文摘要 · Abstract (English)
Real-world image super-resolution is a critical image processing task, where two key evaluation criteria are the fidelity to the original image and the visual realness of the generated results. Although existing methods based on diffusion models excel in visual realness by leveraging strong priors, they often struggle to achieve an effective balance between fidelity and realness. In our preliminary experiments, we observe that a linear combination of multiple models outperforms individual models, motivating us to harness the strengths of different models for a more effective trade-off. Based on this insight, we propose a distillation-based approach that leverages the geometric decomposition of both fidelity and realness, alongside the performance advantages of multiple teacher models, to strike a more balanced trade-off. Furthermore, we explore the controllability of this trade-off, enabling a flexible and adjustable super-resolution process, which we call CTSR (Controllable Trade-off Super-Resolution). Experiments conducted on several real-world image super-resolution benchmarks demonstrate that our method surpasses existing state-of-the-art approaches, achieving superior performance across both fidelity and realness metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。