破解超分辨率中保真与感知质量的隐藏矛盾,实现更好平衡。
Interest Entanglement: The Hidden Barrier to Blind Super-Resolution Optimization

- 分离不同优化目标的学习过程,避免目标冲突
- 在五个数据集上均优于现有方法,细节更清晰
- 适合关注图像生成质量与真实感的研究者
图像超分辨率(SR)任务中,保真度与视觉感知质量是本质对立的目标。回归损失提升模型保真度但忽略高频细节,感知损失改善视觉质量却可能引入伪影。现有方法仅通过调节损失权重尝试平衡,忽视了深层的‘兴趣纠缠’问题。本文分析了回归与感知目标在频域上的内在冲突,提出基于共享特征表示的超分辨率框架SFR,解耦不同目标的学习过程,使模型能共同探索优化方向,有效平衡二者。为更好利用共享特征,设计了InfoSqueeze模块,通过降维与升维过滤冗余信息,将特征映射到一致空间。在五个代表性数据集上的定量与定性实验验证了SFR的优越性。
原文摘要 · Abstract (English)
Fidelity and perceptual quality are two inherently competing and conflicting objectives in the image super-resolution (SR) task. Different loss functions focus on these objectives to varying extents. Regression losses enhance the model's fidelity but lack sufficient attention to high-frequency details, resulting in a loss of fine details. In contrast, perception losses improve the model's visual quality but may introduce undesirable artifacts. Balancing these two optimization goals can be viewed as a Multi-Objective Optimization problem. Existing methods are limited to cautiously adjusting weight parameters between these losses, overlooking the underlying Interest Entanglement problem. To address this problem, we explore the inherent frequency-domain conflict between the regression objective and the perceptual objective, and analyze the causes of Interest Entanglement in SR tasks. According to our findings, we propose the Shared-Feature-Representation based Super-Resolution framework (SFR), which decouples the learning process of different optimization objectives, allowing the model to explore a common optimization direction for both goals and achieve an effective balance between them. To better leverage shared features, we also proposed the InfoSqueeze module, which filters redundant information through a dimensionality reduction and expansion process, effectively transforming features into a consistent space. Quantitative and qualitative experiments across five representative datasets affirm the superiority of SFR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。