用文本先验学习连续退化等级,提升扩散模型超分辨率精度
Learning Ordinal Degradation Representations with Textual Priors for Diffusion-Based Blind Image Super-Resolution
- 将退化程度建模为连续谱,而非离散标签
- 在真实图像上实现未知与混合退化下的高保真恢复
- 适合需要精细退化建模的图像修复研究者
盲超分辨率(Blind SR)通过生成先验已实现出色的感知质量。然而,缺乏对退化强度和混合退化的明确表示,导致方法无法准确反映实际退化过程,严重损害复原保真度并引发内容不一致,尤其在依赖简单文本描述的扩散模型中。为弥合高层语义与低层退化伪影之间的差距,我们提出有序退化CLIP(OD-CLIP),利用文本先验增强连续退化层级表示的学习。不同于标准CLIP文本编码器难以表达数值强度,OD-CLIP将未知退化建模为连续谱,捕捉退化类型及其相对严重程度,显式建模退化层次并支持未见水平间的插值。实验表明,与基线方法相比,OD-CLIP在序数排序和感知距离建模上表现更优;将其应用于盲超分辨率,在真实世界基准上,无论未知或混合退化设置下均保持更高保真度与内容结构一致性。
原文摘要 · Abstract (English)
Blind image super-resolution (Blind SR) has achieved remarkable perceptual quality via generative priors. However, lacking clear degradation representations such as varying severity and mixtures, these methods fail to accurately reflect the actual degradation process. This limitation severely compromises restoration fidelity and leads to content inconsistencies, especially in diffusion-based blind SR models that rely on simple textual descriptions for contextual guidance. To bridge the gap between high-level semantics and low-level degradation artifacts, we introduce Ordinal Degradation CLIP (OD-CLIP), leveraging textual priors to enhance the learning of continuous degradation-level representations. Unlike standard CLIP text encoders, which struggle to represent numerical intensity, OD-CLIP moves beyond coarse labels by modeling unknown degradations as a continuous spectrum representing quality. By learning an ordinal embedding from low-quality inputs, our design captures both degradation types and their relative severity, explicitly modeling the degradation hierarchy and enabling interpolation across unseen levels. In our experiments, the OD-CLIP representation demonstrates stronger ordinal ranking and perceptual distance modeling compared to baseline methods. When applied to blind SR, we show that conditioning on OD-CLIP maintains fidelity and preserves content structures over existing methods in both unknown and mixed-degradation settings on real-world benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。