提出新方法提升任意缩放图像超分辨率的细节真实感与结构准确性。
Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolution

- 通过融合保真度与感知特征,设计局部隐式注意力模块增强表示能力。
- 在标准数据集上同时实现更优的视觉真实感与重建精度,优于现有方法。
- 适合需要高质量图像生成的视觉任务,如医学影像、高清视频修复。
任意尺度图像超分辨率(ASISR)旨在从低分辨率输入中重建高分辨率图像,覆盖连续的缩放因子范围。传统像素回归方法常产生过于平滑的结果,缺乏真实细节;而近期扩散模型虽能生成更锐利、逼真的纹理,却易引入结构幻觉。为此,本文提出保真度与感知感知局部隐式注意力(FPLIA)框架,将保真度导向特征有效融入扩散流程,以实现真实且忠实的重构。我们设计了保真度与感知注意力模块(FPAM),对保真度和感知特征分别施加自注意力与交叉注意力,增强表征能力。为进一步挖掘两者互补性,提出保真度与感知选择模块(FPSM),自适应筛选最具有代表性的特征用于预测RGB值。大量实验证明该框架有效性。定性与定量结果均显示,FPLIA在标准ASISR基准上兼具卓越的感知真实感与重建精度。代码已开源:https://github.com/XUSean0118/FPLIA。
原文摘要 · Abstract (English)
Arbitrary-scale image super-resolution (ASISR) aims to reconstruct high-resolution images from low-resolution inputs over a continuous range of upscaling factors. While traditional pixel-regression approaches often produce overly smooth results that lack realistic details, recent diffusion methods can produce sharper and more realistic textures. However, these diffusion techniques frequently introduce the risk of structural hallucinations. To address these issues, we propose Fidelity- and Perception-Aware Local Implicit Attention (FPLIA), a framework that effectively integrates fidelity-oriented features into a diffusion pipeline to produce realistic and faithful reconstructions for ASISR. We introduce a Fidelity and Perception Attention Module (FPAM), which applies both self-attention and cross-attention to fidelity-oriented and perceptual features to enhance representational capacity. To further exploit their complements, we design a Fidelity and Perception Select Module (FPSM) that adaptively selects the most representative features for RGB values prediction. We conduct extensive experiments to validate the effectiveness of these components. Both qualitative and quantitative results show that FPLIA delivers superior perceptual realism while maintaining reconstruction accuracy on standard ASISR benchmarks. The source code is accessible at the following repository: https://github.com/XUSean0118/FPLIA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。