提出新框架实现任意缩放图像超分辨率,兼顾真实感与保真度。
OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolution
- 用显式尺度控制机制增强扩散模型的缩放适应性
- 在多种缩放倍数下均优于现有方法,尤其在大倍数时表现突出
- 适合需要高真实感图像重建的应用场景
任意尺度超分辨率(ASSR)突破了传统超分辨率仅支持固定倍数(如4x)的局限,使单一模型可处理任意放大倍数。现有大多数ASSR方法依赖隐式神经表示(INR),其基于回归的特征提取和聚合方式限制了细粒度细节生成,导致真实感不足。近期基于扩散模型的逼真超分辨率(Real-ISR)在4x设置下表现出色,得益于强大的预训练扩散先验。我们发现该先验可隐式适应不同尺度,实现多尺度生成。但缺乏显式尺度控制会导致生成结果在超高倍率下出现过度幻觉或模糊。为此,我们提出OmniScaleSR,一种基于扩散模型的逼真任意尺度超分辨率框架,引入与扩散过程原生兼容的显式尺度控制机制,协同隐式尺度自适应能力,实现尺度感知与内容感知的扩散过程调节。同时采用多域保真度增强设计进一步提升重建精度。在双三次退化基准及真实世界数据集上的大量实验表明,OmniScaleSR在保真度与感知真实感方面均超越当前最优方法,尤其在大倍率放大时表现优异。代码将发布于https://github.com/chaixinning/OmniScaleSR。
原文摘要 · Abstract (English)
Arbitrary-scale super-resolution (ASSR) overcomes the limitation of traditional super-resolution (SR) methods that operate only at fixed scales (e.g., 4x), enabling a single model to handle arbitrary magnification. Most existing ASSR approaches rely on implicit neural representation (INR), but its regression-driven feature extraction and aggregation intrinsically limit the ability to synthesize fine details, leading to low realism. Recent diffusion-based realistic image super-resolution (Real-ISR) models leverage powerful pre-trained diffusion priors and show impressive results at the 4x setting. We observe that they can also achieve ASSR because the diffusion prior implicitly adapts to scale by encouraging high-realism generation. However, without explicit scale control, the diffusion process cannot be properly adjusted for different magnification levels, resulting in excessive hallucination or blurry outputs, especially under ultra-high scales. To address these issues, we propose OmniScaleSR, a diffusion-based realistic arbitrary-scale SR framework designed to achieve both high fidelity and high realism. We introduce explicit, diffusion-native scale control mechanisms that work synergistically with implicit scale adaptation, enabling scale-aware and content-aware modulation of the diffusion process. In addition, we incorporate multi-domain fidelity enhancement designs to further improve reconstruction accuracy. Extensive experiments on bicubic degradation benchmarks and real-world datasets show that OmniScaleSR surpasses state-of-the-art methods in both fidelity and perceptual realism, with particularly strong performance at large magnification factors. Code will be released at https://github.com/chaixinning/OmniScaleSR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。