arXiv:2509.10122cs.CVcs.AI2025-09中稿 · AAAI被引 4

提出可调控真实感的一步扩散模型,提升真实图像超分辨率效果。

Realism Control One-step Diffusion for Real-World Image Super-Resolution

  • 通过潜在空间分组实现生成时对保真度与真实感的灵活控制。
  • 在多个数据集上优于现有一步扩散方法,峰值信噪比提升0.2~0.5dB。
  • 支持推理阶段动态调节真实感,适合实际应用中的多场景需求。

预训练扩散模型在真实世界图像超分辨率(Real-ISR)任务中展现出巨大潜力,能够实现高分辨率重建。尽管一步扩散(OSD)方法相比传统多步方法显著提升了效率,但在不同场景下仍难以平衡保真度与真实感。由于现有的OSD-SR通常仅在单个时间步训练或蒸馏,缺乏自适应调整这一权衡的机制,而多步方法可通过调节采样步数实现。为此,我们提出一种现实感可控的一步扩散(RCOD)框架用于Real-ISR。RCOD引入潜在域分组策略,在噪声预测阶段实现对保真度-真实感权衡的显式控制,且仅需少量训练修改和原始数据。同时提出退化感知采样策略,使蒸馏正则化与分组策略对齐,增强权衡控制能力。此外,使用视觉提示注入模块替代传统文本提示,采用退化感知视觉标记,提升重建精度与语义一致性。大量实验表明,RCOD在定量指标与视觉质量上均优于当前最先进的OSD方法,并在推理阶段具备灵活的真实感控制能力。

原文摘要 · Abstract (English)

Pre-trained diffusion models have shown great potential in real-world image super-resolution (Real-ISR) tasks by enabling high-resolution reconstructions. While one-step diffusion (OSD) methods significantly improve efficiency compared to traditional multi-step approaches, they still have limitations in balancing fidelity and realism across diverse scenarios. Since the OSDs for SR are usually trained or distilled by a single timestep, they lack flexible control mechanisms to adaptively prioritize these competing objectives, which are inherently manageable in multi-step methods through adjusting sampling steps. To address this challenge, we propose a Realism Controlled One-step Diffusion (RCOD) framework for Real-ISR. RCOD provides a latent domain grouping strategy that enables explicit control over fidelity-realism trade-offs during the noise prediction phase with minimal training paradigm modifications and original training data. A degradation-aware sampling strategy is also introduced to align distillation regularization with the grouping strategy and enhance the controlling of trade-offs. Moreover, a visual prompt injection module is used to replace conventional text prompts with degradation-aware visual tokens, enhancing both restoration accuracy and semantic consistency. Our method achieves superior fidelity and perceptual quality while maintaining computational efficiency. Extensive experiments demonstrate that RCOD outperforms state-of-the-art OSD methods in both quantitative metrics and visual qualities, with flexible realism control capabilities in the inference stage.

图像超分辨率扩散模型真实感控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。