arXiv:2503.02537cs.CVcs.AI2025-03被引 1

无需训练即可高效生成高清图像,解决模糊问题。

RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectification

  • 通过噪声重置策略实现无训练高分辨率生成
  • 发现能量衰减导致图像模糊并提出调参优化
  • 兼容多种扩散模型技术,适合图像编辑与视频生成

扩散模型在视觉生成任务中取得了显著进展,但在生成高于训练分辨率的内容时性能大幅下降。尽管已有诸多方法支持高分辨率生成,但普遍存在效率低下问题。本文提出RectifiedHR,一种无需训练的高效高分辨率合成方案。我们提出一种噪声重置策略,使模型具备无需训练的高分辨率生成能力,并提升效率。首次观察到能量衰减现象,该现象可能导致高分辨率生成过程中的图像模糊。通过平均隐空间能量分析,发现调节无分类器引导超参数可显著改善生成效果。本方法完全无需训练,表现高效。此外,RectifiedHR兼容多种扩散模型技术,支持图像编辑、定制化生成和视频合成等高级功能。大量对比实验验证了其优越的有效性与效率。

原文摘要 · Abstract (English)

Diffusion models have achieved remarkable progress across various visual generation tasks. However, their performance significantly declines when generating content at resolutions higher than those used during training. Although numerous methods have been proposed to enable high-resolution generation, they all suffer from inefficiency. In this paper, we propose RectifiedHR, a straightforward and efficient solution for training-free high-resolution synthesis. Specifically, we propose a noise refresh strategy that unlocks the model's training-free high-resolution synthesis capability and improves efficiency. Additionally, we are the first to observe the phenomenon of energy decay, which may cause image blurriness during the high-resolution synthesis process. To address this issue, we introduce average latent energy analysis and find that tuning the classifier-free guidance hyperparameter can significantly improve generation performance. Our method is entirely training-free and demonstrates efficient performance. Furthermore, we show that RectifiedHR is compatible with various diffusion model techniques, enabling advanced features such as image editing, customized generation, and video synthesis. Extensive comparisons with numerous baseline methods validate the superior effectiveness and efficiency of RectifiedHR.

扩散模型高清生成无训练图像编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。