arXiv:2509.22300cs.CVcs.AI2025-09被引 2

用历史预测优化采样,让扩散模型生成更快更真实。

HiGS: History-Guided Sampling for Plug-and-Play Enhancement of Diffusion Models

  • 基于历史预测差值引导采样,提升细节和结构
  • 30步生成就达1.61的FID新纪录
  • 无需训练,可无缝接入现有模型

尽管扩散模型在图像生成上取得显著进展,但在较少神经函数评估次数(NFE)或较低引导尺度下,生成结果仍可能不真实且缺乏细节。为此,我们提出一种新型动量式采样技术——历史引导采样(HiGS),通过将近期模型预测整合到每个推理步骤中,提升扩散采样的质量和效率。具体而言,HiGS利用当前预测与过去预测加权平均之间的差异,引导采样过程生成更具真实感、细节更丰富的图像。该方法几乎不增加计算开销,且可无缝集成至现有扩散框架,无需额外训练或微调。大量实验表明,HiGS在多种模型架构及不同采样预算和引导尺度下均能持续提升图像质量。使用预训练的SiT模型,HiGS在仅30步采样下,实现了256×256无引导ImageNet生成的最新FID得分1.61(标准为250步)。因此,我们提出一种即插即用的扩散采样增强方案,实现更快生成与更高保真度。

原文摘要 · Abstract (English)

While diffusion models have made remarkable progress in image generation, their outputs can still appear unrealistic and lack fine details, especially when using fewer number of neural function evaluations (NFEs) or lower guidance scales. To address this issue, we propose a novel momentum-based sampling technique, termed history-guided sampling (HiGS), which enhances quality and efficiency of diffusion sampling by integrating recent model predictions into each inference step. Specifically, HiGS leverages the difference between the current prediction and a weighted average of past predictions to steer the sampling process toward more realistic outputs with better details and structure. Our approach introduces practically no additional computation and integrates seamlessly into existing diffusion frameworks, requiring neither extra training nor fine-tuning. Extensive experiments show that HiGS consistently improves image quality across diverse models and architectures and under varying sampling budgets and guidance scales. Moreover, using a pretrained SiT model, HiGS achieves a new state-of-the-art FID of 1.61 for unguided ImageNet generation at 256$\times$256 with only 30 sampling steps (instead of the standard 250). We thus present HiGS as a plug-and-play enhancement to standard diffusion sampling that enables faster generation with higher fidelity.

扩散模型采样优化图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。