arXiv:2509.26096cs.CVcs.IT2025-09NeurIPS被引 14

通过优化条件熵提升扩散模型生成效率,显著降低误差与推理成本。

EVODiff: Entropy-aware Variance Optimized Diffusion Inference

  • 从信息论角度优化反向过程中的条件方差,减少不确定性。
  • 在CIFAR-10上比DPM-Solver++降低45.5%重建误差,FID从5.10降至2.78。
  • 适用于高保真图像生成,尤其适合追求低推理成本的场景。

扩散模型(DMs)在图像生成中表现优异,但存在推理缓慢和训练-推理不一致问题。尽管基于梯度的求解器能加速去噪推理,但往往缺乏信息传输效率的理论基础。本文从信息论视角揭示:成功去噪本质上是降低反向转移中的条件熵。由此得到两大关键洞察:(1) 数据预测参数化优于噪声预测;(2) 优化条件方差可无参考地最小化转移与重构误差。基于此,我们提出熵感知的方差优化方法EVODiff,系统性地在去噪过程中优化条件熵。大量实验验证了上述洞见,结果表明该方法显著且一致地超越现有最先进(SOTA)梯度求解器。例如,在CIFAR-10上,相比DPM-Solver++,EVODiff在10次函数评估(NFE)下将重建误差降低45.5%(FID从5.10降至2.78),在ImageNet-256上将高质量样本的NFE成本降低25%(从20降至15),同时提升文本到图像生成质量并减少伪影。代码已开源。

原文摘要 · Abstract (English)

Diffusion models (DMs) excel in image generation but suffer from slow inference and training-inference discrepancies. Although gradient-based solvers for DMs accelerate denoising inference, they often lack theoretical foundations in information transmission efficiency. In this work, we introduce an information-theoretic perspective on the inference processes of DMs, revealing that successful denoising fundamentally reduces conditional entropy in reverse transitions. This principle leads to our key insights into the inference processes: (1) data prediction parameterization outperforms its noise counterpart, and (2) optimizing conditional variance offers a reference-free way to minimize both transition and reconstruction errors. Based on these insights, we propose an entropy-aware variance optimized method for the generative process of DMs, called EVODiff, which systematically reduces uncertainty by optimizing conditional entropy during denoising. Extensive experiments on DMs validate our insights and demonstrate that our method significantly and consistently outperforms state-of-the-art (SOTA) gradient-based solvers. For example, compared to the DPM-Solver++, EVODiff reduces the reconstruction error by up to 45.5\% (FID improves from 5.10 to 2.78) at 10 function evaluations (NFE) on CIFAR-10, cuts the NFE cost by 25\% (from 20 to 15 NFE) for high-quality samples on ImageNet-256, and improves text-to-image generation while reducing artifacts. Code is available at https://github.com/ShiguiLi/EVODiff.

扩散模型图像生成熵优化推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。