arXiv:2506.06185cs.LGcs.NA2025-06被引 4

给扩散模型加相反噪声,能大幅提高不确定性估计精度。

Antithetic Noise in Diffusion Models

  • 用成对相反噪声提升生成结果的可靠性。
  • 不确定性区间宽度缩小最高达90%。
  • 无需训练、不增加计算量,适合各类生成模型。

我们系统研究了扩散模型中的反向初始噪声,发现将每个噪声样本与其相反数配对可产生稳定的负相关性。这一普遍现象在不同数据集、模型架构、条件与无条件采样中均成立,甚至适用于变分自编码器(VAEs)和归一化流等其他生成模型。为解释该现象,结合实验与理论提出“对称性猜想”:学习到的得分函数近似为仿射反对称(奇对称加常数偏移),并有实证支持。这种负相关使不确定性量化更加可靠,置信区间最窄可缩减90%。我们在像素级统计估计和扩散逆求解器评估等任务中验证了该优势。此外,还提出了基于随机准蒙特卡洛噪声设计的扩展方案,并探索其在图像编辑和生成多样性提升中的应用。该框架无需训练、模型无关,且不增加运行时开销。代码已开源。

原文摘要 · Abstract (English)

We systematically study antithetic initial noise in diffusion models, discovering that pairing each noise sample with its negation consistently produces strong negative correlation. This universal phenomenon holds across datasets, model architectures, conditional and unconditional sampling, and even other generative models such as VAEs and Normalizing Flows. To explain it, we combine experiments and theory and propose a \textit{symmetry conjecture} that the learned score function is approximately affine antisymmetric (odd symmetry up to a constant shift), supported by empirical evidence. This negative correlation leads to substantially more reliable uncertainty quantification with up to $90\%$ narrower confidence intervals. We demonstrate these gains on tasks including estimating pixel-wise statistics and evaluating diffusion inverse solvers. We also provide extensions with randomized quasi-Monte Carlo noise designs for uncertainty quantification, and explore additional applications of the antithetic noise design to improve image editing and generation diversity. Our framework is training-free, model-agnostic, and adds no runtime overhead. Code is available at https://github.com/jjia131/Antithetic-Noise-in-Diffusion-Models-page.

扩散模型不确定性噪声设计生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。