arXiv:2510.12497cs.LG2025-10被引 1

提出噪声感知引导,解决扩散模型采样时噪声水平错位问题

Mitigating the Noise Shift for Denoising Generative Models via Noise Awareness Guidance

  • 通过显式校正采样路径与预设噪声调度的一致性
  • 在ImageNet等任务上显著提升生成质量
  • 无需外部分类器,适配主流扩散模型

现有去噪生成模型依赖求解离散化的反向时间SDE或ODE。本文发现该类模型中普遍存在一个长期被忽视的问题:采样过程中中间状态所编码的实际噪声水平与预设噪声水平存在偏差,称为噪声漂移。实证分析表明,噪声漂移在现代扩散模型中广泛存在且具有系统性偏差,导致生成效果不佳,既因分布外泛化又因去噪更新不准确。为此,我们提出噪声感知引导(NAG),一种简单有效的修正方法,可显式引导采样轨迹保持与预设噪声调度的一致性。进一步提出无分类器版本的NAG,通过噪声条件丢弃联合训练噪声条件与无条件模型,消除对外部分类器的需求。大量实验,包括ImageNet生成和多种监督微调任务,均显示NAG能持续缓解噪声漂移,显著提升主流扩散模型的生成质量。

原文摘要 · Abstract (English)

Existing denoising generative models rely on solving discretized reverse-time SDEs or ODEs. In this paper, we identify a long-overlooked yet pervasive issue in this family of models: a misalignment between the pre-defined noise level and the actual noise level encoded in intermediate states during sampling. We refer to this misalignment as noise shift. Through empirical analysis, we demonstrate that noise shift is widespread in modern diffusion models and exhibits a systematic bias, leading to sub-optimal generation due to both out-of-distribution generalization and inaccurate denoising updates. To address this problem, we propose Noise Awareness Guidance (NAG), a simple yet effective correction method that explicitly steers sampling trajectories to remain consistent with the pre-defined noise schedule. We further introduce a classifier-free variant of NAG, which jointly trains a noise-conditional and a noise-unconditional model via noise-condition dropout, thereby eliminating the need for external classifiers. Extensive experiments, including ImageNet generation and various supervised fine-tuning tasks, show that NAG consistently mitigates noise shift and substantially improves the generation quality of mainstream diffusion models.

扩散模型去噪生成噪声校正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。