arXiv:2608.29507cs.LGcs.AI2026-08

用去噪器做投影,让扩散模型生成符合约束的优化样本

Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion

论文配图:Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion
图 1 · 摘自论文原文
  • 将目标梯度融入去噪步骤,实现约束优化的推理时更新
  • 在三类几何结构上证明了目标函数下降与有限步收敛
  • 适合需要保持数据结构的生成任务,如图像修复、逆问题求解

扩散模型不仅用于从学习到的数据分布中采样,还被用于生成优化特定任务目标的样本。常见的方法是使用外部目标的梯度引导反向扩散过程,但当数据分布在有结构的可行集(如流形或约束集)上时,梯度引导可能使样本偏离学习到的数据几何结构。本文提出一种基于斯坦去噪算子可近似投影到数据几何的观察,采用投影梯度引导的扩散更新。该方法将目标梯度嵌入去噪步骤,仅需预训练去噪器和梯度评估即可实现推理时更新。我们将其分析为在学习到的可行几何上的不精确投影梯度法,涵盖三类设定:线性流形、紧凸可行集、紧黎曼子流形。在所有情形下均证明了目标下降与有限时间收敛性。数值实验验证了理论解释,并展示该方法在目标下降与几何保持之间的平衡能力。

原文摘要 · Abstract (English)

Diffusion models are increasingly used not only for sampling from learned data distributions, but also for generating samples that optimize task-specific objectives. A common approach is to guide the reverse diffusion process using gradients of an external objective. However, when the data distribution is supported on a structured feasible set, such as a manifold or a constraint set, gradient guidance can move samples away from the learned data geometry. In this paper, we study a simple projected-gradient-guided diffusion update based on the observation that the Stein denoising operator can act as an approximate projection onto the data geometry. The proposed update incorporates the objective gradient inside the denoising step, yielding an inference-time method that uses only a pretrained denoiser and gradient evaluations. We analyze this update as an inexact projected-gradient method for constrained optimization over learned feasible geometries. Our theory covers three settings: linear manifolds, compact convex feasible sets, and compact Riemannian submanifolds. In all these settings, we prove descent and finite-time convergence guarantees. Numerical experiments support the theoretical interpretation and illustrate how the proposed update balances objective descent with preservation of the learned geometry.

扩散模型约束优化去噪器几何保持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。