arXiv:2602.05533cs.AI2026-02被引 9

让扩散模型生成满足硬约束的样本,确保100%达标。

Conditional Diffusion Guidance under Hard Constraint: A Stochastic Analysis Approach

  • 用杜布h-变换构建条件引导框架,不改原有模型。
  • 提出两种新算法,仅用预训练轨迹估计约束梯度。
  • 理论保证生成结果在统计距离上逼近理想分布。

我们研究扩散模型在硬约束下的条件生成问题,要求生成样本以概率1满足指定事件。此类约束在安全关键应用和罕见事件模拟中至关重要,传统软性或基于奖励的引导方法无法保证约束满足。基于扩散模型的概率解释,我们提出一种基于杜布h-变换、鞅表示与二次变差过程的严谨条件引导框架。所提引导动态通过显式漂移修正增强预训练扩散模型,涉及条件函数对数梯度,且不修改原始得分网络。利用鞅与二次变差恒等式,我们设计了两种新颖的离线学习算法,分别基于鞅损失与鞅-协变损失,仅使用预训练模型轨迹即可估计h函数及其梯度。我们为所得条件采样器提供了非渐近性保证,明确刻画了得分近似误差与引导估计误差对总变差与沃瑟斯坦距离的影响。数值实验验证了方法在强制硬约束和生成稀有事件样本方面的有效性。代码见 https://github.com/ZhengyiGuo2002/CDG_Finance。

原文摘要 · Abstract (English)

We study conditional generation in diffusion models under hard constraints, where generated samples must satisfy prescribed events with probability one. Such constraints arise naturally in safety-critical applications and in rare-event simulation, where soft or reward-based guidance methods offer no guarantee of constraint satisfaction. Building on a probabilistic interpretation of diffusion models, we develop a principled conditional diffusion guidance framework based on Doob's h-transform, martingale representation and quadratic variation process. Specifically, the resulting guided dynamics augment a pretrained diffusion with an explicit drift correction involving the logarithmic gradient of a conditioning function, without modifying the pretrained score network. Leveraging martingale and quadratic-variation identities, we propose two novel off-policy learning algorithms based on a martingale loss and a martingale-covariation loss to estimate h and its gradient using only trajectories from the pretrained model. We provide non-asymptotic guarantees for the resulting conditional sampler in both total variation and Wasserstein distances, explicitly characterizing the impact of score approximation and guidance estimation errors. Numerical experiments demonstrate the effectiveness of the proposed methods in enforcing hard constraints and generating rare-event samples. The code of the numerical experiments can be found at https://github.com/ZhengyiGuo2002/CDG_Finance.

扩散模型条件生成硬约束理论保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。