让扩散模型同时优化分布与约束条件,实现更精准的受控生成。
Constrained Diffusion Models with Primal-Dual Inference

- 联合推断最优分布与约束对偶变量,动态调整采样过程。
- 在混合高斯、资源分配等任务中实现约束满足率超95%。
- 适合需要严格遵守平均约束的生成任务,如金融与通信系统。
本文提出基于对偶推断(PDI)的约束扩散模型,用于从带有平均约束的熵正则化优化问题的最优分布中采样。通过在拉格朗日对偶域中形式化约束采样,最优分布表现为由最优对偶变量参数化的吉布斯分布。不同于先估计并固定对偶乘子再采样的传统方法,PDI在反向扩散过程中同步推断最优原始分布及其对偶变量。每一步去噪使用当前乘子对应的得分场,并通过梯度上升更新乘子,利用去噪样本的约束违反程度进行优化。为支持这一条件得分场,训练单一依赖对偶变量的得分网络,覆盖推断过程中遇到的吉布斯分布族。理论证明:推断轨迹中对偶变量的时间平均收敛于最优对偶邻域,且残差对偶失配对终态分布的影响可通过依赖调度的稳定性因子控制。实验在混合高斯、无线资源分配和投资组合管理任务上验证了PDI的有效性。
原文摘要 · Abstract (English)
This paper develops constrained diffusion models with primal-dual inference (PDI) to sample from optimal distributions of entropy-regularized optimization problems with \emph{average} constraints. We formalize constrained sampling in the Lagrangian dual domain, where the optimal distribution takes the form of a Gibbs distribution indexed by the optimal dual variable. Rather than estimating this dual multiplier before sampling and freezing it throughout generation, PDI jointly infers the optimal primal distribution and its parametrizing dual variable. Each reverse diffusion step denoises using the score field associated with the current multiplier and then updates the multiplier through dual ascent using the estimated constraint violation of the denoised samples. To enable this conditional score field, we train a single dual-conditioned score network over the family of Gibbs distributions induced by the dual variables encountered during inference. We prove that the time average of the dual variables generated along the inference trajectory converges to a neighborhood of the dual optimum and bound the effect of residual dual mismatch on the terminal distribution through schedule-dependent stability factors. We evaluate PDI on constrained sampling from a mixture of Gaussians, wireless resource allocation, and portfolio management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。