提出新方法在不重训练模型的前提下,让扩散模型生成目标分布数据。
Inference-Time Alignment for Diffusion Models via Variationally Stable Doob's Matching
- 基于杜布变换构造可证明的引导估计框架
- 理论保证引导估计收敛,生成结果在2-Wasserstein距离下逼近目标分布
- 对低维子空间假设自适应,缓解高维诅咒问题
推理时对齐扩散模型旨在不重新训练参考得分网络的情况下,将预训练的参考扩散模型适配至目标分布,从而保留参考模型的生成能力并实现推理时的期望特性。核心机制是通过附加漂移项修改采样动态的引导方法。本文提出一种基于杜布 $h$-变换的变分稳定杜布匹配新框架,将引导表示为潜在杜布 $h$-函数的对数梯度,并采用梯度正则化回归同时估计 $h$-函数及其梯度,获得一致的引导估计器。理论上,我们建立了引导估计的非渐近收敛速率;进一步分析了可控扩散过程,证明生成分布在 2-沃瑟斯坦距离下的非渐近收敛性。最后,我们证明变分稳定的引导估计器对未知低维性具有自适应性,在低维子空间假设下有效缓解维度灾难。
原文摘要 · Abstract (English)
Inference-time alignment for diffusion models aims to adapt a pre-trained reference diffusion model toward a target distribution without retraining the reference score network, thereby preserving the generative capacity of the reference model while enforcing desired properties at the inference time. A central mechanism for achieving such alignment is guidance, which modifies the sampling dynamics through an additional drift term. In this work, we introduce variationally stable Doob's matching, a novel framework for provable guidance estimation grounded in Doob's $h$-transform. Our approach formulates guidance as the gradient of logarithm of an underlying Doob's $h$-function and employs gradient-regularized regression to simultaneously estimate both the $h$-function and its gradient, resulting in a consistent estimator of the guidance. Theoretically, we establish non-asymptotic convergence rates for the estimated guidance. Moreover, we analyze the resulting controllable diffusion processes and prove non-asymptotic convergence guarantees for the generated distributions in the 2-Wasserstein distance. Finally, we show that variationally stable guidance estimators are adaptive to unknown low dimensionality, effectively mitigating the curse of dimensionality under low-dimensional subspace assumptions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。