arXiv:2507.05482cs.LGstat.ML2025-07中稿 · ICML

无需训练即可精准引导扩散模型采样低密度区域

Stein Diffusion Guidance: Training-Free Posterior Correction for Sampling Beyond High-Density Regions

  • 基于斯坦因变分推断构建新型无训练引导框架
  • 在低密度区域采样效果显著优于传统方法
  • 适合需要高精度采样的分子生成与图像引导任务

无训练扩散引导为利用现成分类器提供了灵活框架,但现有方法依赖基于Tweedie公式的后验近似,常在低密度区域产生不可靠引导。随机最优控制(SOC)虽能实现合理后验采样,但计算成本过高。本文提出斯坦因扩散引导(SDG),一种基于代理SOC目标的新型无训练框架。我们建立了SOC价值函数的新理论界,揭示了修正近似后验以反映真实扩散动力学的必要性。基于斯坦因变分推断,SDG计算使近似后验与真实后验间KL散度最小化的最陡下降方向,并结合新型运行代价函数,在低密度区域实现有效引导。在多种图像引导任务及蛋白质对接中的小分子采样挑战上,SDG均持续优于标准无训练引导方法,展现出在高密度以外区域更广泛后验采样问题上的潜力。

原文摘要 · Abstract (English)

Training-free diffusion guidance offers a flexible framework for leveraging off-the-shelf classifiers without additional training. Yet, current approaches hinge on posterior approximations via Tweedie's formula, which often yield unreliable guidance, particularly in low-density regions. Stochastic optimal control (SOC), in contrast, enables principled posterior sampling but remains computationally prohibitive for efficient inference. In this work, we reconcile the strengths of these paradigms by introducing Stein Diffusion Guidance (SDG), a novel training-free framework grounded in a surrogate SOC objective. We establish a new theoretical bound on the SOC value function, revealing the necessity of correcting approximate posteriors to reflect true diffusion dynamics. Building on Stein variational inference, SDG computes the steepest descent direction that minimizes the Kullback-Leibler divergence between approximate and true posteriors. By integrating a principled Stein correction mechanism along with a novel running cost functional, SDG enables effective guidance in low-density regions. Our experiments on diverse image-guidance tasks and on challenging small-ligand sampling for protein docking suggest that SDG consistently outperforms standard training-free guidance methods and highlights its potential for broader posterior sampling problems beyond high-density regimes.

扩散模型无训练引导分子生成低密度采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。