arXiv:2506.18165cs.LGcs.AI2025-06NeurIPS被引 9

用可调动态参考过程提升扩散采样效率与稳定性

Non-equilibrium Annealed Adjoint Sampler

  • 采用非平衡退火参考过程,引导采样轨迹更高效逼近目标分布
  • 在经典能量景观和分子玻尔兹曼分布上均实现高质量采样
  • 框架兼容多种最优控制求解器,适合需要灵活设计的生成模型研究

近年来,基于学习的扩散采样方法在从给定非归一化密度采样方面取得显著进展。许多方法将采样任务建模为使用标准无信息参考过程的随机最优控制(SOC)问题,限制了其引导轨迹高效逼近目标分布的能力。本文提出非平衡退火伴随采样器(NAAS),一种基于SOC的新型扩散框架,采用退火参考动力学作为非平稳基础SDE。该退火结构自然地引导轨迹向目标分布演化,生成有信息的参考轨迹,从而增强控制学习的稳定性和效率。得益于我们的SOC公式,该框架可集成多种SOC求解器,提供高度算法设计灵活性。作为实例,我们采用受伴随匹配启发的轻量级伴随系统,实现高效且可扩展的训练。我们在一系列任务中验证了NAAS的有效性,包括经典能量景观和分子玻尔兹曼分布的采样。

原文摘要 · Abstract (English)

Recently, there has been significant progress in learning-based diffusion samplers, which aim to sample from a given unnormalized density. Many of these approaches formulate the sampling task as a stochastic optimal control (SOC) problem using a canonical uninformative reference process, which limits their ability to efficiently guide trajectories toward the target distribution. In this work, we propose the Non-Equilibrium Annealed Adjoint Sampler (NAAS), a novel SOC-based diffusion framework that employs annealed reference dynamics as a non-stationary base SDE. This annealing structure provides a natural progression toward the target distribution and generates informative reference trajectories, thereby enhancing the stability and efficiency of learning the control. Owing to our SOC formulation, our framework can incorporate a variety of SOC solvers, thereby offering high flexibility in algorithmic design. As one instantiation, we employ a lean adjoint system inspired by adjoint matching, enabling efficient and scalable training. We demonstrate the effectiveness of NAAS across a range of tasks, including sampling from classical energy landscapes and molecular Boltzmann distributions.

扩散模型最优控制采样器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。