arXiv:2412.07081stat.MLcs.AI2024-12ICLR被引 50

将SMC与扩散模型结合,提升采样效率与稳定性。

Sequential Controlled Langevin Diffusions

  • 用连续时间路径空间视角融合SMC与扩散采样
  • 在多个基准上性能优于现有方法,仅需10%训练预算
  • 适合追求高效稳定采样的研究人员

从非归一化密度中采样的一种有效方法是通过逐步将样本从简单先验传输到复杂目标分布。两种主流方法为:(1) 顺序蒙特卡洛(SMC),通过预设的马尔可夫链和重采样步骤沿一系列退火密度进行传输;(2) 最近发展的基于扩散的采样方法,采用学习得到的动力学传输过程。尽管目标相同,两者各有优劣:SMC的重采样能聚焦于空间中的有利区域,表现稳健,但缺乏灵活可学习的转移机制,导致收敛慢;而扩散采样可自适应目标分布,却常面临训练不稳定性。本文提出一个统一框架,将两种方法在连续时间下统一建模,并在路径空间上考虑概率测度,由此导出新的序列控制朗之万扩散(SCLD)采样方法。该方法结合了两者的优点,在多个基准任务中实现更优性能,许多情况下仅需先前扩散采样器10%的训练预算。

原文摘要 · Abstract (English)

An effective approach for sampling from unnormalized densities is based on the idea of gradually transporting samples from an easy prior to the complicated target distribution. Two popular methods are (1) Sequential Monte Carlo (SMC), where the transport is performed through successive annealed densities via prescribed Markov chains and resampling steps, and (2) recently developed diffusion-based sampling methods, where a learned dynamical transport is used. Despite the common goal, both approaches have different, often complementary, advantages and drawbacks. The resampling steps in SMC allow focusing on promising regions of the space, often leading to robust performance. While the algorithm enjoys asymptotic guarantees, the lack of flexible, learnable transitions can lead to slow convergence. On the other hand, diffusion-based samplers are learned and can potentially better adapt themselves to the target at hand, yet often suffer from training instabilities. In this work, we present a principled framework for combining SMC with diffusion-based samplers by viewing both methods in continuous time and considering measures on path space. This culminates in the new Sequential Controlled Langevin Diffusion (SCLD) sampling method, which is able to utilize the benefits of both methods and reaches improved performance on multiple benchmark problems, in many cases using only 10% of the training budget of previous diffusion-based samplers.

采样算法扩散模型蒙特卡洛

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。