arXiv:2603.06685cs.LG2026-03中稿 · ICLR

用蒙特卡洛采样改进扩散模型的引导生成,提升结果一致性

One step further with Monte-Carlo sampler to guide diffusion better

  • 增加反向去噪步骤与蒙特卡洛采样,降低梯度估计误差
  • 在轨迹生成、图像修复等任务中均显著提升生成质量
  • 适合追求高精度生成的科研与工程应用

基于随机微分方程(SDE)的生成模型在无需训练的可微损失引导方法下取得了显著进展。然而,现有利用后验采样的方法普遍存在较大估计误差,导致引导梯度不准确,生成结果不一致。为此,我们提出一种额外反向去噪与蒙特卡洛采样(ABMS)的插件式调整策略,可有效改善引导扩散过程。通过理论分析和双焦点评估框架验证了该方法的有效性,凸显了现有方法中跨条件干扰的关键问题。我们在多种任务设置与数据类型上进行了实验,包括条件在线手写轨迹生成、图像逆问题(修补、超分辨率、高斯模糊去噪)及分子逆设计等。结果表明,该方法能与高阶采样器协同工作,在所有场景中一致提升生成样本质量。

原文摘要 · Abstract (English)

Stochastic differential equation (SDE)-based generative models have achieved substantial progress in conditional generation via training-free differentiable loss-guided approaches. However, existing methodologies utilizing posterior sam- pling typically confront a substantial estimation error, which results in inaccu- rate gradients for guidance and leading to inconsistent generation results. To mitigate this issue, we propose that performing an additional backward denois- ing step and Monte-Carlo sampling (ABMS) can achieve better guided diffu- sion, which is a plug-and-play adjustment strategy. To verify the effectiveness of our method, we provide theoretical analysis and propose the adoption of a dual-focus evaluation framework, which further serves to highlight the critical problem of cross-condition interference prevalent in existing approaches. We conduct experiments across various task settings and data types, mainly includ- ing conditional online handwritten trajectory generation, image inverse problems (inpainting, super resolution and gaussian deblurring) molecular inverse design and so on. Experimental results demonstrate that our approach can be effec- tively used with higher order samplers and consistently improves the quality of generation samples across all the different scenarios.

扩散模型采样优化生成质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。