arXiv:2605.09302cs.LGcs.CV2026-05

提出一种无需离散变量连续松弛的高效离散后验采样方法。

Discrete Langevin-Inspired Posterior Sampling

论文配图:Discrete Langevin-Inspired Posterior Sampling
图 1 · 摘自论文原文
  • 基于梯度引导在离散空间内直接搜索最优更新路径。
  • 在MNIST、CIFAR、FFHQ上均优于现有离散扩散后验采样器。
  • 适用于多种逆问题,适合追求高效离散建模的研究者。

我们研究了在离散状态空间中利用离散扩散模型作为生成先验的逆问题后验采样。尽管连续扩散模型已广泛应用于逆问题,其离散版本仍相对未被充分探索。现有离散后验采样器常依赖于离散变量的连续松弛、Gibbs式更新或特定退化过程的专用机制,限制了可扩展性与通用性。我们提出ΔLPS,一种受朗之万启发的离散后验采样器,利用梯度信息识别有前景的离散移动,且不离开离散状态空间。该方法支持所有词元维度的高效并行更新,对离散扩散先验的训练范式(包括掩码和均匀状态扩散)完全无关。我们在图像修复任务(涵盖MNIST、CIFAR、FFHQ)及空间映射上进行了评估,覆盖线性、非线性及盲逆问题。在这些设置下,我们的方法优于近期离散扩散后验采样器,并与强大的连续扩散基逆求解器相当。结果表明,完全离散的、梯度驱动的后验采样器为离散表示上的逆问题求解提供了可扩展且通用的路径。

原文摘要 · Abstract (English)

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts remain comparatively underexplored. Existing discrete posterior samplers often rely on continuous relaxations of discrete variables, Gibbs-style updates, or mechanisms specialized to particular corruption processes, which can limit scalability or generality. We propose $Δ$LPS, a Discrete Langevin-Inspired Posterior Sampler that uses gradient information to identify promising discrete moves without leaving the discrete state space. The resulting approach enables efficient parallel updates across all token dimensions and is agnostic to the training paradigm of the discrete diffusion prior, including masked and uniform-state diffusion. We evaluate our method on image restoration tasks across MNIST, CIFAR, and FFHQ, as well as spatial mapping, covering linear, nonlinear, and blind inverse problems. Across these settings, we improve over recent discrete diffusion posterior samplers and are competitive with strong continuous diffusion-based inverse solvers. Our results suggest that fully discrete, gradient-informed posterior samplers offer a scalable and general path toward solving inverse problems over discrete representations.

逆问题离散扩散后验采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。