arXiv:2601.02594eess.IVcs.AI2026-01

用多尺度能量模型加速图像修复,支持准确估计与不确定性量化。

Annealed Langevin Posterior Sampling (ALPS): A Rapid Algorithm for Image Restoration with Multiscale Energy Models

  • 将预训练扩散模型知识蒸馏到多尺度能量模型中,提升采样效率。
  • 在图像修复与磁共振重建任务上,精度和速度优于扩散基线模型。
  • 适合需要可信推理的科研与临床图像处理场景。

成像中的逆问题求解需要支持高效推断、不确定性量化和严谨概率推理的模型。基于能量的模型(EBMs)因其可解释的能量景观和组合结构,非常适合此类任务,但长期面临计算成本高和训练不稳定的难题。为此,我们提出一种快速知识蒸馏策略,将预训练扩散模型的优势转移到多尺度EBM中。这些蒸馏后的EBM实现了高效采样,同时保留了潜在型框架的可解释性与组合性。利用EBM的组合特性,我们提出退火型朗之万后验采样(ALPS)算法,用于图像逆问题中的最大后验(MAP)、最小均方误差(MMSE)估计及不确定性分析。不同于扩散模型对潜变量使用复杂引导策略,我们对静态且可组合的后验分布进行退火。在图像修复和磁共振成像重建实验中,本方法在准确性和效率上达到或超越扩散基线,同时支持MAP恢复。整体框架为成像逆问题提供了可扩展且原理清晰的解决方案,具备在科学与临床场景中实际部署的潜力。ALPS代码已开源。

原文摘要 · Abstract (English)

Solving inverse problems in imaging requires models that support efficient inference, uncertainty quantification, and principled probabilistic reasoning. Energy-Based Models (EBMs), with their interpretable energy landscapes and compositional structure, are well-suited for this task but have historically suffered from high computational costs and training instability. To overcome the historical shortcomings of EBMs, we introduce a fast distillation strategy to transfer the strengths of pre-trained diffusion models into multi-scale EBMs. These distilled EBMs enable efficient sampling and preserve the interpretability and compositionality inherent to potential-based frameworks. Leveraging EBM compositionality, we propose Annealed Langevin Posterior Sampling (ALPS) algorithm for Maximum-A-Posteriori (MAP), Minimum Mean Square Error (MMSE), and uncertainty estimates for inverse problems in imaging. Unlike diffusion models that use complex guidance strategies for latent variables, we perform annealing on static posterior distributions that are well-defined and composable. Experiments on image inpainting and MRI reconstruction demonstrate that our method matches or surpasses diffusion-based baselines in both accuracy and efficiency, while also supporting MAP recovery. Overall, our framework offers a scalable and principled solution for inverse problems in imaging, with potential for practical deployment in scientific and clinical settings. ALPS code is available at the GitHub repository \href{https://github.com/JyoChand/ALPS}{ALPS}.

图像修复能量模型不确定性量化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。