arXiv:2509.22736eess.IVcs.AI2025-09被引 8

用一致性模型做图像逆问题,4次计算就出高清结果。

PnP-CM: Consistency Models as Plug-and-Play Priors for Inverse Problems

  • 把一致性模型当先验,插到ADMM框架里直接用
  • 4次神经网络计算就完成高质量重建
  • 适合医疗成像等需快速重建的场景

扩散模型广泛用于求解逆问题,通过从给定观测值的数据后验分布中采样。最近提出的一致性模型(CMs)可直接预测扩散微分方程轨迹上任意点的最终输出,仅需少数神经网络函数评估(NFE)即可实现高质量采样。尽管已有将CM应用于逆问题的研究,但现有方法要么需要额外的任务特定训练,要么依赖收敛缓慢的数据保真操作,限制了其在大规模及非线性问题中的应用。本文重新将一致性模型视为先验的近端算子,使其可融入即插即用(PnP)框架。我们提出PnP-CM,一种基于ADMM的PnP求解器,统一处理多种逆问题,并引入噪声扰动与动量更新,显著提升低NFE条件下的性能。我们在一系列线性和非线性逆问题上进行评估,并首次在磁共振成像(MRI)数据上训练和应用一致性模型。结果表明,PnP-CM可在仅4次NFE下实现高质量重建,2步内即产生有意义结果,展现出在真实逆问题中的高效性,优于现有基于CM的方法。

原文摘要 · Abstract (English)

Diffusion models have found extensive use in solving inverse problems, by sampling from an approximate posterior distribution of data given the measurements. Recently, consistency models (CMs) have been proposed to directly predict the final output from any point on the diffusion ODE trajectory, enabling high-quality sampling in just a few neural function evaluations (NFEs). CMs have also been utilized for inverse problems, but existing CM-based solvers either require additional task-specific training or utilize data fidelity operations with slow convergence, limiting their applicability to large-scale problems and making them difficult to extend to nonlinear settings. In this work, we reinterpret CMs as proximal operators of a prior, enabling their integration into plug-and-play (PnP) frameworks. Specifically, we propose PnP-CM, an ADMM-based PnP solver that provides a unified framework for solving a wide range of inverse problems, and incorporates noise perturbations and momentum-based updates to improve performance in the low-NFE regime. We evaluate our approach on a diverse set of linear and nonlinear inverse problems. We also train and apply CMs to MRI data for the first time. Our results show that PnP-CM achieves high-quality reconstructions in as few as 4 NFEs, and produces meaningful results in 2 steps, highlighting its effectiveness in real-world inverse problems while outperforming existing CM-based approaches.

逆问题一致性模型MRI重建快速采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。