arXiv:2510.03352cs.CVcs.AI2025-10被引 1

用推理时搜索融合侧信息,提升扩散模型图像重建质量。

Inference-Time Search Using Side Information for Diffusion-Based Image Reconstruction

  • 推理时通过搜索融入参考图、文本描述等侧信息。
  • 在修复、超分、去模糊任务中均显著提升重建效果。
  • 无需训练、适配多种扩散模型,通用性强。

扩散模型已被用作求解逆问题的先验。然而,现有方法通常忽视了可能显著提升重建质量的侧信息,尤其在严重病态设置下。本文提出一种新框架,通过推理时搜索,以即插即用、无需训练的方式将侧信息融入现有的基于扩散的逆问题求解器。在多种逆问题(包括图像修复、超分辨率和多个去模糊任务)及多个扩散模型求解器(DPS、DAPS、MPGD)上进行大量实验,结果表明,该框架可一致地提升各求解器的重建质量。为验证方法的通用性,我们尝试了多种侧信息形式,包括参考图像、文本描述和解剖学MRI扫描。代码已公开于GitHub。

原文摘要 · Abstract (English)

Diffusion models have been used as priors for solving inverse problems. However, existing approaches typically overlook side information that could significantly improve reconstruction quality, especially in severely ill-posed settings. In this work, we propose a novel framework that incorporates side information into existing diffusion-based inverse problem solvers via inference-time search, in a plug-and-play, training-free manner. Through extensive experiments across a range of inverse problems, including inpainting, super-resolution, and several deblurring tasks, and across multiple diffusion-based inverse problem solvers (DPS, DAPS, and MPGD), we show that augmenting each solver with our framework consistently improves the quality of the reconstructions over the corresponding original method. To demonstrate the generality of our approach, we consider diverse forms of side information, including reference images, textual descriptions, and anatomical MRI scans. The code is available at this \href{https://github.com/mahdi-farahbakhsh/DISS}{repository}\footnote{https://github.com/mahdi-farahbakhsh/DISS}.

图像重建扩散模型侧信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。