提出JAPS方法,提升扩散模型在逆问题中的重建质量。
Jacobian-Aware Posterior Sampling for Inverse Problems
- 结合直接法与邻近法优势,利用雅可比矩阵先验知识。
- 在多种线性和非线性噪声成像任务中,提升感知质量并保持失真指标。
- 无需额外计算成本,适配DDIM采样,适用于图像重建场景。
扩散模型通过从条件于损坏测量的后验分布采样,为求解逆问题提供强大的生成先验。现有方法主要遵循两种范式:直接法近似似然项,邻近法将满足测量约束的中间解融入采样过程。在标准高斯近似和局部线性测量下,我们发现这两种方法在似然项中对扩散去噪器雅可比矩阵的处理存在根本差异。尽管该雅可比矩阵编码了数据分布的关键先验知识,但训练引起的非理想性可能在零样本设置中降低性能。本文提出一种原理性的雅可比感知后验采样器(JAPS),融合雅可比先验知识并通过对偶邻近解缓解其负面影响,且不增加额外计算开销。此外,我们将引导机制整合至DDIM采样中,修正了以往工作中缺失的条件因子。所提方法在多种线性和非线性噪声成像任务中显著提升重建质量,优于现有基于扩散模型的基线,在感知质量上表现更优,同时保持或改善失真指标。
原文摘要 · Abstract (English)
Diffusion models provide powerful generative priors for solving inverse problems by sampling from a posterior distribution conditioned on corrupted measurements. Existing methods primarily follow two paradigms: direct methods, which approximate the likelihood term, and proximal methods, which incorporate intermediate solutions satisfying measurement constraints into the sampling process. Under standard Gaussian approximations and locally-linear measurements, we demonstrate that these approaches differ fundamentally in their treatment of the diffusion denoiser's Jacobian within the likelihood term. While this Jacobian encodes critical prior knowledge of the data distribution, training-induced non-idealities can degrade performance in zero-shot settings. In this work, we bridge direct and proximal approaches by proposing a principled Jacobian-Aware Posterior Sampler (JAPS). JAPS leverages the Jacobian's prior knowledge while mitigating its detrimental effects through a corresponding proximal solution, requiring no additional computational cost. Additionally, we integrate our guidance into DDIM sampling, with a corrected conditional factor that has been missing in previous works. Our method enhances reconstruction quality across diverse linear and nonlinear noisy imaging tasks, outperforming existing diffusion-based baselines in perceptual quality while maintaining or improving distortion metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。