用信息论优化扩散模型,提升图像修复质量。
Conditional Mutual Information Based Diffusion Posterior Sampling for Solving Inverse Problems
- 通过最大化条件互信息引导扩散过程
- 显著改善图像重建的清晰度与细节保留
- 适合图像恢复、逆问题求解的研究者
逆问题是科学与工程中的常见挑战。在计算机视觉中,图像修复、去模糊和超分辨率等任务均可建模为逆问题。近年来,扩散模型(DMs)在解决含噪线性逆问题方面展现出潜力,无需额外任务训练即可提供有效解法。具体而言,利用扩散模型的先验知识,可通过寻找似然分布来从后验采样。由于似然难以直接计算,现有方法常采用近似,但会降低生成图像质量。为此,本文提出一种基于信息论的方法:最大化条件互信息 $\mathrm{I}(\boldsymbol{x}_0; \boldsymbol{y} | \boldsymbol{x}_t)$,其中 $\boldsymbol{x}_0$ 为重建信号,$\boldsymbol{y}$ 为观测值,$\boldsymbol{x}_t$ 为第 $t$ 阶段的中间信号。该策略确保中间表示能最大限度保留观测信息,从而提升最终重建质量。实验表明,该方法可无缝集成至现有框架,并在定性和定量上均带来性能提升。
原文摘要 · Abstract (English)
Inverse problems are prevalent across various disciplines in science and engineering. In the field of computer vision, tasks such as inpainting, deblurring, and super-resolution are commonly formulated as inverse problems. Recently, diffusion models (DMs) have emerged as a promising approach for addressing noisy linear inverse problems, offering effective solutions without requiring additional task-specific training. Specifically, with the prior provided by DMs, one can sample from the posterior by finding the likelihood. Since the likelihood is intractable, it is often approximated in the literature. However, this approximation compromises the quality of the generated images. To overcome this limitation and improve the effectiveness of DMs in solving inverse problems, we propose an information-theoretic approach. Specifically, we maximize the conditional mutual information $\mathrm{I}(\boldsymbol{x}_0; \boldsymbol{y} | \boldsymbol{x}_t)$, where $\boldsymbol{x}_0$ represents the reconstructed signal, $\boldsymbol{y}$ is the measurement, and $\boldsymbol{x}_t$ is the intermediate signal at stage $t$. This ensures that the intermediate signals $\boldsymbol{x}_t$ are generated in a way that the final reconstructed signal $\boldsymbol{x}_0$ retains as much information as possible about the measurement $\boldsymbol{y}$. We demonstrate that this method can be seamlessly integrated with recent approaches and, once incorporated, enhances their performance both qualitatively and quantitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。