arXiv:2409.04384cs.CVcs.CL2024-09被引 7

用扩散模型先验加速贝叶斯图像修复,又快又准。

Empirical Bayesian image restoration by Langevin sampling with a denoising diffusion implicit prior

  • 将DDPM去噪器嵌入贝叶斯朗之万采样,联合优化超参数
  • 在去模糊、超分辨、补全任务上精度和速度均领先
  • 适合需要高保真与高效计算的图像修复场景

基于得分的扩散方法通过灵活结合预训练的基础先验模型与测试时指定的似然函数,为图像修复任务提供强大策略。此类方法主要源于两种随机过程:逆转奥恩斯坦-乌伦贝克过程(支撑著名去噪扩散概率模型DDPM与去噪扩散隐式模型DDIM),以及朗之万扩散过程。DDPM和DDIM的解通常极为逼真,但因似然不可计算及伴随近似而未必与测量值一致。相反,使用朗之万过程可规避似然不可计算问题,但常导致修复质量较差且计算耗时较长。本文提出一种新颖且高度高效的图像修复方法,将基础DDPM去噪器精巧嵌入经验贝叶斯朗之万算法中,同时估计后验均值并联合校准关键模型超参数。在三个典型任务(图像去模糊、超分辨率、图像补全)上的大量实验表明,该方法在图像估计精度与计算时间上均优于现有最优策略。

原文摘要 · Abstract (English)

Score-based diffusion methods provide a powerful strategy to solve image restoration tasks by flexibly combining a pre-trained foundational prior model with a likelihood function specified during test time. Such methods are predominantly derived from two stochastic processes: reversing Ornstein-Uhlenbeck, which underpins the celebrated denoising diffusion probabilistic models (DDPM) and denoising diffusion implicit models (DDIM), and the Langevin diffusion process. The solutions delivered by DDPM and DDIM are often remarkably realistic, but they are not always consistent with measurements because of likelihood intractability issues and the associated required approximations. Alternatively, using a Langevin process circumvents the intractable likelihood issue, but usually leads to restoration results of inferior quality and longer computing times. This paper presents a novel and highly computationally efficient image restoration method that carefully embeds a foundational DDPM denoiser within an empirical Bayesian Langevin algorithm, which jointly calibrates key model hyper-parameters as it estimates the model's posterior mean. Extensive experimental results on three canonical tasks (image deblurring, super-resolution, and inpainting) demonstrate that the proposed approach improves on state-of-the-art strategies both in image estimation accuracy and computing time.

图像修复扩散模型贝叶斯推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。