arXiv:2410.00418eess.IVcs.AI2024-10ICLR被引 39

提出新方法提升图像恢复质量,兼顾清晰度与真实感。

Posterior-Mean Rectified Flow: Towards Minimum MSE Photo-Realistic Image Restoration

  • 先预测后验均值,再用修正流模型将其映射到真实图像分布
  • 在多种任务中显著降低均方误差,同时保持最佳感知质量
  • 适合追求高保真图像恢复的研究者与工程师

照片级图像恢复算法通常通过失真度量(如PSNR、SSIM)和感知质量度量(如FID、NIQE)评估,目标是在不牺牲感知质量的前提下尽可能降低失真。现有方法多尝试从后验分布采样或优化均方误差(MSE)与感知损失(如GAN)的加权和。本文关注在感知指数完全匹配(即重建图像分布等于真实图像分布)条件下,最小化MSE的最优估计器。最近理论表明,该估计器可通过最优传输后验均值预测(MMSE估计)实现。受此启发,我们提出后验均值修正流(PMRF),一种简单高效的方法:先预测后验均值,再通过修正流模型近似最优传输映射,将结果转化为高质量图像。我们分析了PMRF的理论优势,并在多种图像恢复任务中证明其持续优于先前方法。

原文摘要 · Abstract (English)

Photo-realistic image restoration algorithms are typically evaluated by distortion measures (e.g., PSNR, SSIM) and by perceptual quality measures (e.g., FID, NIQE), where the desire is to attain the lowest possible distortion without compromising on perceptual quality. To achieve this goal, current methods commonly attempt to sample from the posterior distribution, or to optimize a weighted sum of a distortion loss (e.g., MSE) and a perceptual quality loss (e.g., GAN). Unlike previous works, this paper is concerned specifically with the optimal estimator that minimizes the MSE under a constraint of perfect perceptual index, namely where the distribution of the reconstructed images is equal to that of the ground-truth ones. A recent theoretical result shows that such an estimator can be constructed by optimally transporting the posterior mean prediction (MMSE estimate) to the distribution of the ground-truth images. Inspired by this result, we introduce Posterior-Mean Rectified Flow (PMRF), a simple yet highly effective algorithm that approximates this optimal estimator. In particular, PMRF first predicts the posterior mean, and then transports the result to a high-quality image using a rectified flow model that approximates the desired optimal transport map. We investigate the theoretical utility of PMRF and demonstrate that it consistently outperforms previous methods on a variety of image restoration tasks.

图像恢复修正流感知质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。