用修复模型的固定点构建新先验,提升图像逆问题求解效果
FiRe: Fixed-points of Restoration Priors for Solving Inverse Problems
- 基于修复模型与退化操作的复合不变性,构造显式隐式先验
- 多种修复网络可统一作为先验,提升图像重建质量
- 适用于多模型融合与感知数据驱动的修复,适合图像重建研究者
在成像逆问题中,选择合适的先验以弥补测量算子导致的信息损失是一项基本挑战。基于去噪神经网络的隐式先验已成为广泛使用的插件式(Plug-and-Play, PnP)算法的核心。本文提出固定点修复(FiRe)先验框架,将PnP中的先验概念拓展至传统去噪模型以外的通用修复模型。核心思想是:平滑图像成为退化算子与对应修复模型复合操作下的固定点。由此,我们通过量化该复合操作下的图像不变性,推导出隐式先验的显式表达式。采用这一固定点视角,我们展示了多种修复网络可有效作为求解逆问题的先验。FiRe框架还支持多个修复模型的集成式组合以及感知信息驱动的修复网络,均在统一优化框架内实现。实验结果验证了FiRe在多种逆问题上的有效性,为预训练修复模型融入PnP类算法建立了新范式。代码已公开于 https://github.com/matthieutrs/fire。
原文摘要 · Abstract (English)
Selecting an appropriate prior to compensate for information loss due to the measurement operator is a fundamental challenge in imaging inverse problems. Implicit priors based on denoising neural networks have become central to widely-used frameworks such as Plug-and-Play (PnP) algorithms. In this work, we introduce Fixed-points of Restoration (FiRe) priors as a new framework for expanding the notion of priors in PnP to general restoration models beyond traditional denoising models. The key insight behind FiRe is that smooth images emerge as fixed points of the composition of a degradation operator with the corresponding restoration model. This enables us to derive an explicit formula for our implicit prior by quantifying invariance of images under this composite operation. Adopting this fixed-point perspective, we show how various restoration networks can effectively serve as priors for solving inverse problems. The FiRe framework further enables ensemble-like combinations of multiple restoration models as well as acquisition-informed restoration networks, all within a unified optimization approach. Experimental results validate the effectiveness of FiRe across various inverse problems, establishing a new paradigm for incorporating pretrained restoration models into PnP-like algorithms. Code available at https://github.com/matthieutrs/fire.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。