arXiv:2605.25299cs.CVcs.LG2026-05

提出自参考早停法,无需噪声估计就能稳定提升图像修复效果。

A Principled Self-Referenced Early Stopping Approach for Deep Image Prior

论文配图:A Principled Self-Referenced Early Stopping Approach for Deep Image Prior
图 1 · 摘自论文原文
  • 用伪自参考图像构造双副本,检测过拟合信号
  • 在多种图像修复任务中均超越现有方法,且不依赖噪声水平
  • 适合医疗图像、自然图像等无训练数据的逆问题场景

深度图像先验(DIP)通过优化随机初始化的卷积神经网络,在无训练数据条件下解决逆成像问题(IIPs),但因网络过参数化易对噪声测量过拟合,早停(ES)至关重要。现有最优方法依赖网络输出运行方差波动检测过拟合,但在多场景下可能过早出现,导致重建不稳定。本文首次证明:当存在两个独立的退化图像噪声副本时,可实现近乎最优的早停。鉴于实际无法获取完全独立副本,我们提出基于伪自参考图像的过拟合检测框架,衍生出三种针对不同IIP的算法。理论支持包括单参考验证、伪验证估计及共享噪声影响分析。在从自然图像修复到医学图像重建等多种任务、不同噪声水平与类型下,本方法持续优于现有DIP早停策略,且无需准确噪声水平估计。

原文摘要 · Abstract (English)

Recently, Deep Image Prior (DIP) has demonstrated strong capabilities for solving inverse imaging problems (IIPs) by optimizing a randomly initialized convolutional neural network in a training-data-free regime. However, DIP suffers from overfitting to noisy measurements due to network over-parameterization, making early stopping (ES) essential. The most successful ES method tracks fluctuations in the running variance of the network output to detect overfitting. However, in many applications, these fluctuations may appear prematurely, leading to unstable reconstructions. In this paper, we first show that nearly optimal DIP early stopping can be achieved when two independent noisy copies of the degraded image are available. Motivated by this observation, and since obtaining two fully independent copies is infeasible, we propose an overfitting detection framework based on constructing pseudo self-referenced images, resulting in three IIP-specific algorithms. Our approach is further supported by theoretical results on single-reference validation, pseudo-validation estimation, and the impact of shared noise. Across different IIPs, ranging from natural image restoration to medical image reconstruction, and under varying noise levels and noise types, our methods consistently outperform existing DIP early stopping approaches, all without requiring an accurate estimate of the noise level.

图像修复深度先验早停机制无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。