为深度投影先验设计随机正交正则化,提升图像逆问题求解速度与鲁棒性。
Stochastic Orthogonal Regularization for deep projective priors
- 通过随机正交正则化训练深度投影先验,逼近最优正交投影。
- 在两类神经网络结构上验证,显著加快GPGD收敛速度并提升稳定性。
- 适合从事图像重建、逆问题求解的研究者参考。
图像处理与计算机视觉中的许多关键任务可建模为逆问题,因此设计快速且鲁棒的算法至关重要。本文聚焦于广义投影梯度下降(GPGD)方法,其中广义投影由学习的神经网络实现,已在成像逆问题中取得领先性能。这类投影被称为深度投影先验,能够对复杂数据(如图像)建模未知低维流形。理论上,在满足限制等距假设条件下,使用低维模型集的正交投影可使正交PGD以线性速率收敛,达到经典稀疏恢复问题中近似最优的收敛性能。然而,对于基于经典均方误差损失训练的深度投影先验,其满足线性收敛假设的条件缺乏保障。为此,本文提出一种用于深度投影先验训练的随机正交正则化方法。该正则化由理论分析驱动:对正交投影的充分逼近可保证线性稳定恢复,性能接近正交PGD。实验结果表明,采用两种不同架构的深度投影先验(自编码器与去噪网络),所提方法生成的投影能显著提升GPGD在挑战性逆问题场景下的收敛速度与鲁棒性,符合理论预期。
原文摘要 · Abstract (English)
Many crucial tasks of image processing and computer vision are formulated as inverse problems. Thus, it is of great importance to design fast and robust algorithms to solve these problems. In this paper, we focus on generalized projected gradient descent (GPGD) algorithms where generalized projections are realized with learned neural networks and provide state-of-the-art results for imaging inverse problems. Indeed, neural networks allow for projections onto unknown low-dimensional sets that model complex data, such as images. We call these projections deep projective priors. In generic settings, when the orthogonal projection onto a lowdimensional model set is used, it has been shown, under a restricted isometry assumption, that the corresponding orthogonal PGD converges with a linear rate, yielding near-optimal convergence (within the class of GPGD methods) in the classical case of sparse recovery. However, for deep projective priors trained with classical mean squared error losses, there is little guarantee that the hypotheses for linear convergence are satisfied. In this paper, we propose a stochastic orthogonal regularization of the training loss for deep projective priors. This regularization is motivated by our theoretical results: a sufficiently good approximation of the orthogonal projection guarantees linear stable recovery with performance close to orthogonal PGD. We show experimentally, using two different deep projective priors (based on autoencoders and on denoising networks), that our stochastic orthogonal regularization yields projections that improve convergence speed and robustness of GPGD in challenging inverse problem settings, in accordance with our theoretical findings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。