arXiv:2508.04832eess.IV2025-08

用知识蒸馏设计非线性预条件器,提升病态传感矩阵下的图像重建效果。

Deep Distillation Gradient Preconditioning for Inverse Problems

  • 通过教师-学生框架,用合成良条件矩阵指导病态矩阵的梯度更新。
  • 在单像素、MRI和超分辨任务中均实现更优重建质量与更快收敛。
  • 适合需要高精度图像重建且传感矩阵条件差的研究者。

成像反问题通常通过最小化测量一致性与信号先验项来解决。尽管先进先验模型备受关注,但当与病态传感矩阵结合时,其性能仍会下降,导致收敛困难和重建质量恶化。优化理论中,预条件器可通过变换梯度更新来改善算法收敛性。传统线性预条件方法受限于传感矩阵结构;基于学习的线性预条件器虽有进展,但仅优化数据保真项,可能导致解落在传感矩阵的零空间。本文提出一种基于知识蒸馏的非线性预条件操作符:使用良条件(合成)传感矩阵的教师算法,通过预条件神经网络引导具有病态传感矩阵的学生算法进行梯度匹配。我们在单像素成像、磁共振成像和超分辨任务中验证了该方法在插件式FISTA中的有效性,结果显示性能一致提升,且收敛性显著改善。

原文摘要 · Abstract (English)

Imaging inverse problems are commonly addressed by minimizing measurement consistency and signal prior terms. While huge attention has been paid to developing high-performance priors, even the most advanced signal prior may lose its effectiveness when paired with an ill-conditioned sensing matrix that hinders convergence and degrades reconstruction quality. In optimization theory, preconditioners allow improving the algorithm's convergence by transforming the gradient update. Traditional linear preconditioning techniques enhance convergence, but their performance remains limited due to their dependence on the structure of the sensing matrix. Learning-based linear preconditioners have been proposed, but they are optimized only for data-fidelity optimization, which may lead to solutions in the null-space of the sensing matrix. This paper employs knowledge distillation to design a nonlinear preconditioning operator. In our method, a teacher algorithm using a better-conditioned (synthetic) sensing matrix guides the student algorithm with an ill-conditioned sensing matrix through gradient matching via a preconditioning neural network. We validate our nonlinear preconditioner for plug-and-play FISTA in single-pixel, magnetic resonance, and super-resolution imaging tasks, showing consistent performance improvements and better empirical convergence.

图像重建反问题知识蒸馏预条件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。