arXiv:2505.11720cs.CVcs.LG2025-05NeurIPS被引 3

用少量数据训练的图像重建新方法,提升速度与质量。

UGoDIT: Unsupervised Group Deep Image Prior Via Transferable Weights

  • 共享编码器+多解码器结构,学习可迁移权重
  • 测试时固定部分参数,加速收敛并减少噪声过拟合
  • 适合医疗影像等数据稀缺场景,无需大量干净数据

近期基于数据的深度生成模型在解决逆成像问题上取得显著进展,但通常需要大量完整采样的训练数据,这在动态医学成像中难以实现。而无训练数据的方法如深度图像先验(DIP)虽不依赖真实图像,却存在噪声过拟合和计算成本高的问题,且常忽略利用少量欠采样测量数据进行先验学习。本文提出UGoDIT,一种基于可迁移权重的无监督分组深度图像先验方法,适用于仅能获取极少量M个欠采样测量向量的低数据场景。通过优化一个共享编码器和M个解耦解码器,学习一组可迁移权重。测试时,使用DIP网络重构未见的退化图像,其中部分参数固定为学习到的权重,其余参数则优化以满足测量一致性。我们在多线圈MRI、超分辨率和非线性模糊去除等任务中评估了UGoDIT,结果表明相比现有独立DIP方法,其收敛更快、重建质量更优;且在不需大量干净数据的前提下,性能媲美最先进基于扩散模型和监督学习的方法。

原文摘要 · Abstract (English)

Recent advances in data-centric deep generative models have led to significant progress in solving inverse imaging problems. However, these models (e.g., diffusion models (DMs)) typically require large amounts of fully sampled (clean) training data, which is often impractical in medical and scientific settings such as dynamic imaging. On the other hand, training-data-free approaches like the Deep Image Prior (DIP) do not require clean ground-truth images but suffer from noise overfitting and can be computationally expensive as the network parameters need to be optimized for each measurement set independently. Moreover, DIP-based methods often overlook the potential of learning a prior using a small number of sub-sampled measurements (or degraded images) available during training. In this paper, we propose UGoDIT, an Unsupervised Group DIP via Transferable weights, designed for the low-data regime where only a very small number, M, of sub-sampled measurement vectors are available during training. Our method learns a set of transferable weights by optimizing a shared encoder and M disentangled decoders. At test time, we reconstruct the unseen degraded image using a DIP network, where part of the parameters are fixed to the learned weights, while the remaining are optimized to enforce measurement consistency. We evaluate UGoDIT on both medical (multi-coil MRI) and natural (super resolution and non-linear deblurring) image recovery tasks under various settings. Compared to recent standalone DIP methods, UGoDIT provides accelerated convergence and notable improvement in reconstruction quality. Furthermore, our method achieves performance competitive with SOTA DM-based and supervised approaches, despite not requiring large amounts of clean training data.

图像重建无监督学习低数据DIP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。