arXiv:2409.10394eess.IVcs.AI2024-09被引 4

用持续学习优化磁共振重建,让一张图像同时服务多个下游任务。

MOST: MR reconstruction Optimization for multiple downStream Tasks via continual learning

  • 通过持续学习融合回放与图像引导损失,避免遗忘旧任务。
  • 在多任务场景下显著提升重建图像对分割等任务的性能。
  • 适合需要兼顾多种下游分析的医学影像研究者使用。

基于深度学习的磁共振(MR)重建方法通常聚焦于生成高质量图像,却忽略了重建结果对下游任务(如分割)的影响。将独立训练的重建网络与下游任务网络级联会导致性能下降,源于误差传播和训练数据集间的领域差异。针对单一下游任务的重建优化已有研究,但扩展至多任务场景尚不明确。本文提出MOST(MR重建多任务持续学习优化),通过持续学习机制,使单个重建网络可依次适应多个下游任务。MOST结合基于回放的持续学习与图像引导损失,有效缓解灾难性遗忘问题。对比实验表明,MOST优于未经微调、简单微调及传统持续学习方法。源代码已开源:https://github.com/SNU-LIST/MOST。

原文摘要 · Abstract (English)

Deep learning-based Magnetic Resonance (MR) reconstruction methods have focused on generating high-quality images but often overlook the impact on downstream tasks (e.g., segmentation) that utilize the reconstructed images. Cascading separately trained reconstruction network and downstream task network has been shown to introduce performance degradation due to error propagation and domain gaps between training datasets. To mitigate this issue, downstream task-oriented reconstruction optimization has been proposed for a single downstream task. Expanding this optimization to multi-task scenarios is not straightforward. In this work, we extended this optimization to sequentially introduced multiple downstream tasks and demonstrated that a single MR reconstruction network can be optimized for multiple downstream tasks by deploying continual learning (MOST). MOST integrated techniques from replay-based continual learning and image-guided loss to overcome catastrophic forgetting. Comparative experiments demonstrated that MOST outperformed a reconstruction network without finetuning, a reconstruction network with naïve finetuning, and conventional continual learning methods. The source code is available at: https://github.com/SNU-LIST/MOST.

MR重建持续学习多任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。