arXiv:2503.05682eess.IVcs.CV2025-03被引 1

针对标注少的脑肿瘤分割,提出动态协同学习框架提升多模态MRI信息利用。

Task-oriented Uncertainty Collaborative Learning for Label-Efficient Brain Tumor Segmentation

  • 设计任务导向提示注意力机制,动态融合多模态影像特征
  • 在有限标注下实现88.2%的Dice和10.853mm的HD95指标
  • 适合医学图像分割、小样本学习与多模态数据融合研究者

多对比度磁共振成像(MRI)通过不同序列互补信息,在脑肿瘤分割与诊断中至关重要。各对比度突出肿瘤不同特征,有助于全面理解肿瘤形态、水肿及病理异质性。然而现有方法在标注有限情况下仍面临多层级特异性感知难题,包括数据异质性、粒度差异以及冗余信息干扰。为此,本文提出面向任务的不确定性协同学习(TUCL)框架,引入任务导向提示注意力(TPA)模块,通过内部与跨提示注意力机制动态建模跨对比度与任务的特征交互;设计循环过程将预测反馈至提示,确保提示有效利用。解码阶段采用双路径不确定性精炼策略,实现预测迭代优化。在标注数据受限条件下,实验表明TUCL显著提升分割精度(Dice达88.2%,HD95为10.853 mm),具备高效提取多对比度信息并降低对大量标注依赖的能力。代码已公开于:https://github.com/Zhenxuan-Zhang/TUCL_BrainSeg。

原文摘要 · Abstract (English)

Multi-contrast magnetic resonance imaging (MRI) plays a vital role in brain tumor segmentation and diagnosis by leveraging complementary information from different contrasts. Each contrast highlights specific tumor characteristics, enabling a comprehensive understanding of tumor morphology, edema, and pathological heterogeneity. However, existing methods still face the challenges of multi-level specificity perception across different contrasts, especially with limited annotations. These challenges include data heterogeneity, granularity differences, and interference from redundant information. To address these limitations, we propose a Task-oriented Uncertainty Collaborative Learning (TUCL) framework for multi-contrast MRI segmentation. TUCL introduces a task-oriented prompt attention (TPA) module with intra-prompt and cross-prompt attention mechanisms to dynamically model feature interactions across contrasts and tasks. Additionally, a cyclic process is designed to map the predictions back to the prompt to ensure that the prompts are effectively utilized. In the decoding stage, the TUCL framework proposes a dual-path uncertainty refinement (DUR) strategy which ensures robust segmentation by refining predictions iteratively. Extensive experimental results on limited labeled data demonstrate that TUCL significantly improves segmentation accuracy (88.2\% in Dice and 10.853 mm in HD95). It shows that TUCL has the potential to extract multi-contrast information and reduce the reliance on extensive annotations. The code is available at: https://github.com/Zhenxuan-Zhang/TUCL_BrainSeg.

脑肿瘤分割多模态小样本学习不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。