arXiv:2409.12167eess.IVcs.CV2024-09被引 14

融合多模态影像信息的Transformer模型,提升脑肿瘤分割精度。

multiPI-TransBTS: A Multi-Path Learning Framework for Brain Tumor Image Segmentation Based on Multi-Physical Information

  • 设计多分支编码器与自适应特征融合模块,整合多模态影像特征。
  • 在BraTS2019和2020数据集上,Dice分数、Hausdorff距离和敏感性均优于现有方法。
  • 适用于临床精准诊断,尤其对增强肿瘤区域分割有显著改进。

脑肿瘤分割(BraTS)在临床诊断、治疗规划和病情监测中具有关键作用。由于不同MRI模态下肿瘤表现、大小和强度的差异,自动化分割仍具挑战。本文提出一种基于Transformer的新型框架multiPI-TransBTS,融合空间、语义及多模态影像信息以提升分割精度。该框架包含编码器、自适应特征融合(AFF)模块和多源多尺度解码器。编码器采用多分支结构,分别提取不同MRI序列的模态特异性特征;AFF模块通过通道与逐元素注意力融合多源信息,实现有效特征重校准;解码器结合通用与任务特定特征,通过任务特定特征引入(TSFI)策略生成全肿瘤(WT)、肿瘤核心(TC)和增强肿瘤(ET)的分割结果。在BraTS2019与BraTS2020数据集上的综合评估表明,multiPI-TransBTS优于当前最优方法,持续取得更优的Dice系数、Hausdorff距离与敏感性评分,凸显其应对BraTS挑战的有效性。结果亦提示需进一步探索ET分割中精确率与召回率的平衡。该框架为脑肿瘤分割带来显著进展,有望改善患者临床结局。

原文摘要 · Abstract (English)

Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI modalities, automated segmentation remains a challenging task. In this study, we propose a novel Transformer-based framework, multiPI-TransBTS, which integrates multi-physical information to enhance segmentation accuracy. The model leverages spatial information, semantic information, and multi-modal imaging data, addressing the inherent heterogeneity in brain tumor characteristics. The multiPI-TransBTS framework consists of an encoder, an Adaptive Feature Fusion (AFF) module, and a multi-source, multi-scale feature decoder. The encoder incorporates a multi-branch architecture to separately extract modality-specific features from different MRI sequences. The AFF module fuses information from multiple sources using channel-wise and element-wise attention, ensuring effective feature recalibration. The decoder combines both common and task-specific features through a Task-Specific Feature Introduction (TSFI) strategy, producing accurate segmentation outputs for Whole Tumor (WT), Tumor Core (TC), and Enhancing Tumor (ET) regions. Comprehensive evaluations on the BraTS2019 and BraTS2020 datasets demonstrate the superiority of multiPI-TransBTS over the state-of-the-art methods. The model consistently achieves better Dice coefficients, Hausdorff distances, and Sensitivity scores, highlighting its effectiveness in addressing the BraTS challenges. Our results also indicate the need for further exploration of the balance between precision and recall in the ET segmentation task. The proposed framework represents a significant advancement in BraTS, with potential implications for improving clinical outcomes for brain tumor patients.

脑肿瘤分割Transformer多模态融合医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。