arXiv:2512.09801cs.CV2025-12被引 1

针对多模态脑肿瘤分割,提升各模态特有信息并自适应融合互补特征。

Modality-Specific Enhancement and Complementary Fusion for Semi-Supervised Multi-Modal Brain Tumor Segmentation

  • 用通道注意力增强每种影像模态的特有语义信息。
  • 在1%、5%、10%标注数据下,Dice和敏感度均显著优于基线。
  • 适合少样本医疗图像分割研究者参考,尤其关注多模态协同建模。

半监督学习(SSL)为医学图像分割提供了新路径,使模型能在少量标注数据和大量未标注样本中学习。然而,现有针对多模态医学影像的SSL方法常因模态间语义差异和序列错位而难以挖掘模态间的互补信息。为此,我们提出一种新颖的半监督多模态框架,显式增强模态特异性表示,并实现自适应跨模态信息融合。具体地,引入模态特异性增强模块(MEM),通过通道注意力强化每种模态的独特语义线索;设计可学习的互补信息融合(CIF)模块,动态交换模态间的互补知识。整体框架采用监督分割损失与未标注数据上的跨模态一致性正则化相结合的混合目标进行优化。在BraTS 2019(HGG子集)上的大量实验表明,该方法在1%、5%、10%标注数据设置下持续超越强基线,显著提升Dice与敏感度得分。消融实验证实,MEM与CIF在弥合跨模态差异、提升稀缺标注下的分割鲁棒性方面具有互补作用。

原文摘要 · Abstract (English)

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal medical imaging often struggle to exploit the complementary information between modalities due to semantic discrepancies and misalignment across MRI sequences. To address this, we propose a novel semi-supervised multi-modal framework that explicitly enhances modality-specific representations and facilitates adaptive cross-modal information fusion. Specifically, we introduce a Modality-specific Enhancing Module (MEM) to strengthen semantic cues unique to each modality via channel-wise attention, and a learnable Complementary Information Fusion (CIF) module to adaptively exchange complementary knowledge between modalities. The overall framework is optimized using a hybrid objective combining supervised segmentation loss and cross-modal consistency regularization on unlabeled data. Extensive experiments on the BraTS 2019 (HGG subset) demonstrate that our method consistently outperforms strong semi-supervised and multi-modal baselines under 1\%, 5\%, and 10\% labeled data settings, achieving significant improvements in both Dice and Sensitivity scores. Ablation studies further confirm the complementary effects of our proposed MEM and CIF in bridging cross-modality discrepancies and improving segmentation robustness under scarce supervision.

多模态半监督脑肿瘤图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。