用虚拟节点动态补偿缺失脑肿瘤影像模态,提升分割鲁棒性。
Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities

- 引入模态专用虚拟节点补全缺失信息
- 动态调整图连接结构适应不同模态组合
- 一阶段训练,适合临床实际中模态缺失场景
多模态磁共振成像(MRI)对脑肿瘤分割至关重要,通常依赖四种关键模态以捕捉互补信息。然而实际中多个模态缺失极为常见,导致现有全模态方法性能显著下降。受限于结构化数据建模,近期工作常采用分阶段训练策略应对完整与缺失模态情形,增加训练成本且未能有效缓解缺失干扰。本文提出一种基于图神经网络的一阶段框架,实现对缺失模态的鲁棒分割。具体地,引入模态特异性虚拟节点作为补充信息源以补偿缺失模态;利用图网络固有的灵活性设计动态连接机制,根据模态可用性动态调整邻接矩阵,保持有益信息流并抑制缺失带来的干扰;进一步通过异质权重矩阵增强模型对多模态场景的适应能力。在BRATS-2018和BRATS-2020数据集上的大量实验表明,该方法在几乎所有不完整模态子集上均优于当前最先进方法。
原文摘要 · Abstract (English)
Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of several modalities is very common in practice, leading to severe performance degradation in existing full-modality segmentation methods. Limited by the structured data model, recent works often adopt a multi-stage training strategy for full-modality and missing-modality scenarios, which increases training costs and inadequately addresses the interference of miss. In this work, we propose a graph-based one-stage framework for robust brain tumor segmentation with missing modalities. Specifically, we introduce modality-specific virtual nodes that serve as supplementary information sources to compensate for missing modalities. To enhance model robustness against arbitrary modality combinations, we leverage the inherent flexibility of graph networks to devise a dynamic connection strategy. This mechanism dynamically adjusts the adjacency matrix based on modality availability, preserving beneficial information flow while mitigating interference effects caused by missing modalities. Furthermore, we enhance the graph network through heterogeneous weight matrices, enhancing its adaptability to multimodal scenarios. Extensive experiments on the BRATS-2018 and BRATS-2020 datasets demonstrate that our method outperforms the state-of-the-art methods on almost all subsets of incomplete modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。