针对缺失MRI模态的脑肿瘤分割难题,提出新模型D3Seg提升精度与鲁棒性。
D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities

- 构建多跳模态图融合机制,捕捉不同影像模态间的复杂依赖关系。
- 在潜在空间中用轻量扩散模型补全缺失的T1ce和FLAIR特征,提升完整性。
- 通过概率空间决策优化,改善肿瘤边界划分,尤其对稀有区域更有效。
基于多参数MRI的精准脑肿瘤分割对治疗规划至关重要,但临床中常因部分MRI序列缺失导致现有分割方法性能显著下降,因其多采用简单的特征拼接或直接融合策略。为此,我们提出新型分割模型D3Seg,可在模态缺失条件下保持稳定表现。D3Seg引入多跳模态图融合(MMGF)以建模高阶模态间依赖关系,设计轻量级扩散重构机制,在潜空间补全缺失的T1ce与FLAIR特征表示,并采用概率空间决策精修策略缓解主导类别过自信问题,提升罕见肿瘤亚区的边界分割效果。我们在BraTS 2023胶质瘤数据集上进行主要评估,并在外部BraTS 2023脑膜瘤子集上测试泛化能力。结果表明,在多种模态缺失配置下,相较于当前最先进模型,D3Seg在增强肿瘤(ET)上平均提升约1.5–2.0%的Dice分数,在肿瘤核心(TC)上提升约1.0%;在脑膜瘤数据集上跨队列评估亦显示一致优势,其中TC与ET区域分别获得约1.5–3.0%与1.5–6.5%的增益。
原文摘要 · Abstract (English)
Accurate brain tumor segmentation using multi-parametric MRI is critical for effective treatment planning. However, in clinical settings, complete acquisition of all MRI sequences is not always possible. The absence of certain MRI modalities results in substantial performance degradation in existing segmentation methods, which typically rely on naive feature concatenation or direct fusion strategies. To address this limitation, we propose a novel segmentation model D3Seg which is designed to maintain stable performance under missing-modality settings. D3Seg introduces Multi-hop Modality Graph Fusion (MMGF) to model higher-order inter-modality dependencies, a lightweight diffusion-based imputation mechanism to compensate for missing T1ce and FLAIR feature representations in latent space, and probability-space decision refinement to mitigate dominant-class overconfidence and improve delineation of underrepresented tumor subregions. We evaluate the proposed D3Seg model on BraTS 2023 Glioma as the primary benchmark and further test it on a subset of the external BraTS 2023 Meningioma cohort to assess generalization across tumor pathologies. The results are compared with the state-of-the-art models under different missing-modality conditions. The proposed model achieves approximately 1.5-2.0% Dice improvement on enhancing tumor (ET) and around 1.0% on tumor core (TC) across multiple missing-modality configurations compared to the current state-of-the-art model on BraTS Glioma dataset. Cross-cohort evaluation on BraTS Meningioma dataset demonstrates the generalizability of the proposed model, showing consistent improvements in the challenging TC and ET regions, with approximately 1.5-3.0% and 1.5-6.5% gains respectively across several missing-modality configurations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。