解决脑肿瘤分割中多模态缺失问题,提升模型鲁棒性。
CCSD: Cross-Modal Compositional Self-Distillation for Robust Brain Tumor Segmentation with Missing Modalities
- 设计跨模态组合自蒸馏框架,灵活应对任意模态缺失。
- 在多种缺模场景下达到当前最佳性能,分割准确率显著提升。
- 适合临床实际中模态不全的脑肿瘤分割任务使用。
从多模态MRI中精确分割脑肿瘤对临床诊断和治疗规划至关重要。尽管融合不同MRI序列的互补信息是常见做法,但真实临床环境中常出现一个或多个模态缺失,严重削弱基于深度学习的分割模型性能与泛化能力。为此,我们提出一种新型跨模态组合自蒸馏(CCSD)框架,可灵活处理任意输入模态组合。CCSD采用共享-特定编码器-解码器架构,并引入两种自蒸馏策略:(i) 分层模态自蒸馏机制,通过跨模态层级知识迁移减少语义差异;(ii) 渐进式模态组合蒸馏方法,在训练中模拟逐步模态缺失,增强对缺失模态的鲁棒性。在公开脑肿瘤分割基准上的大量实验表明,CCSD在各种缺模场景下均实现最先进的性能,具备强泛化性和稳定性。
原文摘要 · Abstract (English)
The accurate segmentation of brain tumors from multi-modal MRI is critical for clinical diagnosis and treatment planning. While integrating complementary information from various MRI sequences is a common practice, the frequent absence of one or more modalities in real-world clinical settings poses a significant challenge, severely compromising the performance and generalizability of deep learning-based segmentation models. To address this challenge, we propose a novel Cross-Modal Compositional Self-Distillation (CCSD) framework that can flexibly handle arbitrary combinations of input modalities. CCSD adopts a shared-specific encoder-decoder architecture and incorporates two self-distillation strategies: (i) a hierarchical modality self-distillation mechanism that transfers knowledge across modality hierarchies to reduce semantic discrepancies, and (ii) a progressive modality combination distillation approach that enhances robustness to missing modalities by simulating gradual modality dropout during training. Extensive experiments on public brain tumor segmentation benchmarks demonstrate that CCSD achieves state-of-the-art performance across various missing-modality scenarios, with strong generalization and stability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。