arXiv:2505.16809cs.CVcs.MM2025-05被引 11

解决脑肿瘤分割中模态缺失与新增时的遗忘问题。

Hypergraph Tversky-Aware Domain Incremental Learning for Brain Tumor Segmentation with Missing Modalities

  • 用超图建模患者间高阶关联,提升跨场景分割能力。
  • 引入Tversky感知对比损失,缓解模态间与内部信息不平衡。
  • 支持增量学习新模态,避免重训且不丢失旧知识,适合临床持续迭代。

现有多模态MRI脑肿瘤分割方法通常假设所有模态在训练时均可用,但临床中因序列采集常出现模态缺失,导致性能下降。重新训练模型以适应新模态效率低,易过拟合并损害已有知识。为此,我们提出基于回放的超图领域增量学习(ReHyDIL)框架,利用领域增量学习使模型在不遗忘旧知识的前提下,从新增的MRI模态中持续学习。为提升多样患者场景下的分割性能,引入跨患者超图分割网络(CHSNet),通过超图捕捉患者间的高阶关联;同时采用Tversky感知对比损失(TAC),有效缓解模态间及模态内信息不平衡问题。在BraTS2019数据集上的大量实验表明,ReHyDIL相比现有最优方法,在多个肿瘤区域的骰子相似系数上提升超过2%。代码已开源:https://github.com/reeive/ReHyDIL。

原文摘要 · Abstract (English)

Existing methods for multimodal MRI segmentation with missing modalities typically assume that all MRI modalities are available during training. However, in clinical practice, some modalities may be missing due to the sequential nature of MRI acquisition, leading to performance degradation. Furthermore, retraining models to accommodate newly available modalities can be inefficient and may cause overfitting, potentially compromising previously learned knowledge. To address these challenges, we propose Replay-based Hypergraph Domain Incremental Learning (ReHyDIL) for brain tumor segmentation with missing modalities. ReHyDIL leverages Domain Incremental Learning (DIL) to enable the segmentation model to learn from newly acquired MRI modalities without forgetting previously learned information. To enhance segmentation performance across diverse patient scenarios, we introduce the Cross-Patient Hypergraph Segmentation Network (CHSNet), which utilizes hypergraphs to capture high-order associations between patients. Additionally, we incorporate Tversky-Aware Contrastive (TAC) loss to effectively mitigate information imbalance both across and within different modalities. Extensive experiments on the BraTS2019 dataset demonstrate that ReHyDIL outperforms state-of-the-art methods, achieving an improvement of over 2% in the Dice Similarity Coefficient across various tumor regions. Our code is available at https://github.com/reeive/ReHyDIL.

脑肿瘤分割增量学习多模态超图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。