利用解剖结构先验提升医学图像分割的测试时泛化能力
Test-Time Domain Generalization via Universe Learning: A Multi-Graph Matching Approach for Medical Image Segmentation
- 通过多图匹配融合解剖形态先验,构建可学习的全局嵌入
- 在两个医学图像分割基准上超越现有方法,单源/多源场景均有效
- 适合需要强鲁棒性的医疗影像模型部署场景
尽管领域泛化(DG)显著缓解了预训练模型因领域偏移导致的性能下降,但在真实部署中仍显不足。测试时自适应(TTA)通过使用无标签测试数据调整已学模型,展现出良好前景。然而,多数现有TTA方法在医学图像分割任务中表现不佳,主要因其忽视了医学图像中固有的重要先验知识。为此,我们引入解剖形态信息,提出基于多图匹配的框架。具体地,在多源训练中引入可学习的全局嵌入以整合形态先验,并设计新颖的无监督测试时自适应范式。该方法保证多匹配中的循环一致性,使模型更有效捕捉未见数据的不变先验,显著减轻领域偏移影响。大量实验表明,本方法在两个医学图像分割基准上,于多源与单源领域泛化任务中均优于现有最先进方法。源代码已公开于https://github.com/Yore0/TTDG-MGM。
原文摘要 · Abstract (English)
Despite domain generalization (DG) has significantly addressed the performance degradation of pre-trained models caused by domain shifts, it often falls short in real-world deployment. Test-time adaptation (TTA), which adjusts a learned model using unlabeled test data, presents a promising solution. However, most existing TTA methods struggle to deliver strong performance in medical image segmentation, primarily because they overlook the crucial prior knowledge inherent to medical images. To address this challenge, we incorporate morphological information and propose a framework based on multi-graph matching. Specifically, we introduce learnable universe embeddings that integrate morphological priors during multi-source training, along with novel unsupervised test-time paradigms for domain adaptation. This approach guarantees cycle-consistency in multi-matching while enabling the model to more effectively capture the invariant priors of unseen data, significantly mitigating the effects of domain shifts. Extensive experiments demonstrate that our method outperforms other state-of-the-art approaches on two medical image segmentation benchmarks for both multi-source and single-source domain generalization tasks. The source code is available at https://github.com/Yore0/TTDG-MGM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。