通过语义提示增强图聚类,实现医疗图像分割的持续测试时自适应。
SPEGC: Continual Test-Time Adaptation via Semantic-Prompt-Enhanced Graph Clustering for Medical Image Segmentation
- 用语义提示分离共性与差异特征,增强局部特征抗噪声能力。
- 将边稀疏化建模为最优传输问题,端到端生成高阶结构表示。
- 提升模型在动态数据域下的分割一致性,适合临床部署场景。
在医疗图像分割任务中,训练与测试数据采集差异导致的领域偏移严重制约预训练模型在临床实践中的应用。持续测试时自适应(CTTA)旨在使预训练模型适应不断变化的无标签领域,是解决该问题的有效途径。然而,现有CTTA方法常依赖不可靠的监督信号,引发错误累积的自我强化循环,最终导致性能灾难性下降。为此,本文提出基于语义提示增强图聚类的CTTA方法(SPEGC)。首先,设计语义提示特征增强机制,通过解耦的共性与异质性提示池,将全局上下文信息注入局部特征,缓解其在领域迁移下的噪声敏感性。其次,基于增强特征设计可微图聚类求解器,将全局边稀疏化重构为最优传输问题,以端到端方式从原始相似矩阵提炼出精细化、高阶结构表示。最后,利用该鲁棒结构表示引导模型自适应,确保聚类级预测一致性并动态调整决策边界。大量实验表明,SPEGC在两个医学图像分割基准上均优于其他先进CTTA方法。源代码已开源:https://github.com/Jwei-Z/SPEGC-for-MIS。
原文摘要 · Abstract (English)
In medical image segmentation tasks, the domain gap caused by the difference in data collection between training and testing data seriously hinders the deployment of pre-trained models in clinical practice. Continual Test-Time Adaptation (CTTA) aims to enable pre-trained models to adapt to continuously changing unlabeled domains, providing an effective approach to solving this problem. However, existing CTTA methods often rely on unreliable supervisory signals, igniting a self-reinforcing cycle of error accumulation that culminates in catastrophic performance degradation. To overcome these challenges, we propose a CTTA via Semantic-Prompt-Enhanced Graph Clustering (SPEGC) for medical image segmentation. First, we design a semantic prompt feature enhancement mechanism that utilizes decoupled commonality and heterogeneity prompt pools to inject global contextual information into local features, alleviating their susceptibility to noise interference under domain shift. Second, based on these enhanced features, we design a differentiable graph clustering solver. This solver reframes global edge sparsification as an optimal transport problem, allowing it to distill a raw similarity matrix into a refined and high-order structural representation in an end-to-end manner. Finally, this robust structural representation is used to guide model adaptation, ensuring predictions are consistent at a cluster-level and dynamically adjusting decision boundaries. Extensive experiments demonstrate that SPEGC outperforms other state-of-the-art CTTA methods on two medical image segmentation benchmarks. The source code is available at https://github.com/Jwei-Z/SPEGC-for-MIS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。