针对血管结构分割的域偏移问题,提出首个拓扑增强的测试时自适应方法。
TopoTTA: Topology-Enhanced Test-Time Adaptation for Tubular Structure Segmentation
- 引入拓扑元差异卷积,无须修改预训练参数即可增强拓扑表征。
- 在10个数据集上平均提升clDice 31.81%,显著改善拓扑连续性。
- 适用于基于CNN的血管分割模型,可即插即用,适合医学图像分析场景。
管状结构分割(TSS)在血流动力学分析和路径导航等应用中至关重要。尽管取得了显著进展,域偏移仍是主要挑战,导致在未见目标域上性能下降。与一般分割任务不同,TSS对域偏移更敏感,因为拓扑结构变化会破坏分割完整性,局部特征(如纹理和对比度)的差异也可能破坏拓扑连续性。为此,我们提出拓扑增强的测试时自适应(TopoTTA),首个专为TSS设计的测试时自适应框架。该方法包含两阶段:第一阶段使用提出的拓扑元差异卷积(TopoMDCs)适应跨域拓扑差异,增强拓扑表示且不修改预训练参数;第二阶段通过新型拓扑困难样本生成(TopoHG)策略,在伪断裂区域生成伪标签并进行预测对齐,以提升拓扑连续性。在四个场景和十个数据集上的大量实验表明,TopoTTA能有效应对拓扑分布偏移,平均提升clDice 31.81%。TopoTTA还可作为即插即用的TTA方案,适用于基于CNN的TSS模型。
原文摘要 · Abstract (English)
Tubular structure segmentation (TSS) is important for various applications, such as hemodynamic analysis and route navigation. Despite significant progress in TSS, domain shifts remain a major challenge, leading to performance degradation in unseen target domains. Unlike other segmentation tasks, TSS is more sensitive to domain shifts, as changes in topological structures can compromise segmentation integrity, and variations in local features distinguishing foreground from background (e.g., texture and contrast) may further disrupt topological continuity. To address these challenges, we propose Topology-enhanced Test-Time Adaptation (TopoTTA), the first test-time adaptation framework designed specifically for TSS. TopoTTA consists of two stages: Stage 1 adapts models to cross-domain topological discrepancies using the proposed Topological Meta Difference Convolutions (TopoMDCs), which enhance topological representation without altering pre-trained parameters; Stage 2 improves topological continuity by a novel Topology Hard sample Generation (TopoHG) strategy and prediction alignment on hard samples with pseudo-labels in the generated pseudo-break regions. Extensive experiments across four scenarios and ten datasets demonstrate TopoTTA's effectiveness in handling topological distribution shifts, achieving an average improvement of 31.81% in clDice. TopoTTA also serves as a plug-and-play TTA solution for CNN-based TSS models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。