提出拓扑驱动的医学分割模型迁移能力评估方法,无需微调即可高效选型。
Topology-Driven Transferability Estimation of Medical Foundation Models for Segmentation

- 基于最小生成树与流形结构一致性,量化特征与标签的拓扑相似性。
- 在OpenMind数据集上相比最优基线提升31%的加权肯德尔相关性。
- 适用于器官分割等密集预测任务,尤其适合无标注数据场景下的模型筛选。
大规模自监督学习催生了众多医学基础模型,但针对特定分割任务选择最优模型仍是计算瓶颈。现有迁移能力评估方法多面向分类任务,依赖全局统计假设,难以捕捉密集预测所需的拓扑复杂性。本文提出一种拓扑驱动的迁移能力评估框架,评估流形可迁徙性而非统计重叠。引入三个组件:(1) 全局表示拓扑差异(GRTD),利用最小生成树量化特征-标签结构同构性;(2) 局部边界感知拓扑一致性(LBTC),专门评估关键解剖边界处的流形可分性;(3) 任务自适应融合,根据目标任务语义基数动态整合全局与局部指标。在涵盖多种解剖目标和SSL基础模型的大规模OpenMind基准上验证,相比现有最佳基线,加权肯德尔相关性提升约31%,提供无需训练的高效模型选择代理,显著降低微调成本。代码将在录用后公开。
原文摘要 · Abstract (English)
The advent of large-scale self-supervised learning (SSL) has produced a vast zoo of medical foundation models. However, selecting optimal medical foundation models for specific segmentation tasks remains a computational bottleneck. Existing Transferability Estimation (TE) metrics, primarily designed for classification, rely on global statistical assumptions and fail to capture the topological complexity essential for dense prediction. We propose a novel Topology-Driven Transferability Estimation framework that evaluates manifold tractability rather than statistical overlap. Our approach introduces three components: (1) Global Representation Topology Divergence (GRTD), utilizing Minimum Spanning Trees to quantify feature-label structural isomorphism; (2) Local Boundary-Aware Topological Consistency (LBTC), which assesses manifold separability specifically at critical anatomical boundaries; and (3) Task-Adaptive Fusion, which dynamically integrates global and local metrics based on the semantic cardinality of the target task. Validated on the large-scale OpenMind benchmark across diverse anatomical targets and SSL foundation models, our approach significantly outperforms state-of-the-art baselines by around 31% relative improvement in the weighted Kendall metric, providing a robust, training-free proxy for efficient model selection without the cost of fine-tuning. The code will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。