arXiv:2607.04199cs.CV2026-07

用拓扑结构评估3D医学模型迁移能力,省去大量调参计算。

Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models

论文配图:Topology-Driven Transferability Estimation for 3D Medical Vision Foundation Models
图 1 · 摘自论文原文
  • 基于最小生成树构建稀疏骨架图,从拓扑对齐度衡量迁移潜力。
  • 在11.4万例3D医学影像上实现0.36的领先性能,提速56倍。
  • 适合需要快速筛选分割模型的临床研究者使用。

医学视觉基础模型数量激增,亟需高效模型选择方法。现有主流方法依赖全量微调,计算成本高昂;而多数迁移性评估指标专为图像分类设计,难以保留空间关系与精细边界,不适用于3D医学图像分割任务。本文提出一种非参数化、拓扑驱动的评估框架,直接通过密集特征的1-骨架图与语义标签之间的对齐关系(基于最小生成树)进行估计。将对齐解耦为两个互补几何尺度:局部边界感知拓扑一致性(LBTC),用于评估边界可分性,证明最小生成树泄漏率是贝叶斯误差的有限样本下界;全局表示拓扑差异(GRTD),用于评价整体解剖布局。关键发现:未经微调的随机初始化分割解码器具有拓扑保持的空间投影能力,降低成对距离估计方差,稳定全局对齐评估。双指标通过任务自适应门控融合,适配多样化临床复杂场景。在包含114,000个3D医学体积的大规模基准上,本方法达到当前最优的加权肯德尔相关系数,平均提升0.36,同时加速评估56倍。

原文摘要 · Abstract (English)

The growing number of medical vision foundation models highlights the need for effective model selection. However, mainstream selection methods rely on exhaustive fine-tuning, which is computationally expensive. Most of the existing Transferability Estimation (TE) metrics are primarily designed for image-level classification. They fail to preserve spatial relationships and fine-grained boundary details, which are crucial for the segmentation task. Additionally, while image-level tasks typically process a single feature vector per input, dense prediction tasks in 3D medical imaging require voxel-wise evaluation against dense annotations. To bridge these gaps, we propose a \textit{non-parametric, topology-driven} framework that estimates transferability directly from the alignment between the sparse 1-skeleton graph of dense features and semantic labels via Minimum Spanning Trees (MST). We decouple the alignment into two complementary geometric scales: Local Boundary-Aware Topological Consistency (LBTC) to assess boundary separability, where we prove that the MST leakage rate serves as a finite-sample lower bound on the Bayes error; and Global Representation Topology Divergence (GRTD) to evaluate the overall anatomical layout. Crucially, we formally justify a counterintuitive mechanism: Although without fine-tuning, the randomly initialized segmentation decoder acts as a topology-preserving spatial projector, reducing the variance of pairwise distance estimates and stabilizing global alignment evaluation. Fused via a task-adaptive gating mechanism, these dual metrics adapt to diverse clinical complexities. Evaluated on a large-scale benchmark of 114,000 3D medical volumes across diverse anatomical tasks, our topological framework achieves state-of-the-art transferability estimation with an average weighted Kendall (outperforming by 0.36) while accelerating evaluation by 56 times.

3D医学迁移性评估拓扑学习分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。