arXiv:2412.20172cs.CV2024-12被引 4

提出新指标评估医学图像迁移性能,更准更可靠。

On dataset transferability in medical image classification

  • 融合特征质量与梯度信息,评估模型适配性
  • 在医学图像和跨域迁移中均优于现有方法
  • 提供真实基准数据,助力后续研究

当前针对自然图像数据集设计的迁移性估计方法在医学图像分类中表现不佳。这些方法主要关注预训练模型特征对目标数据集的适用性,常导致不合理的预测结果,例如认为目标数据集自身是最优源数据。为此,我们提出一种新型迁移性度量方法,结合特征质量与梯度信息,评估源模型特征在目标任务中的适用性与可适应性。我们在两个新场景下验证该方法:医学图像分类中的源数据集迁移性,以及跨域迁移性(自然图像到医学图像)。实验结果表明,该方法在两种场景下均优于现有迁移性度量。此外,我们揭示了影响医学图像分类迁移性能的关键因素,并分析了从自然图像到医学图像的跨域迁移动态。我们还提供了真实迁移性能的基准测试结果,以推动医学图像迁移性估计的进一步研究。代码与实验已开源于 https://github.com/DovileDo/transferability-in-medical-imaging。

原文摘要 · Abstract (English)

Current transferability estimation methods designed for natural image datasets are often suboptimal in medical image classification. These methods primarily focus on estimating the suitability of pre-trained source model features for a target dataset, which can lead to unrealistic predictions, such as suggesting that the target dataset is the best source for itself. To address this, we propose a novel transferability metric that combines feature quality with gradients to evaluate both the suitability and adaptability of source model features for target tasks. We evaluate our approach in two new scenarios: source dataset transferability for medical image classification and cross-domain transferability. Our results show that our method outperforms existing transferability metrics in both settings. We also provide insight into the factors influencing transfer performance in medical image classification, as well as the dynamics of cross-domain transfer from natural to medical images. Additionally, we provide ground-truth transfer performance benchmarking results to encourage further research into transferability estimation for medical image classification. Our code and experiments are available at https://github.com/DovileDo/transferability-in-medical-imaging.

医学图像迁移性模型评估深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。