arXiv:2508.03441cs.CV2025-08被引 1

首个基于大模型的医学影像主动学习基准,提升标注效率。

MedCAL-Bench: A Comprehensive Benchmark on Cold-Start Active Learning with Foundation Models for Medical Image Analysis

  • 用预训练大模型提取医学影像特征,替代传统自监督方法。
  • 不同大模型在分割任务中表现差异显著,分类任务中差异小。
  • 提出最优策略组合:分割用ALPS,分类用RepDiv,适配不同数据集。

冷启动主动学习(CSAL)旨在无先验知识下选择有信息量的样本进行标注,对有限标注预算下的医学影像分析具有重要意义。现有方法多依赖目标数据集上的自监督学习进行特征提取,效率低且表征能力受限。近期预训练基础模型(FMs)展现出强大特征提取能力,有望提升CSAL性能,但该范式研究较少,缺乏可比较的基准。为此,我们提出MedCAL-Bench,首个系统性的医学影像分析领域基于大模型的冷启动主动学习基准。在7个数据集上评估14种基础模型和7种主动学习策略,覆盖多种医学模态的分类与分割任务,不同标注预算下进行测试。这是首个同时评估特征提取与样本选择两个阶段的主动学习基准。实验结果表明:1)多数基础模型在主动学习中为有效特征提取器,其中DINO系列在分割任务中表现最佳;2)分割任务中各模型性能差异大,而分类任务中差异较小;3)不同数据集应采用不同采样策略,分割任务推荐使用基于处理意外度的主动学习(ALPS),分类任务则以RepDiv为优。代码已开源。

原文摘要 · Abstract (English)

Cold-Start Active Learning (CSAL) aims to select informative samples for annotation without prior knowledge, which is important for improving annotation efficiency and model performance under a limited annotation budget in medical image analysis. Most existing CSAL methods rely on Self-Supervised Learning (SSL) on the target dataset for feature extraction, which is inefficient and limited by insufficient feature representation. Recently, pre-trained Foundation Models (FMs) have shown powerful feature extraction ability with a potential for better CSAL. However, this paradigm has been rarely investigated, with a lack of benchmarks for comparison of FMs in CSAL tasks. To this end, we propose MedCAL-Bench, the first systematic FM-based CSAL benchmark for medical image analysis. We evaluate 14 FMs and 7 CSAL strategies across 7 datasets under different annotation budgets, covering classification and segmentation tasks from diverse medical modalities. It is also the first CSAL benchmark that evaluates both the feature extraction and sample selection stages. Our experimental results reveal that: 1) Most FMs are effective feature extractors for CSAL, with DINO family performing the best in segmentation; 2) The performance differences of these FMs are large in segmentation tasks, while small for classification; 3) Different sample selection strategies should be considered in CSAL on different datasets, with Active Learning by Processing Surprisal (ALPS) performing the best in segmentation while RepDiv leading for classification. The code is available at https://github.com/HiLab-git/MedCAL-Bench.

主动学习医学影像大模型基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。