arXiv:2506.15318cs.CV2025-06被引 2

用视觉语言模型提升病理图像主动学习效率,有效过滤无关样本。

OpenPath: Open-Set Active Learning for Pathology Image Classification via Pre-trained Vision-Language Models

  • 首轮查询用任务提示筛选相关且有信息量的图像,避免盲目标注。
  • 后续采样结合原型与熵值,确保所选样本既纯净又具代表性。
  • 适合需要高效标注的医学图像分类场景,尤其含大量异常数据时。

病理图像分类在精准医疗诊断与治疗规划中至关重要。训练高性能模型通常需大规模标注数据,但标注成本高、耗时长。主动学习(AL)通过迭代选择最具信息量的样本减少标注负担。然而,多数方法假设所有未标注图像均属于已知类别(闭集),而真实临床环境中存在大量分布外(OOD)数据,导致传统方法效率低下。此外,多数方法首轮随机采样,造成标注资源浪费。为此,本文提出OpenPath,一种基于预训练视觉-语言模型的开放集主动学习方法。首轮使用结合目标类与相关非目标类提示的任务特定提示,从未标注池中筛选出分布内(ID)且信息丰富的样本。后续查询采用多样性信息量采样(DIS),包含基于原型的候选选择(PIS)与熵引导的随机采样(EGSS),确保查询样本兼具纯度与信息性,避免引入分布外样本。在两个公开病理图像数据集上的实验表明,由于所选样本纯度高,OpenPath显著提升模型性能,优于多种前沿开放集主动学习方法。代码已开源。

原文摘要 · Abstract (English)

Pathology image classification plays a crucial role in accurate medical diagnosis and treatment planning. Training high-performance models for this task typically requires large-scale annotated datasets, which are both expensive and time-consuming to acquire. Active Learning (AL) offers a solution by iteratively selecting the most informative samples for annotation, thereby reducing the labeling effort. However, most AL methods are designed under the assumption of a closed-set scenario, where all the unannotated images belong to target classes. In real-world clinical environments, the unlabeled pool often contains a substantial amount of Out-Of-Distribution (OOD) data, leading to low efficiency of annotation in traditional AL methods. Furthermore, most existing AL methods start with random selection in the first query round, leading to a significant waste of labeling costs in open-set scenarios. To address these challenges, we propose OpenPath, a novel open-set active learning approach for pathological image classification leveraging a pre-trained Vision-Language Model (VLM). In the first query, we propose task-specific prompts that combine target and relevant non-target class prompts to effectively select In-Distribution (ID) and informative samples from the unlabeled pool. In subsequent queries, Diverse Informative ID Sampling (DIS) that includes Prototype-based ID candidate Selection (PIS) and Entropy-Guided Stochastic Sampling (EGSS) is proposed to ensure both purity and informativeness in a query, avoiding the selection of OOD samples. Experiments on two public pathology image datasets show that OpenPath significantly enhances the model's performance due to its high purity of selected samples, and outperforms several state-of-the-art open-set AL methods. The code is available at \href{https://github.com/HiLab-git/OpenPath}{https://github.com/HiLab-git/OpenPath}..

主动学习病理图像视觉语言模型开放集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。