提出无需检测器的开放集主动学习框架,利用未知样本提升标注效率和模型性能。
Revisiting Unknowns: Towards Effective and Efficient Open-Set Active Learning
- 基于冻结对比预训练特征空间进行标签引导聚类,发现未知类潜在结构。
- 通过狄利克雷校准辅助头,同时优化已知类判别与置信度校准。
- 设计双阶段查询策略,兼顾精度与效率,适合实际部署场景。
开放集主动学习(OSAL)旨在处理未标注数据中可能包含新类别的情况,这在安全关键和开放世界场景中十分常见。现有方法通常依赖独立训练的开放集检测器,带来显著训练开销,并忽视了已标注未知样本对已知类学习的监督价值。本文提出E$^2$OAL(有效且高效的开放集主动学习),一个统一且无需检测器的框架,充分利用已标注未知样本以增强监督并提高查询可靠性。E$^2$OAL首先在冻结的对比预训练特征空间中通过标签引导聚类揭示未知类的潜在结构,使用结构感知的F1-乘积目标进行优化;为利用已标注未知样本,引入狄利克雷校准的辅助头,联合建模已知与未知类别,提升置信度校准与已知类区分能力。在此基础上,采用对数边际纯度分数估计已知类可能性,构建高纯度候选池,结合专为OSAL设计的信息性度量,优先选择部分模糊但可靠的样本。上述组件构成灵活的两阶段查询策略,具备自适应精度控制与低超参数敏感性。在多个OSAL基准上的大量实验表明,E$^2$OAL在准确性、效率和查询精度上持续优于当前最优方法,凸显其有效性和实用性。代码已公开于github.com/chenchenzong/E2OAL。
原文摘要 · Abstract (English)
Open-set active learning (OSAL) aims to identify informative samples for annotation when unlabeled data may contain previously unseen classes-a common challenge in safety-critical and open-world scenarios. Existing approaches typically rely on separately trained open-set detectors, introducing substantial training overhead and overlooking the supervisory value of labeled unknowns for improving known-class learning. In this paper, we propose E$^2$OAL (Effective and Efficient Open-set Active Learning), a unified and detector-free framework that fully exploits labeled unknowns for both stronger supervision and more reliable querying. E$^2$OAL first uncovers the latent class structure of unknowns through label-guided clustering in a frozen contrastively pre-trained feature space, optimized by a structure-aware F1-product objective. To leverage labeled unknowns, it employs a Dirichlet-calibrated auxiliary head that jointly models known and unknown categories, improving both confidence calibration and known-class discrimination. Building on this, a logit-margin purity score estimates the likelihood of known classes to construct a high-purity candidate pool, while an OSAL-specific informativeness metric prioritizes partially ambiguous yet reliable samples. These components together form a flexible two-stage query strategy with adaptive precision control and minimal hyperparameter sensitivity. Extensive experiments across multiple OSAL benchmarks demonstrate that E$^2$OAL consistently surpasses state-of-the-art methods in accuracy, efficiency, and query precision, highlighting its effectiveness and practicality for real-world applications. The code is available at github.com/chenchenzong/E2OAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。