arXiv:2502.19691cs.CVcs.AI2025-02CVPR被引 9

用能量模型统一处理认知与随机不确定性,提升开放集主动标注效果

Rethinking Epistemic and Aleatoric Uncertainty for Active Open-Set Annotation: An Energy-Based Approach

  • 引入能量机制同时衡量认知与随机不确定性,结合目标驱动采样策略
  • 在多个数据集上达到最优性能,查询精度高且训练开销低
  • 适合需要高效标注未知类别的开放集场景,尤其适用于资源受限任务

主动学习在开放集场景下面临挑战:现有方法要么优先选择已知类别中置信度高的样本(低认知不确定性),要么关注预测不确定的样本(高随机不确定性),但二者均表现不佳。前者信息量有限,后者对未知类样本的随机不确定性度量意义不大。本文提出基于能量的开放集主动标注框架(EAOA),融合认知与随机不确定性。EAOA包含一个 (C+1) 类检测器和一个目标分类器,分别采用能量机制计算认知不确定性、设计用于检测器的边际能量损失,并为分类器构建能量型随机不确定性度量。关键创新在于目标驱动的自适应采样策略:先筛选低认知不确定性样本构成小候选集以保证闭集特性,再从中选取高随机不确定性样本作为最终查询集,候选集大小动态调整。大量实验表明,EAOA实现当前最优性能,兼具高查询精度与低训练开销。代码已公开于 https://github.com/chenchenzong/EAOA。

原文摘要 · Abstract (English)

Active learning (AL), which iteratively queries the most informative examples from a large pool of unlabeled candidates for model training, faces significant challenges in the presence of open-set classes. Existing methods either prioritize query examples likely to belong to known classes, indicating low epistemic uncertainty (EU), or focus on querying those with highly uncertain predictions, reflecting high aleatoric uncertainty (AU). However, they both yield suboptimal performance, as low EU corresponds to limited useful information, and closed-set AU metrics for unknown class examples are less meaningful. In this paper, we propose an Energy-based Active Open-set Annotation (EAOA) framework, which effectively integrates EU and AU to achieve superior performance. EAOA features a $(C+1)$-class detector and a target classifier, incorporating an energy-based EU measure and a margin-based energy loss designed for the detector, alongside an energy-based AU measure for the target classifier. Another crucial component is the target-driven adaptive sampling strategy. It first forms a smaller candidate set with low EU scores to ensure closed-set properties, making AU metrics meaningful. Subsequently, examples with high AU scores are queried to form the final query set, with the candidate set size adjusted adaptively. Extensive experiments show that EAOA achieves state-of-the-art performance while maintaining high query precision and low training overhead. The code is available at https://github.com/chenchenzong/EAOA.

主动学习开放集不确定性能量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。