用检测性能引导选样本,让模型少标注多提升。
Performance-guided Reinforced Active Learning for Object Detection
- 以检测精度提升为奖励,用强化学习选最该标注的样本。
- 在PASCAL VOC和COCO上达到最高标注效率,显著优于现有方法。
- 适合追求高效标注的视觉检测研究者与工业落地团队。
主动学习旨在用最少标注成本训练高性能模型,仅选择最具信息量的样本进行标注。当前方法多基于数据分布或内在信息量评估样本价值,未直接关联下游任务性能(如目标检测的mAP)。为此,我们提出性能引导(即mAP引导)的强化主动学习方法(MGRAL),将模型输出变化的期望作为信息量度量。针对批量样本选择的组合爆炸及模型性能与选样间非可导性问题,MGRAL采用基于策略梯度的强化学习采样代理,以mAP提升为奖励优化选择策略。同时,为降低使用未标注样本估算mAP的计算开销,MGRAL引入无监督快速查表机制,保障实际部署可行性。我们在PASCAL VOC与COCO基准上评估了MGRAL在检测任务中的主动学习性能,结果表明其在标注曲线中表现最优,并提供直观可视化支持,确立了强化学习驱动主动目标检测的新范式。
原文摘要 · Abstract (English)
Active learning (AL) strategies aim to train high-performance models with minimal labeling efforts, only selecting the most informative instances for annotation. Current approaches to evaluating data informativeness predominantly focus on the data's distribution or intrinsic information content and do not directly correlate with downstream task performance, such as mean average precision (mAP) in object detection. Thus, we propose Performance-guided (i.e. mAP-guided) Reinforced Active Learning for Object Detection (MGRAL), a novel approach that leverages the concept of expected model output changes as informativeness. To address the combinatorial explosion challenge of batch sample selection and the non-differentiable correlation between model performance and selected batches, MGRAL skillfully employs a reinforcement learning-based sampling agent that optimizes selection using policy gradient with mAP improvement as reward. Moreover, to reduce the computational overhead of mAP estimation with unlabeled samples, MGRAL utilizes an unsupervised way with fast look-up tables, ensuring feasible deployment. We evaluate MGRAL's active learning performance on detection tasks over PASCAL VOC and COCO benchmarks. Our approach demonstrates the highest AL curve with convincing visualizations, establishing a new paradigm in reinforcement learning-driven active object detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。