提出首个面向室内3D目标检测的主动学习框架,兼顾不确定性与多样性。
Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection
- 结合不确定性和多样性双重标准筛选最需标注的样本。
- 仅用10%标注预算即达全监督性能的85%以上。
- 适合标注成本高、类别多样的室内3D场景应用。
主动学习在降低3D目标检测标注负担方面展现出巨大潜力,但主要研究集中于室外环境。相比之下,室内数据集面临更少每类样本、更多类别、更严重的类别不平衡以及多样化的场景类型和类内差异等挑战。本文首次系统研究了室内3D目标检测中的主动学习,提出一种专为此任务设计的新框架。该方法融合不确定性与多样性两个关键准则:不确定性准则同时考虑误检与漏检,优先选择最模糊的样本;多样性准则通过联合优化物体类别分布与场景类型多样性,引入新的类别感知自适应原型(CAP)库,动态为各类别分配代表性原型以捕捉类内差异。我们在SUN RGB-D和ScanNetV2上评估该方法,结果表明其显著优于基线,在仅使用10%标注预算时,性能达到全监督水平的85%以上。
原文摘要 · Abstract (English)
Active learning has emerged as a promising approach to reduce the substantial annotation burden in 3D object detection tasks, spurring several initiatives in outdoor environments. However, its application in indoor environments remains unexplored. Compared to outdoor 3D datasets, indoor datasets face significant challenges, including fewer training samples per class, a greater number of classes, more severe class imbalance, and more diverse scene types and intra-class variances. This paper presents the first study on active learning for indoor 3D object detection, where we propose a novel framework tailored for this task. Our method incorporates two key criteria - uncertainty and diversity - to actively select the most ambiguous and informative unlabeled samples for annotation. The uncertainty criterion accounts for both inaccurate detections and undetected objects, ensuring that the most ambiguous samples are prioritized. Meanwhile, the diversity criterion is formulated as a joint optimization problem that maximizes the diversity of both object class distributions and scene types, using a new Class-aware Adaptive Prototype (CAP) bank. The CAP bank dynamically allocates representative prototypes to each class, helping to capture varying intra-class diversity across different categories. We evaluate our method on SUN RGB-D and ScanNetV2, where it outperforms baselines by a significant margin, achieving over 85% of fully-supervised performance with just 10% of the annotation budget.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。