针对单目3D检测标注成本高的问题,提出实例级主动学习新方法。
IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection
- 基于多样化的集成模型,按实例选择需标注的目标
- 仅用60%标注量,性能媲美全量数据训练
- 适合标注预算有限的单目3D检测场景
单目3D检测仅依赖单个摄像头,部署便捷,但需大量标注,尤其3D标签成本高昂。为在有限标注预算下提升性能,需优先标注最具信息量的样本,这正是主动学习的核心。然而现有方法存在两大缺陷:一是按图像整体选样,导致非相关信息也被标注;二是依赖不确定性采样,在单目3D检测中偏向深度模糊的远距离目标,忽视近距离目标。为此,本文提出首个面向单目3D检测的实例级主动学习框架IDEAL-M3D。首次证明,通过异构骨干网络、任务无关特征、损失权重扰动和时间依赖袋装法构建的多样化集成模型,可有效提升多样性驱动的主动学习性能。在KITTI验证集和测试集上,仅使用60%标注样本,即达到或超过全量数据训练的AP3D指标。
原文摘要 · Abstract (English)
Monocular 3D detection relies on just a single camera and is therefore easy to deploy. Yet, achieving reliable 3D understanding from monocular images requires substantial annotation, and 3D labels are especially costly. To maximize performance under constrained labeling budgets, it is essential to prioritize annotating samples expected to deliver the largest performance gains. This prioritization is the focus of active learning. Curiously, we observed two significant limitations in active learning algorithms for 3D monocular object detection. First, previous approaches select entire images, which is inefficient, as non-informative instances contained in the same image also need to be labeled. Secondly, existing methods rely on uncertainty-based selection, which in monocular 3D object detection creates a bias toward depth ambiguity. Consequently, distant objects are selected, while nearby objects are overlooked. To address these limitations, we propose IDEAL-M3D, the first instance-level pipeline for monocular 3D detection. For the first time, we demonstrate that an explicitly diverse, fast-to-train ensemble improves diversity-driven active learning for monocular 3D. We induce diversity with heterogeneous backbones and task-agnostic features, loss weight perturbation, and time-dependent bagging. IDEAL-M3D shows superior performance and significant resource savings: with just 60% of the annotations, we achieve similar or better AP3D on KITTI validation and test set results compared to training the same detector on the whole dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。