通过空间感知预热与大模型先验,提升无监督3D目标检测的准确率。
OWL: Unsupervised 3D Object Detection by Occupancy Guided Warm-up and Large Model Priors Reasoning
- 用占用引导预热初始化网络,减少错误伪标签干扰
- 引入大模型先验评估伪标签质量,实现精准过滤与修正
- 动态加权自训练策略,显著提升检测性能,适合自动驾驶场景
无监督3D目标检测通过启发式算法发现潜在物体,有望降低自动驾驶标注成本。现有方法主要依赖伪标签并经自训练迭代优化,但初期伪标签常不准确,易误导优化过程,且有效筛选与修正仍具挑战。本文提出OWL方法,结合占用引导预热(OGW)与大模型先验推理(ICR)。OGW策略通过空间感知能力初始化主干网络权重,缓解错误伪标签对收敛的影响;ICR模块利用大模型先验评估伪标签质量,实现精确过滤与修正;此外,设计权重自适应自训练(WAS)策略,动态调整伪标签权重,提升自训练效果。在Waymo Open Dataset(WOD)和KITTI上的实验表明,OWL相比最先进无监督方法提升超过15.0% mAP,验证了方法有效性。
原文摘要 · Abstract (English)
Unsupervised 3D object detection leverages heuristic algorithms to discover potential objects, offering a promising route to reduce annotation costs in autonomous driving. Existing approaches mainly generate pseudo labels and refine them through self-training iterations. However, these pseudo-labels are often incorrect at the beginning of training, resulting in misleading the optimization process. Moreover, effectively filtering and refining them remains a critical challenge. In this paper, we propose OWL for unsupervised 3D object detection by occupancy guided warm-up and large-model priors reasoning. OWL first employs an Occupancy Guided Warm-up (OGW) strategy to initialize the backbone weight with spatial perception capabilities, mitigating the interference of incorrect pseudo-labels on network convergence. Furthermore, OWL introduces an Instance-Cued Reasoning (ICR) module that leverages the prior knowledge of large models to assess pseudo-label quality, enabling precise filtering and refinement. Finally, we design a Weight-adapted Self-training (WAS) strategy to dynamically re-weight pseudo-labels, improving the performance through self-training. Extensive experiments on Waymo Open Dataset (WOD) and KITTI demonstrate that OWL outperforms state-of-the-art unsupervised methods by over 15.0% mAP, revealing the effectiveness of our method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。