解决点云检测训练与推理不一致问题,提升实时3D检测精度
Real-Time 3D Object Detection with Inference-Aligned Learning
- 基于空间优先和排序感知设计新训练策略
- 在ScanNet V2和SUN RGB-D上显著提优,保持实时速度
- 适合需要高精度实时3D感知的机器人、AR应用
从点云中实现实时3D目标检测对增强现实、机器人导航等动态场景理解至关重要。本文提出一种面向室内点云的新型空间优先与排序感知3D检测框架SR3D,以弥合检测器训练与评估之间的差距。该差距源于训练时缺乏空间可靠性与排序感知,与推理阶段基于排序的选择机制相冲突,阻碍模型学习与推理行为一致的表征。为解决此问题,SR3D包含两个针对点云空间特性的组件:一种新颖的空间优先最优传输分配机制,动态强化定位准确、空间可靠的样本;以及一种排序感知自蒸馏方案,通过自蒸馏范式自适应注入排序感知能力。在ScanNet V2和SUN RGB-D上的大量实验表明,SR3D有效缩小了训练-推理差距,在保持实时速度的同时显著优于现有方法。
原文摘要 · Abstract (English)
Real-time 3D object detection from point clouds is essential for dynamic scene understanding in applications such as augmented reality, robotics and navigation. We introduce a novel Spatial-prioritized and Rank-aware 3D object detection (SR3D) framework for indoor point clouds, to bridge the gap between how detectors are trained and how they are evaluated. This gap stems from the lack of spatial reliability and ranking awareness during training, which conflicts with the ranking-based prediction selection used as inference. Such a training-inference gap hampers the model's ability to learn representations aligned with inference-time behavior. To address the limitation, SR3D consists of two components tailored to the spatial nature of point clouds during training: a novel spatial-prioritized optimal transport assignment that dynamically emphasizes well-located and spatially reliable samples, and a rank-aware adaptive self-distillation scheme that adaptively injects ranking perception via a self-distillation paradigm. Extensive experiments on ScanNet V2 and SUN RGB-D show that SR3D effectively bridges the training-inference gap and significantly outperforms prior methods in accuracy while maintaining real-time speed.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。