arXiv:2510.11632cs.CVcs.AI2025-10

用法向量增强点云特征,提升自动驾驶3D目标检测精度

NV3D: Leveraging Spatial Shape Through Normal Vector-based 3D Object Detection

  • 通过KNN与PCA计算体素法向量,捕捉物体表面形状信息
  • 在KITTI数据集上,汽车检测达86.60% mAP,优于基线模型2.61%
  • 支持两种采样策略,可删减55%数据仍保持性能

针对自动驾驶中3D目标检测的挑战,现有方法多依赖多模态融合或局部特征提取,但存在特征对齐困难或表征不足的问题。本文提出NV3D模型,基于体素邻域计算法向量(采用KNN与PCA),获取物体表面结构信息以理解目标与周围空间的关系。该方法设计了两种采样策略:法向量密度采样和视野感知分箱采样,可在去除约55%体素的前提下维持性能。同时引入元素级注意力融合机制,以体素特征为查询与值,法向量特征为键。在KITTI数据集上,未采样时汽车与骑行人检测的mAP分别达到86.60%与80.18%,较基准模型Voxel R-CNN提升2.61%与4.23%;采用采样后汽车检测仍达85.54% mAP,超出基线1.56%。

原文摘要 · Abstract (English)

Recent studies in 3D object detection for autonomous vehicles aim to enrich features through the utilization of multi-modal setups or the extraction of local patterns within LiDAR point clouds. However, multi-modal methods face significant challenges in feature alignment, and gaining features locally can be oversimplified for complex 3D object detection tasks. In this paper, we propose a novel model, NV3D, which utilizes local features acquired from voxel neighbors, as normal vectors computed per voxel basis using K-nearest neighbors (KNN) and principal component analysis (PCA). This informative feature enables NV3D to determine the relationship between the surface and pertinent target entities, including cars, pedestrians, or cyclists. During the normal vector extraction process, NV3D offers two distinct sampling strategies: normal vector density-based sampling and FOV-aware bin-based sampling, allowing elimination of up to 55% of data while maintaining performance. In addition, we applied element-wise attention fusion, which accepts voxel features as the query and value and normal vector features as the key, similar to the attention mechanism. Our method is trained on the KITTI dataset and has demonstrated superior performance in car and cyclist detection owing to their spatial shapes. In the validation set, NV3D without sampling achieves 86.60% and 80.18% mean Average Precision (mAP), greater than the baseline Voxel R-CNN by 2.61% and 4.23% mAP, respectively. With both samplings, NV3D achieves 85.54% mAP in car detection, exceeding the baseline by 1.56% mAP, despite roughly 55% of voxels being filtered out.

3D检测点云处理法向量自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。