通过点金字塔融合多尺度特征,提升远距离3D目标检测性能
Multi-scale Feature Fusion with Point Pyramid for 3D Object Detection
- 构建点金字塔增强模块,打通不同空间尺度与语义深度的信息通道
- 在KITTI和Waymo数据集上实现显著性能提升,尤其在远距离检测中优势明显
- 轻量级设计适配多种现有框架,适合资源受限的自动驾驶系统
有效的点云处理对基于激光雷达的自动驾驶系统至关重要。智能车辆检测需要理解多尺度特征,因为道路使用者可能以不同尺寸出现。近期方法集中于设计特征聚合算子,从编码器主干网络中收集不同尺度的特征并分配给感兴趣点。然而,如何融合这些多尺度特征的重要性被忽视,导致跨尺度特征通信不足。为此,本文提出点金字塔检测框架POP-RCNN,包含点金字塔特征增强(PPFE)模块,建立空间尺度与语义深度间的连接以实现信息交换。该模块有效融合多尺度特征,在不增加特征聚合复杂度的前提下提供丰富信息。为缓解点密度不一致的影响,引入点密度置信度模块。该设计使轻量级特征聚合器成为可能,并兼顾浅层与深层语义,实现高效的3D目标检测框架。该方法具有强适应性,可应用于多种现有框架以增强特征表达,尤其适用于远距离检测。在基于体素和点-体素基线模型中引入PPFE,KITTI和Waymo Open Dataset上的实验表明,即使计算资源有限,仍能取得显著性能提升。
原文摘要 · Abstract (English)
Effective point cloud processing is crucial to LiDARbased autonomous driving systems. The capability to understand features at multiple scales is required for object detection of intelligent vehicles, where road users may appear in different sizes. Recent methods focus on the design of the feature aggregation operators, which collect features at different scales from the encoder backbone and assign them to the points of interest. While efforts are made into the aggregation modules, the importance of how to fuse these multi-scale features has been overlooked. This leads to insufficient feature communication across scales. To address this issue, this paper proposes the Point Pyramid RCNN (POP-RCNN), a feature pyramid-based framework for 3D object detection on point clouds. POP-RCNN consists of a Point Pyramid Feature Enhancement (PPFE) module to establish connections across spatial scales and semantic depths for information exchange. The PPFE module effectively fuses multi-scale features for rich information without the increased complexity in feature aggregation. To remedy the impact of inconsistent point densities, a point density confidence module is deployed. This design integration enables the use of a lightweight feature aggregator, and the emphasis on both shallow and deep semantics, realising a detection framework for 3D object detection. With great adaptability, the proposed method can be applied to a variety of existing frameworks to increase feature richness, especially for long-distance detection. By adopting the PPFE in the voxel-based and point-voxel-based baselines, experimental results on KITTI and Waymo Open Dataset show that the proposed method achieves remarkable performance even with limited computational headroom.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。