arXiv:2502.07822cs.CVcs.AI2025-02

通过点膨胀机制增强3D目标检测的感知范围,提升稀疏物体识别能力。

PDM-SSD: Single-Stage Three-Dimensional Object Detector With Point Dilation

  • 引入点膨胀机制,在欧氏空间扩展采样点覆盖范围
  • 在KITTI上实现单模态最佳性能,推理速度达68帧/秒
  • 适合处理稀疏、不完整目标,可无缝集成到现有模型中

现有基于点的检测器仅依赖原始点信息,感受野有限,全局建模能力不足。本文提出一种单阶段3D检测方法PDM-SSD,利用点膨胀机制(PDM)增强特征表达。首先采用PointNet风格的3D骨干网络进行高效特征编码;随后通过包含点膨胀与特征填充两步的颈模块扩展特征空间:前者在欧氏空间将点扩展为指定大小的网格,后者基于球谐系数和高斯密度函数,用方向与尺度信息填充空网格以支持反向传播。接着通过高度压缩融合多个膨胀中心的系数,生成稀疏网格特征。最后设计混合检测头,联合预测场景热图以补全投票点集,并通过特征融合校准检测框的目标置信度。在Kitti数据集上,PDM-SSD在单模态多类别检测中达到当前最优效果,推理速度为68帧/秒。实验表明其在检测稀疏与不完整目标方面表现优异。此外,PDM可作为辅助网络连接采样点与物体中心,提升精度而不影响推理速度。代码将开源于https://github.com/AlanLiangC/PDM-SSD.git。

原文摘要 · Abstract (English)

Current Point-based detectors can only learn from the provided points, with limited receptive fields and insufficient global learning capabilities for such targets. In this paper, we present a novel Point Dilation Mechanism for single-stage 3D detection (PDM-SSD) that takes advantage of these two representations. Specifically, we first use a PointNet-style 3D backbone for efficient feature encoding. Then, a neck with Point Dilation Mechanism (PDM) is used to expand the feature space, which involves two key steps: point dilation and feature filling. The former expands points to a certain size grid centered around the sampled points in Euclidean space. The latter fills the unoccupied grid with feature for backpropagation using spherical harmonic coefficients and Gaussian density function in terms of direction and scale. Next, we associate multiple dilation centers and fuse coefficients to obtain sparse grid features through height compression. Finally, we design a hybrid detection head for joint learning, where on one hand, the scene heatmap is predicted to complement the voting point set for improved detection accuracy, and on the other hand, the target probability of detected boxes are calibrated through feature fusion. On the challenging Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI) dataset, PDM-SSD achieves state-of-the-art results for multi-class detection among single-modal methods with an inference speed of 68 frames. We also demonstrate the advantages of PDM-SSD in detecting sparse and incomplete objects through numerous object-level instances. Additionally, PDM can serve as an auxiliary network to establish a connection between sampling points and object centers, thereby improving the accuracy of the model without sacrificing inference speed. Our code will be available at https://github.com/AlanLiangC/PDM-SSD.git.

3D检测点云点膨胀KITTI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。