arXiv:2410.08365cs.ROcs.CV2024-10中稿 · IROS 2024 PPNIV Wo…被引 12

对比多种3D语义分割方法,评估其在嵌入式设备上的实时性能。

Are We Ready for Real-Time LiDAR Semantic Segmentation in Autonomous Driving?

  • 在Jetson平台测试多种3D分割模型,统一训练流程保证公平比较
  • 在SemanticKITTI和nuScenes上给出AGX Orin/Xavier的基准性能数据
  • 为资源受限机器人系统提供实际部署参考,适合自动驾驶感知研究者

在自主移动与机器人系统的感知框架中,由激光雷达生成的三维点云语义分析对目标检测、识别及场景重建等应用至关重要。通过将三维空间数据直接结合专用深度神经网络,可实现场景语义分割。尽管此类数据富含环境几何信息,但其非结构化、稀疏性及大小不可预测的特性,以及高计算需求,制约了实时分析,尤其在资源受限的嵌入式硬件平台上。本文系统研究多种3D语义分割方法,在嵌入式NVIDIA Jetson平台(AGX Orin和AGX Xavier系列)上评估其在资源约束下的推理性能。通过标准化训练协议与数据增强,对SemanticKITTI和nuScenes两个大规模室外数据集进行基准测试,提供可复现的性能结果。

原文摘要 · Abstract (English)

Within a perception framework for autonomous mobile and robotic systems, semantic analysis of 3D point clouds typically generated by LiDARs is key to numerous applications, such as object detection and recognition, and scene reconstruction. Scene semantic segmentation can be achieved by directly integrating 3D spatial data with specialized deep neural networks. Although this type of data provides rich geometric information regarding the surrounding environment, it also presents numerous challenges: its unstructured and sparse nature, its unpredictable size, and its demanding computational requirements. These characteristics hinder the real-time semantic analysis, particularly on resource-constrained hardware architectures that constitute the main computational components of numerous robotic applications. Therefore, in this paper, we investigate various 3D semantic segmentation methodologies and analyze their performance and capabilities for resource-constrained inference on embedded NVIDIA Jetson platforms. We evaluate them for a fair comparison through a standardized training protocol and data augmentations, providing benchmark results on the Jetson AGX Orin and AGX Xavier series for two large-scale outdoor datasets: SemanticKITTI and nuScenes.

3D语义分割激光雷达嵌入式部署自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。