arXiv:2412.18165cs.CV2024-12

为高速自动驾驶设计并行感知网络,实现与车速匹配的实时环境理解。

Parallel Neural Computing for Scene Understanding from LiDAR Perception in Autonomous Racing

  • 双神经网络并行运行于独立硬件,同步处理点云数据
  • 相比串行配置,推理速度提升2倍,满足高速场景实时需求
  • 适合追求低延迟的自动驾驶系统研发者使用

高速自动驾驶赛车中的场景理解面临巨大挑战,因赛道环境变化迅速。传统串行网络难以满足高动态环境下自主体在短时间内完成大位移时的实时认知与决策需求。本文提出一种新型基准架构——并行感知网络(PPN),支持真正硬件级并行计算,使神经处理速度与车辆高速运动相匹配。该模型由两个独立神经网络(分割与重建)组成,在分离的加速硬件上并行运行。输入为激光雷达原始3D点云数据,两设备均将其转换为2D鸟瞰图。各网络分别沿时空维度提取特征,并独立生成输出。模型在配备两块NVIDIA T4 GPU的系统上训练,采用包含边缘保持在内的多损失函数组合,实现相比串行配置2倍的推理速度提升。代码已开源:https://github.com/suwesh/Parallel-Perception-Network;训练参数可在Hugging Face获取:https://huggingface.co/suwesh/ParallelPerceptionNetwork。

原文摘要 · Abstract (English)

Autonomous driving in high-speed racing, as opposed to urban environments, presents significant challenges in scene understanding due to rapid changes in the track environment. Traditional sequential network approaches may struggle to meet the real-time knowledge and decision-making demands of an autonomous agent covering large displacements in a short time. This paper proposes a novel baseline architecture for developing sophisticated models capable of true hardware-enabled parallelism, achieving neural processing speeds that mirror the agent's high velocity. The proposed model (Parallel Perception Network (PPN)) consists of two independent neural networks, segmentation and reconstruction networks, running parallelly on separate accelerated hardware. The model takes raw 3D point cloud data from the LiDAR sensor as input and converts it into a 2D Bird's Eye View Map on both devices. Each network independently extracts its input features along space and time dimensions and produces outputs parallelly. The proposed method's model is trained on a system with two NVIDIA T4 GPUs, using a combination of loss functions, including edge preservation, and demonstrates a 2x speedup in model inference time compared to a sequential configuration. Implementation is available at: https://github.com/suwesh/Parallel-Perception-Network. Learned parameters of the trained networks are provided at: https://huggingface.co/suwesh/ParallelPerceptionNetwork.

LiDAR感知并行计算自动驾驶实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。