动态调整激光雷达输入分辨率,实现自动驾驶中实时3D目标检测
On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection

- 通过多分辨率推理实现动态输入缩放,仅需一个模型
- 在nuScenes数据集上显著优于现有方法
- 适合需要实时响应的自动驾驶系统
为应对动态运行需求下的延迟与性能权衡(即即时计算),本文聚焦于处理激光雷达点云的深度神经网络在3D目标检测中的即时计算能力。提出一种新方法,支持以柱状或体素方式处理点云的模型进行多分辨率推理,可动态调整输入分辨率以满足时序要求。关键优势在于内存高效,仅需部署单一模型,无需为不同分辨率训练多个模型。同时引入截止时间感知调度器,能实时准确预测所有可能分辨率的执行时间,克服了激光雷达点云不规则带来的挑战。在nuScenes自动驾驶数据集上的实验表明,该方法显著优于现有的激光雷达目标检测即时计算方案。最终在模拟自动驾驶系统中部署,持续实现无碰撞导航,避免因环境复杂度导致的非必要停顿。
原文摘要 · Abstract (English)
Making tradeoffs between execution latency and result utility (i.e., anytime computing) for adapting to dynamic operational requirements has been shown to enhance the performance of cyber-physical systems. In this work, we focus on enabling anytime computing for deep neural networks (DNNs) that process LiDAR point clouds for 3D object detection. We propose a novel method that enables multi-resolution inference for models that process point clouds as pillars or voxels, allowing the input to be dynamically scaled and processed at the resolution needed to meet timing requirements. Importantly, our memory-efficient approach requires the deployment of only a single DNN model, avoiding the need to deploy multiple models, each trained for a different input resolution. We also introduce a deadline-aware scheduler that selects the highest possible resolution for any given input by accurately predicting the execution time for all possible resolutions at runtime, which is challenging due to the irregularity of LiDAR point clouds. Experimental results on the nuScenes autonomous driving dataset demonstrate that our method significantly outperforms existing anytime computing approaches for LiDAR object detection. Finally, we deploy our approach in a simulated autonomous driving system, where it consistently enables collision-free navigation while avoiding unnecessary stalls caused by environmental complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。