基于边缘计算的专家混合系统,实现自动驾驶3D目标检测的高精度低延迟。
Towards Accurate and Efficient 3D Object Detection for Autonomous Driving: A Mixture of Experts Computing System on Edge
- 采用场景感知的专家混合架构,动态分配任务到专用模型。
- 在KITTI上比15种基线方法提升3.58%准确率,推理速度提高159.06%。
- 适合资源受限的车载边缘设备,兼顾精度与实时性。
本文提出面向自动驾驶的边缘计算专家混合协同系统(EMC2),在低延迟和高精度之间取得平衡。不同于传统方法,EMC2采用专为边缘平台优化的场景感知型混合专家架构,通过融合激光雷达与摄像头数据,利用稀疏点云与密集图像的互补优势生成鲁棒的多模态表征。系统引入自适应多模态数据桥,对传感器输入进行多尺度预处理,并通过场景感知路由机制,根据物体可见性和距离动态分发特征至专用专家模型。此外,集成软硬件协同优化,包括硬件资源利用率提升与计算图简化,确保在资源受限边缘设备上的高效实时推理。在公开基准测试中,EMC2表现显著:在KITTI数据集上相较15种基线方法平均提升3.58%准确率,推理速度提升159.06%;nuScenes数据集也获得相似性能增益,验证了其在可靠、实时3D目标检测任务中的有效性。官方代码已开源:https://github.com/LinshenLiu622/EMC2。
原文摘要 · Abstract (English)
This paper presents Edge-based Mixture of Experts (MoE) Collaborative Computing (EMC2), an optimal computing system designed for autonomous vehicles (AVs) that simultaneously achieves low-latency and high-accuracy 3D object detection. Unlike conventional approaches, EMC2 incorporates a scenario-aware MoE architecture specifically optimized for edge platforms. By effectively fusing LiDAR and camera data, the system leverages the complementary strengths of sparse 3D point clouds and dense 2D images to generate robust multimodal representations. To enable this, EMC2 employs an adaptive multimodal data bridge that performs multi-scale preprocessing on sensor inputs, followed by a scenario-aware routing mechanism that dynamically dispatches features to dedicated expert models based on object visibility and distance. In addition, EMC2 integrates joint hardware-software optimizations, including hardware resource utilization optimization and computational graph simplification, to ensure efficient and real-time inference on resource-constrained edge devices. Experiments on open-source benchmarks clearly show the EMC2 advancements as an end-to-end system. On the KITTI dataset, it achieves an average accuracy improvement of 3.58% and a 159.06% inference speedup compared to 15 baseline methods on Jetson platforms, with similar performance gains on the nuScenes dataset, highlighting its capability to advance reliable, real-time 3D object detection tasks for AVs. The official implementation is available at https://github.com/LinshenLiu622/EMC2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。