用图结构融合多传感器数据,提升自动驾驶环境感知精度。
Graph-Based Multi-Modal Sensor Fusion for Autonomous Driving
- 构建图表示的卡尔曼滤波器,实现多模态数据在线融合
- 在nuScenes数据集上,追踪精度提升,误匹配和位置误差减少
- 适合需要高安全性的自动驾驶感知系统研发者使用
移动机器人与自动驾驶对鲁棒场景理解的需求日益增长,促使多传感器融合技术发展。通过整合摄像头与激光雷达等异构传感器数据,可克服单一传感器局限性,实现更完整准确的环境感知。本文提出一种基于图的状态表示方法,设计首个面向多模态图数据的在线状态估计算法——传感器无关图感知卡尔曼滤波器(SAGA-KF),能有效融合来自噪声多传感器的图结构信息。该图表示作为基础,支持多目标跟踪(MOT)等高级应用,显著提升系统态势感知能力。在合成数据与真实驾驶数据集nuScenes上的实验表明,SAGA-KF在多目标追踪任务中提升了MOTA指标,同时降低了位置误差(MOTP)与身份切换次数(IDS)。该框架还能融合语义对象与几何结构等异质信息,推动更全面的场景理解,增强自动驾驶系统的安全性与有效性。
原文摘要 · Abstract (English)
The growing demand for robust scene understanding in mobile robotics and autonomous driving has highlighted the importance of integrating multiple sensing modalities. By combining data from diverse sensors like cameras and LIDARs, fusion techniques can overcome the limitations of individual sensors, enabling a more complete and accurate perception of the environment. We introduce a novel approach to multi-modal sensor fusion, focusing on developing a graph-based state representation that supports critical decision-making processes in autonomous driving. We present a Sensor-Agnostic Graph-Aware Kalman Filter [3], the first online state estimation technique designed to fuse multi-modal graphs derived from noisy multi-sensor data. The estimated graph-based state representations serve as a foundation for advanced applications like Multi-Object Tracking (MOT), offering a comprehensive framework for enhancing the situational awareness and safety of autonomous systems. We validate the effectiveness of our proposed framework through extensive experiments conducted on both synthetic and real-world driving datasets (nuScenes). Our results showcase an improvement in MOTA and a reduction in estimated position errors (MOTP) and identity switches (IDS) for tracked objects using the SAGA-KF. Furthermore, we highlight the capability of such a framework to develop methods that can leverage heterogeneous information (like semantic objects and geometric structures) from various sensing modalities, enabling a more holistic approach to scene understanding and enhancing the safety and effectiveness of autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。