arXiv:2506.00034cs.ROcs.CV2025-06NeurIPS被引 19

用高斯表示融合多传感器数据,提升自动驾驶系统可解释性与性能

GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving

  • 以2D高斯为中间载体,统一编码多源感知信息
  • 在NAVSIM和Bench2Drive上实现更优的轨迹预测效果
  • 适合关注可解释性与端到端规划的自动驾驶研究者

多传感器融合对提升端到端自动驾驶系统的性能与鲁棒性至关重要。现有方法主要采用基于注意力的扁平化融合或通过几何变换实现的鸟瞰图融合,但往往存在可解释性差或计算密集的问题。本文提出GaussianFusion,一种基于高斯的多传感器融合框架。该方法在驾驶场景中均匀初始化一组2D高斯,每个高斯由物理属性参数化,并携带显式与隐式特征。通过逐步融合多模态特征,显式特征捕捉丰富的语义与空间信息,隐式特征则为轨迹规划提供互补线索。为充分挖掘高斯中的空间与语义信息,设计了级联规划头,通过与高斯的迭代交互实现轨迹预测优化。在NAVSIM与Bench2Drive基准上的大量实验验证了该框架的有效性与鲁棒性。

原文摘要 · Abstract (English)

Multi-sensor fusion is crucial for improving the performance and robustness of end-to-end autonomous driving systems. Existing methods predominantly adopt either attention-based flatten fusion or bird's eye view fusion through geometric transformations. However, these approaches often suffer from limited interpretability or dense computational overhead. In this paper, we introduce GaussianFusion, a Gaussian-based multi-sensor fusion framework for end-to-end autonomous driving. Our method employs intuitive and compact Gaussian representations as intermediate carriers to aggregate information from diverse sensors. Specifically, we initialize a set of 2D Gaussians uniformly across the driving scene, where each Gaussian is parameterized by physical attributes and equipped with explicit and implicit features. These Gaussians are progressively refined by integrating multi-modal features. The explicit features capture rich semantic and spatial information about the traffic scene, while the implicit features provide complementary cues beneficial for trajectory planning. To fully exploit rich spatial and semantic information in Gaussians, we design a cascade planning head that iteratively refines trajectory predictions through interactions with Gaussians. Extensive experiments on the NAVSIM and Bench2Drive benchmarks demonstrate the effectiveness and robustness of the proposed GaussianFusion framework. The source code will be released at https://github.com/Say2L/GaussianFusion.

自动驾驶多传感器融合高斯表示端到端规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。