arXiv:2603.19193cs.CV2026-03被引 1

用3D高斯点云重建提升鸟瞰图感知精度

Reconstruction Matters: Learning Geometry-Aligned BEV Representation through 3D Gaussian Splatting

  • 通过多视角图像重建3D场景,生成几何对齐的特征
  • 在nuScenes和argoverse上达到当前最佳性能
  • 适合需要精确空间理解的自动驾驶感知任务

鸟瞰图(BEV)感知是自动驾驶的核心,通过融合多视角图像实现统一空间表示,支持语义分割、3D目标检测和运动预测等下游任务。然而,现有大多数BEV框架采用端到端训练,直接将图像特征映射到BEV空间,仅依赖下游任务监督,缺乏显式的3D几何理解,导致性能受限。本文提出Splat2BEV,一种基于高斯点云渲染的BEV感知框架,强调显式3D重建对准确感知的重要性。首先预训练一个高斯生成器,从多视角输入中显式重建3D场景,生成几何对齐的特征表示;随后将其投影至BEV空间作为下游任务输入。在nuScenes和argoverse数据集上的大量实验表明,Splat2BEV达到当前最优性能,验证了显式3D重建在BEV感知中的有效性。

原文摘要 · Abstract (English)

Bird's-Eye-View (BEV) perception serves as a cornerstone for autonomous driving, offering a unified spatial representation that fuses surrounding-view images to enable reasoning for various downstream tasks, such as semantic segmentation, 3D object detection, and motion prediction. However, most existing BEV perception frameworks adopt an end-to-end training paradigm, where image features are directly transformed into the BEV space and optimized solely through downstream task supervision. This formulation treats the entire perception process as a black box, often lacking explicit 3D geometric understanding and interpretability, leading to suboptimal performance. In this paper, we claim that an explicit 3D representation matters for accurate BEV perception, and we propose Splat2BEV, a Gaussian Splatting-assisted framework for BEV tasks. Splat2BEV aims to learn BEV feature representations that are both semantically rich and geometrically precise. We first pre-train a Gaussian generator that explicitly reconstructs 3D scenes from multi-view inputs, enabling the generation of geometry-aligned feature representations. These representations are then projected into the BEV space to serve as inputs for downstream tasks. Extensive experiments on nuScenes and argoverse dataset demonstrate that Splat2BEV achieves state-of-the-art performance and validate the effectiveness of incorporating explicit 3D reconstruction into BEV perception.

鸟瞰图感知3D重建高斯点云自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。