arXiv:2508.15376cs.CV2025-08

统一神经高斯重建动态驾驶场景,兼顾静态背景与复杂运动物体。

DriveSplat: Unified Neural Gaussian Reconstruction for Dynamic Driving Scenes

  • 分层细节建模静态背景,自适应分配多尺度高斯点。
  • 物体级高斯表示结合刚性变换与两阶段形变,处理非刚性运动。
  • 融合预训练模型的深度与法向先验,提升重建稳定性与一致性。

大尺度动态驾驶场景重建面临静态环境与极端深度变化、多样动态物体复杂运动共存的挑战。现有基于高斯溅射的方法多聚焦于小规模或物体中心设置,对大规模动态驾驶场景的适用性不足,尤其在极端尺度变化和非刚性运动下表现有限。本文提出 DriveSplat,一种统一的神经高斯框架,用于在统一高斯表示下重建动态驾驶场景。针对静态背景,引入场景感知的可学习细节层次(LOD)建模策略,显式区分近、中、远距离深度范围,实现自适应多尺度高斯分配。对于动态物体,采用物体中心形式,使用神经高斯原语,通过全局刚性变换建模运动,并通过两阶段形变机制——先调整锚点,再更新高斯点——处理非刚性动态。为增强优化稳定性,引入预训练模型提供的密集深度与表面法向先验作为辅助监督。在 Waymo 与 KITTI 基准上的大量实验表明,DriveSplat 在新视角合成上达到当前最优性能,同时生成时间稳定且几何一致的动态场景重建结果。

原文摘要 · Abstract (English)

Reconstructing large-scale dynamic driving scenes remains challenging due to the coexistence of static environments with extreme depth variation and diverse dynamic actors exhibiting complex motions. Existing Gaussian Splatting based methods have primarily focused on limited-scale or object-centric settings, and their applicability to large-scale dynamic driving scenes remains underexplored, particularly in the presence of extreme scale variation and non-rigid motions. In this work, we propose DriveSplat, a unified neural Gaussian framework for reconstructing dynamic driving scenes within a unified Gaussian-based representation. For static backgrounds, we introduce a scene-aware learnable level-of-detail (LOD) modeling strategy that explicitly accounts for near, intermediate, and far depth ranges in driving environments, enabling adaptive multi-scale Gaussian allocation. For dynamic actors, we use an object-centric formulation with neural Gaussian primitives, modeling motion through a global rigid transformation and handling non-rigid dynamics via a two-stage deformation that first adjusts anchors and subsequently updates the Gaussians. To further regularize the optimization, we incorporate dense depth and surface normal priors from pre-trained models as auxiliary supervision. Extensive experiments on the Waymo and KITTI benchmarks demonstrate that DriveSplat achieves state-of-the-art performance in novel-view synthesis while producing temporally stable and geometrically consistent reconstructions of dynamic driving scenes. Project page: https://physwm.github.io/drivesplat.

动态重建高斯溅射自动驾驶神经表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。