arXiv:2503.06744cs.CV2025-03ICCV被引 27

让3D点云动态更真实,提升自动驾驶仿真精度

CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Driving

  • 用语义模型自监督学习点的上下文特征
  • 跟踪点随时间变形,实现动态补偿
  • 适合需要高保真动态场景的自动驾驶研究

动态场景渲染为自动驾驶开辟了新路径,可通过拟真数据闭环验证端到端算法。然而交通环境复杂多变,精准渲染极具挑战。本文提出一种新的4D高斯溅射方法(CoDa-4DGS),引入上下文与时间形变感知机制。通过2D语义分割基础模型自监督学习高斯点的4维语义特征,确保语义嵌入有意义;同时追踪每个高斯点在相邻帧间的时间形变。将语义与形变特征聚合编码后,使每个高斯点具备3D空间内潜在形变补偿能力,从而更精确表达动态场景。实验表明,该方法在自动驾驶动态场景渲染中捕捉细节能力更强,优于其他自监督4D重建与新视角合成方法。此外,语义特征随高斯点变形,拓展了应用范围。

原文摘要 · Abstract (English)

Dynamic scene rendering opens new avenues in autonomous driving by enabling closed-loop simulations with photorealistic data, which is crucial for validating end-to-end algorithms. However, the complex and highly dynamic nature of traffic environments presents significant challenges in accurately rendering these scenes. In this paper, we introduce a novel 4D Gaussian Splatting (4DGS) approach, which incorporates context and temporal deformation awareness to improve dynamic scene rendering. Specifically, we employ a 2D semantic segmentation foundation model to self-supervise the 4D semantic features of Gaussians, ensuring meaningful contextual embedding. Simultaneously, we track the temporal deformation of each Gaussian across adjacent frames. By aggregating and encoding both semantic and temporal deformation features, each Gaussian is equipped with cues for potential deformation compensation within 3D space, facilitating a more precise representation of dynamic scenes. Experimental results show that our method improves 4DGS's ability to capture fine details in dynamic scene rendering for autonomous driving and outperforms other self-supervised methods in 4D reconstruction and novel view synthesis. Furthermore, CoDa-4DGS deforms semantic features with each Gaussian, enabling broader applications.

动态渲染自动驾驶4D高斯语义感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。