提出多粒度外观优化方法,提升动态城市场景建模的细节与实时性。
ArmGS: Composite Gaussian Appearance Refinement for Modeling Dynamic Urban Environments
- 设计多层级外观建模框架,融合局部与全局变化。
- 在Waymo等4个数据集上实现更优的渲染质量与速度。
- 适合自动驾驶仿真中需要高保真动态场景的开发者。
本研究聚焦自动驾驶仿真中的动态城市环境建模。当前基于神经辐射场的数据驱动方法虽实现逼真场景渲染,但存在渲染效率低的问题。近期部分方法采用3D高斯点云实现动态场景建模,支持高保真重建与实时渲染,但仍忽略帧间及视角间的细粒度外观差异,导致效果受限。本文提出ArmGS方法,通过复合高斯点云与多粒度外观精修,实现动态驾驶场景建模。核心思想是构建多层次外观建模机制,从局部高斯点到全局图像及动态物体层面,优化多粒度变换参数,以同时捕捉帧间与视角间全局变化,以及背景与物体的局部细微变化。在Waymo、KITTI、NOTR和VKITTI2等多个挑战性自动驾驶数据集上的大量实验表明,该方法优于现有最先进方法。
原文摘要 · Abstract (English)
This work focuses on modeling dynamic urban environments for autonomous driving simulation. Contemporary data-driven methods using neural radiance fields have achieved photorealistic driving scene modeling, but they suffer from low rendering efficacy. Recently, some approaches have explored 3D Gaussian splatting for modeling dynamic urban scenes, enabling high-fidelity reconstruction and real-time rendering. However, these approaches often neglect to model fine-grained variations between frames and camera viewpoints, leading to suboptimal results. In this work, we propose a new approach named ArmGS that exploits composite driving Gaussian splatting with multi-granularity appearance refinement for autonomous driving scene modeling. The core idea of our approach is devising a multi-level appearance modeling scheme to optimize a set of transformation parameters for composite Gaussian refinement from multiple granularities, ranging from local Gaussian level to global image level and dynamic actor level. This not only models global scene appearance variations between frames and camera viewpoints, but also models local fine-grained changes of background and objects. Extensive experiments on multiple challenging autonomous driving datasets, namely, Waymo, KITTI, NOTR and VKITTI2, demonstrate the superiority of our approach over the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。