夜间自动驾驶场景重建新方法,提升真实感与精度。
Nighttime Autonomous Driving Scene Reconstruction with Physically-Based Gaussian Splatting
- 将物理渲染融入3D高斯点云,联合优化材质属性。
- 在nuScenes和Waymo数据集上,夜间重建质量超越现有方法。
- 适合研究自动驾驶视觉感知与实时渲染的学者与工程师。
本文针对自动驾驶仿真中的夜间场景重建问题,提出一种融合物理基础渲染的3D高斯点云方法。现有基于神经辐射场(NeRF)和3D高斯溅射(3DGS)的方法多聚焦于正常光照条件,难以应对夜间复杂光照与外观变化,导致性能下降。为此,本工作将物理渲染机制引入复合场景高斯表示中,联合优化基于双向反射分布函数(BRDF)的材质属性。通过全局光照模块显式建模漫反射成分,利用各向异性球形高斯建模镜面成分。实验在nuScenes和Waymo两个真实世界自动驾驶数据集上进行,涵盖多种夜间场景,结果表明该方法在定量与定性指标上均优于当前最优方法,同时保持实时渲染能力。
原文摘要 · Abstract (English)
This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in autonomous driving scene reconstruction, but they primarily focus on normal-light conditions. Low-light driving scenes are more challenging to model due to their complex lighting and appearance conditions, which often causes performance degradation of existing methods. To address this problem, this work presents a novel approach that integrates physically based rendering into 3DGS to enhance nighttime scene reconstruction for autonomous driving. Specifically, our approach integrates physically based rendering into composite scene Gaussian representations and jointly optimizes Bidirectional Reflectance Distribution Function (BRDF) based material properties. We explicitly model diffuse components through a global illumination module and specular components by anisotropic spherical Gaussians. As a result, our approach improves reconstruction quality for outdoor nighttime driving scenes, while maintaining real-time rendering. Extensive experiments across diverse nighttime scenarios on two real-world autonomous driving datasets, including nuScenes and Waymo, demonstrate that our approach outperforms the state-of-the-art methods both quantitatively and qualitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。