arXiv:2506.05280cs.CV2025-06NeurIPS被引 26

融合外观码与多尺度双边网格,提升自动驾驶场景重建精度

Unifying Appearance Codes and Bilateral Grids for Driving Scene Gaussian Splatting

  • 提出多尺度双边网格统一外观码与颜色映射机制
  • 在4个数据集上显著减少光度不一致导致的伪影
  • 适合需要高精度几何重建的自动驾驶系统研究

神经渲染技术如NeRF和高斯点阵(Gaussian Splatting, GS)依赖光度一致性生成高质量重建结果。然而,在真实场景中难以保证图像间完全光度一致。外观码虽被广泛用于缓解此问题,但其建模能力受限,因仅对整张图像使用单一编码。近期引入的双边网格可实现像素级颜色映射,但优化与约束困难。本文提出一种新型多尺度双边网格,统一外观码与双边网格。实验表明,该方法显著提升了动态、解耦的自动驾驶场景重建中的几何精度,优于单独使用外观码或双边网格。这在自动驾驶中至关重要,因精确几何信息对障碍物规避与控制至关重要。方法在Waymo、NuScenes、Argoverse和PandaSet四个数据集上均表现优异。进一步分析显示,几何精度提升主要源于多尺度双边网格,其有效抑制了由光度不一致引起的浮点伪影。

原文摘要 · Abstract (English)

Neural rendering techniques, including NeRF and Gaussian Splatting (GS), rely on photometric consistency to produce high-quality reconstructions. However, in real-world scenarios, it is challenging to guarantee perfect photometric consistency in acquired images. Appearance codes have been widely used to address this issue, but their modeling capability is limited, as a single code is applied to the entire image. Recently, the bilateral grid was introduced to perform pixel-wise color mapping, but it is difficult to optimize and constrain effectively. In this paper, we propose a novel multi-scale bilateral grid that unifies appearance codes and bilateral grids. We demonstrate that this approach significantly improves geometric accuracy in dynamic, decoupled autonomous driving scene reconstruction, outperforming both appearance codes and bilateral grids. This is crucial for autonomous driving, where accurate geometry is important for obstacle avoidance and control. Our method shows strong results across four datasets: Waymo, NuScenes, Argoverse, and PandaSet. We further demonstrate that the improvement in geometry is driven by the multi-scale bilateral grid, which effectively reduces floaters caused by photometric inconsistency.

3D重建自动驾驶高斯点阵光度一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。