arXiv:2606.29374cs.CVcs.GR2026-06

让3D高斯场景重建更快更准,还能少用显存。

L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstruction

论文配图:L2D2-GS: Learning to Densify for Feedforward Dynamic Gaussian Scene Reconstruction
图 1 · 摘自论文原文
  • 把重建过程变成可迭代优化的动态增密流程
  • 在PandaSet和Waymo上实现顶尖保真度,用的点数更少
  • 适合做自动驾驶仿真和大规模场景建模的人看

高保真动态城市环境重建是自动驾驶仿真与大尺度世界建模的核心。尽管3D高斯喷溅(3DGS)已确立实时渲染新标准,但其依赖昂贵的逐场景优化限制了可扩展性。近期前馈方法虽提升速度,却面临高分辨率下内存不可行、多视角稠密观测融合不一致的根本瓶颈。本文提出L2D2-GS,将可泛化重建重构为鲁棒的迭代优化与增密过程。为解决原始生成中监督模糊问题,设计自监督增密策略,从全局重建增益中提取显式奖励信号以指导局部增密。此外,通过重参数化几何正则化机制,约束优化流形,缓解早期阶段不可逆伪影,避免陷入劣质局部最优。在PandaSet与Waymo数据集上的实验表明,该方法在重建保真度上达到当前最优,并具备强零样本泛化能力,且使用的高斯点数少于现有基线。

原文摘要 · Abstract (English)

High-fidelity reconstruction of dynamic urban environments is a cornerstone of autonomous driving simulation and large-scale world modeling. While 3D Gaussian Splatting (3DGS) has established a new standard for real-time rendering, its reliance on expensive per-scene optimization limits scalability. Conversely, recent feedforward methods that infer Gaussian parameters offer faster speed but face fundamental bottlenecks: they are memory-prohibitive at high resolutions and struggle to fuse dense multi-view observations consistently. This paper presents L2D2-GS, a unified framework that reformulates generalizable reconstruction not as a one-shot regression, but as a robust iterative process of optimization and densification. To resolve the ambiguity of supervision in primitive generation, we propose a self-supervised densification policy that derives explicit reward signals from global reconstruction gains to guide local densification. Furthermore, we mitigate irreversible early-stage artifacts through a geometric regularization mechanism, utilizing reparameterization to constrain the optimization manifold and prevent convergence to poor local optima. Extensive experiments on the PandaSet and Waymo datasets demonstrate that our method achieves state-of-the-art reconstruction fidelity and strong zero-shot generalization, while using fewer primitives than competing baselines.

3D重建高斯喷溅动态场景自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。