通过干预引导优化高斯结构,提升前馈驱动场景重建质量
Learning Gaussian Structure: Intervention-Guided Density Control for Feed-Forward Driving Reconstruction

- 基于干预的梯度响应分析,动态决定高斯点增删策略
- 在Waymo和PandaSet上优于现有方法,重建精度显著提升
- 适合需要高效、高质量3D场景重建的研究与应用
前馈高斯重建近年成为驱动场景重建的高效方法。然而,主流基于激光雷达的方法保留观测点与高斯基元间的初始对应关系,将初始化基元集视为最终表示,无法在训练中积累梯度以指导场景表示的稠密化。同时,共享稀疏主干仅隐式融合不同时间戳的观测信息,未显式聚合单个基元的跨时证据。本文提出学习高斯结构(LGS)框架,同时增强高斯结构与基元属性。核心观察是:由剪枝或添加干预引发的局部梯度响应变化,可揭示结构调整是否有利于重建。基于此,我们设计高斯稠密化策略,从受控干预中学习包含剪枝与新增评分的稠密化图,并在推理时直接调整高斯结构。此外,我们开发了紧凑的跨时间点查询机制,显式检索并聚合其他时间戳高斯基元的邻近特征,实现可靠属性预测。在Waymo Open Dataset和PandaSet上的大量实验表明,LGS始终优于现有方法。
原文摘要 · Abstract (English)
Feed-forward Gaussian reconstruction has recently emerged as an efficient approach for driving scene reconstruction. However, prevailing LiDAR-based methods preserve the initial correspondence between observed points and Gaussian primitives, treating the initialized primitive set as the final representation. Unlike optimization-based 3DGS, these methods cannot accumulate gradients during training to determine how the scenes representation should be densified. Meanwhile, the shared sparse backbone only fuses observations from different timestamps implicitly, without explicitly aggregating cross-time evidence for individual primitives. In this paper, we present Learning Gaussian Structure (LGS), a framework that enhances both Gaussian structure and primitive attributes. Our key observation is that changes in local gradient responses induced by a prune or add intervention reveal whether the corresponding structural adjustment benefits reconstruction. Based on this observation, our Gaussian Densify Policy learns a Densify Map comprising Prune and Addition Scores from controlled interventions, and directly adjusts the Gaussian structure during inference. We further develop a compact Cross-Time Point Query that explicitly retrieves and aggregates neighboring features from Gaussian primitives at other timestamps for reliable attribute prediction. Extensive experiments on the Waymo Open Dataset and PandaSet demonstrate that LGS consistently outperforms existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。