用奖励机制引导扩散模型生成,提升驾驶场景重建的完整性与稳定性
RGE-GS: Reward-Guided Expansive Driving Scene Reconstruction via Diffusion Priors
- 通过奖励网络筛选一致生成的结构,确保重建空间稳定
- 根据场景收敛度动态调整高斯点优化进度,加速收敛
- 适合自动驾驶仿真、3D场景重建领域的研究者使用
单次拍摄的驾驶片段常导致道路结构扫描不完整,因此场景扩展对传感器模拟器有效预测驾驶行为至关重要。尽管当前3D高斯点阵(3DGS)技术已实现优异重建质量,但直接结合扩散先验常引发累积物理不一致性并降低训练效率。为此,我们提出RGE-GS,一种融合扩散生成与奖励引导高斯集成的新型扩展重建框架。其核心创新包括:首先,设计奖励网络在重建前识别并优先保留一致生成模式,以保障空间稳定性;其次,在重建过程中采用差异化训练策略,根据场景收敛指标自动调节高斯优化进度,实现优于基线方法的收敛性能。在多个公开数据集上的广泛评估表明,RGE-GS在重建质量上达到当前最优水平。代码将开源于https://github.com/CN-ADLab/RGE-GS。
原文摘要 · Abstract (English)
A single-pass driving clip frequently results in incomplete scanning of the road structure, making reconstructed scene expanding a critical requirement for sensor simulators to effectively regress driving actions. Although contemporary 3D Gaussian Splatting (3DGS) techniques achieve remarkable reconstruction quality, their direct extension through the integration of diffusion priors often introduces cumulative physical inconsistencies and compromises training efficiency. To address these limitations, we present RGE-GS, a novel expansive reconstruction framework that synergizes diffusion-based generation with reward-guided Gaussian integration. The RGE-GS framework incorporates two key innovations: First, we propose a reward network that learns to identify and prioritize consistently generated patterns prior to reconstruction phases, thereby enabling selective retention of diffusion outputs for spatial stability. Second, during the reconstruction process, we devise a differentiated training strategy that automatically adjust Gaussian optimization progress according to scene converge metrics, which achieving better convergence than baseline methods. Extensive evaluations of publicly available datasets demonstrate that RGE-GS achieves state-of-the-art performance in reconstruction quality. Our source-code will be made publicly available at https://github.com/CN-ADLab/RGE-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。