arXiv:2601.15951cs.CV2026-01被引 2

提出一种高效4D城市场景合成方法,兼顾静态与动态物体的高精度重建。

EVolSplat4D: Efficient Volume-based Gaussian Splatting for 4D Urban Scene Synthesis

  • 分三路统一体积与像素级高斯表示,提升多视角一致性。
  • 在KITTI-360等数据集上实现优于现有方法的重建精度和稳定性。
  • 适合自动驾驶仿真中需要快速生成逼真动态场景的场景。

动态城市场景的新视角合成对自动驾驶仿真至关重要,但现有方法常难以平衡重建速度与质量。尽管先进神经辐射场和3D高斯溅射方法能实现逼真效果,却往往依赖耗时的逐场景优化;而新兴的前馈方法多采用逐像素高斯表示,在复杂动态环境中聚合多视图预测时易产生3D不一致。本文提出EvolSplat4D,一种前馈框架,突破现有逐像素范式,通过三个专用分支统一体积与像素级高斯预测:近距静态区域直接从3D特征体预测多帧一致几何,并结合语义增强图像渲染模块预测外观;动态目标利用对象中心的规范空间与运动调整渲染模块,融合时序特征以应对噪声运动先验;远场景采用高效逐像素高斯分支保证全场景覆盖。在KITTI-360、KITTI、Waymo和PandaSet数据集上的实验表明,EvolSplat4D在静态与动态环境重建中均取得更优的准确性和一致性,超越依赖逐场景优化及当前最优前馈基线的方法。

原文摘要 · Abstract (English)

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and 3D Gaussian Splatting approaches achieve photorealism, they often rely on time-consuming per-scene optimization. Conversely, emerging feed-forward methods frequently adopt per-pixel Gaussian representations, which lead to 3D inconsistencies when aggregating multi-view predictions in complex, dynamic environments. We propose EvolSplat4D, a feed-forward framework that moves beyond existing per-pixel paradigms by unifying volume-based and pixel-based Gaussian prediction across three specialized branches. For close-range static regions, we predict consistent geometry of 3D Gaussians over multiple frames directly from a 3D feature volume, complemented by a semantically-enhanced image-based rendering module for predicting their appearance. For dynamic actors, we utilize object-centric canonical spaces and a motion-adjusted rendering module to aggregate temporal features, ensuring stable 4D reconstruction despite noisy motion priors. Far-Field scenery is handled by an efficient per-pixel Gaussian branch to ensure full-scene coverage. Experimental results on the KITTI-360, KITTI, Waymo, and PandaSet datasets show that EvolSplat4D reconstructs both static and dynamic environments with superior accuracy and consistency, outperforming both per-scene optimization and state-of-the-art feed-forward baselines.

4D重建高斯溅射自动驾驶动态场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。