arXiv:2503.08217cs.CV2025-03ICCV被引 1

S3R-GS加速大规模街景重建,效率提升超50%。

S3R-GS: Streamlining the Pipeline for Large-Scale Street Scene Reconstruction

  • 重构流程去冗余:减少无用坐标转换与远距离渲染开销。
  • 仅需2D框即可分离动态静态物体,降低标注成本。
  • 在Argoverse2上速度提升至原方法的20%-50%,效果领先。

近期,3D高斯点阵(3DGS)重塑了逼真三维重建领域,实现了优异的渲染质量和速度。然而,在大规模街景应用中,现有方法随场景规模扩大导致每视角重建成本急剧上升,带来显著计算开销。通过重新审视传统流程,我们识别出三个关键问题:不必要的局部到全局变换、过多的3D到2D投影以及远距离内容渲染低效。为此,提出S3R-GS框架,通过优化管线有效缓解上述限制。此外,多数现有街景3DGS方法依赖真实3D边界框分离动态与静态元素,但3D框获取困难,限制实际应用。为此,我们提出使用更易标注或可由现成视觉基础模型预测的2D框作为替代方案。该设计使S3R-GS能轻松适配大规模真实场景。大量实验表明,S3R-GS不仅提升渲染质量,还显著加速重建过程。尤其在具有挑战性的Argoverse2数据集视频上,其达到当前最优的PSNR与SSIM指标,重建时间降至竞品方法的50%以下,甚至低至20%。

原文摘要 · Abstract (English)

Recently, 3D Gaussian Splatting (3DGS) has reshaped the field of photorealistic 3D reconstruction, achieving impressive rendering quality and speed. However, when applied to large-scale street scenes, existing methods suffer from rapidly escalating per-viewpoint reconstruction costs as scene size increases, leading to significant computational overhead. After revisiting the conventional pipeline, we identify three key factors accounting for this issue: unnecessary local-to-global transformations, excessive 3D-to-2D projections, and inefficient rendering of distant content. To address these challenges, we propose S3R-GS, a 3DGS framework that Streamlines the pipeline for large-scale Street Scene Reconstruction, effectively mitigating these limitations. Moreover, most existing street 3DGS methods rely on ground-truth 3D bounding boxes to separate dynamic and static components, but 3D bounding boxes are difficult to obtain, limiting real-world applicability. To address this, we propose an alternative solution with 2D boxes, which are easier to annotate or can be predicted by off-the-shelf vision foundation models. Such designs together make S3R-GS readily adapt to large, in-the-wild scenarios. Extensive experiments demonstrate that S3R-GS enhances rendering quality and significantly accelerates reconstruction. Remarkably, when applied to videos from the challenging Argoverse2 dataset, it achieves state-of-the-art PSNR and SSIM, reducing reconstruction time to below 50%--and even 20%--of competing methods.

3D重建街景建模高斯点阵效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。