arXiv:2512.08498cs.CV2025-12被引 2

多相机实时重建3D场景,2分钟建模数百米,无需标定。

On-the-fly Large-scale 3D Reconstruction from Multi-Camera Rigs

  • 多相机流融合生成统一高斯表示,实现无漂移轨迹估计。
  • 2分钟内完成数百米场景重建,保持高保真与实时性。
  • 无需相机标定,适合移动设备或野外快速建模场景。

3D高斯点云渲染(3DGS)的进展使得自由视角渲染和逼真场景重建成为可能。尽管单目视频流的在线扩展已展现实时重建潜力,但受限于视场(FOV),常无法实现完整3D覆盖。采用多相机阵列可从根本上解决此问题。本文提出首个面向多相机阵列的在线3D重建框架。方法通过增量融合多个重叠相机的密集RGB流,构建统一高斯表示,实现无漂移轨迹估计与高效在线重建。我们设计分层相机初始化方案,在无需标定情况下实现粗略相机对齐;随后引入轻量级多相机束调整,稳定轨迹同时保持实时性能。此外,提出无冗余高斯采样策略与频率感知优化调度器,减少高斯素数量及优化迭代次数,兼顾效率与重建保真度。仅需原始多相机视频流,即可在2分钟内重建数百米长的3D场景,展现出前所未有的速度、鲁棒性与保真度。

原文摘要 · Abstract (English)

Recent advances in 3D Gaussian Splatting (3DGS) have enabled efficient free-viewpoint rendering and photorealistic scene reconstruction. While on-the-fly extensions of 3DGS have shown promise for real-time reconstruction from monocular RGB streams, they often fail to achieve complete 3D coverage due to the limited field of view (FOV). Employing a multi-camera rig fundamentally addresses this limitation. In this paper, we present the first on-the-fly 3D reconstruction framework for multi-camera rigs. Our method incrementally fuses dense RGB streams from multiple overlapping cameras into a unified Gaussian representation, achieving drift-free trajectory estimation and efficient online reconstruction. We propose a hierarchical camera initialization scheme that enables coarse inter-camera alignment without calibration, followed by a lightweight multi-camera bundle adjustment that stabilizes trajectories while maintaining real-time performance. Furthermore, we introduce a redundancy-free Gaussian sampling strategy and a frequency-aware optimization scheduler to reduce the number of Gaussian primitives and the required optimization iterations, thereby maintaining both efficiency and reconstruction fidelity. Our method reconstructs hundreds of meters of 3D scenes within just 2 minutes using only raw multi-camera video streams, demonstrating unprecedented speed, robustness, and Fidelity for on-the-fly 3D scene reconstruction.

3D重建多相机实时渲染高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。