实现无序输入下实时3D高斯点云重建,兼顾全局一致性和效率。
Immediate 3D Gaussian Splat Reconstruction of Unordered Input with Global Consistency

- 利用视觉定位模型与共视图快速匹配无序图像序列中的关键帧。
- 通过聚类闭环检测和层级结构,支持数千张图像的大场景重建。
- 适合需要即时反馈的移动采集、机器人导航等实时3D重建场景。
3D高斯点云(3DGS)已成为捕获场景重建与实时渲染的首选方法。为获得高质量视觉效果,通常需结合连续图像序列与无序拍摄以提升场景覆盖率。传统的运动恢复结构(SfM)需等待所有图像全部收集后才能启动,计算成本高;而增量式重建方法(如SLAM)虽可提供即时反馈,但难以处理无序输入。本文首次提出一种支持无序输入的即时反馈3DGS重建方案,具备全局一致性。首先,通过复用视觉位置识别模型与共视图,实现无序序列中快速关键帧匹配,提升有序序列的重建质量。其次,结合GPU优化与精细的高斯原语布局,实现快速局部重建。进一步提出基于聚类的闭环检测方法,无需依赖顺序输入即可高效完成闭环。最后,引入渐进式层次结构,使方法能扩展至大场景而不损失效率。实验表明,在多个数据集上,本方法可处理高达数千张图像的输入,实现高质量即时3DGS重建。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has become the method of choice for reconstructing and real-time rendering of captured scenes. To capture a scene with good visual quality, continuous image sequences are usually combined with out-of-order shots for better scene coverage. Structure from motion can reconstruct such captures, but only after they are all available and often with high computational cost. Incremental reconstruction methods -- often derived from SLAM solutions -- provide immediate feedback, but cannot handle the out-of-order capture we require. We provide the first immediate feedback solution for such radiance field capture that provides global consistency. We first introduce a method for fast matching in out-of-order sequences, by repurposing visual place recognition models and a covisibility graph, and provide an efficient way to find highly connected keyframes, improving quality even for ordered sequences. We show how these steps -- together with GPU optimization and careful Gaussian primitive placement -- provide fast local reconstruction, in our challenging radiance field reconstruction case. We then introduce a novel cluster-based method, again using the covisibility graph, to provide efficient loop closure that does not require sequential input. Finally, to handle large scenes in our context, we introduce a progressive hierarchy that allows our method to scale to large environments, without compromising efficiency. Our results show we provide immediate feedback 3DGS reconstruction with good visual quality in several datasets, with up to thousands of input images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。