arXiv:2608.00931cs.ROcs.CV2026-08

实时融合视觉惯性追踪与增量高斯点云,实现机器人/扩展现实的即时三维重建。

Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking

论文配图:Stipple: Real-Time Incremental Gaussian Splatting with Visual-Inertial Tracking
图 1 · 摘自论文原文
  • 基于Basalt的视觉惯性跟踪系统,结合增量式高斯点云更新方法。
  • 无需传统繁重预处理,直接利用跟踪系统信息进行高效训练。
  • 支持与跟踪线程并行运行,适用于实时场景重建任务。

3D高斯点云(3DGS)能高效渲染逼真场景,但其复杂的预处理和训练步骤使其难以用于机器人或扩展现实(XR)中的实时重建。视觉惯性里程计(VIO)和视觉惯性同时定位与地图构建(VI-SLAM)系统则专为这类实时应用设计,是与3DGS集成的理想选择。本文提出一种新方法,通过基于Basalt的高效视觉惯性跟踪系统,结合基于Brush(一个高效的Rust实现的跨GPU厂商3DGS框架)的增量训练策略,实现跟踪与重建的实时同步。我们证明,3DGS中许多繁重的预处理和训练步骤可被更高效的增量训练替代,并直接利用视觉惯性跟踪产生的信息。此外,我们引入多项实用改进,提升训练效率,使其可在与跟踪线程并行的条件下实时运行。该工作凸显了SLAM与3DGS互补性的价值,为实时3D重建提供了有前景的解决方案。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) provides efficient rendering of photo-realistic scenes, but its heavy preprocessing and training steps make it a poor fit for applications that require real-time reconstruction in robotics or XR. This capability is important since it allows immediate feedback and interaction with new environments. Visual-inertial odometry (VIO) and simultaneous localization and mapping (VI-SLAM) systems, on the other hand, specifically target these real-time applications, which makes them a good choice for integration with 3DGS. We propose a new method that tracks and reconstructs simultaneously in real-time by leveraging an efficient visual-inertial tracking system based on Basalt together with a novel incremental method built on top of Brush, an efficient Rust-based GPU-vendor-agnostic implementation of 3D Gaussian Splatting. We show that many of the heavy preprocessing and training steps of 3DGS can be replaced with a more efficient incremental training strategy that has direct access to the information generated by the visual-inertial tracking system. Furthermore, we propose and combine multiple practical improvements to increase the efficiency of the training pipeline and adapt it to run in real-time, parallel to the tracking thread. This work highlights the value of exploiting the complementary nature of SLAM and 3DGS, and how that can lead to promising results for real-time 3D reconstruction.

三维重建实时系统视觉惯性高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。