arXiv:2509.00433cs.ARcs.RO2025-09被引 2

通过视频编码器提取共视信息,加速3D高斯溅射SLAM的实时性能。

AGS: Accelerating 3D Gaussian Splatting SLAM via CODEC-Assisted Frame Covisibility Detection

  • 利用视频编码中间数据检测帧间共视性,减少重复计算。
  • 在移动和高端GPU上分别提速17.12倍与6.71倍。
  • 适合需要实时3D重建的自动驾驶系统使用。

同步定位与地图构建(SLAM)是自动驾驶车辆在未知环境中构建地图并实现自我定位的关键任务。近期进展将SLAM与3D高斯溅射(3DGS)结合,实现了极高的重建保真度。然而,现有3DGS-SLAM系统因每帧需多次训练迭代及大量高斯点而吞吐量不足。本文提出AGS,一种软硬件协同设计框架,基于机器人运动中相邻帧高度相似的特性进行加速。软件层面:1)提出粗到细的位姿追踪方法;2)通过共享高斯贡献信息避免冗余计算。硬件层面:设计帧共视性检测引擎,从视频编码器提取中间数据,并实现位姿追踪与建图引擎,搭配工作负载调度器高效部署。评估显示,AGS在移动与高端GPU上分别达到17.12×、6.71×及5.41×的加速比,优于当前最先进的3DGS加速器GSCore。

原文摘要 · Abstract (English)

Simultaneous Localization and Mapping (SLAM) is a critical task that enables autonomous vehicles to construct maps and localize themselves in unknown environments. Recent breakthroughs combine SLAM with 3D Gaussian Splatting (3DGS) to achieve exceptional reconstruction fidelity. However, existing 3DGS-SLAM systems provide insufficient throughput due to the need for multiple training iterations per frame and the vast number of Gaussians. In this paper, we propose AGS, an algorithm-hardware co-design framework to boost the efficiency of 3DGS-SLAM based on the intuition that SLAM systems process frames in a streaming manner, where adjacent frames exhibit high similarity that can be utilized for acceleration. On the software level: 1) We propose a coarse-then-fine-grained pose tracking method with respect to the robot's movement. 2) We avoid redundant computations of Gaussians by sharing their contribution information across frames. On the hardware level, we propose a frame covisibility detection engine to extract intermediate data from the video CODEC. We also implement a pose tracking engine and a mapping engine with workload schedulers to efficiently deploy the AGS algorithm. Our evaluation shows that AGS achieves up to $17.12\times$, $6.71\times$, and $5.41\times$ speedups against the mobile and high-end GPUs, and a state-of-the-art 3DGS accelerator, GSCore.

SLAM3D高斯加速器视频编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。