无需深度传感器,多机单目相机实现高保真协同三维重建。
MAGS-SLAM: Monocular Multi-Agent Gaussian Splatting SLAM for Geometrically and Photometrically Consistent Reconstruction

- 各机器人独立构建单目局部高斯地图,仅传输压缩地图摘要。
- 在无深度信息下仍实现几何与外观一致的全局重建,精度媲美带深度传感器的方法。
- 适合低成本、低功耗机器人平台,尤其适用于虚拟制作与多机协同探索。
多智能体协同进行逼真三维重建,可快速完成大场景捕捉,适用于虚拟制作与多机器人协作探索。尽管近期3D高斯点云(3DGS)SLAM算法能实现实时高保真建图,但现有大多数多机高斯SLAM方法依赖RGB-D传感器获取度量深度并简化跨智能体对齐,限制了其在低成本或低功耗机器人平台的应用,尤其是在广泛使用的单目相机背景下。为此,我们提出MAGS-SLAM,首个基于纯RGB的多智能体3DGS SLAM框架,用于协同场景重建。每个智能体独立构建单目局部高斯子地图,并仅传输紧凑的子地图摘要而非原始观测或稠密地图。为应对单目尺度模糊问题,框架集成紧凑子地图通信、几何与外观感知的回环验证以及占用感知的高斯融合机制,实现无需主动深度传感器的连贯全局重建。我们进一步构建ReplicaMultiagent Plus基准数据集,包含更大规模机器人团队,用于评估协同高斯SLAM。在合成与真实数据集上的大量实验表明,MAGS-SLAM仅使用RGB图像即可达到与最先进的基于RGB-D的协同高斯SLAM方法相当甚至更优的追踪精度与渲染质量。
原文摘要 · Abstract (English)
Collaborative photorealistic 3D reconstruction from multiple agents enables rapid large-scale scene capture for virtual production and cooperative multi-robot exploration. While recent 3D Gaussian Splatting (3DGS) SLAM algorithms can generate high-fidelity real-time mapping, most of the existing multi-agent Gaussian SLAM methods still rely on RGB-D sensors to obtain metric depth and simplify cross-agent alignment, limiting their deployment on low-cost or power-constrained robotic platforms, especially given the wider availability of RGB cameras. To address this challenge, we propose MAGS-SLAM, the first RGB-only multi-agent 3DGS SLAM framework for collaborative scene reconstruction. Each agent independently builds local monocular Gaussian submaps and transmits compact submap summaries rather than raw observations or dense maps. To facilitate robust collaboration in the presence of monocular scale ambiguity, our framework integrates compact submap communication, geometry- and appearance-aware loop verification, and occupancy-aware Gaussian fusion, enabling coherent global reconstruction without active depth sensors. We further introduce ReplicaMultiagent Plus, a benchmark containing larger robot teams for evaluating collaborative Gaussian SLAM. Extensive experiments on synthetic and real-world datasets show that MAGS-SLAM achieves tracking accuracy and rendering quality competitive with or superior to those of state-of-the-art RGB-D collaborative Gaussian SLAM methods using RGB images alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。