arXiv:2604.01605cs.CVcs.RO2026-04中稿 · CVPR被引 1

联邦3D高斯点云重建,让多机器人协同建模更高效

F3DGS: Federated 3D Gaussian Splatting for Decentralized Multi-Agent World Modeling

论文配图:F3DGS: Federated 3D Gaussian Splatting for Decentralized Multi-Agent World Modeling
图 1 · 摘自论文原文
  • 分步构建共享几何骨架,仅更新外观属性保持对齐
  • 通信开销低,重建质量接近集中式训练
  • 适合分布式机器人系统、无需中心数据聚合

我们提出F3DGS,一种用于去中心化多智能体3D建模的联邦3D高斯点云渲染框架。现有3DGS方法依赖集中式观测数据,难以适用于独立运行的分布式机器人场景,且直接扩展会带来通信开销与几何不一致问题。F3DGS首先通过注册多个客户端的本地融合激光雷达点云,构建共享几何骨架,初始化全局3DGS模型。在联邦优化过程中,固定高斯位置以保持几何对齐,各客户端仅更新外观相关属性(包括协方差、透明度和球谐系数)。服务器采用可见性感知聚合策略,根据每个客户端对特定高斯的观测频率加权其贡献,有效解决多智能体探索中的部分可观测性挑战。为评估去中心化重建性能,我们采集了一个包含同步激光雷达、RGB与IMU数据的多序列室内数据集。实验表明,F3DGS在重建质量上接近集中式训练,同时支持跨智能体的分布式优化。数据集、开发工具包及源代码将公开发布。

原文摘要 · Abstract (English)

We present F3DGS, a federated 3D Gaussian Splatting framework for decentralized multi-agent 3D reconstruction. Existing 3DGS pipelines assume centralized access to all observations, which limits their applicability in distributed robotic settings where agents operate independently, and centralized data aggregation may be restricted. Directly extending centralized training to multi-agent systems introduces communication overhead and geometric inconsistency. F3DGS first constructs a shared geometric scaffold by registering locally merged LiDAR point clouds from multiple clients to initialize a global 3DGS model. During federated optimization, Gaussian positions are fixed to preserve geometric alignment, while each client updates only appearance-related attributes, including covariance, opacity, and spherical harmonic coefficients. The server aggregates these updates using visibility-aware aggregation, weighting each client's contribution by how frequently it observed each Gaussian, resolving the partial-observability challenge inherent to multi-agent exploration. To evaluate decentralized reconstruction, we collect a multi-sequence indoor dataset with synchronized LiDAR, RGB, and IMU measurements. Experiments show that F3DGS achieves reconstruction quality comparable to centralized training while enabling distributed optimization across agents. The dataset, development kit, and source code will be publicly released.

3D建模联邦学习机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。