多机器人协作学习神经辐射场,高效建模环境。
Distributed NeRF Learning for Collaborative Multi-Robot Perception
- 各机器人本地训练NeRF并仅共享模型,降低通信开销。
- 实测性能媲美中心化建图,稀疏视角下更优。
- 适合带宽受限的多机器人系统,提升几何一致性。
高效环境感知对机器人下游应用至关重要。单个机器人常面临遮挡和视野受限问题,而多智能体系统可实现更全面的场景映射、更快覆盖速度和更高容错性。本文提出一种协作式多机器人感知系统,通过协同学习神经辐射场(NeRF)来表征场景。每个智能体处理本地感知数据,并仅与其他智能体共享其学习到的NeRF模型,从而减少通信开销。由于NeRF具有低内存占用特性,该方法特别适用于带宽有限的机器人系统,直接传输原始数据不现实。所提出的分布式学习框架确保各智能体本地NeRF模型的一致性,推动收敛至统一的场景表示。在包含复杂真实场景的数据集上进行大量实验验证了方法的有效性,性能与将数据集中上传至服务器处理的中心化建图相当。此外,我们发现多智能体学习具有正则化效果,在输入视图稀疏情况下显著提升几何一致性;在此类场景中,多智能体建图甚至优于中心化训练。
原文摘要 · Abstract (English)
Effective environment perception is crucial for enabling downstream robotic applications. Individual robotic agents often face occlusion and limited visibility issues, whereas multi-agent systems can offer a more comprehensive mapping of the environment, quicker coverage, and increased fault tolerance. In this paper, we propose a collaborative multi-agent perception system where agents collectively learn a neural radiance field (NeRF) from posed RGB images to represent a scene. Each agent processes its local sensory data and shares only its learned NeRF model with other agents, reducing communication overhead. Given NeRF's low memory footprint, this approach is well-suited for robotic systems with limited bandwidth, where transmitting all raw data is impractical. Our distributed learning framework ensures consistency across agents' local NeRF models, enabling convergence to a unified scene representation. We show the effectiveness of our method through an extensive set of experiments on datasets containing challenging real-world scenes, achieving performance comparable to centralized mapping of the environment where data is sent to a central server for processing. Additionally, we find that multi-agent learning provides regularization benefits, improving geometric consistency in scenarios with sparse input views. We show that in such scenarios, multi-agent mapping can even outperform centralized training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。