用强化学习让多机器人自适应优化位姿图,精度更高、速度更快。
Policies over Poses: Reinforcement Learning based Distributed Pose-Graph Optimization for Multi-Robot SLAM
- 基于多智能体强化学习,将位姿图优化转为局部策略博弈。
- 平均降低全局目标函数37.5%,推理效率提升至少6倍。
- 单个策略可无须重训扩展至更大机器人团队。
我们研究分布式位姿图优化(PGO)问题,这是多机器人同步定位与地图构建(SLAM)中精确轨迹估计的基础。传统迭代方法线性化高度非凸的目标函数,需反复求解正规方程,常收敛至局部最优,导致次优估计。本文提出一种可扩展、抗异常值的分布式平面PGO框架,采用多智能体强化学习(MARL)。将分布式PGO建模为基于局部位姿图的不完全可观测马尔可夫博弈,每个动作优化一条边的位姿估计。图划分器分解全局位姿图,各机器人运行带自适应边门控的循环边条件图神经网络(GNN)编码器以去噪噪声边。机器人通过融合历史动作记忆与图嵌入的混合策略依次修正位姿。局部修正后,共识机制协调机器人间差异,生成全局一致估计。在综合合成与真实数据集上的大量实验表明,所学的MARL代理相比最先进分布式PGO框架,平均降低全局目标函数37.5%,且推理效率提升至少6倍。此外,代理复制使单一学习策略可无缝扩展至更大规模机器人团队,无需重新训练。代码已公开于https://github.com/herolab-uga/policies-over-poses。
原文摘要 · Abstract (English)
We consider the distributed pose-graph optimization (PGO) problem, which is fundamental in accurate trajectory estimation in multi-robot simultaneous localization and mapping (SLAM). Conventional iterative approaches linearize a highly non-convex optimization objective, requiring repeated solving of normal equations, which often converge to local minima and thus produce suboptimal estimates. We propose a scalable, outlier-robust distributed planar PGO framework using Multi-Agent Reinforcement Learning (MARL). We cast distributed PGO as a partially observable Markov game defined on local pose-graphs, where each action refines a single edge's pose estimate. A graph partitioner decomposes the global pose graph, and each robot runs a recurrent edge-conditioned Graph Neural Network (GNN) encoder with adaptive edge-gating to denoise noisy edges. Robots sequentially refine poses through a hybrid policy that utilizes prior action memory and graph embeddings. After local graph correction, a consensus scheme reconciles inter-robot disagreements to produce a globally consistent estimate. Our extensive evaluations on a comprehensive suite of synthetic and real-world datasets demonstrate that our learned MARL-based actors reduce the global objective by an average of 37.5% more than the state-of-the-art distributed PGO framework, while enhancing inference efficiency by at least 6X. We also demonstrate that actor replication allows a single learned policy to scale effortlessly to substantially larger robot teams without any retraining. Code is publicly available at https://github.com/herolab-uga/policies-over-poses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。