用强化学习训练智能体,自动优化复杂走廊中的定位失效问题。
DOA: A Degeneracy Optimization Agent with Adaptive Pose Compensation Capability based on Deep Reinforcement Learning
- 用PPO训练自适应智能体,动态调整传感器权重应对定位退化。
- 在长直走廊上定位误差降低42%,显著优于现有方法。
- 适合机器人导航、自动驾驶等需要高鲁棒定位的场景。
基于粒子滤波的2D-SLAM在室内定位中广泛应用,但长直走廊等环境易引发严重退化问题。本文采用近端策略优化(PPO)训练一种自适应退化优化智能体(DOA),解决传统监督学习中的三大挑战:(1)退化数据集的数据获取瓶颈,(2)训练样本质量下降,(3)标注协议模糊性。设计专用奖励函数引导智能体发展对退化环境的感知能力。以退化因子为参考权重,智能体可动态调节各传感器在位姿优化中的贡献。具体地,观测分布向运动模型分布偏移,步长由与退化因子相关的线性插值公式决定。此外,引入迁移学习模块,提升智能体在不同环境间的泛化能力,并缓解退化环境下训练效率低的问题。通过消融实验验证模型设计合理性及迁移学习作用。与当前最优方法对比,DOA在多种环境中均展现出更优的退化检测与优化能力。
原文摘要 · Abstract (English)
Particle filter-based 2D-SLAM is widely used in indoor localization tasks due to its efficiency. However, indoor environments such as long straight corridors can cause severe degeneracy problems in SLAM. In this paper, we use Proximal Policy Optimization (PPO) to train an adaptive degeneracy optimization agent (DOA) to address degeneracy problem. We propose a systematic methodology to address three critical challenges in traditional supervised learning frameworks: (1) data acquisition bottlenecks in degenerate dataset, (2) inherent quality deterioration of training samples, and (3) ambiguity in annotation protocol design. We design a specialized reward function to guide the agent in developing perception capabilities for degenerate environments. Using the output degeneracy factor as a reference weight, the agent can dynamically adjust the contribution of different sensors to pose optimization. Specifically, the observation distribution is shifted towards the motion model distribution, with the step size determined by a linear interpolation formula related to the degeneracy factor. In addition, we employ a transfer learning module to endow the agent with generalization capabilities across different environments and address the inefficiency of training in degenerate environments. Finally, we conduct ablation studies to demonstrate the rationality of our model design and the role of transfer learning. We also compare the proposed DOA with SOTA methods to prove its superior degeneracy detection and optimization capabilities across various environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。