提出自适应切换控制框架,让机器人更安全高效地跟人协作导航。
Adaptive Reinforcement and Model Predictive Control Switching for Safe Human-Robot Cooperative Navigation
- 用强化学习和模型预测控制混合决策,根据环境风险动态切换
- 在复杂场景中成功率82.5%,比基准方法高3.1%~7.1%
- 适合需要高安全性的实际人机协同场景,如医疗或仓储机器人
本文针对移动协作机器人在同时需保持近距跟随与满足安全约束条件下的自主导航挑战,提出自适应强化与模型预测控制切换(ARMS)框架。该框架融合了基于近端策略优化(PPO)训练的强化学习跟随者与基于二次规划的安全滤波器式单步模型预测控制(MPC)。为应对感知不完全与人类运动非平稳问题,采用解耦传感架构:使用长短期记忆网络(LSTM)编码人-机相对状态,空间编码360度激光雷达扫描。核心创新在于一个可学习的神经切换器,实现双控制器间的上下文感知软融合:低风险区域优先采用保守的约束感知QP控制;高拥挤或受限场景下逐步将控制权移交至强化学习跟随者以提升机动性;当QP不可行时则回归跟随者动作。大量实验对比纯追踪、动态窗口法(DWA)及纯强化学习基线表明,ARMS在高度杂乱环境中成功率达82.5%,优于DWA和纯强化学习方法3.1%和7.1%;计算延迟降低33%至5.2毫秒,较多步MPC基线显著提升。额外仿真迁移测试(Gazebo)与初步真实世界部署结果进一步验证其实用性与鲁棒性。源码与演示视频见https://github.com/21ning/ARMS.git。
原文摘要 · Abstract (English)
This paper addresses the challenge of human-guided navigation for mobile collaborative robots under simultaneous proximity regulation and safety constraints. We introduce Adaptive Reinforcement and Model Predictive Control Switching (ARMS), a hybrid learning-control framework that integrates a reinforcement learning follower trained with Proximal Policy Optimization (PPO) and an analytical one-step Model Predictive Control (MPC) formulated as a quadratic program safety filter. To enable robust perception under partial observability and non-stationary human motion, ARMS employs a decoupled sensing architecture with a Long Short-Term Memory (LSTM) temporal encoder for the human-robot relative state and a spatial encoder for 360-degree LiDAR scans. The core contribution is a learned adaptive neural switcher that performs context-aware soft action fusion between the two controllers, favoring conservative, constraint-aware QP-based control in low-risk regions while progressively shifting control authority to the learned follower in highly cluttered or constrained scenarios where maneuverability is critical, and reverting to the follower action when the QP becomes infeasible. Extensive evaluations against Pure Pursuit, Dynamic Window Approach (DWA), and an RL-only baseline demonstrate that ARMS achieves an 82.5 percent success rate in highly cluttered environments, outperforming DWA and RL-only approaches by 7.1 percent and 3.1 percent, respectively, while reducing average computational latency by 33 percent to 5.2 milliseconds compared to a multi-step MPC baseline. Additional simulation transfer in Gazebo and initial real-world deployment results further indicate the practicality and robustness of ARMS for safe and efficient human-robot collaboration. Source code and a demonstration video are available at https://github.com/21ning/ARMS.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。