arXiv:2507.13277cs.ROcs.AI2025-07被引 1

用强化学习训练仿生四足机器人像导盲犬一样避障导航,PPO效果最佳。

Evaluating Reinforcement Learning Algorithms for Navigation in Simulated Robotic Quadrupeds: A Comparative Study Inspired by Guide Dog Behaviour

  • 对比DQN、Q-learning和PPO三种算法在仿真环境中的导航表现。
  • PPO在平均与中位步数至目标上显著优于其他算法,碰撞率更低。
  • 研究为医疗助行机器人和仿生导盲犬提供可行技术路径。

机器人在医疗等领域应用日益广泛,但四足机器人在辅助场景中的潜力尚未充分挖掘。本研究探讨三种强化学习算法在训练仿真四足机器人自主导航与避障方面的有效性,目标是构建具备路径跟随与障碍规避能力的仿生导盲犬模拟系统,长期有望为视障人士提供实际帮助,并拓展医疗‘宠物’机器人的研究边界。基于对13篇相关论文的分析,确立了包括碰撞检测、路径规划、传感器使用、机器人类型和仿真平台在内的评估标准。研究聚焦于传感器输入、碰撞频率、奖励信号与学习进展,通过自建环境确保三类算法在受控条件下的公平比较。结果表明,近端策略优化(PPO)在所有指标上均优于深度Q网络(DQN)与Q-learning,尤其在每回合平均与中位步数至目标方面表现突出。该研究为机器人导航、人工智能与医疗机器人提供了新见解,验证了基于AI的四足移动系统的可行性及其在辅助机器人中的潜在作用。

原文摘要 · Abstract (English)

Robots are increasingly integrated across industries, particularly in healthcare. However, many valuable applications for quadrupedal robots remain overlooked. This research explores the effectiveness of three reinforcement learning algorithms in training a simulated quadruped robot for autonomous navigation and obstacle avoidance. The goal is to develop a robotic guide dog simulation capable of path following and obstacle avoidance, with long-term potential for real-world assistance to guide dogs and visually impaired individuals. It also seeks to expand research into medical 'pets', including robotic guide and alert dogs. A comparative analysis of thirteen related research papers shaped key evaluation criteria, including collision detection, pathfinding algorithms, sensor usage, robot type, and simulation platforms. The study focuses on sensor inputs, collision frequency, reward signals, and learning progression to determine which algorithm best supports robotic navigation in complex environments. Custom-made environments were used to ensure fair evaluation of all three algorithms under controlled conditions, allowing consistent data collection. Results show that Proximal Policy Optimization (PPO) outperformed Deep Q-Network (DQN) and Q-learning across all metrics, particularly in average and median steps to goal per episode. By analysing these results, this study contributes to robotic navigation, AI and medical robotics, offering insights into the feasibility of AI-driven quadruped mobility and its role in assistive robotics.

强化学习四足机器人导盲犬医疗机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。