让四足机器人高速奔跑中平滑转向,提升敏捷导航能力
SmoothTurn: Learning to Turn Smoothly for Agile Navigation with Quadrupedal Robots
- 设计新奖励机制与前瞻观测窗口,支持连续转向任务
- 实测在真实机器人上实现高速平滑转向,避免停顿失速
- 适合需要快速变向的搜救、巡检等场景使用
四足机器人在消防救援和工业巡检等实际应用中潜力巨大,这些任务常需快速响应与敏捷运动。现有方法多学习单目标到达策略,导致在连续转向时无法预判动作或保持动量,限制了机器人的敏捷性发挥。本文提出SmoothTurn,将任务定义为连续局部导航,引入新型序列目标奖励、包含未来目标前瞻窗口的扩展观测空间,以及基于性能自动升级难度的目标课程。训练后的策略可直接部署于搭载本地传感器与计算单元的真实四足机器人。仿真与实测结果均表明,该框架能生成高速平滑转向的运动策略,展现出如提前面向下一目标、切换时控制动量、规划高效路径等涌现行为。
原文摘要 · Abstract (English)
Quadrupedal robots show great potential for valuable real-world applications such as fire rescue and industrial inspection. Such applications often require urgency and the ability to navigate agilely, which in turn demands the capability to change directions smoothly while running in high speed. Existing approaches for agile navigation typically learn a single-goal reaching policy by encouraging the robot to stay at the target position after reaching there. As a result, when the policy is used to reach sequential goals that require changing directions, it cannot anticipate upcoming maneuvers or maintain momentum across the switch of goals, thereby preventing the robot from fully exploiting its agility potential. In this work, we formulate the task as sequential local navigation, extending the single-goal-conditioned local navigation formulation in prior work. We then introduce SmoothTurn, a learning-based control framework that learns to turn smoothly while running rapidly for agile sequential local navigation. The framework adopts a novel sequential goal-reaching reward, an expanded observation space with a lookahead window for future goals, and an automatic goal curriculum that progressively expands the difficulty of sampled goal sequences based on the goal-reaching performance. The trained policy can be directly deployed on real quadrupedal robots with onboard sensors and computation. Both simulation and real-world empirical results show that SmoothTurn learns an agile locomotion policy that performs smooth turning across goals, with emergent behaviors such as controlling momentum when switching goals, facing towards the future goal in advance, and planning efficient paths.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。