arXiv:2603.14156cs.RO2026-03

用多维课程学习让四足机器人更快更稳地跑,无需重新训练就能上硬件。

TransCurriculum: Multi-Dimensional Curriculum Learning for Fast & Stable Locomotion

  • 用Transformer动态调整速度、地形和物理参数的训练难度
  • 实测最高时速6.3米,地毯上达4.1米,比现有方法快18.8%
  • 减少27%到18%的迁移损失,适合部署在真实机器人上

高速四足行走在部署时面临稳定性差与迁移损失大的问题。现有课程学习通常仅沿单一维度(如速度范围、地形难度或摩擦/负载参数)提升难度,且依赖固定规则或即时奖励,忽视训练历史。本文提出TransCurriculum,一种基于Transformer的多维课程学习方法,同时适应速度指令、地形复杂度及域随机化参数(摩擦系数与负载质量)。不将奖励历史直接输入底层控制策略,而是由教师模型在课程层面利用历史奖励序列预测未来奖励、成功率与学习进度,指导多维课程扩展至高性能任务区间。我们在Isaac Gym仿真中验证该方法,并零样本部署至Unitree Go1机器人。结果表明,该方法在仿真中实现最高6.3 m/s的速度,优于先前基线;在地毯、斜坡、瓷砖、混凝土等不同地形测试中,地毯上达到4.1 m/s,较最快方法提升18.8%;零样本表现最优,多维课程使迁移损失从27%降至18%,在刚性室内外表面保持80%-90%任务成功率。

原文摘要 · Abstract (English)

High-speed legged locomotion struggles with stability and transfer losses at higher command velocities during deployment. One reason is that most curricula vary difficulty along single axis, for example increase the range of command velocities, terrain difficulty, or domain parameters (e.g. friction or payload mass) using either fixed update rule or instantaneous rewards while ignoring how the history of robot training has evolved. We propose TransCurriculum, a transformer-based multi-dimensional curriculum learning approach for agile quadrupedal locomotion. TransCurriculum adapts to 3 axes, velocity command targets, terrain difficulty, and domain randomization parameters (friction and payload mass). Rather than feeding task reward history directly into the low-level control policy, our formulation exploits it at the curriculum level. A transformer-based teacher retrieves the sequence of rewards and uses it to predict future rewards, success rate, and learning progress to guide expansion of this multidimensional curriculum towards high performing task bins. Finally we validate our approach on the Unitree Go1 robot in simulation (Isaac Gym) and deploy it zero-shot on Go1 hardware. Our TransCurriculum policy achieves a maximum velocity of 6.3 m/s in simulation and outperforms prior curriculum baselines. We tested our TransCurriculum trained policy on terrains (carpets, slopes, tiles, concrete), achieving a forward velocity of 4.1 m/s on carpet surpassing the fastest curriculum methods by 18.8% and achieves maximum zero-shot value among all tested methods. Our multi-dimensional curriculum also reduces the transfer loss to 18% from 27% for command only curriculum, demonstrating the benefits of joint training over velocity, terrain and domain randomization dimension while keeping the task success rate of 80-90% on rigid indoor and outdoor surfaces.

四足机器人课程学习强化学习零样本部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。