用未来状态预测提升机器人越障行走的稳定性与泛化能力
ParkourFormer: Integrating Predictive Supervision and Sequence Modeling into Parkour Locomotion

- 基于Transformer构建时序建模框架,融合历史轨迹与未来状态预测
- 在复杂地形上实现93.85%成功率,比基线最高提升47.12%
- 统一策略适配多种地形,适合高动态全身运动控制研究
类人机器人越障需在快速变化的地形(如台阶、缝隙、斜坡、障碍物)中协调全身动力学。现有强化学习策略多为被动响应,直接从观测映射动作,未显式建模未来身体状态。在敏捷运动任务中,成功执行高度依赖对即将发生的接触切换和身体动态的预判。本文提出ParkourFormer,一种基于Transformer的序列建模框架,将类人运动重新定义为未来条件下的决策问题。当前机器人状态通过交叉注意力查询历史传感运动轨迹,轻量级预测头则预报短时程本体感知状态。经监督信号训练的预测状态与时间特征融合生成动作,使策略能联合推理运动历史与预期动态。在包含台阶、缝隙、斜坡、崎岖地形和障碍穿越的多地形越障基准上评估,仿真与真实机器人实验均显示,ParkourFormer在高难度地形上平均通行成功率达93.85%,相比强基线MLP、MoE-MLP及原始Transformer提升最高达47.12%,且保持单一统一策略覆盖所有地形类型。结果表明,显式未来状态建模显著提升敏捷全身运动的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Humanoid parkour requires locomotion policies to coordinate whole-body dynamics across rapidly changing terrains such as stairs, gaps, slopes, and obstacles. Existing reinforcement learning policies are largely reactive, mapping observations directly to actions without explicitly modeling future body states. Such modeling becomes critical in agile locomotion tasks where successful motion execution depends strongly on anticipating upcoming contact transitions and body dynamics. We present ParkourFormer, a Transformer-based sequence modeling framework that reformulates humanoid locomotion as a future-conditioned decision-making problem. The current robot state queries historical sensorimotor trajectories through cross-attention, while a lightweight prediction head forecasts short-horizon future proprioceptive states. The predicted future states, trained with supervised signals, are fused with temporal features to generate actions, enabling the policy to jointly reason over motion history and anticipated future dynamics. We evaluate ParkourFormer on a diverse multi-terrain humanoid parkour benchmark including stairs, gaps, slopes, rough terrain, and obstacle traversal. Experiments in simulation and on a real humanoid robot show that ParkourFormer achieves a 93.85% average traversal success rate on highly challenging terrains, with improvements of up to 47.12% over strong MLP, MoE-based MLP, and vanilla Transformer baselines, while maintaining a single unified policy across all terrain types. These results demonstrate that explicit future-state modeling significantly improves robustness and generalization for agile whole-body locomotion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。