提出分层框架,让机器人在长时间操作中精准跟踪世界坐标下的末端位置。
HiWET: Hierarchical World-Frame End-Effector Tracking for Long-Horizon Humanoid Loco-Manipulation
- 分层强化学习:高层规划目标,低层执行并保证稳定
- 引入运动学流形先验,减少无效动作探索,提升控制精度
- 可在真实机器人上零样本迁移,适配复杂动态任务
类人机器人在执行长时间操作任务时,需在基座移动和冲击下保持动态稳定并完成精确操控。现有方法通常以机体为中心生成指令,无法自动纠正由步行引起的累积世界坐标漂移。本文将问题重定义为世界坐标系下的末端执行器跟踪,并提出HiWET——一种分层强化学习框架,将全局规划与动态执行解耦。高层策略生成同时优化末端精度与基座定位的子目标,低层策略在稳定性约束下执行命令。引入运动学流形先验(KMP),通过残差学习将操纵流形嵌入动作空间,降低探索维度并抑制非物理可行行为。大量仿真与消融实验表明,HiWET在长时序世界坐标任务中实现高精度、高稳定的末端跟踪。我们在真实类人机器人上验证了低层策略的零样本模拟到现实迁移,证明其在多样化操作指令下仍能保持稳定行走。结果表明,显式的世界坐标推理结合分层控制,为长时序类人机器人操控行为提供了一种有效且可扩展的解决方案。
原文摘要 · Abstract (English)
Humanoid loco-manipulation requires executing precise manipulation tasks while maintaining dynamic stability amid base motion and impacts. Existing approaches typically formulate commands in body-centric frames, fail to inherently correct cumulative world-frame drift induced by legged locomotion. We reformulate the problem as world-frame end-effector tracking and propose HiWET, a hierarchical reinforcement learning framework that decouples global reasoning from dynamic execution. The high-level policy generates subgoals that jointly optimize end-effector accuracy and base positioning in the world frame, while the low-level policy executes these commands under stability constraints. We introduce a Kinematic Manifold Prior (KMP) that embeds the manipulation manifold into the action space via residual learning, reducing exploration dimensionality and mitigating kinematically invalid behaviors. Extensive simulation and ablation studies demonstrate that HiWET achieves precise and stable end-effector tracking in long-horizon world-frame tasks. We validate zero-shot sim-to-real transfer of the low-level policy on a physical humanoid, demonstrating stable locomotion under diverse manipulation commands. These results indicate that explicit world-frame reasoning combined with hierarchical control provides an effective and scalable solution for long-horizon humanoid loco-manipulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。