让机器人像人一样打拳,分三步实现自主决策与动作执行
RoboStriker: Hierarchical Decision-Making for Autonomous Humanoid Boxing
- 分三层架构:先学人类拳击动作,再压缩成合理运动空间,最后在潜空间博弈训练
- 在仿真中表现优于传统方法,且能成功迁移到真实机器人
- 适合对人形机器人策略生成、强化学习应用感兴趣的开发者
实现人形机器人在接触密集、动态剧烈的任务(如拳击)中达到人类水平的智能与敏捷性仍是重大挑战。尽管多智能体强化学习(MARL)为策略交互提供了理论框架,但其直接应用于人形机器人控制受限于高维接触动力学和缺乏强物理运动先验。本文提出RoboStriker,一种分层三阶段框架,通过解耦高层战略推理与底层物理执行,实现完全自主的人形拳击。首先,基于人类动作捕捉数据训练单智能体运动追踪器,学习完整的拳击技能库;其次,将这些技能提炼为结构化的潜空间流形,并通过将高斯参数分布投影到单位超球面进行正则化,有效约束探索范围至物理可实现的动作子空间;最后引入潜空间神经虚构自博弈(LS-NFSP),竞争智能体在潜空间而非原始电机空间交互学习对抗策略,显著稳定多智能体训练过程。实验表明,RoboStriker在仿真中取得更优竞技表现,并具备良好的模拟到现实迁移能力。
原文摘要 · Abstract (English)
Achieving human-level competitive intelligence and physical agility in humanoid robots remains a major challenge, particularly in contact-rich and highly dynamic tasks such as boxing. While Multi-Agent Reinforcement Learning (MARL) offers a principled framework for strategic interaction, its direct application to humanoid control is hindered by high-dimensional contact dynamics and the absence of strong physical motion priors. We propose RoboStriker, a hierarchical three-stage framework that enables fully autonomous humanoid boxing by decoupling high-level strategic reasoning from low-level physical execution. The framework first learns a comprehensive repertoire of boxing skills by training a single-agent motion tracker on human motion capture data. These skills are subsequently distilled into a structured latent manifold, regularized by projecting the Gaussian-parameterized distribution onto a unit hypersphere. This topological constraint effectively confines exploration to the subspace of physically plausible motions. In the final stage, we introduce Latent-Space Neural Fictitious Self-Play (LS-NFSP), where competing agents learn competitive tactics by interacting within the latent action space rather than the raw motor space, significantly stabilizing multi-agent training. Experimental results demonstrate that RoboStriker achieves superior competitive performance in simulation and exhibits sim-to-real transfer. Our website is available at RoboStriker.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。