让仿人机器人学会专业网球动作,实现在真实世界稳定执行。
Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking

- 分层设计:规划器生成风格化动作,追踪器低干扰执行。
- 在真实机器人上实现无动捕网球发球与击球,成功率超90%。
- 通过自适应速度学习提升追踪鲁棒性,解决仿真到现实的差距。
仿人机器人在真实世界球类运动中展现出潜力,但实现专业动作风格的同时保持强任务性能仍具挑战。本文提出AdaPT框架,直接从电视转播视频中学习专业网球发球与对打动作。该分层设计的核心洞察是:规划器生成风格化运动学动作,而追踪器以最小干扰执行。尽管在仿真中表现良好,但仿真到现实的差距显著:追踪性能在真实机器人上下降,且自回归规划忽视此问题,感知噪声进一步加剧误差。为此,我们的自适应机制通过学习追踪随机执行速度来提升追踪鲁棒性,并通过学习的动作-速度适配器使规划器条件化,缓解误差累积。在Unitree G1上的真实实验验证了该机制的有效性。我们进一步将AdaPT策略部署于全尺寸Dobot Atom仿人机器人(1.7米),实现了无需动作捕捉的野外发球。实验还揭示了未来仿人球类系统在算法与工程层面的关键洞察。视频与代码见项目网站。
原文摘要 · Abstract (English)
Humanoid robots have recently demonstrated promising capabilities in real-world ball sports. However, achieving professional motion styles while maintaining strong task performance remains challenging. In this work, we propose AdaPT, an Adaptive Motion Planning and Tracking framework that learns professional tennis serving and rally styles directly from broadcast videos. This hierarchical design is motivated by the key insight that the planner generates stylistic kinematic motions, while the tracker executes them with minimal interference with planning. Despite its effectiveness in simulation, a substantial sim-to-real gap emerges: tracking performance inevitably degrades on real robots, and this degradation is partially overlooked by autoregressive planning and further compounded by noisy perception. To address these issues, our adaptation mechanism improves tracking robustness by learning to track randomized execution speeds, while conditioning the planner on a learned motion-speed adapter to mitigate compounding errors. Real-world experiments on the Unitree G1 demonstrate the effectiveness of our adaptation mechanism in bridging the sim-to-real gap. We further deploy AdaPT policies on the full-size Dobot Atom humanoid robot (1.7m) and demonstrate in-the-wild serving without motion capture. Beyond these results, our real-world experiments reveal both algorithmic and engineering insights for future humanoid ball-sports systems. Videos and code are available on our \href{https://humanoidtennis.github.io/AdaPT/}{project website}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。