让机器人通过分阶段强化学习打羽毛球,实现精准挥拍与移动协同。
Humanoid Whole-Body Badminton via Multi-Stage Reinforcement Learning
- 分三阶段训练:先学走路,再练击球,最后优化任务表现。
- 仿真中连续对打21次,实机击球速度达19.1米/秒,平均落点距4米。
- 无需预测轨迹也能达到相近效果,适合实际部署场景。
类人机器人在静态环境下的运动与操作已表现出强大能力,但动态真实交互仍具挑战。为应对快速移动物体的交互问题,我们提出一种基于强化学习的训练流程,生成统一的全身控制器,实现类人羽毛球击打,协调腿部移动与手臂挥拍,无需运动先验或专家示范。训练采用三阶段课程:足部动作习得、精度引导的击球生成、任务聚焦的精细调整,使四肢协同完成击球目标。部署时使用扩展卡尔曼滤波器(EKF)估计并预测羽毛球轨迹以实现目标击打,并开发了无预测版本以移除EKF和显式预测。我们在仿真和硬件上进行了五组实验验证。仿真中,两台机器人连续对打21次;实机测试中,面对机械喂球及人机对打,机器人击出速度最高达19.1米/秒,平均回球落点距离为4米。此外,无预测版本性能与基于EKF的已知目标策略相当。整体而言,该方法实现了类人机器人在动态环境中的精准目标击打,为更复杂的全身动态交互任务提供了可行路径。
原文摘要 · Abstract (English)
Humanoid robots have demonstrated strong capabilities for interacting with static scenes across locomotion and manipulation, yet dynamic real-world interactions remain challenging. As a step toward fast-moving object interactions, we present a reinforcement-learning training pipeline that yields a unified whole-body controller for humanoid badminton, coordinating footwork and striking without motion priors or expert demonstrations. Training follows a three-stage curriculum (footwork acquisition, precision-guided swing generation, and task-focused refinement) so legs and arms jointly serve the hitting objective. For deployment, we use an Extended Kalman Filter (EKF) to estimate and predict shuttlecock trajectories for target striking, and also develop a prediction-free variant that removes the EKF and explicit prediction. We validate the framework with five sets of experiments in simulation and on hardware. In simulation, two robots sustain a rally of 21 consecutive hits. In real-world tests with both machine-fed shuttles and human-robot rallies, the robot achieves outgoing shuttle speeds up to 19.1~m/s with a mean return landing distance of 4~m. Moreover, the prediction-free variant attains comparable performance to the EKF-based target-known policy. Overall, our approach enables dynamic yet precise goal striking in humanoid badminton and suggests a path toward more dynamics-critical whole-body interaction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。