让机器人用摄像头直接控制踢球动作,自适应视觉误差。
Learning Vision-Driven Reactive Soccer Skills for Humanoid Robots
- 用强化学习统一视觉与运动控制,直接端到端训练
- 比规则基线减少46%球位误判,踢球准备时间缩短64%
- 适合真实场景下需要视觉反馈的仿人机器人任务
仿人足球是具身智能的代表性挑战,要求机器人在动态环境中协调敏捷运动与不可靠的视觉感知。现有系统多采用感知与控制分离的模块化设计,或假设理想传感,难以在真实感知限制下实现连贯反应行为。本文提出一种基于强化学习的统一控制器,使仿人机器人通过直接耦合视觉感知与运动控制,学习视觉驱动的足球技能。机器人在仿真中训练,利用对抗性运动先验引导策略学习自然运动模式。为提升在感知不完善下的鲁棒性,引入编码器-解码器结构与虚拟感知系统,模拟机载视觉的关键特征,在训练中暴露于感知噪声和检测失败,促使策略内化感知不确定性并闭环持续调整运动。所提控制器仅依赖机载视觉即可完成寻球、追球与多方向踢球等协调行为,相比规则基线将球位估计误差降低46%,踢球准备时间缩短达64%,前场位置踢球成功率约90%。在多种环境与动态场景(包括真实RoboCup竞赛)中的实验进一步验证了控制器的鲁棒性。结果表明,将感知不确定性直接融入策略学习,能有效实现仿人机器人在真实条件下的可靠视觉驱动行为。
原文摘要 · Abstract (English)
Humanoid soccer poses a representative challenge for embodied intelligence, requiring robots to coordinate agile locomotion with unreliable visual perception in dynamic environments. However, existing systems typically rely on modular pipelines that separate perception from control or assume ideal sensing, making it difficult to achieve coherent and reactive behavior under real-world perceptual limitations. In this work, we present a unified reinforcement learning-based controller that enables humanoid robots to learn vision-driven reactive soccer skills by directly coupling visual perception with locomotion control. The robot is trained in simulation to acquire soccer behaviors, and adversarial motion priors guide policy learning toward natural motion patterns. To support robust performance under imperfect sensing, we introduce an encoder-decoder architecture together with a virtual perception system that models key characteristics of onboard vision, exposing the policy to perceptual noise and detection failures during training. This design encourages the policy to internalize perceptual uncertainty and continuously adapt its motion in a closed loop. The resulting controller produces coordinated soccer behaviors using only onboard vision, including ball searching, chasing, and multidirectional kicking. It reduces ball position estimation error by 46% and shortens time-to-kick by up to 64% compared with a rule-based baseline, achieving around 90% kicking success in frontfield positions. Experiments across diverse environments and dynamic scenarios, including real RoboCup competitions, further demonstrate the robust performance of the controller. These results highlight the practical effectiveness of integrating perceptual uncertainty directly into policy learning for achieving reliable vision-driven behaviors in humanoid robots operating under real-world conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。