arXiv:2604.01158cs.RO2026-04被引 5

无需外部摄像头,机器人用自身视角实现高速乒乓球对打。

SMASH: Mastering Scalable Whole-Body Skills for Humanoid Ping-Pong with Egocentric Vision

  • 用自建视角感知系统实现全身协调控制。
  • 生成多样化击球动作,覆盖大范围空间。
  • 首个仅靠自身感官完成连续击球的类人机器人。

现有类人机器人乒乓球系统受限于对外部传感器的依赖,以及在快速运动中难以实现低延迟、鲁棒的本体视角感知和全身协调的精确执行。本文提出 methodname,一个统一可扩展全身技能学习与机载本体视角感知的模块化系统,部署时无需外部摄像头。该工作在三个方面超越此前系统:第一,通过紧密协同的全身控制实现敏捷精准的球体交互,而非上下肢分离控制,支持爆发式全身体能扣杀和低姿击球等多样动作;第二,借助生成模型增强并多样化击球动作,引入可扩展的动作先验,使系统在广阔工作空间中生成自然且稳健的击球行为;第三,据我们所知,首次实现仅依赖机载感知的连续击球,克服了低延迟感知、自身运动引起的不稳定性及视野有限等挑战。大量真实世界实验验证了高速条件下稳定精准的球体交换,证明了面向动态交互任务的可扩展、感知驱动的全身技能学习的有效性。

原文摘要 · Abstract (English)

Existing humanoid table tennis systems remain limited by their reliance on external sensing and their inability to achieve agile whole-body coordination for precise task execution. These limitations stem from two core challenges: achieving low-latency and robust onboard egocentric perception under fast robot motion, and obtaining sufficiently diverse task-aligned strike motions for learning precise yet natural whole-body behaviors. In this work, we present \methodname, a modular system for agile humanoid table tennis that unifies scalable whole-body skill learning with onboard egocentric perception, eliminating the need for external cameras during deployment. Our work advances prior humanoid table-tennis systems in three key aspects. First, we achieve agile and precise ball interaction with tightly coordinated whole-body control, rather than relying on decoupled upper- and lower-body behaviors. This enables the system to exhibit diverse strike motions, including explosive whole-body smashes and low crouching shots. Second, by augmenting and diversifying strike motions with a generative model, our framework benefits from scalable motion priors and produces natural, robust striking behaviors across a wide workspace. Third, to the best of our knowledge, we demonstrate the first humanoid table-tennis system capable of consecutive strikes using onboard sensing alone, despite the challenges of low-latency perception, ego-motion-induced instability, and limited field of view. Extensive real-world experiments demonstrate stable and precise ball exchanges under high-speed conditions, validating scalable, perception-driven whole-body skill learning for dynamic humanoid interaction tasks.

类人机器人乒乓球本体视觉全身控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。