arXiv:2604.04618cs.RO2026-04

用类人视觉和高效学习,让乒乓球机器人更快更准反应

Biologically Inspired Event-Based Perception and Sample-Efficient Learning for High-Speed Table Tennis Robots

  • 直接处理异步事件流,不重建图像就能精准追踪球
  • 训练次数减少,高精度击球成功率提升35.8%
  • 适合高速动态场景的机器人感知与决策系统

高速动态场景中的机器人感知与决策仍具挑战。以乒乓球为例,传统帧式视觉传感器存在运动模糊、高延迟和数据冗余问题,难以满足实时精准感知需求。受人类视觉系统启发,事件基感知通过异步感知、高时间分辨率和固有稀疏性克服上述缺陷。但现有方法多局限于简化球体场景。同时,现有决策方法通常需数千次环境交互才能收敛,计算成本高。本文提出一种生物启发式方法,结合事件基感知与样本高效学习。感知方面,提出基于运动线索与几何一致性的事件基球体检测方法,直接在异步事件流上运行,无需帧重建,实现真实对打中的鲁棒高效检测。决策方面,引入类人样本高效训练策略:先在低速场景中逐步学习基础到高级技能,再通过依赖案例的时间自适应奖励与奖励阈值机制,引导迁移到高速场景。相同训练轮次下,返回目标准确率提升35.8%。结果验证了生物启发式感知与决策在高速机器人系统中的有效性。

原文摘要 · Abstract (English)

Perception and decision-making in high-speed dynamic scenarios remain challenging for current robots. In contrast, humans and animals can rapidly perceive and make decisions in such environments. Taking table tennis as a typical example, conventional frame-based vision sensors suffer from motion blur, high latency and data redundancy, which can hardly meet real-time, accurate perception requirements. Inspired by the human visual system, event-based perception methods address these limitations through asynchronous sensing, high temporal resolution, and inherently sparse data representations. However, current event-based methods are still restricted to simplified, unrealistic ball-only scenarios. Meanwhile, existing decision-making approaches typically require thousands of interactions with the environment to converge, resulting in significant computational costs. In this work, we present a biologically inspired approach for high-speed table tennis robots, combining event-based perception with sample-efficient learning. On the perception side, we propose an event-based ball detection method that leverages motion cues and geometric consistency, operating directly on asynchronous event streams without frame reconstruction, to achieve robust and efficient detection in real-world rallies. On the decision-making side, we introduce a human-inspired, sample-efficient training strategy that first trains policies in low-speed scenarios, progressively acquiring skills from basic to advanced, and then adapts them to high-speed scenarios, guided by a case-dependent temporally adaptive reward and a reward-threshold mechanism. With the same training episodes, our method improves return-to-target accuracy by 35.8%. These results demonstrate the effectiveness of biologically inspired perception and decision-making for high-speed robotic systems.

事件相机机器人控制样本效率乒乓球机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。