用类脑视觉+双系统控制,让机器人打乒乓球更准更快
SpikePingpong: Spike Vision-based Fast-Slow Pingpong Robot System
- 分快慢两套系统:快系统毫秒级检测球,慢系统精准校正击球点
- 30厘米目标命中率92%,20厘米高精度目标也达70%
- 适合研究高速机器人操控、类脑视觉与智能运动规划的学者
在动态环境中操控高速物体是机器人学的核心挑战。乒乓球因其高动态性成为检验机器人能力的理想场景。该任务面临两大难题:需高精度视觉系统准确预测复杂运动下的球轨迹,还需智能控制策略实现对目标区域的精准击打。传统高速操作依赖高时间分辨率的视觉硬件。受卡尼曼双系统理论启发——快速直觉与慢速推理相辅相成,我们提出 extit{ extbf{SpikePingpong}} 系统,融合脉冲视觉与模仿学习,实现高精度机器人乒乓击打。系统采用快-慢架构:系统1以毫秒级响应完成快速球检测与初步轨迹预测;系统2通过面向脉冲神经网络的校准机制,实现击球位置的精确修正。针对击球策略,引入基于示范学习的运动规划与控制技术,从人类示范中学习最优击打动作。实验表明,该系统在30厘米精度区域成功率高达92%,在更具挑战性的20厘米目标区域仍保持70%的成功率。本工作验证了快-慢架构在时序敏感操作任务中的潜力。
原文摘要 · Abstract (English)
Learning to control high-speed objects in dynamic environments represents a fundamental challenge in robotics. Table tennis serves as an ideal testbed for advancing robotic capabilities in dynamic environments. This task presents two fundamental challenges: it requires a high-precision vision system capable of accurately predicting ball trajectories under complex dynamics, and it necessitates intelligent control strategies to ensure precise ball striking to target regions. High-speed object manipulation typically demands advanced visual perception hardware capable of capturing rapid motion with exceptional temporal resolution. Drawing inspiration from Kahneman's dual-system theory, where fast intuitive processing complements slower deliberate reasoning, there exists an opportunity to develop more robust perception architectures that can handle high-speed dynamics while maintaining accuracy. To this end, we present \textit{\textbf{SpikePingpong}}, a novel system that integrates spike-based vision with imitation learning for high-precision robotic table tennis. We develop a Fast-Slow system architecture where System 1 provides rapid ball detection and preliminary trajectory prediction with millisecond-level responses, while System 2 employs spike-oriented neural calibration for precise hittable position corrections. For strategic ball striking, we introduce Imitation-based Motion Planning And Control Technology, which learns optimal robotic arm striking policies through demonstration-based learning. Experimental results demonstrate that \textit{\textbf{SpikePingpong}} achieves a remarkable 92\% success rate for 30 cm accuracy zones and 70\% in the more challenging 20 cm precision targeting. This work demonstrates the potential of Fast-Slow architectures for advancing robotic capabilities in time-critical manipulation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。