arXiv:2502.00749cs.ROcs.CV2025-02被引 6

用事件相机实现乒乓球机器人实时感知,速度提升一个数量级。

An Event-Based Perception Pipeline for a Table Tennis Robot

  • 仅用事件相机构建实时感知流水线,异步响应像素变化
  • 感知更新率比帧基系统高一个数量级,达微秒级精度
  • 适合对响应速度要求极高的机器人控制场景

近年来,乒乓球机器人成为控制与感知算法的重要研究挑战。快速准确地检测球的位置对机械臂成功回击至关重要。以往多数系统依赖帧基摄像头,但面对高速运动物体时易产生运动模糊。事件相机则通过像素异步、独立报告亮度变化,生成微秒级时间分辨率的事件流,无此缺陷。据我们所知,本文首次提出仅使用事件相机的实时乒乓球机器人感知流水线。实验表明,相比帧基方案,该系统感知更新率提升一个数量级,显著降低球位置、速度和旋转估计的均值误差与不确定性。这一优势对于需要在极短时间内完成击球动作的机器人控制极为关键。

原文摘要 · Abstract (English)

Table tennis robots gained traction over the last years and have become a popular research challenge for control and perception algorithms. Fast and accurate ball detection is crucial for enabling a robotic arm to rally the ball back successfully. So far, most table tennis robots use conventional, frame-based cameras for the perception pipeline. However, frame-based cameras suffer from motion blur if the frame rate is not high enough for fast-moving objects. Event-based cameras, on the other hand, do not have this drawback since pixels report changes in intensity asynchronously and independently, leading to an event stream with a temporal resolution on the order of us. To the best of our knowledge, we present the first real-time perception pipeline for a table tennis robot that uses only event-based cameras. We show that compared to a frame-based pipeline, event-based perception pipelines have an update rate which is an order of magnitude higher. This is beneficial for the estimation and prediction of the ball's position, velocity, and spin, resulting in lower mean errors and uncertainties. These improvements are an advantage for the robot control, which has to be fast, given the short time a table tennis ball is flying until the robot has to hit back.

事件相机机器人感知实时系统乒乓球机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。