arXiv:2410.08065cs.RO2024-10中稿 · IROS 2024被引 7

四足机器人用前腿接住飞来物体,靠视觉与预测精准抓取。

Dynamic Object Catching with Quadruped Robot Front Legs

  • 用YOLOv8和轨迹预测提前规划前腿动作。
  • 三种抓点选择法中,基于可达空间的高斯混合模型效果最好,成功率80%。
  • 适合对机器人动态抓取感兴趣的科研人员或工程师。

本文提出一种四足机器人在后腿站立状态下,利用前腿动态抓取飞来物体的框架。系统融合计算机视觉、轨迹预测与腿部控制,通过机载摄像头实现对抛掷物体的视觉检测、跟踪与成功捕获。采用微调后的YOLOv8进行目标检测,结合基于回归的轨迹预测模块,使机器人能迭代调整前腿位置以预判并拦截物体。抓取过程包括确定最优抓点、使用笛卡尔空间PD控制调节前腿姿态,并在合适时机闭合双腿。文中提出并验证三种抓点选择方法:1)预测轨迹与垂直平面交点;2)轨迹上距离腿初始中心最近的点;3)基于高斯混合模型(GMM)建模机器人可达空间的最高概率点。实验表明系统在多种场景下均表现稳健,其中GMM方法性能最佳,抓取成功率达80%。视频演示见https://youtu.be/sm7RdxRfIYg。

原文摘要 · Abstract (English)

This paper presents a framework for dynamic object catching using a quadruped robot's front legs while it stands on its rear legs. The system integrates computer vision, trajectory prediction, and leg control to enable the quadruped to visually detect, track, and successfully catch a thrown object using an onboard camera. Leveraging a fine-tuned YOLOv8 model for object detection and a regression-based trajectory prediction module, the quadruped adapts its front leg positions iteratively to anticipate and intercept the object. The catching maneuver involves identifying the optimal catching position, controlling the front legs with Cartesian PD control, and closing the legs together at the right moment. We propose and validate three different methods for selecting the optimal catching position: 1) intersecting the predicted trajectory with a vertical plane, 2) selecting the point on the predicted trajectory with the minimal distance to the center of the robot's legs in their nominal position, and 3) selecting the point on the predicted trajectory with the highest likelihood on a Gaussian Mixture Model (GMM) modelling the robot's reachable space. Experimental results demonstrate robust catching capabilities across various scenarios, with the GMM method achieving the best performance, leading to an 80% catching success rate. A video demonstration of the system in action can be found at https://youtu.be/sm7RdxRfIYg .

四足机器人动态抓取视觉控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。