arXiv:2410.00706cs.ROcs.CV2024-10被引 3

通过手载多视角主动视觉,实现工厂自动化中低成本高速抓取。

A Low-Cost, High-Speed, and Robust Bin Picking System for Factory Automation Enabled by a Non-Stop, Multi-View, and Active Vision Scheme

  • 手载多视角主动视觉与机器人动作并行,提升速度
  • 单次感知最慢1.682秒,平均拾取成功率超97.75%
  • 适合工业场景中对速度与鲁棒性要求高的自动抓取

工厂自动化中的抓取系统常因金属物体三维数据稀疏且噪声大而面临鲁棒性问题。采用多视角、一次性3D传感器及“传感器在手上”的配置正变得越来越流行,因其高效、灵活且成本低。然而,在移动3D传感器以获取多视角进行3D融合或主动视觉时,由于感知模块与运动任务分离,未针对抓取系统专门设计,导致速度低下。为此,我们设计了一种抓取系统,将多视角主动视觉方案与运动任务紧密耦合于“传感器在手上”架构中。该系统不仅通过将高速感知与机器人位姿动作并行,显著加快整体速度,还自主规划下一感知路径,确保整个抓取过程连续不断。不同于仅关注感知性能的研究,我们通过在5种不同物体上无须人工干预的抓取实验评估了该设计。实验表明,整个感知方案在CPU上最慢仅需1.682秒,平均抓取完成率超过97.75%。由于与机器人运动并行,感知环节在节拍时间中平均仅占0.635秒。

原文摘要 · Abstract (English)

Bin picking systems in factory automation usually face robustness issues caused by sparse and noisy 3D data of metallic objects. Utilizing multiple views, especially with a one-shot 3D sensor and "sensor on hand" configuration is getting more popularity due to its effectiveness, flexibility, and low cost. While moving the 3D sensor to acquire multiple views for 3D fusion, joint optimization, or active vision suffers from low-speed issues. That is because sensing is taken as a decoupled module from motion tasks and is not intentionally designed for a bin picking system. To address the problems, we designed a bin picking system, which tightly couples a multi-view, active vision scheme with motion tasks in a "sensor on hand" configuration. It not only speeds up the system by parallelizing the high-speed sensing scheme to the robot place action but also decides the next sensing path to maintain the continuity of the whole picking process. Unlike others focusing only on sensing evaluation, we also evaluated our design by picking experiments on 5 different types of objects without human intervention. Our experiments show the whole sensing scheme can be finished within 1.682 seconds (maximum) on CPU and the average picking complete rate is over 97.75%. Due to the parallelization with robot motion, the sensing scheme accounts for only 0.635 seconds in takt time on average.

工业自动化多视角视觉抓取系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。