开发可自主采摘甜椒的双臂机器人,突破户外复杂环境下的精准抓取难题。
Vision-guided Autonomous Dual-arm Extraction Robot for Bell Pepper Harvesting
- 双臂协同规划:一臂抓握一臂切割,实现自动提取。
- 户外采摘成功率超60%,单果作业时间少于100秒。
- 构建3200+图像数据集,支持从粗到精的视觉定位训练。
农业机器人是缓解人工采摘人力短缺与成本上升的关键方案。甜椒采摘尤为耗时,占总生产成本高达50%。尽管自动化系统在受控温室中表现良好,但户外非结构化环境因光照、遮挡等变化仍具挑战。本文提出VADER(Vision-guided Autonomous Dual-arm Extraction Robot),一种专为户外甜椒采摘设计的双臂移动操作机器人。系统集成鲁棒感知流程与双臂协同规划框架,由抓取臂和切割臂配合完成果实提取。通过多种真实场景测试,系统在单果周期低于100秒的前提下,采摘成功率超过60%,并基于GELLO遥操作框架实现故障安全的远程干预。为支持强健感知,我们构建了包含3200多张图像的分层数据集,涵盖室内外广角场景与近距离甜椒图像,支持从果实检测到高精度位姿估计的渐进式训练策略。代码与数据集将在论文接受后公开。
原文摘要 · Abstract (English)
Agricultural robotics has emerged as a critical solution to the labor shortages and rising costs associated with manual crop harvesting. Bell pepper harvesting, in particular, is a labor-intensive task, accounting for up to 50% of total production costs. While automated solutions have shown promise in controlled greenhouse environments, harvesting in unstructured outdoor farms remains an open challenge due to environmental variability and occlusion. This paper presents VADER (Vision-guided Autonomous Dual-arm Extraction Robot), a dual-arm mobile manipulation system designed specifically for the autonomous harvesting of bell peppers in outdoor environments. The system integrates a robust perception pipeline coupled with a dual-arm planning framework that coordinates a gripping arm and a cutting arm for extraction. We validate the system through trials in various realistic conditions, demonstrating a harvest success rate exceeding 60% with a cycle time of under 100 seconds per fruit, while also featuring a teleoperation fail-safe based on the GELLO teleoperation framework to ensure robustness. To support robust perception, we contribute a hierarchically structured dataset of over 3,200 images spanning indoor and outdoor domains, pairing wide-field scene images with close-up pepper images to enable a coarse-to-fine training strategy from fruit detection to high-precision pose estimation. The code and dataset will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。