用少量标注数据训练出能在复杂果园中精准定位葡萄树干的机器人检测系统。
An Annotation-to-Detection Framework for Autonomous and Robust Vine Trunk Localization in the Field by Mobile Agricultural Robots
- 通过跨模态标注迁移和早期传感器融合,提升小样本下的检测能力。
- 单次巡检识别超70%树干,平均定位误差小于0.37米。
- 适合无人农场、移动农机等真实田间场景的鲁棒目标定位。
农业田间环境动态且复杂,对自主移动机器人在未见过的非结构化环境中进行目标检测与定位带来挑战。同时,亟需不依赖大规模人工标注真实数据集的实时检测系统。本文提出一种从标注到检测的全流程框架,仅用有限且部分标注的数据训练鲁棒的多模态检测器。该方法结合跨模态标注迁移与早期传感器融合,配合多阶段检测架构,有效提升了系统的多模态检测性能。在多样光照条件与不同作物密度的新鲜葡萄园场景中验证了其有效性。当与定制化的多模态LiDAR与里程计映射(LOAM)算法及树关联模块集成后,系统实现了高性能的树干定位,在单次遍历中成功识别超过70%的树木,平均距离误差低于0.37米。结果表明,通过多模态、增量式标注与训练,该框架即使初始标注有限,仍可实现鲁棒检测,具备在真实近地农业应用中的潜力。
原文摘要 · Abstract (English)
The dynamic and heterogeneous nature of agricultural fields presents significant challenges for object detection and localization, particularly for autonomous mobile robots that are tasked with surveying previously unseen unstructured environments. Concurrently, there is a growing need for real-time detection systems that do not depend on large-scale manually labeled real-world datasets. In this work, we introduce a comprehensive annotation-to-detection framework designed to train a robust multi-modal detector using limited and partially labeled training data. The proposed methodology incorporates cross-modal annotation transfer and an early-stage sensor fusion pipeline, which, in conjunction with a multi-stage detection architecture, effectively trains and enhances the system's multi-modal detection capabilities. The effectiveness of the framework was demonstrated through vine trunk detection in novel vineyard settings that featured diverse lighting conditions and varying crop densities to validate performance. When integrated with a customized multi-modal LiDAR and Odometry Mapping (LOAM) algorithm and a tree association module, the system demonstrated high-performance trunk localization, successfully identifying over 70% of trees in a single traversal with a mean distance error of less than 0.37m. The results reveal that by leveraging multi-modal, incremental-stage annotation and training, the proposed framework achieves robust detection performance regardless of limited starting annotations, showcasing its potential for real-world and near-ground agricultural applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。