让农田机器人在树下自主导航,无需人工干预。
AdaCropFollow: Self-Supervised Online Adaptation for Visual Under-Canopy Navigation
- 用视觉大模型+几何先验+伪标签实现在线自监督适应
- 仅需少量数据和微调参数即可跨场景稳定追踪关键点
- 适合农业机器人、野外自主导航研究者使用
树下农业机器人可实现全生长季的精准监测、喷洒、除草和植株操作。然而,由于RTK-GPS精度下降及视觉场景随时间变化剧烈,自主导航极具挑战。此前我们基于监督学习构建了带语义关键点的感知系统,但部署中大量失败源于模型无法适应域偏移。本文提出一种自监督在线适配方法,利用视觉基础模型、几何先验与伪标签,对语义关键点表征进行动态调整。初步实验表明,仅需少量数据和参数微调,源域训练的关键点预测模型即可通过该方法,在机器人本地计算平台上自监督地适应多种复杂目标域。这使得树下机器人可在不同田块和作物间实现无需人工干预的全程自动行进跟随。
原文摘要 · Abstract (English)
Under-canopy agricultural robots can enable various applications like precise monitoring, spraying, weeding, and plant manipulation tasks throughout the growing season. Autonomous navigation under the canopy is challenging due to the degradation in accuracy of RTK-GPS and the large variability in the visual appearance of the scene over time. In prior work, we developed a supervised learning-based perception system with semantic keypoint representation and deployed this in various field conditions. A large number of failures of this system can be attributed to the inability of the perception model to adapt to the domain shift encountered during deployment. In this paper, we propose a self-supervised online adaptation method for adapting the semantic keypoint representation using a visual foundational model, geometric prior, and pseudo labeling. Our preliminary experiments show that with minimal data and fine-tuning of parameters, the keypoint prediction model trained with labels on the source domain can be adapted in a self-supervised manner to various challenging target domains onboard the robot computer using our method. This can enable fully autonomous row-following capability in under-canopy robots across fields and crops without requiring human intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。