无需人工标注,让无人船在真实水域自动视觉对准停靠点
Supervised Visual Docking Network for Unmanned Surface Vehicles Using Auto-labeling in Real-world Water Environments
- 用自动标注生成带位姿信息的图像数据,省去人工标注
- 神经网络直接预测相对停靠位姿,精度高且不依赖标定
- 真实水域实测有效,适合无人船自主停靠场景
无人水面艇(USVs)广泛应用于环境监测和河流制图等水体作业,但精准自主停靠仍面临挑战,目前多依赖远程人工控制或外部定位系统,限制了完全无人化部署。本文提出一种基于自动标注的监督学习框架,实现无人船视觉自主停靠。首先设计了自动标注的数据采集流程,为图像对附加相对位姿信息,无需传统人工标注。其次提出神经停靠位姿估计器(NDPE),无需手工特征工程、相机标定或外部标记,即可在真实水域环境中准确预测相对停靠位姿,支持基于位置的视觉伺服(PBVS)与底层运动控制器,实现高效自主停靠。实验表明,NDPE对距离变化和船速扰动具有鲁棒性。所提方案在真实水域环境中验证有效,具备处理实际自主停靠任务的能力。
原文摘要 · Abstract (English)
Unmanned Surface Vehicles (USVs) are increasingly applied to water operations such as environmental monitoring and river-map modeling. It faces a significant challenge in achieving precise autonomous docking at ports or stations, still relying on remote human control or external positioning systems for accuracy and safety which limits the full potential of human-out-of-loop deployment for USVs.This paper introduces a novel supervised learning pipeline with the auto-labeling technique for USVs autonomous visual docking. Firstly, we designed an auto-labeling data collection pipeline that appends relative pose and image pair to the dataset. This step does not require conventional manual labeling for supervised learning. Secondly, the Neural Dock Pose Estimator (NDPE) is proposed to achieve relative dock pose prediction without the need for hand-crafted feature engineering, camera calibration, and peripheral markers. Moreover, The NDPE can accurately predict the relative dock pose in real-world water environments, facilitating the implementation of Position-Based Visual Servo (PBVS) and low-level motion controllers for efficient and autonomous docking.Experiments show that the NDPE is robust to the disturbance of the distance and the USV velocity. The effectiveness of our proposed solution is tested and validated in real-world water environments, reflecting its capability to handle real-world autonomous docking tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。