用合成数据训练的轻量模型,实现无人机对目标的实时相对定位导航
AIVIO: Closed-loop, Object-relative Navigation of UAVs with AI-aided Visual Inertial Odometry
- 基于合成数据训练的轻量级视觉惯性里程计,支持低功耗部署
- 仅用IMU和摄像头实现闭环飞行,定位误差小于15厘米
- 适合电力杆等工业巡检场景,适用于资源受限的无人机
面向自主关键基础设施巡检等任务,物体相对移动机器人导航需从原始传感数据中提取语义信息。尽管深度学习方法能高效识别图像中的物体类别及相对6自由度(6-DoF)位姿,但计算开销大,难以部署于负载受限的移动机器人。本文提出一种实时可用的无人飞行器(UAV)系统,采用最小传感器配置(仅含惯性测量单元IMU与RGB相机),结合基于深度学习的物体位姿估计器,该模型仅在合成数据上训练并优化用于嵌入式平台部署。通过融合物体相对位姿与IMU数据,实现物体相对定位。我们在真实世界中对电力杆巡检这一挑战性场景进行了多组实验验证,系统表现出良好性能。示例闭环飞行过程见补充视频。
原文摘要 · Abstract (English)
Object-relative mobile robot navigation is essential for a variety of tasks, e.g. autonomous critical infrastructure inspection, but requires the capability to extract semantic information about the objects of interest from raw sensory data. While deep learning-based (DL) methods excel at inferring semantic object information from images, such as class and relative 6 degree of freedom (6-DoF) pose, they are computationally demanding and thus often not suitable for payload constrained mobile robots. In this letter we present a real-time capable unmanned aerial vehicle (UAV) system for object-relative, closed-loop navigation with a minimal sensor configuration consisting of an inertial measurement unit (IMU) and RGB camera. Utilizing a DL-based object pose estimator, solely trained on synthetic data and optimized for companion board deployment, the object-relative pose measurements are fused with the IMU data to perform object-relative localization. We conduct multiple real-world experiments to validate the performance of our system for the challenging use case of power pole inspection. An example closed-loop flight is presented in the supplementary video.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。