arXiv:2409.18253cs.RO2024-09ICRA被引 9

用无人机俯视图自监督学习越野地形特征,提升导航安全性。

UAV-Assisted Self-Supervised Terrain Awareness for Off-Road Navigation

  • 用悬停无人机获取地面视角图像,训练车辆振动、颠簸和能耗预测模型。
  • 相比地面图像,整体预测性能提升21.37%,高植被区域提升37.35%。
  • 适合无人车越野导航、智能农业与野外探测场景使用。

地形感知是实现真正自主越野导航的关键一步。准确预测地形特性有助于优化路径并规避潜在风险。现有方法采用深度神经网络,基于本体感知信号进行自监督学习,但车载摄像头因视角限制,存在遮挡和远距离像素密度下降问题。本文提出一种新方法:利用悬停无人机的空中视角采集地形对齐图像,结合地面车辆采样数据,训练简单模型预测振动、颠簸和能耗。数据集包含在森林环境中采集的2.8公里越野数据,含13,484张地面图像和12,935张空中图像。实验表明,相较于地面图像,无人机影像使整体预测性能提升21.37%,在高植被区域提升达37.35%。通过消融实验分析性能提升主因,并实证展示了该方法在未知区域侦察、路径规划与地面执行中的实际应用能力。

原文摘要 · Abstract (English)

Terrain awareness is an essential milestone to enable truly autonomous off-road navigation. Accurately predicting terrain characteristics allows optimizing a vehicle's path against potential hazards. Recent methods use deep neural networks to predict traversability-related terrain properties in a self-supervised manner, relying on proprioception as a training signal. However, onboard cameras are inherently limited by their point-of-view relative to the ground, suffering from occlusions and vanishing pixel density with distance. This paper introduces a novel approach for self-supervised terrain characterization using an aerial perspective from a hovering drone. We capture terrain-aligned images while sampling the environment with a ground vehicle, effectively training a simple predictor for vibrations, bumpiness, and energy consumption. Our dataset includes 2.8 km of off-road data collected in forest environment, comprising 13 484 ground-based images and 12 935 aerial images. Our findings show that drone imagery improves terrain property prediction by 21.37 % on the whole dataset and 37.35 % in high vegetation, compared to ground robot images. We conduct ablation studies to identify the main causes of these performance improvements. We also demonstrate the real-world applicability of our approach by scouting an unseen area with a drone, planning and executing an optimized path on the ground.

越野导航无人机辅助自监督学习地形感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。