arXiv:2409.08824cs.CV2024-09被引 5

用低空飞机和二值化神经网络,高效生成完整道路地图

Pathfinder for Low-altitude Aircraft with Binary Neural Network

  • 融合雷达与摄像头数据,设计二值化双流道路分割模型
  • 在两个数据集上达到顶尖精度,路径识别效率显著提升
  • 适合边缘部署,为自动驾驶地图构建提供轻量方案

先验全局拓扑地图(如OpenStreetMap, OSM)可显著提升地面机器人自主建图性能,但常因部分路径未标注而缺失。为此,本文提出一种基于低空飞机搭载机载传感器的OSM生成方法,核心是结合激光雷达与相机数据的新型高效路径探测算法——二值化双流道路分割模型。具体地,采用基于UNet架构的多尺度特征提取处理图像与点云数据;为缓解点云稀疏带来的影响,设计注意力引导的门控模块融合图像与点云特征;为优化模型在边缘设备上的部署能力,显著降低存储占用与计算需求,提出对每个模型组件进行二值化处理,包括图像分支中变体视觉变压器(ViT)编码器,并引入新的焦点损失与感知损失以优化训练。在两个数据集上的实验表明,该路径探测方法在从低层次机载传感器中提取路径时,实现了最先进的准确率与高效率,可基于分割出的道路骨架生成完整的先验OSM地图。代码与数据见:https://github.com/IMRL/Pathfinder。

原文摘要 · Abstract (English)

A prior global topological map (e.g., the OpenStreetMap, OSM) can boost the performance of autonomous mapping by a ground mobile robot. However, the prior map is usually incomplete due to lacking labeling in partial paths. To solve this problem, this paper proposes an OSM maker using airborne sensors carried by low-altitude aircraft, where the core of the OSM maker is a novel efficient pathfinder approach based on LiDAR and camera data, i.e., a binary dual-stream road segmentation model. Specifically, a multi-scale feature extraction based on the UNet architecture is implemented for images and point clouds. To reduce the effect caused by the sparsity of point cloud, an attention-guided gated block is designed to integrate image and point-cloud features. To optimize the model for edge deployment that significantly reduces storage footprint and computational demands, we propose a binarization streamline to each model component, including a variant of vision transformer (ViT) architecture as the encoder of the image branch, and new focal and perception losses to optimize the model training. The experimental results on two datasets demonstrate that our pathfinder method achieves SOTA accuracy with high efficiency in finding paths from the low-level airborne sensors, and we can create complete OSM prior maps based on the segmented road skeletons. Code and data are available at: \href{https://github.com/IMRL/Pathfinder}{https://github.com/IMRL/Pathfinder}.

道路分割边缘计算二值化无人机建图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。