arXiv:2604.09694cs.CV2026-04被引 2

融合图像、深度与边缘信息,提升无人机对细小障碍物的分割精度。

EDFNet: Early Fusion of Edge and Depth for Thin-Obstacle Segmentation in UAV Navigation

  • 早期融合RGB、深度与边缘三路信息,构建模块化分割框架。
  • 在DDOS数据集上实现0.244的细结构评分,边界交并比达0.234。
  • 适合需要高精度障碍物感知的无人机自主导航场景。

自主无人机需可靠检测电线、杆状物和枝条等细小障碍物以实现在真实环境中的安全飞行。这类结构因占据像素少、视觉对比弱且受类别不平衡影响大,难以被感知。现有分割方法多针对粗粒度障碍物,未能充分利用细结构感知所需的多模态互补线索。本文提出EDFNet,一种模块化早期融合分割框架,集成RGB、深度与边缘信息,用于复杂空中场景下的细障碍物感知。在包含十六种模态-骨干配置的无人机深度与障碍物分割(DDOS)数据集上进行评估,采用U-Net与DeepLabV3模型,涵盖预训练与非预训练设置。结果表明,早期RGB-深度-边缘融合提供了一个竞争性强且均衡的基准,尤其在边界敏感与召回导向指标上表现突出。预训练的RGBDE U-Net达到最佳整体性能:细结构评分0.244、平均交并比0.219、边界交并比0.234,同时在测试硬件上保持19.62 FPS的高效推理速度。然而,所有模型在最稀有的超细类别上表现仍较低,表明超细结构分割仍是开放挑战。总体而言,早期RGB-深度-边缘融合可作为无人机导航中细障碍物分割的实用且模块化基线。

原文摘要 · Abstract (English)

Autonomous Unmanned Aerial Vehicles (UAVs) must reliably detect thin obstacles such as wires, poles, and branches to navigate safely in real-world environments. These structures remain difficult to perceive because they occupy few pixels, often exhibit weak visual contrast, and are strongly affected by class imbalance. Existing segmentation methods primarily target coarser obstacles and do not fully exploit the complementary multimodal cues needed for thin-structure perception. We present EDFNet, a modular early-fusion segmentation framework that integrates RGB, depth, and edge information for thin-obstacle perception in cluttered aerial scenes. We evaluate EDFNet on the Drone Depth and Obstacle Segmentation (DDOS) dataset across sixteen modality-backbone configurations using U-Net and DeepLabV3 in pretrained and non-pretrained settings. The results show that early RGB-Depth-Edge fusion provides a competitive and well-balanced baseline, with the most consistent gains appearing in boundary-sensitive and recall-oriented metrics. The pretrained RGBDE U-Net achieves the best overall performance, with the highest Thin-Structure Evaluation Score (0.244), mean IoU (0.219), and boundary IoU (0.234), while maintaining competitive runtime performance (19.62 FPS) on our evaluation hardware. However, performance on the rarest ultra-thin categories remains low across all models, indicating that reliable ultra-thin segmentation is still an open challenge. Overall, these findings position early RGB-Depth-Edge fusion as a practical and modular baseline for thin-obstacle segmentation in UAV navigation.

障碍物分割无人机导航多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。