arXiv:2501.15099cs.CVcs.LG2025-01被引 2

融合可见光与红外图像,提升复杂环境下输电线路检测精度

Bringing RGB and IR Together: Hierarchical Multi-Modal Enhancement for Robust Transmission Line Detection

  • 分层融合RGB与IR特征,逐级增强多模态信息
  • 在多种天气下误检率降低,边界识别更清晰
  • 适合无人机边缘计算场景的轻量化检测应用

保障农村地区稳定供电依赖于对电力设备尤其是输电线路(TLs)的有效巡检。然而,在航空影像中检测输电线路时,可见光(RGB)与红外(IR)图像间的配准偏差,以及卷积网络中高层与低层特征的不匹配,带来了挑战。为此,我们提出一种新型分层多模态增强网络(HMMEN),通过融合RGB与IR数据实现鲁棒、精准的输电线路检测。方法包含两个关键组件:(1) 相互多模态增强块(MMEB),以粗到精的方式融合并增强层级化的RGB与IR特征图;(2) 特征对齐块(FAB),利用可变形卷积修正解码器输出与红外特征图间的错位。采用基于MobileNet的编码器处理双路输入,满足边缘计算约束并降低计算开销。在雾、夜间、雪天和白天等多种复杂气象条件下的实验表明,本方法显著优于当前最优技术,有效减少误报,提升边界分割质量,整体检测性能更优。该框架为无人机开展大规模实际输电线路巡检提供了可行方案。

原文摘要 · Abstract (English)

Ensuring a stable power supply in rural areas relies heavily on effective inspection of power equipment, particularly transmission lines (TLs). However, detecting TLs from aerial imagery can be challenging when dealing with misalignments between visible light (RGB) and infrared (IR) images, as well as mismatched high- and low-level features in convolutional networks. To address these limitations, we propose a novel Hierarchical Multi-Modal Enhancement Network (HMMEN) that integrates RGB and IR data for robust and accurate TL detection. Our method introduces two key components: (1) a Mutual Multi-Modal Enhanced Block (MMEB), which fuses and enhances hierarchical RGB and IR feature maps in a coarse-to-fine manner, and (2) a Feature Alignment Block (FAB) that corrects misalignments between decoder outputs and IR feature maps by leveraging deformable convolutions. We employ MobileNet-based encoders for both RGB and IR inputs to accommodate edge-computing constraints and reduce computational overhead. Experimental results on diverse weather and lighting conditionsfog, night, snow, and daytimedemonstrate the superiority and robustness of our approach compared to state-of-the-art methods, resulting in fewer false positives, enhanced boundary delineation, and better overall detection performance. This framework thus shows promise for practical large-scale power line inspections with unmanned aerial vehicles.

输电线路检测多模态融合边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。