arXiv:2412.06211cs.CVcs.AI2024-12被引 2

用视觉Mamba和超分辨率融合多光谱图像,提升裂缝检测精度。

MSCrackMamba: Leveraging Vision Mamba for Crack Detection in Fused Multispectral Imagery

  • 先超分辨率对齐红外与可见光图像,再用Vision Mamba主干网络建模
  • 在Crack900数据集上mIoU提升3.55%,优于现有最佳方法
  • 适合需要高精度裂缝检测的基础设施智能巡检场景

裂缝检测是结构健康监测的关键任务,用于评估桥梁、建筑和道路的结构完整性以防止潜在故障。基于视觉的裂缝检测因实现简便且有效,已成为主流方法。将红外(IR)通道与红绿蓝(RGB)通道融合可增强特征表示,从而提升检测效果。然而,IR与RGB通道常存在分辨率差异,通常需将高分辨率的RGB图像下采样以匹配红外图像分辨率,导致细节丢失。此外,传统图像分割网络受限于有限的感受野和高计算复杂度,影响检测性能。受近期提出的Mamba神经架构启发,本文提出一种两阶段框架MSCrackMamba,结合超分辨率网络与Vision Mamba,解决上述问题。具体而言,首先对红外通道进行超分辨率处理,使其与RGB通道分辨率对齐,实现数据融合;随后采用Vision Mamba作为主干网络,UperNet作为解码器进行裂缝检测。该方法在大规模裂缝检测数据集Crack900上验证,mIoU相比最优基线方法提升3.55%。

原文摘要 · Abstract (English)

Crack detection is a critical task in structural health monitoring, aimed at assessing the structural integrity of bridges, buildings, and roads to prevent potential failures. Vision-based crack detection has become the mainstream approach due to its ease of implementation and effectiveness. Fusing infrared (IR) channels with red, green and blue (RGB) channels can enhance feature representation and thus improve crack detection. However, IR and RGB channels often differ in resolution. To align them, higher-resolution RGB images typically need to be downsampled to match the IR image resolution, which leads to the loss of fine details. Moreover, crack detection performance is restricted by the limited receptive fields and high computational complexity of traditional image segmentation networks. Inspired by the recently proposed Mamba neural architecture, this study introduces a two-stage paradigm called MSCrackMamba, which leverages Vision Mamba along with a super-resolution network to address these challenges. Specifically, to align IR and RGB channels, we first apply super-resolution to IR channels to match the resolution of RGB channels for data fusion. Vision Mamba is then adopted as the backbone network, while UperNet is employed as the decoder for crack detection. Our approach is validated on the large-scale Crack Detection dataset Crack900, demonstrating an improvement of 3.55% in mIoU compared to the best-performing baseline methods.

裂缝检测视觉Mamba多光谱融合超分辨率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。