arXiv:2512.20113cs.CVeess.IV2025-12

融合雷达与红外数据,用注意力机制提升桥梁脱层检测精度

Attention Fusion for Bridge Deck Delamination Detection

  • 用分层注意力融合GPR和IRT数据,实现深层与浅层缺陷协同识别
  • 模型仅0.53万参数,且可解析各模块的容量分布与不确定性估计
  • 揭示了数据不平衡如何影响注意力权重,适合桥梁检测等小样本场景

钢筋混凝土桥面板内部脱层难以通过常规目视检查发现。目前主要检测手段中,探地雷达(GPR)虽能深入探测但近表面性能下降,红外热成像(IRT)可分辨浅层缺陷却无法穿透深层结构。本文提出一种基于分层注意力的多模态融合框架:对GPR A-scan采用时间自注意力,对IRT图像块使用通道-空间注意力,并引入带可学习模态嵌入的跨模态多头注意力,结合分解式随机/认知不确定性估计。模型轻量,约0.53万参数,且具备闭式容量分析能力。进一步提供基础形式化分析:两令牌跨模态注意力等价于每样本的可学习门控单元;梯度分配论证表明类别不平衡会抑制少数类信号,损失重加权以牺牲梯度方差为代价缓解该问题;多数类崩溃下的指标下界揭示了排序型指标(如AUC)与阈值型指标(如F1)的诊断差异。分析提示,因特征选择策略为学习所得,自适应加权融合可能在实际桥面检测的严重类别不平衡下尤为脆弱,具体影响有待实证验证。

原文摘要 · Abstract (English)

Subsurface delaminations in reinforced concrete bridge decks escape conventional visual inspection, and the two principal sensing techniques used to find them are individually incomplete: Ground Penetrating Radar (GPR) penetrates deeply but degrades near the surface, while Infrared Thermography (IRT) resolves shallow defects but cannot reach deeper structure. This paper presents a framework for fusing the two modalities through hierarchical attention: temporal self-attention over GPR A-scans, channel-spatial attention over IRT patches, and cross-modal multi-head attention with learnable modality embeddings, coupled with decomposed aleatoric/epistemic uncertainty estimation. Beyond the architecture itself, which is lightweight at approximately 0.53M parameters with a closed-form accounting of where capacity resides, we contribute an elementary formal analysis. Two-token cross-modal attention is shown to be exactly a bank of per-sample learned gates; a gradient-allocation proposition quantifies how class imbalance starves attention parameters of minority-class signal and how loss reweighting trades that starvation for gradient variance; and closed-form metric floors under majority-class collapse anchor a diagnostic divergence between ranking metrics (AUC) and thresholded metrics (F1). The analysis suggests that adaptively weighted fusion, precisely because its feature-selection policy is learned, may be distinctively vulnerable to the severe class imbalance typical of operational bridge decks; establishing whether and when this occurs is deferred to empirical evaluation.

缺陷检测多模态融合注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。