融合两种热成像模态,提升缺陷分割与深度估计精度
Multi-Modal Attention Networks for Enhanced Segmentation and Depth Estimation of Subsurface Defects in Pulse Thermography
- 用注意力机制融合PCA与TSR两种热成像特征
- 在Laval IRT-PVC数据集上准确率比现有模型高10%
- 适合做无损检测中深层缺陷分析的研究者
基于AI的脉冲热成像(PT)已成为非破坏性检测(NDT)的关键工具,可自动识别工业部件中的隐藏异常。当前先进方法将压缩后的PT序列输入分割与深度估计网络,分别采用主成分分析(PCA)或热信号重建(TSR)。但独立处理两种模态限制了模型性能,因二者具有互补语义信息。为此,本文提出PT-Fusion,一种基于多模态注意力的融合网络,同时利用PCA与TSR模态进行缺陷分割与深度估计。该方法引入新型特征融合模块:编码器注意力融合门(EAFG)和注意力增强解码块(AEDB),以提升特征融合效果。此外,提出一种基于热成像序列随机采样的新数据增强技术,缓解PT数据集稀缺问题。在Université Laval IRT-PVC数据集上,相比U-Net、注意力U-Net及3D-CNN等先进模型,PT-Fusion在缺陷分割与深度估计精度上均提升10%。
原文摘要 · Abstract (English)
AI-driven pulse thermography (PT) has become a crucial tool in non-destructive testing (NDT), enabling automatic detection of hidden anomalies in various industrial components. Current state-of-the-art techniques feed segmentation and depth estimation networks compressed PT sequences using either Principal Component Analysis (PCA) or Thermographic Signal Reconstruction (TSR). However, treating these two modalities independently constrains the performance of PT inspection models as these representations possess complementary semantic features. To address this limitation, this work proposes PT-Fusion, a multi-modal attention-based fusion network that fuses both PCA and TSR modalities for defect segmentation and depth estimation of subsurface defects in PT setups. PT-Fusion introduces novel feature fusion modules, Encoder Attention Fusion Gate (EAFG) and Attention Enhanced Decoding Block (AEDB), to fuse PCA and TSR features for enhanced segmentation and depth estimation of subsurface defects. In addition, a novel data augmentation technique is proposed based on random data sampling from thermographic sequences to alleviate the scarcity of PT datasets. The proposed method is benchmarked against state-of-the-art PT inspection models, including U-Net, attention U-Net, and 3D-CNN on the Université Laval IRT-PVC dataset. The results demonstrate that PT-Fusion outperforms the aforementioned models in defect segmentation and depth estimation accuracies with a margin of 10%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。