用原型学习+注意力机制,小样本分割管道缺陷,效果显著提升。
Attention-Enhanced Prototypical Learning for Few-Shot Infrastructure Defect Segmentation
- 用自适应特征金字塔网络提取多尺度特征,高效处理小样本数据。
- 8类5样本下达82.55%准确率,2类测试时mIoU达72.26%。
- 引入多种注意力机制,适合快速部署新缺陷检测场景。
少样本语义分割对深度学习驱动的基础设施检测至关重要,因标注数据稀缺且昂贵。现有框架虽表现良好,但仍需大量标注数据,且难以在少量样本下学习新缺陷类别。本文提出增强型特征金字塔网络(E-FPN)框架,用于管渠和污水管缺陷的少样本分割。主要贡献包括:(1) 采用InceptionSepConv与深度可分离卷积的自适应编码器,实现高效多尺度特征提取;(2) 基于掩码平均池化生成强原型,从少量支持样本中学习;(3) 引入全局自注意力、局部自注意力与跨注意力机制优化特征表示。在挑战性基础设施检测数据集上的实验表明,该方法在8类5样本训练配置下达到82.55% F1-score与72.26% mIoU(2类分类测试),自注意力机制相较基线提升2.57% F1-score与2.9% mIoU。本框架解决了基础设施检测系统面对新缺陷类型时快速响应的需求,以极少新数据实现更高效经济的维护方案。
原文摘要 · Abstract (English)
Few-shot semantic segmentation is vital for deep learning-based infrastructure inspection applications, where labeled training examples are scarce and expensive. Although existing deep learning frameworks perform well, the need for extensive labeled datasets and the inability to learn new defect categories with little data are problematic. We present our Enhanced Feature Pyramid Network (E-FPN) framework for few-shot semantic segmentation of culvert and sewer defect categories using a prototypical learning framework. Our approach has three main contributions: (1) adaptive E-FPN encoder using InceptionSepConv blocks and depth-wise separable convolutions for efficient multi-scale feature extraction; (2) prototypical learning with masked average pooling for powerful prototype generation from small support examples; and (3) attention-based feature representation through global self-attention, local self-attention and cross-attention. Comprehensive experimentation on challenging infrastructure inspection datasets illustrates that the method achieves excellent few-shot performance, with the best configuration being 8-way 5-shot training configuration at 82.55% F1-score and 72.26% mIoU in 2-way classification testing. The self-attention method had the most significant performance improvements, providing 2.57% F1-score and 2.9% mIoU gain over baselines. Our framework addresses the critical need to rapidly respond to new defect types in infrastructure inspection systems with limited new training data that lead to more efficient and economical maintenance plans for critical infrastructure systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。