用轻量级网络先分类再超分辨,提升裂缝检测效率与精度
Deep Learning Framework for Infrastructure Maintenance: Crack Detection and High-Resolution Imaging of Infrastructure Surfaces
- 先用CNN分类正负样本,只对有裂缝图像做超分辨
- ESPCNN比双三次插值在所有指标上表现更好,分辨率显著提升
- 适合需要高效、低误报的公路设施巡检场景
近年来,无人机搭载摄像头传感器的数据采集平台在基础设施资产管理中广泛应用。然而,传感器特性、靠近结构的距离、难以到达的位置及环境条件常导致数据集分辨率低下。少数研究采用超分辨率技术解决低分辨率问题,但这些方法因对所有图像(含正负样本)进行处理,导致计算成本上升和误报增多。为此,本研究提出一个包含卷积神经网络(CNN)与轻量级子像素卷积神经网络(ESPCNN)的框架。CNN准确区分正负样本;仅对正样本使用ESPCNN进行超分辨率重建。ESPCNN在所有评估指标上均优于双三次插值。结合结果表明,该框架能有效预处理无损伤图像,降低后续超分辨率的计算开销与误报率。视觉评估显示,ESPCNN可清晰捕捉裂纹扩展路径及微小裂纹的复杂几何形态。该框架有望帮助公路管理部门实现更精准的病害检测与高效资产运维。
原文摘要 · Abstract (English)
Recently, there has been an impetus for the application of cutting-edge data collection platforms such as drones mounted with camera sensors for infrastructure asset management. However, the sensor characteristics, proximity to the structure, hard-to-reach access, and environmental conditions often limit the resolution of the datasets. A few studies used super-resolution techniques to address the problem of low-resolution images. Nevertheless, these techniques were observed to increase computational cost and false alarms of distress detection due to the consideration of all the infrastructure images i.e., positive and negative distress classes. In order to address the pre-processing of false alarm and achieve efficient super-resolution, this study developed a framework consisting of convolutional neural network (CNN) and efficient sub-pixel convolutional neural network (ESPCNN). CNN accurately classified both the classes. ESPCNN, which is the lightweight super-resolution technique, generated high-resolution infrastructure image of positive distress obtained from CNN. The ESPCNN outperformed bicubic interpolation in all the evaluation metrics for super-resolution. Based on the performance metrics, the combination of CNN and ESPCNN was observed to be effective in preprocessing the infrastructure images with negative distress, reducing the computational cost and false alarms in the next step of super-resolution. The visual inspection showed that EPSCNN is able to capture crack propagation, complex geometry of even minor cracks. The proposed framework is expected to help the highway agencies in accurately performing distress detection and assist in efficient asset management practices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。