用无人机+双模态视觉检测结构损伤,精度达91%
Multi-visual modality micro drone-based structural damage detection
- 融合双DCNN输出生成动态视觉模态,提升感知能力
- 螺旋池化增强特征表示,平均精度达0.91
- 适合复杂环境下的桥梁、建筑等基础设施巡检
准确检测与鲁棒性是保障土木基础设施持续使用的关键。本研究提出DetectorX框架,结合微型无人机实现结构损伤检测。通过引入茎干模块和螺旋池化技术,利用双深度卷积神经网络(DCNN)输出生成动态视觉模态,并结合事件驱动的奖励强化学习约束主-子模型行为以获得奖励,从而在原有RGB数据基础上引入两种动态视觉模态。螺旋池化作为在线图像增强方法,通过拼接螺旋化、平均池化与最大池化特征,增强特征表达。在三项实验中:(1) 对比实验,(2) 鲁棒性测试,(3) 实地测试,基于太平洋地震工程研究中心图像数据集,DetectorX在多个指标上表现优异,包括精确率0.88、召回率0.84、平均精确率0.91、平均平均精度0.76、平均平均召回率0.73,优于YOLOX-m等现有检测器。结果表明,DetectorX在复杂环境下具备良好鲁棒性与检测性能。
原文摘要 · Abstract (English)
Accurate detection and resilience of object detectors in structural damage detection are important in ensuring the continuous use of civil infrastructure. However, achieving robustness in object detectors remains a persistent challenge, impacting their ability to generalize effectively. This study proposes DetectorX, a robust framework for structural damage detection coupled with a micro drone. DetectorX addresses the challenges of object detector robustness by incorporating two innovative modules: a stem block and a spiral pooling technique. The stem block introduces a dynamic visual modality by leveraging the outputs of two Deep Convolutional Neural Network (DCNN) models. The framework employs the proposed event-based reward reinforcement learning to constrain the actions of a parent and child DCNN model leading to a reward. This results in the induction of two dynamic visual modalities alongside the Red, Green, and Blue (RGB) data. This enhancement significantly augments DetectorX's perception and adaptability in diverse environmental situations. Further, a spiral pooling technique, an online image augmentation method, strengthens the framework by increasing feature representations by concatenating spiraled and average/max pooled features. In three extensive experiments: (1) comparative and (2) robustness, which use the Pacific Earthquake Engineering Research Hub ImageNet dataset, and (3) field-experiment, DetectorX performed satisfactorily across varying metrics, including precision (0.88), recall (0.84), average precision (0.91), mean average precision (0.76), and mean average recall (0.73), compared to the competing detectors including You Only Look Once X-medium (YOLOX-m) and others. The study's findings indicate that DetectorX can provide satisfactory results and demonstrate resilience in challenging environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。