轻量级网络融合RGB-D数据,高效精准检测轨道缺陷。
LPCAN: Lightweight Pyramid Cross-Attention Network for Rail Surface Defect Detection Using RGB-D Data

- 用MobileNetv2+轻量金字塔模块处理多模态数据,降低计算开销。
- 仅990万参数下达到162.6帧/秒,各项指标优于18种现有方法。
- 跨模态注意力机制增强特征融合,适合工业实时质检场景。
本文针对现有视觉轨面缺陷检测方法存在的计算复杂度高、参数量大、精度不足等问题,提出一种基于RGB-D数据的轻量级金字塔交叉注意力网络(LPCANet)。该模型以MobileNetv2为骨干提取RGB特征,结合轻量级金字塔模块(LPM)处理深度信息,并通过交叉注意力机制(CAM)实现多模态融合,辅以空间特征提取器(SFE)增强结构分析能力。在三个无监督的RGB-D轨面数据集(NEU-RSDDS-AUG、RSDD-TYPE1、RSDD-TYPE2)上评估,LPCANet仅需990万参数、2.50 G FLOPs,推理速度达162.60 fps,性能超越18种已有方法,分别在$S_α$、IOU、MAE上提升+1.48%、+0.86%、+1.77%。消融实验证明了CAM与SFE的关键作用,非轨面数据集(DAGM2007、MT、Kolektor-SDD2)测试表明其具备良好泛化能力。该框架有效融合传统与深度学习方法,具有显著工业应用价值。未来将聚焦进一步模型压缩以支持实时部署。
原文摘要 · Abstract (English)
This paper addresses the limitations of current vision-based rail defect detection methods, including high computational complexity, excessive parameter counts, and suboptimal accuracy. We propose a Lightweight Pyramid Cross-Attention Network (LPCANet) that leverages RGB-D data for efficient and accurate defect identification. The architecture integrates MobileNetv2 as a backbone for RGB feature extraction with a lightweight pyramid module (LPM) for depth processing, coupled with a cross-attention mechanism (CAM) for multimodal fusion and a spatial feature extractor (SFE) for enhanced structural analysis. Comprehensive evaluations on three unsupervised RGB-D rail datasets (NEU-RSDDS-AUG, RSDD-TYPE1, RSDD-TYPE2) demonstrate that LPCANet achieves state-of-the-art performance with only 9.90 million parameters, 2.50 G FLOPs, and 162.60 fps inference speed. Compared to 18 existing methods, LPCANet shows significant improvements, including +1.48\% in $S_α$, +0.86\% in IOU, and +1.77\% in MAE over the best-performing baseline. Ablation studies confirm the critical roles of CAM and SFE, while experiments on non-rail datasets (DAGM2007, MT, Kolektor-SDD2) validate its generalization capability. The proposed framework effectively bridges traditional and deep learning approaches, offering substantial practical value for industrial defect inspection. Future work will focus on further model compression for real-time deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。