对比卷积与视觉变压器在无人机光伏板检测中的表现
Benchmarking CNN and Transformer-Based Object Detectors for UAV Solar Panel Inspection
- 针对类别不平衡问题设计了仅用于训练的增强策略
- ResNet50版Faster R-CNN在定位精度上最优,[email protected]达0.893
- 适合实际无人机部署,兼顾准确率与推理速度
及时准确地检测光伏系统中的缺陷和污染物对保障其效率与可靠性至关重要。尽管已有研究应用深度学习进行光伏板检测,但不同检测器架构间的公平比较以及类别不平衡的无偏处理仍不充分。本文对基于卷积神经网络和视觉变压器的物体检测器在无人机拍摄的太阳能板RGB图像上进行了全面基准测试。提出一种仅应用于训练集的类别目标增强策略,以缓解类别不平衡问题,同时保持评估完整性。评估模型包括采用ResNet50和MobileNetV3作为主干的Faster R-CNN、使用ResNet50的RetinaNet、YOLOv5、YOLOv8,以及集成于Faster R-CNN中的Swin Transformer(Tiny、Small、Base变体)。通过多个IoU阈值下的平均精度(mAP)、精确率、召回率、F1分数及推理吞吐量综合评估性能,支持面向无人机部署的准确率-吞吐量权衡分析。实验结果表明,采用ResNet50主干的Faster R-CNN取得最高定位精度,[email protected]为0.893,[email protected]:0.95为0.759;而MobileNetV3版本在整体可靠性上表现最佳,测试集上召回率为0.745,F1分数为0.809,准确率为0.679。数据集与代码将在论文接收后公开。
原文摘要 · Abstract (English)
Timely and accurate detection of defects and contaminants in solar panels is critical for maintaining the efficiency and reliability of photovoltaic (PV) systems. While recent studies have applied deep learning to PV inspection, fair benchmarking across detector architectures and unbiased handling of class imbalance remain limited. This work presents a comprehensive benchmark of convolutional and transformer-based object detectors on UAV-captured RGB imagery of solar panels. It introduces a class-targeted augmentation strategy applied exclusively to the training split to mitigate imbalance without compromising evaluation integrity. Faster R-CNN with ResNet50 and MobileNetV3 backbones, RetinaNet with ResNet50, YOLOv5, YOLOv8, and Swin Transformer backbones integrated with Faster R-CNN (Tiny, Small, and Base variants) are evaluated. Performance is assessed using mean Average Precision (mAP) across multiple IoU thresholds, precision, recall, F1 score, and inference throughput to enable accuracy-throughput tradeoff analysis relevant to UAV deployment. Experimental results show that Faster R-CNN with a ResNet50 backbone achieves the highest localization accuracy, with [email protected] of 0.893 and [email protected]:0.95 of 0.759, whereas the MobileNetV3 variant provides the best overall reliability balance, achieving recall of 0.745, F1-score of 0.809, and accuracy of 0.679 on the test set. The dataset and code will be released upon acceptance of the paper.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。