对比多种模型在孟加拉沥青坑数据集上的表现,验证了轻量模型的高效性。
A Comparative Performance Analysis of Classification and Segmentation Models on Bangladeshi Pothole Dataset
- 构建824样本的本地化沥青坑数据集,分类与分割任务分别增广10倍和4倍。
- 轻量模型如CCT、Swin Transformer等达到99%以上准确率和F1分数,媲美大型模型。
- 数据集在分割任务中实现67.54%的Dice系数与59.39%的IoU,具备实用价值。
本研究对多种分类与分割模型在自建的孟加拉国沥青坑数据集上进行了全面性能分析。该数据集包含824个样本,采集于达卡与博古拉街道,经四倍增广用于分割任务,十倍增广用于分类评估。测试了九种分类模型(CCT、CNN、INN、Swin Transformer、ConvMixer、VGG16、ResNet50、DenseNet201、Xception)及四种分割模型(U-Net、ResU-Net、U-Net++、Attention-Unet)。重点评估了计算开销低、推理快的轻量级模型。结果表明,轻量模型表现优异,常可媲美重型模型。数据增强显著提升所有模型性能。分类任务准确率与F1分数均超99%,分割任务达到最高67.54% Dice相似系数与59.39% IoU,整体性能与现有数据集相当或更优。
原文摘要 · Abstract (English)
The study involves a comprehensive performance analysis of popular classification and segmentation models, applied over a Bangladeshi pothole dataset, being developed by the authors of this research. This custom dataset of 824 samples, collected from the streets of Dhaka and Bogura performs competitively against the existing industrial and custom datasets utilized in the present literature. The dataset was further augmented four-fold for segmentation and ten-fold for classification evaluation. We tested nine classification models (CCT, CNN, INN, Swin Transformer, ConvMixer, VGG16, ResNet50, DenseNet201, and Xception) and four segmentation models (U-Net, ResU-Net, U-Net++, and Attention-Unet) over both the datasets. Among the classification models, lightweight models namely CCT, CNN, INN, Swin Transformer, and ConvMixer were emphasized due to their low computational requirements and faster prediction times. The lightweight models performed respectfully, oftentimes equating to the performance of heavyweight models. In addition, augmentation was found to enhance the performance of all the tested models. The experimental results exhibit that, our dataset performs on par or outperforms the similar classification models utilized in the existing literature, reaching accuracy and f1-scores over 99%. The dataset also performed on par with the existing datasets for segmentation, achieving model Dice Similarity Coefficient up to 67.54% and IoU scores up to 59.39%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。