对比七种轻量CNN在三数据集上的表现,找最优平衡点。
Comparative Analysis of Lightweight CNNs for Resource-Constrained Devices: Predictive Performance, Efficiency Trade-offs, and Initialization Effects
- 统一微调协议,公平比较七种轻量CNN
- EfficientNetV2-S精度最高,MobileNetV3-S最省资源
- 预训练对小数据集提升更大,适合资源受限场景
轻量卷积神经网络常因训练方法、输入设置和预训练检查点不同而难以直接比较。本研究在共享微调协议下,对七种主流CNN在CIFAR-10、CIFAR-100和Tiny ImageNet上进行受控基准测试。评估指标包括准确率、宏F1、参数量、FP32存储量及乘加操作数。EfficientNetV2-S在三个数据集上均取得最高精度,分别为97.57%、86.98%和78.73%。EfficientNet-B0精度仅低0.85个百分点,但参数量仅为其21%,乘加操作仅14%。MobileNetV3-Small在极低资源下表现优异,参数量为EfficientNet-B0的40%,乘加操作仅15%。对比ImageNet预训练与随机初始化模型发现,预训练优势在CIFAR-100和Tiny ImageNet上显著高于CIFAR-10。结果为多目标优化选型提供可靠参考。
原文摘要 · Abstract (English)
Lightweight convolutional neural networks are often compared using results obtained with different training recipes, input settings, and pretrained checkpoints. Such differences make architecture rankings difficult to interpret. This study presents a controlled benchmark of seven established CNNs across CIFAR-10, CIFAR-100, and Tiny ImageNet under a shared fine tuning protocol. The evaluation reports top-1 accuracy, macro F1, top-5 accuracy, parameter count, FP32 parameter storage, and multiply accumulate operations. EfficientNetV2-S records the highest observed top-1 accuracy on all three datasets, reaching 97.57%, 86.98%, and 78.73%. EfficientNet-B0 remains within 0.85 percentage points of EfficientNetV2-S across the three datasets while requiring only about 21% of its parameters and 14% of its multiply accumulate operations on Tiny ImageNet. It therefore offers a favorable general balance between predictive performance and computational demand. MobileNetV3-Small is a strong candidate for ultra low resource settings. It uses about 40% of the parameters and 15% of the multiply accumulate operations of EfficientNet-B0 while retaining competitive accuracy. A matched comparison of ImageNet pretrained and randomly initialized EfficientNet-B0 and MobileNetV3-Small models shows that the pretrained advantage is substantially larger on CIFAR-100 and Tiny ImageNet than on CIFAR-10 under the fixed protocol. The results provide a focused reference for selecting established lightweight CNNs when predictive quality, parameter storage, and theoretical computation must be considered together.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。