arXiv:2501.15547cs.CVcs.AI2025-01被引 7

轻量级CNN模型在保持高准确率的同时,参数仅1.4万,适合移动端部署。

Building Efficient Lightweight CNN Models

  • 双输入输出训练+渐进解冻,提升模型鲁棒性与收敛速度。
  • MNIST上达99%准确率,参数仅14,862,模型大小0.17MB。
  • 适合资源受限场景,如嵌入式设备或实时推理应用。

卷积神经网络(CNN)在图像分类中表现优异,但计算与内存开销大,难以在资源受限环境部署。本文提出一种构建轻量级CNN的方法,包含双输入输出训练和渐进解冻的迁移学习。双输入模型在原始与增强数据集上联合训练,提升鲁棒性;统一模型通过渐进解冻优化预训练特征,加速收敛并提升准确率。在手写数字MNIST、Fashion MNIST和CIFAR-10三个基准数据集上评估:MNIST上达到99%准确率,参数仅14,862,模型大小0.17MB;Fashion MNIST上为89%;CIFAR-10上为65%,参数低于20,000。模型推理速度快、延迟低,适用于实时应用。未来将探索更先进数据增强、架构扩展及任务泛化能力。

原文摘要 · Abstract (English)

Convolutional Neural Networks (CNNs) are pivotal in image classification tasks due to their robust feature extraction capabilities. However, their high computational and memory requirements pose challenges for deployment in resource-constrained environments. This paper introduces a methodology to construct lightweight CNNs while maintaining competitive accuracy. The approach integrates two stages of training; dual-input-output model and transfer learning with progressive unfreezing. The dual-input-output model train on original and augmented datasets, enhancing robustness. Progressive unfreezing is applied to the unified model to optimize pre-learned features during fine-tuning, enabling faster convergence and improved model accuracy. The methodology was evaluated on three benchmark datasets; handwritten digit MNIST, fashion MNIST, and CIFAR-10. The proposed model achieved a state-of-the-art accuracy of 99% on the handwritten digit MNIST and 89% on fashion MNIST, with only 14,862 parameters and a model size of 0.17 MB. While performance on CIFAR-10 was comparatively lower (65% with less than 20,00 parameters), the results highlight the scalability of this method. The final model demonstrated fast inference times and low latency, making it suitable for real-time applications. Future directions include exploring advanced augmentation techniques, improving architectural scalability for complex datasets, and extending the methodology to tasks beyond classification. This research underscores the potential for creating efficient, scalable, and task-specific CNNs for diverse applications.

轻量级模型CNN高效部署迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。