用自适应温度+混合样本提升轻量模型农业识别精度
ATMS-KD: Adaptive Temperature and Mixed Sample Knowledge Distillation for a Lightweight Residual CNN in Agricultural Embedded Systems
- 结合自适应温度与混合样本增强知识蒸馏
- 轻量模型准确率达97.11%,比次优方法高1.6个百分点
- 适合资源受限的农田智能设备部署
本研究提出ATMS-KD(自适应温度与混合样本知识蒸馏)框架,用于在资源受限的农业环境中构建轻量级卷积神经网络模型。该框架将自适应温度调度与混合样本增强相结合,从一个包含570万参数的MobileNetV3 Large教师模型向三种轻量级残差CNN学生模型迁移知识:紧凑型(130万参数)、标准型(240万参数)和增强型(380万参数)。实验基于摩洛哥东南部达德斯绿洲采集的蔷薇科植物(Rosa damascena)图像数据集进行,涵盖多种环境条件下的成熟度分类任务。结果表明,采用ATMS-KD后,所有学生模型验证准确率均超过96.7%,显著优于直接训练方法(95%-96%)。该框架优于11种现有知识蒸馏方法,在紧凑型模型上达到97.11%准确率,较第二优方法提升1.60个百分点,同时保持最低推理延迟72.19毫秒。所有配置的知识保留率均超过99%,证明了在不同容量学生模型下均能实现高效知识迁移。
原文摘要 · Abstract (English)
This study proposes ATMS-KD (Adaptive Temperature and Mixed-Sample Knowledge Distillation), a novel framework for developing lightweight CNN models suitable for resource-constrained agricultural environments. The framework combines adaptive temperature scheduling with mixed-sample augmentation to transfer knowledge from a MobileNetV3 Large teacher model (5.7\,M parameters) to lightweight residual CNN students. Three student configurations were evaluated: Compact (1.3\,M parameters), Standard (2.4\,M parameters), and Enhanced (3.8\,M parameters). The dataset used in this study consists of images of \textit{Rosa damascena} (Damask rose) collected from agricultural fields in the Dades Oasis, southeastern Morocco, providing a realistic benchmark for agricultural computer vision applications under diverse environmental conditions. Experimental evaluation on the Damascena rose maturity classification dataset demonstrated significant improvements over direct training methods. All student models achieved validation accuracies exceeding 96.7\% with ATMS-KD compared to 95--96\% with direct training. The framework outperformed eleven established knowledge distillation methods, achieving 97.11\% accuracy with the compact model -- a 1.60 percentage point improvement over the second-best approach while maintaining the lowest inference latency of 72.19\,ms. Knowledge retention rates exceeded 99\% for all configurations, demonstrating effective knowledge transfer regardless of student model capacity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。