轻量级模型在农业图像识别中实现高精度与低算力的平衡
Multi-objective hybrid knowledge distillation for efficient deep learning in smart agriculture
- 融合多种知识蒸馏策略,设计结合倒残差与密集连接的轻量学生模型
- 水稻品种识别准确率达98.56%,计算量仅为教师模型的1/2.7,参数量少于110万
- 适合部署在边缘设备的智能农业系统,尤其适用于资源受限场景
在智能农业中,将深度学习模型部署到计算资源受限的边缘设备仍面临效率与精度之间的权衡挑战。为此,本文提出一种混合式多目标知识蒸馏框架,用于构建轻量但高性能的卷积神经网络。所提方法设计了一种结合倒残差块与密集连接的定制化学生模型,并在ResNet18教师模型指导下,采用融合硬标签监督、特征级蒸馏、响应级蒸馏和自蒸馏的多目标策略进行训练。在包含九个品种的水稻种子识别数据集上开展实验,并扩展至水稻、马铃薯、咖啡和玉米四类植物叶片病害数据集,评估其泛化能力。在水稻种子分类任务中,学生模型达到98.56%的准确率,仅比教师模型(98.65%)低0.09%,而计算量仅需0.68 GFLOPs,参数量约107万,相比ResNet18教师模型计算成本降低约2.7倍,模型尺寸缩小超10倍。相较于主流预训练模型,该学生模型参数量较DenseNet121减少逾6倍,较Vision Transformer(ViT)架构减少超80倍,同时保持相当或更优的分类性能。在多个植物病害数据集上的一致优异表现,进一步验证了该框架在硬件受限的智能农业系统中的鲁棒性、高效性和强部署潜力。
原文摘要 · Abstract (English)
Deploying deep learning models on resource-constrained edge devices remains a major challenge in smart agriculture due to the trade-off between computational efficiency and recognition accuracy. To address this challenge, this study proposes a hybrid knowledge distillation framework for developing a lightweight yet high-performance convolutional neural network. The proposed approach designs a customized student model that combines inverted residual blocks with dense connectivity and trains it under the guidance of a ResNet18 teacher network using a multi-objective strategy that integrates hard-label supervision, feature-level distillation, response-level distillation, and self-distillation. Experiments are conducted on a rice seed variety identification dataset containing nine varieties and further extended to four plant leaf disease datasets, including rice, potato, coffee, and corn, to evaluate generalization capability. On the rice seed variety classification task, the distilled student model achieves an accuracy of 98.56%, which is only 0.09% lower than the teacher model (98.65%), while requiring only 0.68 GFLOPs and approximately 1.07 million parameters. This corresponds to a reduction of about 2.7 times in computational cost and more than 10 times in model size compared with the ResNet18 teacher model. In addition, compared with representative pretrained models, the proposed student reduces the number of parameters by more than 6 times relative to DenseNet121 and by over 80 times compared with the Vision Transformer (ViT) architecture, while maintaining comparable or superior classification accuracy. Consistent performance gains across multiple plant leaf disease datasets further demonstrate the robustness, efficiency, and strong deployment potential of the proposed framework for hardware-limited smart agriculture systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。