arXiv:2609.05334cs.CVcs.AI2026-09

轻量化视觉变压器压缩,让田间设备也能精准识别辣椒病害。

Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions

论文配图:Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions
图 1 · 摘自论文原文
  • 联合使用剪枝、量化与知识蒸馏,统一优化模型大小与精度。
  • 在真实农田数据上实现95.13%准确率,模型缩小至6.01MB(原327MB)。
  • 适合资源受限的农业边缘设备部署,尤其适用于田间移动端诊断。

辣椒(Capsicum annuum)是印度最具经济价值的作物之一,但其产量长期受难以识别的病害威胁。尽管视觉变压器(ViTs)已实现高分类精度,但其庞大的计算开销使其在资源受限设备上部署困难。现有压缩方法通常孤立地处理剪枝、量化与知识蒸馏,未充分探索三者协同潜力。本文提出一种统一的视觉变压器压缩框架,结合基于二阶敏感性估计的赫森平衡自适应块剪枝(H-BAC)、量化及基于注意力的知识蒸馏。通过独立消融实验系统筛选各技术最优配置后,构建面向实际农业约束的级联部署流程。在包含真实跨村、跨设备分布外测试集的辣椒三类村庄分割数据集上,压缩模型达到或超过95.13%的FP32基线准确率,模型大小减少74%-98%;全集成管道实现54.5倍压缩(327.42MB → 6.01MB),在四组配置中保持95.13±2.32%准确率。直接对比显示,同等规模(6.01MB INT8)无剪枝与蒸馏的直接训练学生模型达94.87%准确率,表明当前阶段剪枝与蒸馏的增益有限。

原文摘要 · Abstract (English)

Chilli (Capsicum annuum) is one of India's most economically significant crops, yet its productivity is persistently threatened by diseases that are difficult to identify without expert intervention. While Vision Transformers (ViTs) have achieved high classification accuracy, their large computational footprint makes deployment on resource constrained devices challenging. Existing compression approaches typically address pruning, quantization, and knowledge distillation in isolation, leaving the potential benefits and interactions of their combined application insufficiently explored. We propose a unified Vision Transformer compression framework that combines Hessian-Balanced Adaptive Block Pruning (H-BAC), guided by second-order sensitivity estimation, with quantization and attention-based knowledge distillation. To systematically identify the most effective configuration within each compression family, each technique is first evaluated independently through controlled ablation studies, after which the best-performing components are integrated into a sequential deployment pipeline tailored to real-world agricultural constraints. On a chilli 3-class village-split dataset with a genuine cross-village, cross-device out-of-distribution test split, the resulting compressed models match or exceed the 95.13% FP32 baseline's accuracy, alongside 74-98% model size reduction, and the fully integrated compression pipeline achieves a 54.5x size reduction (327.42 MB to 6.01 MB) at 95.13 +/- 2.32% accuracy across four tested configurations. A direct comparison further reveals that, on this dataset, a directly-trained student of the same final size, without pruning or distillation, reaches comparable accuracy of 94.87%, at the same 6.01 MB INT8 size, indicating where H-BAC and knowledge distillation are, and are not yet shown to be, worth their computational cost.

视觉变压器模型压缩农业检测边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。