用混合模型提升大豆病叶识别准确率,还能解释判断依据。
Soybean Disease Detection via Interpretable Hybrid CNN-GNN: Integrating MobileNetV2 and GraphSAGE with Cross-Modal Attention
- 结合MobileNetV2与GraphSAGE,既抓局部病斑又建图像间关系图
- 在10类病害数据集上达97.16%准确率,远超单一模型
- 生成热力图可解释诊断结果,适合田间实时部署
大豆叶片疾病检测对农业产量至关重要,但因症状视觉相似且传统方法可解释性差而面临挑战。本文提出一种可解释的混合序列式CNN-GNN框架,融合MobileNetV2进行局部特征提取与GraphSAGE进行关系建模。通过余弦相似度构建图像节点图,采用自适应邻域采样捕捉细微病灶特征与全局症状模式,解决类别间相似性问题。利用Grad-CAM与Eigen-CAM实现跨模态可解释性,生成热力图标注影响疾病判断的区域。在包含十种大豆叶病的数据集上,模型达到97.16%准确率,显著优于独立CNN(≤95.04%)和传统机器学习模型(≤77.05%)。消融实验证明序列架构优于并行或单模型配置。仅230万参数的轻量级设计确保计算高效,支持资源受限环境下的实时部署。该方法兼顾高精度与实用性,为农业诊断提供可靠工具,并推动了植物病理学中CNN-GNN融合研究。
原文摘要 · Abstract (English)
Soybean leaf disease detection is critical for agricultural productivity but faces challenges due to visually similar symptoms and limited interpretability in conventional methods. While Convolutional Neural Networks (CNNs) excel in spatial feature extraction, they often neglect inter-image relational dependencies, leading to misclassifications. This paper proposes an interpretable hybrid Sequential CNN-Graph Neural Network (GNN) framework that synergizes MobileNetV2 for localized feature extraction and GraphSAGE for relational modeling. The framework constructs a graph where nodes represent leaf images, with edges defined by cosine similarity-based adjacency matrices and adaptive neighborhood sampling. This design captures fine-grained lesion features and global symptom patterns, addressing inter-class similarity challenges. Cross-modal interpretability is achieved via Grad-CAM and Eigen-CAM visualizations, generating heatmaps to highlight disease-influential regions. Evaluated on a dataset of ten soybean leaf diseases, the model achieves $97.16\%$ accuracy, surpassing standalone CNNs ($\le95.04\%$) and traditional machine learning models ($\le77.05\%$). Ablation studies validate the sequential architecture's superiority over parallel or single-model configurations. With only 2.3 million parameters, the lightweight MobileNetV2-GraphSAGE combination ensures computational efficiency, enabling real-time deployment in resource-constrained environments. The proposed approach bridges the gap between accurate classification and practical applicability, offering a robust, interpretable tool for agricultural diagnostics while advancing CNN-GNN integration in plant pathology research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。