提出TCLeaf-Net模型,提升田间植物叶片病害检测精度与鲁棒性
TCLeaf-Net: a transformer-convolution framework with global-local attention for robust in-field lesion-level plant leaf disease detection
- 融合Transformer与卷积的全局-局部注意力架构,抑制复杂背景干扰
- 在田间数据集上达到78.2% mAP@50,比基线提升5.4个百分点
- 适用于多种作物病害检测,适合实际农业场景部署
及时准确地检测叶部病害对保障作物生长、减少产量损失至关重要。然而,在真实田间条件下,复杂的背景、域偏移以及有限的病斑级数据集限制了模型的鲁棒性。为此,我们发布了Daylily-Leaf数据集,包含1,746张RGB图像和7,839个病斑,涵盖理想与田间两种条件,并提出了专为田间应用优化的TCLeaf-Net模型。该模型针对三大挑战:通过变换器-卷积模块(TCM)结合全局上下文与局部保留卷积,抑制非叶片区域干扰;通过原始尺度特征召回与采样(RSFRS)块,采用双线性重采样与卷积结合,保留精细空间细节;通过带可变形对齐的特征金字塔网络(DFPN),利用偏移对齐与多感受野感知,增强多尺度融合能力。实验表明,在Daylily-Leaf田间划分数据集上,TCLeaf-Net相较基线模型提升mAP@50 5.4个百分点至78.2%,同时降低7.5 GFLOPs计算量和8.7% GPU内存占用。此外,其在PlantDoc、Tomato-Leaf和Rice-Leaf数据集上均表现优异,验证了其在多种植物病害检测中的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Timely and accurate detection of foliar diseases is vital for safeguarding crop growth and reducing yield losses. Yet, in real-field conditions, cluttered backgrounds, domain shifts, and limited lesion-level datasets hinder robust modeling. To address these challenges, we release Daylily-Leaf, a paired lesion-level dataset comprising 1,746 RGB images and 7,839 lesions captured under both ideal and in-field conditions, and propose TCLeaf-Net, a transformer-convolution hybrid detector optimized for real-field use. TCLeaf-Net is designed to tackle three major challenges. To mitigate interference from complex backgrounds, the transformer-convolution module (TCM) couples global context with locality-preserving convolution to suppress non-leaf regions. To reduce information loss during downsampling, the raw-scale feature recalling and sampling (RSFRS) block combines bilinear resampling and convolution to preserve fine spatial detail. To handle variations in lesion scale and feature shifts, the deformable alignment block with FPN (DFPN) employs offset-based alignment and multi-receptive-field perception to strengthen multi-scale fusion. Experimental results show that on the in-field split of the Daylily-Leaf dataset, TCLeaf-Net improves mAP@50 by 5.4 percentage points over the baseline model, reaching 78.2\%, while reducing computation by 7.5 GFLOPs and GPU memory usage by 8.7\%. Moreover, the model outperforms recent YOLO and RT-DETR series in both precision and recall, and demonstrates strong performance on the PlantDoc, Tomato-Leaf, and Rice-Leaf datasets, validating its robustness and generalizability to other plant disease detection scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。