用强化学习让AI像昆虫学家一样分析害虫形态特征。
Pest-Thinker: Learning to Think and Reason like Entomologists via Reinforcement Learning

- 构建两个高精度害虫数据集,生成带思维链的标注用于模型训练。
- 通过新型特征奖励机制,使模型聚焦可观察的形态证据,准确率显著提升。
- 适合农业智能诊断、计算机视觉与多模态模型研究者使用。
作物害虫造成的损失严重威胁全球粮食安全与可持续农业发展。尽管多模态大语言模型在视觉理解方面表现强劲,但其在害虫识别中的应用受限于物种间复杂性高、种内变异大及专家标注数据稀缺等挑战。本文提出Pest-Thinker,一种基于知识驱动的强化学习框架,使MLLMs能对细粒度害虫形态进行推理。我们构建了两个高清害虫基准数据集:QFSD与AgriInsect,涵盖多种物种并包含专家标注的形态特征。利用这些数据,我们合成思维链(CoT)推理轨迹,通过监督微调(SFT)引导模型学习害虫特异性视觉线索。随后,采用组相对策略优化(GRPO)并引入新型特征奖励,由大模型作为裁判评估可观察形态证据,引导模型聚焦关键特征。大量实验表明,Pest-Thinker显著提升了域内与跨域形态理解能力,迈向智能农业害虫分析的专家级视觉推理水平。数据集与源码将在录用后公开。
原文摘要 · Abstract (English)
Pest-induced crop losses pose a major threat to global food security and sustainable agricultural development. While recent advances in Multimodal Large Language Models (MLLMs) have shown strong potential for visual understanding and smart agriculture, their direct application to pest recognition remains limited due to the domain's unique challenges such as high inter-species complexity, intra-species variability, and the scarcity of expert-annotated data. In this work, we introduce Pest-Thinker, a knowledge-driven reinforcement learning (RL) framework that enables MLLMs to reason over fine-grained pest morphology. We first construct two high-definition pest benchmarks, QFSD and AgriInsect, comprising diverse species and expert-annotated morphological traits. Leveraging these datasets, we synthesize Chain-of-Thought (CoT) reasoning trajectories to facilitate structured learning of pest-specific visual cues through Supervised Fine-Tuning (SFT). Subsequently, we employ Group Relative Policy Optimization (GRPO) with a novel feature reward that guides the model to focus on observable morphological evidence, assessed by an LLM-as-a-Judge strategy. Extensive experiments demonstrate that Pest-Thinker substantially improves both in-domain and out-of-domain morphological understanding, marking a step toward expert-level visual reasoning for intelligent agricultural pest analysis. The datasets and source code are available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。