arXiv:2504.07252cs.CV2025-04CVPR被引 15

用少量标注数据让检测模型精准识别农作物目标,省时省力。

Few-Shot Adaptation of Grounding DINO for Agricultural Domain

  • 去掉文本编码器,用随机初始化的文本嵌入替代,简化模型结构。
  • 在农业数据上比全微调YOLO高24%的mAP,遥感任务超前代方法10%。
  • 适合农业领域小样本场景,加速专用模型开发,降低标注成本。

深度学习正推动农业应用发展,实现自动化表型分析、监测与产量估计。但其性能高度依赖大量标注数据,而数据标注耗时费力。近年来,开放集目标检测模型如Grounding-DINO可通过文本提示实现目标区域检测。然而零样本实验表明,复杂对象(如单片叶)和视觉相似类别难以构建有效提示。为此,我们提出一种高效的少样本适应方法:移除Grounding-DINO中的文本编码器(BERT),引入随机初始化可训练的文本嵌入。该方法在多个农业数据集上表现优异,涵盖作物杂草检测、植株计数、昆虫识别、果实计数及遥感任务。具体而言,在农业数据集上较全微调YOLO提升约24%的mAP,遥感任务优于先前最优方法约10%,且在少样本条件下表现突出。该方法为自动化标注和农业专用AI解决方案的快速开发提供了可行路径。

原文摘要 · Abstract (English)

Deep learning models are transforming agricultural applications by enabling automated phenotyping, monitoring, and yield estimation. However, their effectiveness heavily depends on large amounts of annotated training data, which can be labor and time intensive. Recent advances in open-set object detection, particularly with models like Grounding-DINO, offer a potential solution to detect regions of interests based on text prompt input. Initial zero-shot experiments revealed challenges in crafting effective text prompts, especially for complex objects like individual leaves and visually similar classes. To address these limitations, we propose an efficient few-shot adaptation method that simplifies the Grounding-DINO architecture by removing the text encoder module (BERT) and introducing a randomly initialized trainable text embedding. This method achieves superior performance across multiple agricultural datasets, including plant-weed detection, plant counting, insect identification, fruit counting, and remote sensing tasks. Specifically, it demonstrates up to a $\sim24\%$ higher mAP than fully fine-tuned YOLO models on agricultural datasets and outperforms previous state-of-the-art methods by $\sim10\%$ in remote sensing, under few-shot learning conditions. Our method offers a promising solution for automating annotation and accelerating the development of specialized agricultural AI solutions.

少样本学习目标检测农业AI文本提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。