arXiv:2509.20857cs.CVcs.AI2025-09被引 6

TasselNetV4实现跨物种、跨场景、跨尺度的植物计数,突破传统模型依赖特定物种的局限。

TasselNetV4: A vision foundation model for cross-scene, cross-scale, and cross-species plant counting

  • 融合局部计数与提取匹配思想,用多分支感知框增强跨尺度鲁棒性
  • 在PAC-105和PAC-Somalia数据集上超越现有最佳模型,计数精度显著提升
  • 可作为植物计数通用基础模型,适合农业育种与智能农作研究者

精准植物计数对作物产量预测、植株密度评估和表型量化具有重要价值。当前主流方法依赖检测或回归模型,针对特定植物种类。然而植物多样性高,新品种不断培育,难以为每类植物构建专用模型。受计算机视觉中无类别植物计数(CAC)启发,我们重新思考植物计数问题:从‘计什么’转向‘怎么计’。与具有时空不变性的日常物体不同,植物结构非刚性且随时间空间变化,导致现有CAC和开放世界检测模型性能不佳。本文在TasselNet基础上提出TasselNetV4,从物种特异性计数转向跨物种计数。它结合TasselNet的局部计数思想与CAC的提取-匹配范式,基于普通视觉变压器架构,引入新型多分支框感知局部计数器以增强跨尺度鲁棒性。构建了两个挑战性数据集PAC-105和PAC-Somalia。大量实验表明,TasselNetV4不仅计数性能优于当前先进CAC模型,还具备高效率。结果表明,TasselNetV4正成为面向跨场景、跨尺度、跨物种植物计数的视觉基础模型。

原文摘要 · Abstract (English)

Accurate plant counting provides valuable information for agriculture such as crop yield prediction, plant density assessment, and phenotype quantification. Vision-based approaches are currently the mainstream solution. Prior art typically uses a detection or a regression model to count a specific plant. However, plants have biodiversity, and new cultivars are increasingly bred each year. It is almost impossible to exhaust and build all species-dependent counting models. Inspired by class-agnostic counting (CAC) in computer vision, we argue that it is time to rethink the problem formulation of plant counting, from what plants to count to how to count plants. In contrast to most daily objects with spatial and temporal invariance, plants are dynamic, changing with time and space. Their non-rigid structure often leads to worse performance than counting rigid instances like heads and cars such that current CAC and open-world detection models are suboptimal to count plants. In this work, we inherit the vein of the TasselNet plant counting model and introduce a new extension, TasselNetV4, shifting from species-specific counting to cross-species counting. TasselNetV4 marries the local counting idea of TasselNet with the extract-and-match paradigm in CAC. It builds upon a plain vision transformer and incorporates novel multi-branch box-aware local counters used to enhance cross-scale robustness. Two challenging datasets, PAC-105 and PAC-Somalia, are harvested. Extensive experiments against state-of-the-art CAC models show that TasselNetV4 achieves not only superior counting performance but also high efficiency.Our results indicate that TasselNetV4 emerges to be a vision foundation model for cross-scene, cross-scale, and cross-species plant counting.

植物计数视觉基础模型跨物种农业AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。