arXiv:2506.16563cs.CVcs.AI2025-06

用少量标注实现高精度实例分割,特别适合密集重叠的农业图像。

From Semantic To Instance: A Semi-Self-Supervised Learning Approach

  • 设计图像-掩码表示法,聚焦形状纹理,弱化颜色依赖。
  • 在小麦穗数据集上达到98.5% mAP@50,超越传统模型。
  • 适用于农业及其他密集物体场景,泛化性强。

实例分割在植物健康、生长和产量的自动化监测中至关重要。然而,构建大规模像素级标注数据集需大量人力,限制了深度学习在该领域的应用,尤其在农作物图像中密集重叠、自我遮挡的情况更为突出。为此,我们提出一种半自监督学习方法,仅需极少人工标注即可训练高性能实例分割模型。设计了GLMask图像-掩码表示,使模型关注形状、纹理和模式,减少对颜色特征的依赖;并构建从语义分割生成实例分割的流水线。该方法显著优于传统实例分割模型,在小麦穗实例分割任务上实现98.5% mAP@50,创下新纪录。同时在通用数据集Microsoft COCO上,mAP@50提升超过12.6%,表明其适用性不仅限于精准农业,还可推广至具有相似数据特征的其他领域。

原文摘要 · Abstract (English)

Instance segmentation is essential for applications such as automated monitoring of plant health, growth, and yield. However, extensive effort is required to create large-scale datasets with pixel-level annotations of each object instance for developing instance segmentation models that restrict the use of deep learning in these areas. This challenge is more significant in images with densely packed, self-occluded objects, which are common in agriculture. To address this challenge, we propose a semi-self-supervised learning approach that requires minimal manual annotation to develop a high-performing instance segmentation model. We design GLMask, an image-mask representation for the model to focus on shape, texture, and pattern while minimizing its dependence on color features. We develop a pipeline to generate semantic segmentation and then transform it into instance-level segmentation. The proposed approach substantially outperforms the conventional instance segmentation models, establishing a state-of-the-art wheat head instance segmentation model with mAP@50 of 98.5%. Additionally, we assessed the proposed methodology on the general-purpose Microsoft COCO dataset, achieving a significant performance improvement of over 12.6% mAP@50. This highlights that the utility of our proposed approach extends beyond precision agriculture and applies to other domains, specifically those with similar data characteristics.

实例分割半自监督农业视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。