arXiv:2609.03680cs.CVcs.RO2026-09

一键点击实现农业图像分割,大幅减少人工标注量。

DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data

论文配图:DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data
图 1 · 摘自论文原文
  • 仅需点击目标物体一次,自动生成伪标签。
  • 缺失50%点击仍保持70%以上分割精度。
  • 适合农业机器人数据标注,省时省力。

标注视觉数据集,尤其是分割任务,耗时且成本高昂,制约了农业机器人技术的发展。本文提出DropClick,一种点击引导的分割工具,通过单次点击生成伪标签,替代人工标注。该方法为半自动化设计,无需对场景中每个物体都进行点击,显著降低用户输入需求。我们在两个挑战性农业机器人数据集SB20(植物分割)和BUP20(果实分割)上评估该方法。DropClick仅在原始训练数据的5张图像上进行微调,即可部署为一键分割系统,在SB20和BUP20上分别达到70.0和72.6的mIoU。当50%点击丢失时,仍维持68.9和71.3的mIoU。通过将输出用于半监督训练Mask2Former模型,验证其作为伪标注的有效性:减少46.3%(SB20)和31.9%(BUP20)的用户输入,性能仅轻微下降至70.1 vs 70.7 AP50(SB20),BUP20无差异(均为77.0)。

原文摘要 · Abstract (English)

Labelling vision datasets, especially for segmentation tasks, is a laborious and costly process that stymies novel developments in agricultural robotics. In this paper, we present DropClick, a click-guided segmentation tool that simplifies the annotation process. Our system utilises single-click inputs on objects to generate pseudo-labels, which can replace manual annotations. DropClick stands out as it is a semi-automated approach and does not require a click for every object in the scene. It can therefore further reduce the required amount of user input drastically. We evaluate our method on two challenging agricultural robotic datasets, SB20 and BUP20 for plant and fruit segmentation, respectively. DropClick is first trained on a small subset of just 5 images from the original training data. This DropClick model can then be deployed as a one-click segmentation system and achieves comparable or higher performance than other one-click methods achieving an mIoU of 70.0 and 72.6 points, for SB20 and BUP20 respectively. DropClick then excels at maintaining high performance when clicks are not given (e.g. dropped); when 50% of the clicks are missing it still maintains an mIoU of 68.9 and 71.3 points, for SB20 and BUP20 respectively. We validate DropClick as a pseudo-labelling approach by taking its outputs to train a Mask2Former instance-based segmentation model in a semi-supervised manner. In this process, partially removing user input from DropClick yields similar high performance when compared to providing all clicks, at 70.1 vs 70.7 points AP50 for SB20 and no difference for BUP20 at 77.0 for both models; at the same time saving 46.3% of total input for SB20 and 31.9% for BUP20.

图像分割农业机器人一键标注伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。