arXiv:2603.14309cs.CV2026-03

无需人工标注,用激光扫描点云实现田间小麦穗的3D实例分割。

In-Field 3D Wheat Head Instance Segmentation From TLS Point Clouds Using Deep Learning Without Manual Labels

  • 两阶段流程:先用多视角投影和零样本分割生成初始候选,再用伪标签训练3D分割网络。
  • 在无标注情况下达到可接受性能,优于基于图像的现有方法(如Wheat3DGS)。
  • 适合农业表型分析等复杂场景,可推广至其他激光点云分割任务。

激光扫描(LiDAR)点云的3D实例分割在多个遥感领域仍具挑战性。现有成功方案通常依赖监督学习与人工标注,因而局限于可通过视觉判断并人工标注的物体。然而,在田间作物表型等更复杂、杂乱的场景中,此类方法往往不可行。本研究直接从地面激光扫描(TLS)点云中解决田间小麦穗的实例分割问题。为克服标注难题,提出一种新型两阶段流程:第一阶段通过3D到2D多视角投影,结合Grounded SAM的零样本2D中心分割与多视角标签融合,获取初始3D实例候选;第二阶段利用这些初始候选作为噪声伪标签,训练一个监督式3D全景风格分割神经网络。结果表明该方法可行,并在性能上优于近期基于多视角RGB图像与3D高斯溅射的Wheat3DGS方案,证明了TLS作为替代传感方式的竞争力。此外,两个阶段均能在无手动标注下提供可用的3D实例分割,显示出向其他类似TLS点云分割任务低投入迁移的潜力。

原文摘要 · Abstract (English)

3D instance segmentation for laser scanning (LiDAR) point clouds remains a challenge in many remote sensing-related domains. Successful solutions typically rely on supervised deep learning and manual annotations, and consequently focus on objects that can be well delineated through visual inspection and manual labeling of point clouds. However, for tasks with more complex and cluttered scenes, such as in-field plant phenotyping in agriculture, such approaches are often infeasible. In this study, we tackle the task of in-field wheat head instance segmentation directly from terrestrial laser scanning (TLS) point clouds. To address the problem and circumvent the need for manual annotations, we propose a novel two-stage pipeline. To obtain the initial 3D instance proposals, the first stage uses 3D-to-2D multi-view projections, the Grounded SAM pipeline for zero-shot 2D object-centric segmentation, and multi-view label fusion. The second stage uses these initial proposals as noisy pseudo-labels to train a supervised 3D panoptic-style segmentation neural network. Our results demonstrate the feasibility of the proposed approach and show performance improvementsrelative to Wheat3DGS, a recent alternative solution for in-field wheat head instance segmentation without manual 3D annotations based on multi-view RGB images and 3D Gaussian Splatting, showcasing TLS as a competitive sensing alternative. Moreover, the results show that both stages of the proposed pipeline can deliver usable 3D instance segmentation without manual annotations, indicating promising, low-effort transferability to other comparable TLS-based point cloud segmentation tasks.

3D分割农业表型激光扫描无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。