arXiv:2512.20148cs.CVcs.RO2025-12

用3D高斯点阵重建果园,大幅减少苹果姿态标注工作量。

Enhancing annotations for 5D apple pose estimation through 3D Gaussian Splatting (3DGS)

  • 用3DGS重建果园场景,自动生成图像中的标注
  • 仅需105次人工标注即生成2.8万条训练数据,效率提升99.6%
  • 对遮挡率≤95%的果实训练效果最佳,F1达0.927

果园自动化面临环境差异大、遮挡严重等挑战,苹果姿态估计尤其困难,因花萼等关键点常被遮挡。现有方法虽不依赖关键点预测,但仍需其用于标注,导致标注耗时费力。由于遮挡,同一果实不同图像间常出现标注冲突或缺失。本文提出新流程:利用3D高斯点阵(3DGS)重建果园场景,简化标注,自动将标注投影至图像,并训练评估姿态估计模型。使用该流程,仅需105次人工标注即可生成28,191条训练标签,标注量减少99.6%。实验表明,在遮挡率≤95%的果实上训练性能最优,原始图像上中性F1得分为0.927,渲染图像上达0.970。调整训练集规模对模型性能影响小。最未遮挡果实的位置估计最优,遮挡越严重精度越差;且模型难以正确学习苹果朝向估计。

原文摘要 · Abstract (English)

Automating tasks in orchards is challenging because of the large amount of variation in the environment and occlusions. One of the challenges is apple pose estimation, where key points, such as the calyx, are often occluded. Recently developed pose estimation methods no longer rely on these key points, but still require them for annotations, making annotating challenging and time-consuming. Due to the abovementioned occlusions, there can be conflicting and missing annotations of the same fruit between different images. Novel 3D reconstruction methods can be used to simplify annotating and enlarge datasets. We propose a novel pipeline consisting of 3D Gaussian Splatting to reconstruct an orchard scene, simplified annotations, automated projection of the annotations to images, and the training and evaluation of a pose estimation method. Using our pipeline, 105 manual annotations were required to obtain 28,191 training labels, a reduction of 99.6%. Experimental results indicated that training with labels of fruits that are $\leq95\%$ occluded resulted in the best performance, with a neutral F1 score of 0.927 on the original images and 0.970 on the rendered images. Adjusting the size of the training dataset had small effects on the model performance in terms of F1 score and pose estimation accuracy. It was found that the least occluded fruits had the best position estimation, which worsened as the fruits became more occluded. It was also found that the tested pose estimation method was unable to correctly learn the orientation estimation of apples.

姿态估计3DGS农业视觉标注优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。