arXiv:2506.01109cs.CVcs.AI2025-06

用语言引导3D点云计数,解决果园果实遮挡难题。

CountingFruit: Language-Guided 3D Fruit Counting with Semantic Gaussian Splatting

  • 基于自适应密度点阵重建果园场景,提升计算效率。
  • 语言过滤机制在无重训练下实现99.7%计数召回率。
  • 适合农业自动化中需精准计数与语义检索的场景。

由于严重遮挡、果实与周围结构语义混淆以及体素重建计算开销大,果园中精确的3D果实计数极具挑战。现有方法依赖多视角2D分割和密集体素采样,易累积融合误差且推理缓慢。本文提出FruitLangGS,一种语言引导的3D果实计数框架,采用半径感知剪枝与块状光栅化的自适应密度高斯点阵重建果园尺度场景,实现可扩展的3D表示。推理时,每个高斯点嵌入压缩的CLIP对齐语义向量,通过双阈值余弦相似度机制筛选与目标提示相关的高斯点,抑制常见干扰(如叶片),无需重训练或图像空间掩码。选定高斯点被采样为稠密点云并进行几何聚类以估计果实实例,在严重遮挡和视角变化下仍保持鲁棒性。在九个不同果园数据集上的实验表明,FruitLangGS在实例计数召回率上持续优于现有方法,在Pfuji-Size_Orch2018数据集上达到最高99.7%召回率。消融实验进一步验证语言条件语义嵌入与双阈值提示过滤对抑制干扰、提升遮挡条件下计数精度至关重要。该框架还可无需重训练实现提示驱动的3D语义检索,展示了语言引导3D感知在可扩展农业场景理解中的潜力。

原文摘要 · Abstract (English)

Accurate 3D fruit counting in orchards is challenging due to heavy occlusion, semantic ambiguity between fruits and surrounding structures, and the high computational cost of volumetric reconstruction. Existing pipelines often rely on multi-view 2D segmentation and dense volumetric sampling, which lead to accumulated fusion errors and slow inference. We introduce FruitLangGS, a language-guided 3D fruit counting framework that reconstructs orchard-scale scenes using an adaptive-density Gaussian Splatting pipeline with radius-aware pruning and tile-based rasterization, enabling scalable 3D representation. During inference, compressed CLIP-aligned semantic vectors embedded in each Gaussian are filtered via a dual-threshold cosine similarity mechanism, retrieving Gaussians relevant to target prompts while suppressing common distractors (e.g., foliage), without requiring retraining or image-space masks. The selected Gaussians are then sampled into dense point clouds and clustered geometrically to estimate fruit instances, remaining robust under severe occlusion and viewpoint variation. Experiments on nine different orchard-scale datasets demonstrate that FruitLangGS consistently outperforms existing pipelines in instance counting recall, avoiding multi-view segmentation fusion errors and achieving up to 99.7% recall on Pfuji-Size_Orch2018 orchard dataset. Ablation studies further confirm that language-conditioned semantic embedding and dual-threshold prompt filtering are essential for suppressing distractors and improving counting accuracy under heavy occlusion. Beyond fruit counting, the same framework enables prompt-driven 3D semantic retrieval without retraining, highlighting the potential of language-guided 3D perception for scalable agricultural scene understanding.

3D计数语言引导果园监测高斯点阵

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。