arXiv:2601.12122cs.RO2026-01

融合八叉树与高斯点云,实现农用机器人精准语义建图与作物表型分析。

OctoSplat: Hybrid OctoMap-Gaussian Splatting for Active Semantic Mapping and Phenotyping with Horticultural Robots

  • 用低分辨率八叉树规划视角,高斯点云融合几何光度语义信息重建场景。
  • 在噪声环境下水果识别F1分数翻倍,运行效率提升三倍,真实场景重建质量显著改善。
  • 适合农业机器人自主导航、果实计数与体积估算,尤其适用于温室环境。

农业场景的语义重建对表型分析和产量预估至关重要。传统人工扫描或固定摄像头方法效率低下,而仅依赖占用网格的主动建图又过于粗略,难以满足精确性状估计需求。为此,我们提出一种基于移动机械臂的主动3D重建框架,融合OctoMap与3D Gaussian Splatting,实现高效精准的目标感知建图。低分辨率OctoMap提供概率占据信息,用于智能视角选择与无碰撞路径规划;3D Gaussian Splatting则结合几何、光度与语义信息,优化3D高斯分布以实现高保真场景重建。我们进一步设计了抗分割与深度噪声的鲁棒建图策略,并引入背景剔除方法降低内存与计算开销。在模拟、实验室及真实温室场景中验证,框架在三种主流高斯点云基线模型上均表现一致提升。仿真中(有真值几何)相比0.01m分辨率的OctoMap,本方法在噪声条件下水果级F1分数翻倍,运行时间最多减少三分之二。在实验室与真实温室中,新视角合成质量持续提升,PSNR与mIoU分别提高最高1.5 dB与18%。重建的语义地图可支持果实计数与体积估算,准确率接近80%。

原文摘要 · Abstract (English)

Semantic reconstruction of agricultural scenes plays a vital role in tasks such as phenotyping and yield estimation. However, traditional approaches based on manual scanning or fixed camera setups remain a major bottleneck, while active-mapping methods based solely on occupancy grids are too coarse for accurate trait estimation. To address this gap, we propose an active 3D reconstruction framework for horticultural environments using a mobile manipulator. The system integrates OctoMap with 3D Gaussian Splatting to enable accurate and efficient target-aware mapping. A low-resolution OctoMap provides probabilistic occupancy information for informative viewpoint selection and collision-free planning, while 3D Gaussian Splatting leverages geometric, photometric, and semantic information to optimize 3D Gaussians for high-fidelity scene reconstruction. We further introduce a robust mapping strategy that mitigates semantic segmentation and depth noise, together with a background pruning method that reduces memory and computational cost. We validate our framework across simulated, laboratory, and real greenhouse scenes, showing consistent improvements across three state-of-the-art Gaussian Splatting backbones. In simulation, where ground-truth geometry is available, our approach outperforms occupancy-based mapping in both reconstruction accuracy and runtime efficiency: compared with a 0.01m-resolution OctoMap, it doubles the fruit-level F1 score under noisy conditions while achieving up to a threefold reduction in runtime. Beyond simulation, novel-view synthesis quality also improves consistently in laboratory and real greenhouse environments, with PSNR and mIoU improving by up to 1.5 dB and 18%, respectively. Finally, the reconstructed semantic maps enable fruit counting and volume estimation with accuracies approaching 80%.

语义建图农业机器人高斯点云表型分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。