arXiv:2508.00900cs.ROcs.AI2025-08

用仿真数据训练机器人精准定位玫瑰花心,提升采摘效率。

Sparse 3D Perception for Rose Harvesting Robots: A Two-Stage Approach Bridging Simulation and Real-World Applications

  • 两阶段算法:先2D检测花心,再用轻量网络估计深度。
  • 真实场景检测F1达74.4%,2米距离深度误差仅3%。
  • 适合农业机器人研发者,解决标注数据少的难题。

随着人口增长,药用植物如大马士革玫瑰的需求激增,但人工采摘仍是规模化生产的瓶颈。为此,我们提出一种专为花朵采摘机器人设计的3D感知流水线,聚焦玫瑰中心的稀疏3D定位。该两阶段算法首先在双目图像上进行基于点的2D检测,随后利用轻量级深度神经网络估计深度。为应对真实世界标注数据稀缺的问题,我们通过Blender生成了逼真的合成数据集,模拟动态玫瑰农场环境并提供精确3D标注,显著降低人工标注成本,同时支持模型稳健训练。我们对比了传统三角测量方法与所提出的深度学习框架,结果表明新方法表现更优:2D检测在合成数据上F1得分为95.6%,真实数据上为74.4%;在合成数据中,2米距离下的深度估计误差仅为3%。该流水线计算高效,适配资源受限的机器人系统。通过弥合仿真与真实数据间的域差距,本工作推动了特种作物的农业自动化,为精准采摘提供可扩展解决方案。

原文摘要 · Abstract (English)

The global demand for medicinal plants, such as Damask roses, has surged with population growth, yet labor-intensive harvesting remains a bottleneck for scalability. To address this, we propose a novel 3D perception pipeline tailored for flower-harvesting robots, focusing on sparse 3D localization of rose centers. Our two-stage algorithm first performs 2D point-based detection on stereo images, followed by depth estimation using a lightweight deep neural network. To overcome the challenge of scarce real-world labeled data, we introduce a photorealistic synthetic dataset generated via Blender, simulating a dynamic rose farm environment with precise 3D annotations. This approach minimizes manual labeling costs while enabling robust model training. We evaluate two depth estimation paradigms: a traditional triangulation-based method and our proposed deep learning framework. Results demonstrate the superiority of our method, achieving an F1 score of 95.6% (synthetic) and 74.4% (real) in 2D detection, with a depth estimation error of 3% at a 2-meter range on synthetic data. The pipeline is optimized for computational efficiency, ensuring compatibility with resource-constrained robotic systems. By bridging the domain gap between synthetic and real-world data, this work advances agricultural automation for specialty crops, offering a scalable solution for precision harvesting.

3D感知农业机器人仿真训练稀疏定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。