用纯合成数据实现草莓6D姿态实时估计,适合农业机器人部署
6D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data
- 通过程序化Blender管道生成逼真合成草莓数据,解决真实数据不足问题
- 在RTX 3090和Jetson Orin Nano上均达到可比精度,后者更适合边缘部署
- 方法可扩展至苹果、桃子等其他水果,推动农业自动化发展
自动化精准采收水果已成为研究热点,尤其针对先进经济体中高成本与季节性劳动力短缺的问题。本文聚焦草莓6D姿态估计,采用完全基于合成数据的方法,通过程序化Blender管道生成逼真渲染图像。使用YOLOX-6D-Pose算法,该模型基于YOLOX骨干网络,兼顾速度与精度,并支持边缘推理。为应对训练数据稀缺,构建了鲁棒且灵活的合成数据生成流程,从多个3D模型出发,重点提升合成数据的真实性。定量评估显示,模型在NVIDIA RTX 3090与Jetson Orin Nano上于多个ADD-S指标上表现相当,其中RTX 3090处理速度更快;而Jetson Orin Nano更适合资源受限环境,适合作为农业机器人部署平台。定性分析表明,模型能准确估计成熟及半成熟草莓的姿态,但对未成熟果实检测能力较弱,未来可通过颜色变化改进。该方法易于拓展至苹果、桃子、李子等其他水果,具有广泛适用性。
原文摘要 · Abstract (English)
Automated and selective harvesting of fruits has become an important area of research, particularly due to challenges such as high costs and a shortage of seasonal labor in advanced economies. This paper focuses on 6D pose estimation of strawberries using purely synthetic data generated through a procedural pipeline for photorealistic rendering. We employ the YOLOX-6D-Pose algorithm, a single-shot approach that leverages the YOLOX backbone, known for its balance between speed and accuracy, and its support for edge inference. To address the lacking availability of training data, we introduce a robust and flexible pipeline for generating synthetic strawberry data from various 3D models via a procedural Blender pipeline, where we focus on enhancing the realism of the synthesized data in comparison to previous work to make it a valuable resource for training pose estimation algorithms. Quantitative evaluations indicate that our models achieve comparable accuracy on both the NVIDIA RTX 3090 and Jetson Orin Nano across several ADD-S metrics, with the RTX 3090 demonstrating superior processing speed. However, the Jetson Orin Nano is particularly suited for resource-constrained environments, making it an excellent choice for deployment in agricultural robotics. Qualitative assessments further confirm the model's performance, demonstrating its capability to accurately infer the poses of ripe and partially ripe strawberries, while facing challenges in detecting unripe specimens. This suggests opportunities for future improvements, especially in enhancing detection capabilities for unripe strawberries (if desired) by exploring variations in color. Furthermore, the methodology presented could be adapted easily for other fruits such as apples, peaches, and plums, thereby expanding its applicability and impact in the field of agricultural automation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。