arXiv:2511.02417cs.CVcs.RO2025-11被引 1

用程序化生成农业机器人仿真环境,支持复杂田间场景与真实感植物分布。

CropCraft: A Procedural World Generator for Robotic Simulation of Agricultural Tasks

  • 通过YAML配置生成多样作物场景,支持间作、果园及杂草丛生田地。
  • 生成1万张合成玉米田图像,训练模型在真实田间实现约90% mIoU。
  • 少量真实数据+大量合成数据可有效提升模型跨域泛化能力。

现代农业推广生态耕作需要能在高度多样且复杂的田间环境中运行的机器人系统。开发与评估此类系统严重依赖仿真,但生成能代表农业生态多样性的真实且可配置的3D环境仍是重大挑战。本文提出CropCraft,一个基于Blender和Python的开源程序化世界生成器,用于生成面向农业机器人任务的3D仿真环境。CropCraft通过简单YAML配置文件生成作物田,支持间作、葡萄园及杂草侵扰田地等多种场景。工具包含多个生长阶段的3D植物模型库(作物、草类、杂草),并采用随机布局算法真实再现实际田地的空间变异。生成的世界可直接导入Gazebo仿真器,并包含所有放置元素的真值标注,支持感知与导航算法开发。为验证实用性,我们使用该工具进行玉米-杂草语义分割任务。生成了10,000张具有不同杂草密度、生长阶段和光照条件的合成图像,用于训练多种分割网络。仅使用合成数据训练的模型在真实田间图像上达到约90%的均值交并比(mIoU),相较于以往最优合成方法表现更优。进一步表明,即使加入少量真实图像,也能显著提升模型在不同域间的泛化能力,为合成数据在农业感知任务中的高效利用提供新见解。

原文摘要 · Abstract (English)

The adoption of agroecological practices in modern agriculture requires robotic systems capable of operating in highly diverse and complex field environments. Developing and evaluating such systems relies heavily on simulation, yet generating realistic and configurable 3D environments representative of agroecological diversity remains a major challenge. This paper presents CropCraft, an open-source procedural world generator built on Blender and Python, designed to produce 3D simulation environments tailored to agricultural robotics. CropCraft generates crop fields from a simple YAML configuration file, supporting a wide range of scenarios including intercropping, vineyards, and weed-infested fields. The tool includes a library of 3D plant models (crops, grasses, and weeds) at multiple growth stages, and uses stochastic placement algorithms to realistically reproduce the spatial variability observed in real fields. Generated worlds are directly importable into the Gazebo simulator and include ground-truth annotations for all placed elements, supporting both perception and navigation algorithm development. To demonstrate the practical utility of CropCraft, we apply it to the task of crop-weed semantic segmentation using deep learning. A dataset of 10,000 synthetic images of maize fields with varying weed densities, growth stages, and lighting conditions was generated and used to train several segmentation architectures. Models trained exclusively on synthetic data achieve a sim-to-real gap of approximately 10% mean Intersection over Union (mIoU) on real field images, outperforming previous state-of-the-art synthetic generation approaches. We further show that combining even a few real images with synthetic data improves generalization across domains, providing new insights into the effective use of synthetic data for agricultural perception tasks.

农业机器人程序化生成合成数据语义分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。