arXiv:2602.11706cs.CVcs.AI2026-02中稿 · IEEE Conference on…

用大模型自动生成农业模拟场景,更准更省时。

LLM-Driven 3D Scene Generation of Agricultural Simulation Environments

  • 分模块设计多大模型流水线,整合资产检索与代码生成
  • 真实种植布局生成准确率高,比人工设计快80%以上
  • 适合农业仿真、自动驾驶训练等需要真实场景的领域

3D渲染引擎中的程序化生成技术已显著降低复杂环境构建对人工设计的依赖。近期基于大语言模型(LLMs)的3D场景生成方法虽具潜力,但普遍缺乏领域特定推理、验证机制与模块化设计,导致控制力弱、可扩展性差。本文研究利用LLMs从自然语言提示生成农业合成仿真环境,重点解决上述局限。提出一种模块化多LLM流水线,融合3D资产检索、领域知识注入与Unreal引擎API代码生成,实现基于提示与领域知识的真实种植布局及环境上下文。通过少样本提示、检索增强生成(RAG)、微调与验证相结合的混合策略提升准确性与可扩展性。相比单体模型,该模块架构支持结构化数据处理、中间验证与灵活扩展。经结构化提示与语义准确率评估,用户研究显示生成场景在真实感与熟悉度上优于随机生成,专家对比证实相较人工设计节省超80%时间。结果表明多LLM流水线能有效实现高可靠、高精度的领域特定3D场景自动化生成。未来将拓展资产层级、支持实时生成,并适配其他仿真领域。

原文摘要 · Abstract (English)

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise but often lack domain-specific reasoning, verification mechanisms, and modular design. These limitations lead to reduced control and poor scalability. This paper investigates the use of LLMs to generate agricultural synthetic simulation environments from natural language prompts, specifically to address the limitations of lacking domain-specific reasoning, verification mechanisms, and modular design. A modular multi-LLM pipeline was developed, integrating 3D asset retrieval, domain knowledge injection, and code generation for the Unreal rendering engine using its API. This results in a 3D environment with realistic planting layouts and environmental context, all based on the input prompt and the domain knowledge. To enhance accuracy and scalability, the system employs a hybrid strategy combining LLM optimization techniques such as few-shot prompting, Retrieval-Augmented Generation (RAG), finetuning, and validation. Unlike monolithic models, the modular architecture enables structured data handling, intermediate verification, and flexible expansion. The system was evaluated using structured prompts and semantic accuracy metrics. A user study assessed realism and familiarity against real-world images, while an expert comparison demonstrated significant time savings over manual scene design. The results confirm the effectiveness of multi-LLM pipelines in automating domain-specific 3D scene generation with improved reliability and precision. Future work will explore expanding the asset hierarchy, incorporating real-time generation, and adapting the pipeline to other simulation domains beyond agriculture.

3D生成农业仿真大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。