arXiv:2509.26161cs.AIcs.SE2025-09被引 4

用自然语言生成可运行的3D游戏,无需编码且速度提升91.4%。

90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development

  • 多智能体协作框架,从自然语言需求自动生成游戏蓝图与代码。
  • 开发时间缩短91.4%,支持Unity/Unreal引擎的完整项目构建。
  • 适合零编程背景用户,尤其适合快速原型设计与教育场景。

3D游戏开发需跨编程、建模与引擎配置等专业技能,限制了数百万潜在创作者。现有自动化方法受限于2D生成或孤立代码片段,需手动集成组件,且难以处理交互逻辑与状态管理。为此,本文提出UniGen——首个端到端多智能体框架,实现基于自然语言要求的零代码3D游戏自动化生成。其包含规划、生成、自动化与调试四个智能体:规划智能体将需求转化为结构化蓝图;生成智能体输出可执行C#脚本;自动化智能体完成引擎特定组件绑定与场景构建;调试智能体通过对话实时纠错。在三个游戏原型上评估显示,UniGen不仅使用户无需编程即可创建可运行项目,还使开发时间减少91.4%。项目开源地址:https://github.com/yxwan123/UniGen,视频演示见:https://www.youtube.com/watch?v=xyJjFfnxUx0。

原文摘要 · Abstract (English)

Developing 3D games requires specialized expertise across multiple domains, including programming, 3D modeling, and engine configuration, which limits access to millions of potential creators. Recently, researchers have begun to explore automated game development. However, existing approaches face three primary challenges: (1) limited scope to 2D content generation or isolated code snippets; (2) requirement for manual integration of generated components into game engines; and (3) poor performance on handling interactive game logic and state management. While Multimodal Large Language Models (MLLMs) demonstrate potential capabilities to ease the game generation task, a critical gap still remains in translating these outputs into production-ready, executable game projects based on game engines such as Unity and Unreal Engine. To bridge the gap, this paper introduces UniGen, the first end-to-end coordinated multi-agent framework that automates zero-coding development of runnable 3D games from natural language requirements. Specifically, UniGen uses a Planning Agent that interprets user requirements into structured blueprints and engineered logic descriptions; after which a Generation Agent produces executable C# scripts; then an Automation Agent handles engine-specific component binding and scene construction; and lastly a Debugging Agent provides real-time error correction through conversational interaction. We evaluated UniGen on three distinct game prototypes. Results demonstrate that UniGen not only democratizes game creation by requiring no coding from the user, but also reduces development time by 91.4%. We release UniGen at https://github.com/yxwan123/UniGen. A video demonstration is available at https://www.youtube.com/watch?v=xyJjFfnxUx0.

3D游戏零代码多智能体MLLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。