用文字自动生成可探索的3D世界，无需建模技能
WorldGen: From Text to Traversable and Interactive 3D Worlds
- 用大模型理解文本，再分步生成场景布局与物体
- 生成的世界可实时渲染，且结构一致、视觉丰富
- 适合游戏开发者、虚拟社交等场景快速构建
我们提出WorldGen，一个能直接从文本提示生成大规模、可交互3D世界的新系统。该方法将自然语言描述转化为可即时探索或编辑的可导航、全纹理环境，兼容标准游戏引擎。通过结合大模型驱动的场景布局推理、程序化生成、基于扩散的3D生成以及物体感知的场景分解，WorldGen弥合了创作意图与功能性虚拟空间之间的差距，使创作者无需手动建模或3D专业技能即可构建连贯、可通行的世界。系统完全模块化，支持对布局、尺度和风格的细粒度控制，生成结果在几何上一致、视觉丰富，并支持实时高效渲染。本工作推动了3D生成AI在游戏、仿真和沉浸式社交环境中的规模化应用。
原文摘要 · Abstract (English)
We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts. Our approach transforms natural language descriptions into traversable, fully textured environments that can be immediately explored or edited within standard game engines. By combining LLM-driven scene layout reasoning, procedural generation, diffusion-based 3D generation, and object-aware scene decomposition, WorldGen bridges the gap between creative intent and functional virtual spaces, allowing creators to design coherent, navigable worlds without manual modeling or specialized 3D expertise. The system is fully modular and supports fine-grained control over layout, scale, and style, producing worlds that are geometrically consistent, visually rich, and efficient to render in real time. This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。