arXiv:2607.06291cs.CVcs.HC2026-07被引 1

用AI自动生成可交互的开放世界,支持实时游玩与自由操作。

AlayaWorld: Long-Horizon and Playable Video World Generation

论文配图:AlayaWorld: Long-Horizon and Playable Video World Generation
图 1 · 摘自论文原文
  • 基于游戏录像和真实视频训练,自回归生成未来画面
  • 支持战斗、施法等多样动作,实现无边界实时交互
  • 开源完整流程,适合研究者快速搭建生成式世界

传统游戏世界依赖人工制作,成本高且难修改。近年来,视频世界模型提供新范式:通过当前世界状态和用户交互,自回归合成未来视觉内容,实现可玩世界的在线生成。该模型结合游戏录像与真实视频训练,能捕捉多样的视觉风格与物理动态,拓展至具身智能等非游戏应用。本文提出开源框架AlayaWorld,支持用户自由探索与战斗、施法、召唤怪物等多样化操作,实现开箱即用的实时交互。框架覆盖数据准备、模型架构、训练、推理加速与部署全链路,采用模块化设计。配套发布可复现的流程、参考实现、评估工具与完整文档,为生成式世界模型的研究与实时应用奠定实践基础。

原文摘要 · Abstract (English)

Game worlds have traditionally been built through labor-intensive production pipelines, making them costly to develop, difficult to customization, and expensive to modify after deployment. Recent advances in video world models offer a fundamentally different paradigm. Rather than explicitly authoring every component of a virtual environment, these models autoregressively synthesize future observations conditioned on the current world state and user interactions, enabling playable worlds to be generated online. Trained on both gameplay recordings and real-world videos, they can capture diverse visual appearances and physical dynamics, opening new opportunities for interactive applications beyond gaming, including embodied intelligence. In this paper, we present \textbf{AlayaWorld}, a full-stack open-source framework for building interactive generative worlds. AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning. The framework unifies the complete development-from data preparation model architecture, model training, inference acceleration, and deployment-within a modular and extensible architecture. Alongside the framework, we release reproducible pipelines, reference implementations, evaluation tools, and comprehensive documentation, establishing a practical foundation for future research and real-time applications of generative world models.

世界生成可交互AI游戏开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。