arXiv:2607.26754cs.CV2026-07被引 1

让游戏生成同时预测画面和内部状态,确保规则一致。

StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation

论文配图:StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation
图 1 · 摘自论文原文
  • 用双分支结构分别预测画面和游戏状态,跨模态交互引导生成
  • 状态预测平均误差低于0.06,规则一致性提升18.6%
  • 适合需要严格遵守游戏机制的生成任务

近期的游戏世界模型可基于玩家动作生成视觉上逼真的互动环境。然而,游戏不仅由像素构成,更受显式机制约束——即依赖内部状态的规则,如血量减少、技能激活与游戏结束条件。这些机制依赖于精确的状态变量(如生命值、技能条、计时器),与视觉观察紧密耦合,决定游戏进程。现有模型若忽略状态动态,虽能生成视觉合理的回放,却可能违反底层规则。本文提出StatePlay,一种新型状态感知游戏世界模型,联合预测视觉内容与游戏状态,以实现机制一致的生成。该模型采用类混合变压器(MoT)架构,在保留视觉与状态专用表示的同时支持跨模态交互,使预测状态引导帧生成。各分支针对其模态优化不同目标。实验表明,状态预测平均归一化L1距离低于0.06;相较于无显式状态建模的模型,本方法在生成回放中机制保真度提升18.6%。研究强调状态感知建模的重要性,推动游戏生成从像素级真实迈向完整且机制忠实的范式升级。

原文摘要 · Abstract (English)

Recent game world models can generate visually realistic and interactive environments conditioned on player actions. However, games are not defined by pixels alone; they are governed by explicit mechanics, namely state-dependent rules that control health reduction, skill activation, and game termination. These mechanics depend on precise internal states, such as health points, skill meters, and timers, which are tightly coupled with visual observations and determine how gameplay evolves. Without modeling these state dynamics, existing game world models may generate visually plausible rollouts but violate the underlying game rules. In this paper, we propose StatePlay, a novel state-aware game world model that jointly predicts visual content and game states to promote mechanics-consistent generation. StatePlay adopts a mixture-of-transformers (MoT)-style architecture that preserves specialized visual and state representations while enabling cross-modal interaction, allowing predicted states to guide frame generation. Each branch is further optimized with a distinct objective suited to its modality. Experiments show that StatePlay achieves an average normalized L1 distance below 0.06 for state prediction. Furthermore, compared with models without explicit state modeling, our method improves mechanics fidelity in generated game rollouts by 18.6%. Overall, our work highlights the importance of state-aware game world modeling and advances beyond pixel-level realism toward complete and mechanically faithful game generation.

游戏生成状态建模机制一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。