arXiv:2605.07442cs.LG2026-05被引 4

用关键点分解法自动验证大模型生成的游戏,速度快且准确

GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injection

论文配图:GameGen-Verifier: Parallel Keypoint-Based Verification for LLM-Generated Games via Runtime State Injection
图 1 · 摘自论文原文
  • 将游戏规范拆解为可验证的关键点,逐个注入运行时状态检测
  • 在100个跨7类游戏上达92.2%准确率,比基线快16.6倍
  • 适合游戏生成、AI测试与自动化验证方向的研究者

基于大模型的游戏生成有望将自然语言描述转化为可执行游戏,但受限于缺乏可靠的自动化验证。与传统代码生成不同,游戏正确性依赖长周期交互:游戏可能表面正常,却违反状态更新、交互规则或阶段转换等核心机制。现有基于智能体的验证方法将验证简化为开放玩法,导致判断结果受可达性、时间、覆盖率和智能体能力影响。本文提出GameGen-Verifier,一种针对大模型生成游戏的自动化验证范式,将规范分解为可验证的关键点,并将其锚定为独立验证单元。每个单元注入游戏运行时至目标状态,执行有限交互后,依据关键点断言判断结果。我们实现GGV-Harness,一个支持并发管理、运行时隔离与故障恢复的可扩展智能体框架。在包含100个游戏的VeriGame数据集上,GameGen-Verifier对人工判断的准确率达92.2%,显著优于覆盖率强制的基准方法(58.8%),同时将实际耗时减少最多16.6倍。

原文摘要 · Abstract (English)

LLM-based game generation promises to turn natural-language specifications into executable games, but progress is limited by the lack of reliable automated verification. Unlike conventional code generation, game correctness is defined over long-horizon interaction: a game may appear correct while violating core mechanics such as state updates, interaction rules, and phase transitions. Existing Agent-as-a-Verifier approaches collapse verification into open-ended gameplay, making verdicts reachability-bound, time-consuming, coverage-limited, and sensitive to the agent's gameplay ability. We present GameGen-Verifier, an automated verification paradigm for LLM-generated games that decomposes a specification into verifiable keypoints and grounds them into independent verification units. Each unit patches the game runtime into a concrete target state, executes a bounded interaction, and judges the outcome against the keypoint assertion. We implement GGV-Harness, a scalable agentic harness providing concurrency management, runtime isolation, and fault recovery. On VeriGame, our dataset of 100 games across seven genres, GameGen-Verifier achieves up to 92.2% accuracy against human judgments versus 58.8% for the coverage-enforced Agent-as-a-Verifier baseline, while reducing wall-clock time by up to 16.6x.

游戏生成自动化验证大模型测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。