arXiv:2605.05138cs.AI2026-05中稿 · publication at AGI…被引 9

用可执行世界模型让代码代理自动解题,15个游戏全通。

Executable World Models for ARC-AGI-3 in the Era of Coding Agents

  • 代理维护可运行的Python世界模型,通过验证与重构提升简洁性。
  • 用GPT-5.5实现15/25游戏全解,平均任务完成率58.12%。
  • 无游戏特有代码,统一代理跨游戏适用,适合研究通用智能体。

我们评估了一个面向ARC-AGI-3的初始代码代理系统,该系统维护一个可执行的Python世界模型,通过与先前观测对比验证模型,并通过重构向更简洁抽象演进,作为类似最小描述长度(MDL)的简洁性偏置的实用代理。系统设计直接:使用脚本化控制器、预定义的世界模型接口、验证程序和计划执行器,不包含任何手工编写的游戏特定逻辑。代理提示、工作区和控制器中不含游戏特定代码、提示、启发式规则、隐藏解法或其他游戏特定信息;同一代理和提示在所有游戏中复用。由于代码代理具备广泛系统访问权限,我们审计了非预期信息通道,描述了早期易受攻击的框架,并说明当前框架如何关闭已知泄漏渠道,同时减少基准特异性信息暴露。报告了在25个公开的ARC-AGI-3游戏上的结果。每次试玩从全新代理实例和干净工作区开始,无法访问之前试玩的文件或对话状态。使用GPT-5.5高推理能力,代理完全解决了15个游戏,平均每游戏相对哈希平均误差(RHAE)为58.12%。使用GPT-5.4高推理能力,完全解决8个游戏,平均每游戏RHAE为41.29%。私有验证集表现尚待测试。总体而言,结果初步表明,基于验证器的可执行世界模型是应对ARC-AGI-3的一种有前景的方法。完整运行成果与代码已发布于https://github.com/astroseger/arc-3-agents-baseline1。

原文摘要 · Abstract (English)

We evaluate an initial coding-agent system for ARC-AGI-3 in which the agent maintains an executable Python world model, verifies it against previous observations, refactors it toward simpler abstractions as a practical proxy for an MDL-like simplicity bias, and plans through the model before acting. The system is intentionally direct: it uses a scripted controller, predefined world-model interfaces, verifier programs, and a plan executor, but no hand-coded game-specific logic. The agent-facing prompts, workspace, and controller contain no game-specific code, game-specific prompts, hand-coded heuristics, hidden solutions, or other game-specific information; the same agent and prompts are used across games. Because the coding agent has broad system access, we audit unintended information channels, describe earlier vulnerable harnesses, and explain how the current harness closes observed leakage channels while reducing benchmark-specific information exposure. We report results on the 25 public ARC-AGI-3 games. Each playthrough starts from a fresh agent instance and clean workspace, with no access to files or conversation state from earlier playthroughs. With GPT-5.5 high reasoning effort, the agent fully solved 15 games and achieved a mean per-game RHAE of 58.12%. With GPT-5.4 high reasoning effort, it fully solved 8 games and achieved a mean per-game RHAE of 41.29%. Performance on the private validation set, which is not yet available to us, remains to be tested. Overall, the results provide preliminary evidence that verifier-driven executable world models are a promising approach for ARC-AGI-3 agents. Full run artifacts are released with the code at https://github.com/astroseger/arc-3-agents-baseline1.

代码代理世界模型ARC-AGI通用智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。