用测试时数字孪生模型自动生成游戏规则,97.8%关卡通关且效率超人类。
Twin: Playing an Unknown Game with a Test-Time Digital Twin

- 通过模拟交互自动构建可执行的世界模型,无需手动设计
- 在ARC-AGI-3游戏中通关179/183关(97.8%),88.3%关卡比人类更高效
- 能提前推断目标或自动搜索目标,适合强化学习与持续学习研究
我们提出测试时世界模型推理(Twin)系统,由前沿编码代理为连续学习任务(如ARC-AGI-3游戏)编写可执行世界模型。传统方法需为每项任务定制设计,而本系统仅通过模拟与交互即可还原游戏规则与目标。其对网格类游戏的归纳先验足够强,能在几乎全部关卡中恢复真实状态转移与目标。通过孪生世界模型进行回放验证,确保动作执行前所有历史转移均被复现;每次预测与实际结果不一致即作为反例用于修复模型。该系统在183关中通关179关(97.8%),其中158关(88.3%)效率高于人类。在156关(87.2%)中于无奖励情况下即推断出目标,其余通过搜索发现。基准评估以0–100分衡量完成度与动作效率,对比首次游玩的人类表现。基础模型直接运行仅得7.8分;通用支架提升至61.1分;而本文的孪生世界模型将同一基础模型提升至93.3分,成功通关23/25个游戏。构建可用世界模型比预期简单,难点在于正确推断目标。
原文摘要 · Abstract (English)
We present a Test-time World-model Inference (Twin) system, in which a frontier coding agent writes an executable world model for completing continual learning tasks, such as ARC-AGI-3 games. Traditional approaches hand-engineer such models, one custom design per task. Each game hides its rules and goal, and our system constructs them from simulation and interaction alone. Its inductive prior over grid games is strong enough to recover the true transitions of the game and the goal on nearly all levels. Replay validation happens in a twin world model. The harness enforces that an action is not made until the program reproduces every previous observed game transition. Each mismatch between a world model prediction and the actual action result becomes a counterexample that is used to repair the world model. Twin clears 179 out of 183 levels (97.8%), and does so more efficiently than humans in 158 out of 179 levels (88.3%). The system infers the goal before any reward on 156 of the levels it clears (87.2%), and in the remaining levels automatically discovers the goal by search. The benchmark scores completion and action efficiency, between 0 and 100, against humans playing each game for the first time. Played directly, the base model scores only 7.8%; an off-the-shelf harness increases it to 61.1%, whereas our twin world model increases the same base model to 93.3%, clearing 23 out of 25 games. Building a usable world model is simpler than anticipated, whereas the harder problem is inferring the right goal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。