arXiv:2607.01531cs.AIcs.LG2026-07被引 3

用程序化世界模型让智能体高效学习未知环境,无需每关重训。

OPINE-World: Programmatic World Modeling with Ontology-error-Prioritized Interactive Exploration for ARC-AGI-3

论文配图:OPINE-World: Programmatic World Modeling with Ontology-error-Prioritized Interactive Exploration for ARC-AGI-3
图 1 · 摘自论文原文
  • 双代理协作:一个试错,一个写代码建模,循环验证。
  • 在ARC-AGI-3上解决20/25关,动作效率达78.4,超人类基准。
  • 基于本体误差引导探索,适合复杂未知环境的自主学习研究者。

从交互中学习环境行为是构建能适应陌生任务的智能体的核心。深度网络训练的世界模型灵活但数据需求高、泛化差;而由大模型生成并经反例引导归纳合成(CEGIS)优化的程序化世界模型则数据高效且可复用,但以往仅适用于已有物体词汇的结构化世界,单次程序搜索难以扩展到需灵活推断对象结构的像素渲染环境。本文提出OPINE-World,一种在线交互中学习对象中心程序化世界模型的LLM智能体。它通过两个协作代理在假设与验证间循环:一个在环境中行动,另一个以代码形式合成模型,并结合回放验证与基于模型的规划;同时利用贝叶斯本体误差度量引导探索。在ARC-AGI-3基准上评估,该模型无需每关训练即解决20/25个游戏,动作效率得分78.4,超过人类基准。

原文摘要 · Abstract (English)

Learning how an environment behaves from interaction is central to building agents that adapt to unfamiliar tasks. World models learned with deep networks are flexible but data-hungry and transfer poorly beyond their training distribution. Program-synthesized world models, written as source code by LLMs and refined through counterexample-guided inductive synthesis (CEGIS), are instead data-efficient and reusable, yet they have been demonstrated mainly on structured-state worlds with a given object vocabulary, and a single program search does not scale to pixel-rendered environments whose object structure must be hypothesized flexibly. We introduce OPINE-World, an LLM agent that learns an object-centric programmatic world model online from interaction. OPINE-World couples two cooperating agents in a loop of hypothesis and test, one acting in the environment and one synthesizing the model in code with replay verification and model-based planning, and it steers exploration with a Bayesian measure of object-type adequacy we call ontology error. We evaluate OPINE-World on ARC-AGI-3, a benchmark for skill-acquisition efficiency in which the object vocabulary, the goal, and the action semantics are withheld. OPINE-World solves 20 of 25 games without per-game training and reaches an action-efficiency score of 78.4 against the human baseline.

世界模型程序化建模强化学习自主学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。