提出可动态追踪动作前提的智能体世界模型,提升复杂环境预测准确性。
AGWM: Affordance-Grounded World Models for Environments with Compositional Prerequisites

- 基于前提依赖有向无环图建模动作可执行性变化
- 多步预测误差降低,新场景泛化能力显著提升
- 适合需要理解动作前提关系的交互式决策任务
在基于模型的学习中,智能体通过世界模型预测轨迹来学习行为。传统世界模型通常学习一个静态转移函数,将状态和动作映射到下一状态,当动作与结果在训练数据中频繁共现时,模型会将其误认为普遍因果规则,忽略动作前提条件。在交互环境中,智能体行为可能重塑未来的动作可执行空间:每个动作仅在满足前提条件时才可执行,或在前提被破坏时不可执行。我们称此类事件为结构改变事件(SC events)。因此,传统世界模型常无法判断当前状态下某动作是否可执行,尤其在多步预测中。每一步想象均基于错误的动作可执行状态,导致预测误差随推演时间累积。本文提出AGWM(Affordance-Grounded World Model),通过学习以有向无环图(DAG)表示的抽象前提依赖结构,显式追踪动作的动态可执行性。在基于游戏的模拟环境中实验表明,该方法有效降低多步预测误差,提升对新配置的泛化能力,并增强可解释性。
原文摘要 · Abstract (English)
In model-based learning, the agent learns behaviors by simulating trajectories based on world model predictions. Standard world models typically learn a stationary transition function that maps states and actions to next states, when an action and an outcome frequently co-occur in training data, the model tends to internalize this correlation as a general causal rule while ignoring action preconditions. In interactive environments, however, agent actions can reshape the future affordance space. At each timestep, an action may becomes executable only after its prerequisites are met, or non-executable when they are destroyed. We term such events structure-changing events (SC events). As a result, a conventional world model often fails to determine whether a given action is executable in the current state, especially in multi-step predictions. Each imagined step is conditioned on an incorrect affordance state, and therefore the prediction error compounds over the rollout horizon. In this paper, we propose AGWM (Affordance-Grounded World Model), which learns an abstract affordance structure represented as a DAG of prerequisite dependencies to explicitly track the dynamic executability of actions. Experiments on game-based simulated environments demonstrate the effectiveness of our method by achieving lower multi-step prediction error, better generalization to novel configurations, and improved interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。