arXiv:2410.22194cs.AIcs.CL2024-10ICLR被引 17

ADAM在游戏世界中自主学习因果关系,让智能体像人一样理解世界并解决问题。

ADAM: An Embodied Causal Agent in Open-World Environments

  • 用交互记录+因果图构建,让智能体从零学懂世界运作逻辑
  • 在无先验知识环境下仍能高效完成复杂任务,表现稳定可靠
  • 适合研究可解释智能体、持续学习与真实世界推理的学者

在类似Minecraft的开放世界中,现有智能体难以持续学习结构化知识,尤其缺乏对因果关系的理解。这源于黑箱模型的不可解释性以及训练中过度依赖先验知识,影响了其可解释性与泛化能力。为此,我们提出ADAM——一个能在Minecraft中自主导航、感知多模态信息、通过终身学习掌握因果世界知识并解决复杂任务的具身因果智能体。ADAM由四个核心模块构成:1)交互模块,边执行动作边记录过程;2)因果模型模块,从零构建不断增长的因果图,提升可解释性并减少对先验知识的依赖;3)控制器模块,包含规划器、执行器和记忆池,利用已学因果图完成任务;4)感知模块,基于多模态大语言模型,使ADAM具备类人感知能力。大量实验表明,ADAM能从零构建近乎完美的因果图,实现高效的任务分解与执行,且具有强可解释性。尤其在无先验知识的改造版Minecraft环境中,其性能保持稳定,展现出显著的鲁棒性与泛化能力。ADAM开创了一种因果方法与具身智能体协同的新范式。

原文摘要 · Abstract (English)

In open-world environments like Minecraft, existing agents face challenges in continuously learning structured knowledge, particularly causality. These challenges stem from the opacity inherent in black-box models and an excessive reliance on prior knowledge during training, which impair their interpretability and generalization capability. To this end, we introduce ADAM, An emboDied causal Agent in Minecraft, that can autonomously navigate the open world, perceive multimodal contexts, learn causal world knowledge, and tackle complex tasks through lifelong learning. ADAM is empowered by four key components: 1) an interaction module, enabling the agent to execute actions while documenting the interaction processes; 2) a causal model module, tasked with constructing an ever-growing causal graph from scratch, which enhances interpretability and diminishes reliance on prior knowledge; 3) a controller module, comprising a planner, an actor, and a memory pool, which uses the learned causal graph to accomplish tasks; 4) a perception module, powered by multimodal large language models, which enables ADAM to perceive like a human player. Extensive experiments show that ADAM constructs an almost perfect causal graph from scratch, enabling efficient task decomposition and execution with strong interpretability. Notably, in our modified Minecraft games where no prior knowledge is available, ADAM maintains its performance and shows remarkable robustness and generalization capability. ADAM pioneers a novel paradigm that integrates causal methods and embodied agents in a synergistic manner. Our project page is at https://opencausalab.github.io/ADAM.

具身智能因果推理终身学习Minecraft AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。