arXiv:2411.12977cs.AIcs.CL2024-11NeurIPS被引 2

让智能体学会换位思考,实现长期文化学习与协作进化

MindForge: Empowering Embodied Agents with Theory of Mind for Lifelong Cultural Learning

  • 用理论心智建模感知、信念、欲望与行为的关联
  • 开放权重模型在任务中表现提升3倍,物品收集量增2.3倍
  • 适合研究多智能体协作与持续学习的学者

基于大语言模型(LLM)的具身智能体(如Voyager)在Minecraft等世界中展现开放能力,但使用开源权重模型微调后仍难以完成基础任务。本文提出MindForge,一种通过显式换位思考实现文化终身学习的生成式智能体框架。包含三项创新:(1) 结构化理论心智表征,连接感知、信念、欲望与行动;(2) 自然的智能体间通信机制;(3) 多组件记忆系统。在指令与协作设置下测试,结果表明,使用开放权重模型的MindForge智能体在基本任务上显著优于Voyager,达成3倍技术树里程碑,收集2.3倍独特物品。在完全协作场景中,两名表现不佳的智能体随通信轮次增加而性能提升,符合康多塞陪审团定理。智能体展现出专家-新手知识传递、协同解题及对分布外任务的适应能力。

原文摘要 · Abstract (English)

Embodied agents powered by large language models (LLMs), such as Voyager, promise open-ended competence in worlds such as Minecraft. However, when powered by open-weight LLMs they still falter on elementary tasks after domain-specific fine-tuning. We propose MindForge, a generative-agent framework for cultural lifelong learning through explicit perspective taking. We introduce three key innovations: (1) a structured theory of mind representation linking percepts, beliefs, desires, and actions; (2) natural inter-agent communication; and (3) a multi-component memory system. Following the cultural learning framework, we test MindForge in both instructive and collaborative settings within Minecraft. In an instructive setting with GPT-4, MindForge agents powered by open-weight LLMs significantly outperform their Voyager counterparts in basic tasks yielding $3\times$ more tech-tree milestones and collecting $2.3\times$ more unique items than the Voyager baseline. Furthermore, in fully \textit{collaborative} settings, we find that the performance of two underachieving agents improves with more communication rounds, echoing the Condorcet Jury Theorem. MindForge agents demonstrate sophisticated behaviors, including expert-novice knowledge transfer, collaborative problem solving, and adaptation to out-of-distribution tasks through accumulated cultural experiences.

具身智能体理论心智协作学习文化演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。