arXiv:2410.21794cs.AIcs.MA2024-10ICLR被引 2

让智能体学会猜对手心思,动态调整策略。

Inverse Attention Agents for Multi-Agent Systems

  • 用注意力机制模拟心智理论,实时推断他人目标。
  • 在复杂协作与对抗任务中显著提升性能。
  • 更擅长与人类合作,行为更接近真人。

多智能体系统面临的核心挑战是如何让智能体在不断变化的环境中动态适应,包括对手和队友的频繁更迭。传统训练方法使智能体仅在特定训练群体内表现良好,面对陌生智能体时性能急剧下降。为此,我们提出逆注意力智能体,结合心智理论(ToM)思想,通过端到端训练的注意力机制实现。其注意力模型权重显式表示对不同目标的关注程度。进一步提出逆注意力网络,基于观测和先前动作推断其他智能体的心智状态,从而优化自身注意力权重并调整最终行动。我们在连续环境中开展实验,涵盖协作、竞争及二者混合的高难度任务。结果表明,逆注意力网络能有效推断其他智能体的关注点,且该信息显著提升智能体表现。额外的人类实验显示,相比基线模型,我们的逆注意力智能体在与人类协作中表现更优,行为更贴近人类模式。

原文摘要 · Abstract (English)

A major challenge for Multi-Agent Systems is enabling agents to adapt dynamically to diverse environments in which opponents and teammates may continually change. Agents trained using conventional methods tend to excel only within the confines of their training cohorts; their performance drops significantly when confronting unfamiliar agents. To address this shortcoming, we introduce Inverse Attention Agents that adopt concepts from the Theory of Mind (ToM) implemented algorithmically using an attention mechanism trained in an end-to-end manner. Crucial to determining the final actions of these agents, the weights in their attention model explicitly represent attention to different goals. We furthermore propose an inverse attention network that deduces the ToM of agents based on observations and prior actions. The network infers the attentional states of other agents, thereby refining the attention weights to adjust the agent's final action. We conduct experiments in a continuous environment, tackling demanding tasks encompassing cooperation, competition, and a blend of both. They demonstrate that the inverse attention network successfully infers the attention of other agents, and that this information improves agent performance. Additional human experiments show that, compared to baseline agent models, our inverse attention agents exhibit superior cooperation with humans and better emulate human behaviors.

多智能体心智理论注意力机制人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。