构建可自适应的社会化多智能体环境,研究社交结构对智能决策的影响。
AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making
- 环境随智能体进展动态生成新任务与社交关系
- 不同社交结构能提升个体和群体收益
- 适合研究社会性智能、强化学习与大模型在复杂协作中的表现
传统交互环境因任务固定限制了智能体的智力发展。近期单智能体环境通过根据智能体行为生成新任务,提升了任务多样性。本文关注多智能体决策问题,其中任务受社交连接影响,进而改变奖励与信息获取。然而现有环境缺乏可适应的物理空间与可变社交结构的结合,阻碍了智能行为的学习。为此,我们提出AdaSociety——一个可定制的多智能体环境,具备扩展的状态与动作空间,以及显式且可修改的社交结构。随着智能体进展,环境会自适应生成带有社交结构的新任务。我们在其中设计三个微型游戏,展示不同的社交结构与任务形式。初步结果表明,特定社交结构可同时促进个体与集体收益,但当前强化学习与基于大模型的算法在利用社交结构提升性能方面仍表现有限。总体而言,AdaSociety为探索多样化物理与社会环境中智能的发展提供了重要研究平台。代码已公开于https://github.com/bigai-ai/AdaSociety。
原文摘要 · Abstract (English)
Traditional interactive environments limit agents' intelligence growth with fixed tasks. Recently, single-agent environments address this by generating new tasks based on agent actions, enhancing task diversity. We consider the decision-making problem in multi-agent settings, where tasks are further influenced by social connections, affecting rewards and information access. However, existing multi-agent environments lack a combination of adaptive physical surroundings and social connections, hindering the learning of intelligent behaviors. To address this, we introduce AdaSociety, a customizable multi-agent environment featuring expanding state and action spaces, alongside explicit and alterable social structures. As agents progress, the environment adaptively generates new tasks with social structures for agents to undertake. In AdaSociety, we develop three mini-games showcasing distinct social structures and tasks. Initial results demonstrate that specific social structures can promote both individual and collective benefits, though current reinforcement learning and LLM-based algorithms show limited effectiveness in leveraging social structures to enhance performance. Overall, AdaSociety serves as a valuable research platform for exploring intelligence in diverse physical and social settings. The code is available at https://github.com/bigai-ai/AdaSociety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。