模型自由的神经网络在协作中自发形成对伙伴能力的建模。
Partner Modelling Emerges in Recurrent Agents (But Only When It Matters)
- 用无模型RNN代理在多样伙伴间协作,无需额外机制
- 在任务分配可影响对方行为时,产生结构化伙伴表征
- 适合研究社会性智能涌现的学者参考
人类在合作中能迅速推断新伙伴的优劣势以达成共同目标。为构建具备此能力的AI系统,需理解其基础:这种灵活性是否需要显式的他人建模机制,还是可在开放协作中自发产生?我们训练简单的无模型RNN代理在`Overcooked-AI'环境中与多样化伙伴协作,收集数千支团队数据并分析其内部隐藏状态。尽管缺乏额外架构特征、归纳偏置或辅助目标,代理仍发展出对伙伴任务能力的结构化内部表征,实现快速适应与泛化至新合作者。通过探测技术和大规模行为分析,我们发现:当代理可通过任务分配影响对方行为时,结构化伙伴建模才会出现。结果表明,伙伴建模可在无模型代理中自发产生,但仅在施加恰当社会压力的环境条件下成立。
原文摘要 · Abstract (English)
Humans are remarkably adept at collaboration, able to infer the strengths and weaknesses of new partners in order to work successfully towards shared goals. To build AI systems with this capability, we must first understand its building blocks: does such flexibility require explicit, dedicated mechanisms for modelling others -- or can it emerge spontaneously from the pressures of open-ended cooperative interaction? To investigate this question, we train simple model-free RNN agents to collaborate with a population of diverse partners. Using the `Overcooked-AI' environment, we collect data from thousands of collaborative teams, and analyse agents' internal hidden states. Despite a lack of additional architectural features, inductive biases, or auxiliary objectives, the agents nevertheless develop structured internal representations of their partners' task abilities, enabling rapid adaptation and generalisation to novel collaborators. We investigated these internal models through probing techniques, and large-scale behavioural analysis. Notably, we find that structured partner modelling emerges when agents can influence partner behaviour by controlling task allocation. Our results show that partner modelling can arise spontaneously in model-free agents -- but only under environmental conditions that impose the right kind of social pressure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。