arXiv:2505.12872cs.AIcs.LG2025-05被引 1

多智能体协作觅食中自发产生类似自然语言的通信机制

From Grunts to Lexicons: Emergent Language from Cooperative Foraging

  • 用强化学习让智能体从零开始学会协作沟通
  • 生成的语言具备任意性、可交换性、指代性等语言特征
  • 适合研究语言演化与群体智能的科研人员参考

语言是强大的交流与认知工具,使人类能够表达思想、分享意图并推理复杂现象。尽管我们熟练使用语言,但其起源与演化仍无定论。语言学与人类学主流假说认为,语言源于早期人类合作所面临的生态与社会需求,而非孤立发展。受此启发,我们在多智能体觅食游戏中研究语言的涌现。这些环境模拟了被认为影响语言演化的认知与生态约束:智能体在共享网格世界中仅拥有部分观测信息,需协作完成拾取高价值目标或执行时序动作等任务。通过端到端深度强化学习,智能体从零开始自主学习行为与通信策略。结果发现,智能体发展出具有自然语言核心特征的通信协议:任意性、可交换性、位移性、文化传承性和组合性。我们量化各项特征,并分析种群规模、社会互动和时间依赖等因素如何塑造语言特性。本框架为研究具身多智能体系统中,由部分可观测性、时间推理与合作目标驱动的语言演化提供了平台。所有数据、代码与模型将公开发布。

原文摘要 · Abstract (English)

Language is a powerful communicative and cognitive tool. It enables humans to express thoughts, share intentions, and reason about complex phenomena. Despite our fluency in using and understanding language, the question of how it arises and evolves over time remains unsolved. A leading hypothesis in linguistics and anthropology posits that language evolved to meet the ecological and social demands of early human cooperation. Language did not arise in isolation, but through shared survival goals. Inspired by this view, we investigate the emergence of language in multi-agent Foraging Games. These environments are designed to reflect the cognitive and ecological constraints believed to have influenced the evolution of communication. Agents operate in a shared grid world with only partial knowledge about other agents and the environment, and must coordinate to complete games like picking up high-value targets or executing temporally ordered actions. Using end-to-end deep reinforcement learning, agents learn both actions and communication strategies from scratch. We find that agents develop communication protocols with hallmark features of natural language: arbitrariness, interchangeability, displacement, cultural transmission, and compositionality. We quantify each property and analyze how different factors, such as population size, social dynamics, and temporal dependencies, shape specific aspects of the emergent language. Our framework serves as a platform for studying how language can evolve from partial observability, temporal reasoning, and cooperative goals in embodied multi-agent settings. We will release all data, code, and models publicly.

多智能体语言演化强化学习协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。