arXiv:2411.10173cs.AIcs.MA2024-11NeurIPS被引 4

研究智能体通信的语义一致性,发现重建目标更优。

Semantics and Spatiality of Emergent Communication

  • 提出语义一致性标准,衡量通信消息在不同情境下含义是否稳定
  • 理论证明重建任务能诱导空间有意义的通信,而分类任务不能
  • 实验验证重建目标更利于生成可解释、结构化的通信协议

当人工智能体通过通信通道协作完成任务时,会自发形成不透明的目标导向通信协议。通常认为良好任务表现即表明有效沟通,但现有实证结果表明,常见目标诱导的通信策略虽能近乎完美完成任务,却可能违背直觉。本文提出一种语义一致性原则,作为有意义通信的前提:消息在不同实例中应保持相似含义。我们形式化定义该概念,并用于对比领域内两种主流目标——判别与重构。在弱假设下证明:语义不一致的通信协议可能是判别任务的最优解,但绝非重构任务的最优解。进一步表明,重构目标促使更强的“空间意义”属性,即消息间的距离也需具有语义意义。在多个涌现通信游戏中进行实验,验证了理论结论。这些发现揭示了基于距离的目标在通信建模中的内在优势,并为先前经验观察提供了理论解释。

原文摘要 · Abstract (English)

When artificial agents are jointly trained to perform collaborative tasks using a communication channel, they develop opaque goal-oriented communication protocols. Good task performance is often considered sufficient evidence that meaningful communication is taking place, but existing empirical results show that communication strategies induced by common objectives can be counterintuitive whilst solving the task nearly perfectly. In this work, we identify a goal-agnostic prerequisite to meaningful communication, which we term semantic consistency, based on the idea that messages should have similar meanings across instances. We provide a formal definition for this idea, and use it to compare the two most common objectives in the field of emergent communication: discrimination and reconstruction. We prove, under mild assumptions, that semantically inconsistent communication protocols can be optimal solutions to the discrimination task, but not to reconstruction. We further show that the reconstruction objective encourages a stricter property, spatial meaningfulness, which also accounts for the distance between messages. Experiments with emergent communication games validate our theoretical results. These findings demonstrate an inherent advantage of distance-based communication goals, and contextualize previous empirical discoveries.

智能体通信语义一致性重建任务协同学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。