用自监督对齐机制让智能体无反馈生成高效通信符号
SimSiam Naming Game: A Unified Approach for Emergent Communication and Representation Learning
- 用对称自监督目标替代采样更新,提升学习效率
- 在CIFAR-10和ImageNet-100上线性探测准确率显著更高
- 适合研究多智能体无监督通信与表征学习的学者
涌现通信(EmCom)研究智能体如何在无预定义语言的情况下通过交互发展出符号化交流。现有框架如马尔可夫链-哈斯廷斯命名游戏(MHNG)将EmCom建模为在联合注意下通过交互协商共享外部表征的过程,无需显式成功反馈。然而,MHNG依赖采样更新,在高维感知空间中拒绝率高,导致复杂视觉数据集上样本效率低下。本文提出SimSiam命名游戏(SSNG),一种无反馈的EmCom框架,以对称自监督表示对齐目标取代采样更新。基于变分推断的自监督学习概率解释,SSNG将符号涌现建模为通过消息交换介导的智能体潜在表示对齐过程。为支持端到端梯度优化,离散符号消息通过Gumbel-Softmax松弛学习,保持离散性的同时维持可微性。在CIFAR-10和ImageNet-100上的实验表明,SSNG学习的涌现消息在线性探测分类任务中显著优于参照游戏、重建游戏和MHNG。结果表明,自监督表示对齐是多智能体系统中无反馈涌现通信的有效机制。
原文摘要 · Abstract (English)
Emergent Communication (EmCom) investigates how agents develop symbolic communication through interaction without predefined language. Recent frameworks, such as the Metropolis--Hastings Naming Game (MHNG), formulate EmCom as the learning of shared external representations negotiated through interaction under joint attention, without explicit success or reward feedback. However, MHNG relies on sampling-based updates that suffer from high rejection rates in high-dimensional perceptual spaces, making the learning process sample-inefficient for complex visual datasets. In this work, we propose the SimSiam Naming Game (SSNG), a feedback-free EmCom framework that replaces sampling-based updates with a symmetric, self-supervised representation alignment objective between autonomous agents. Building on a variational inference--based probabilistic interpretation of self-supervised learning, SSNG formulates symbol emergence as an alignment process between agents' latent representations mediated by message exchange. To enable end-to-end gradient-based optimization, discrete symbolic messages are learned via a Gumbel--Softmax relaxation, preserving the discrete nature of communication while maintaining differentiability. Experiments on CIFAR-10 and ImageNet-100 show that the emergent messages learned by SSNG achieve substantially higher linear-probe classification accuracy than those produced by referential games, reconstruction games, and MHNG. These results indicate that self-supervised representation alignment provides an effective mechanism for feedback-free EmCom in multi-agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。