arXiv:2510.20733cs.LGcs.AI2025-10NeurIPS被引 26

让智能体直接传递隐含思想,突破语言交流的模糊局限。

Thought Communication in Multiagent Collaboration

  • 用潜在变量模型提取智能体间的共享与私有思想
  • 理论证明可无损识别思想共享结构与关系
  • 适用于多模态系统,适合研究协作机制的学者

自然语言虽促进人类协作,但其损耗性、模糊性和间接性限制了集体智能。尽管机器不受此类约束,多数基于大模型的多智能体系统仍仅依赖自然语言交换令牌或嵌入。为超越语言,本文提出思想通信新范式,使智能体实现类心灵感应的直接交互。通过将思想生成建模为未知函数下的潜在变量过程,证明在非参数设定下,无需辅助信息即可识别任意一对智能体间的共享与私有思想,并可恢复全局思想共享结构,具有理论保证。基于此,构建框架,在通信前提取所有智能体的潜在思想并分配相关思想及共享模式。该范式可拓展至所有模态,因多数观测数据源于隐藏生成过程。合成与真实世界基准实验验证理论有效性,并展示思想通信带来的协作优势。本文希望揭示隐藏世界潜力:许多挑战仅靠表面观察无法解决,无论算力或数据规模如何。

原文摘要 · Abstract (English)

Natural language has long enabled human cooperation, but its lossy, ambiguous, and indirect nature limits the potential of collective intelligence. While machines are not subject to these constraints, most LLM-based multi-agent systems still rely solely on natural language, exchanging tokens or their embeddings. To go beyond language, we introduce a new paradigm, thought communication, which enables agents to interact directly mind-to-mind, akin to telepathy. To uncover these latent thoughts in a principled way, we formalize the process as a general latent variable model, where agent states are generated by an unknown function of underlying thoughts. We prove that, in a nonparametric setting without auxiliary information, both shared and private latent thoughts between any pair of agents can be identified. Moreover, the global structure of thought sharing, including which agents share which thoughts and how these relationships are structured, can also be recovered with theoretical guarantees. Guided by the established theory, we develop a framework that extracts latent thoughts from all agents prior to communication and assigns each agent the relevant thoughts, along with their sharing patterns. This paradigm naturally extends beyond LLMs to all modalities, as most observational data arise from hidden generative processes. Experiments on both synthetic and real-world benchmarks validate the theory and demonstrate the collaborative advantages of thought communication. We hope this work illuminates the potential of leveraging the hidden world, as many challenges remain unsolvable through surface-level observation alone, regardless of compute or data scale.

多智能体思想通信潜在变量协作建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。