arXiv:2606.05711cs.CL2026-06被引 3

提出统一框架,系统梳理大模型多智能体的隐空间通信方法

Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems

论文配图:Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems
图 1 · 摘自论文原文
  • 按信息类型、对齐方式、融合机制三维度分类18种隐空间通信方法
  • 揭示五类设计模式,发现跨架构对齐与通道安全等关键挑战
  • 适合研究多智能体协作、高效通信或模型压缩的开发者参考

基于大语言模型的多智能体系统已成为解决复杂推理、规划和工具使用任务的主流范式。当前主流通信协议为自然语言:智能体逐令牌交换消息,显式表达内部思考过程,便于同伴阅读、验证与回应。然而该协议存在三大结构性缺陷——高推理开销、离散化导致不可逆信息损失,以及自然语言的模糊性与冗余性。因此,越来越多研究探索隐空间通信:直接交换连续表示(如嵌入、隐藏状态或键值缓存),绕过文本生成瓶颈。本文提出一个统一框架,系统组织快速发展的隐空间通信文献。我们从三个正交维度分析现有方法:(1) 通信内容(嵌入、隐藏状态、KV缓存或其他连续状态);(2) 发送-接收对齐方式(隐空间对齐与层对齐);(3) 接收端融合方式(拼接、前置、数学运算、交叉注意力或缓存恢复)。基于此三轴框架,我们系统归类了2024至2026年间提出的18项代表性方法,识别出五类主要设计模式,并揭示若干开放挑战——包括跨架构对齐、隐通道安全性、边缘部署压缩,以及隐空间通信与隐式思维链的关系。希望该框架既能降低新研究者入门门槛,也为未来工作提供可比性词汇。

原文摘要 · Abstract (English)

Multi-agent systems built on large language models (LLMs) have become a prevailing paradigm for tackling complex reasoning, planning, and tool-use tasks. The dominant communication protocol in such systems is natural language: agents exchange messages token-by-token, verbalising their internal reasoning so that peers can read, verify, and respond. While convenient and interpretable, this protocol suffers from three structural drawbacks -- high inference cost, irreversible information loss during discretization, and ambiguity/redundancy of natural language. A growing body of work therefore explores an alternative protocol -- latent communication -- in which agents exchange continuous representations (embeddings, hidden states, or KV-caches) directly, bypassing the bottleneck of text generation. This paper presents a unified framework for organising the rapidly expanding literature on latent communication. We analyse existing methods along three orthogonal axes: (1) WHAT information is communicated (Embeddings, Hidden States, KV-Caches, or other continuous state); (2) WHICH sender-receiver alignment is used (latent-space alignment and layer alignment); and (3) HOW the communicated information is fused into the receiver (concatenation, prepending, mathematical operations, cross-attention, or cache restoration). Under this 3-axis framework, we systematically categorise eighteen representative methods proposed between 2024 and 2026, identify five major design patterns, and surface a set of open challenges -- including cross-architecture alignment, security of latent channels, compression for edge deployment, and the relationship between latent communication and latent chain-of-thought. We hope that this framework both lowers the barrier to entry for new researchers and provides a vocabulary for comparing future work.

多智能体隐空间通信大模型协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。