让智能体在潜空间直接通信,提升协作效率与探索能力
Enabling Agents to Communicate Entirely in Latent Space
- 用大模型最后隐藏层的连续潜变量作为思想表示,实现无符号语言通信
- 跨异构模型通信性能超越微调思维链提示,推理速度最高提升24倍
- 适合追求高效多智能体协作与低延迟通信的研究者
尽管自然语言是基于大模型智能体的通用通信方式,但将丰富的内部潜状态下采样为离散词元会固有地限制信息传递的深度与细腻度,阻碍协作解题。受心灵感应启发,我们提出Interlat(智能体间潜空间通信)范式,利用大模型最后隐藏层的连续潜变量作为其思想表示,实现直接通信(称为潜通信)。通过额外学习的压缩过程,进一步对潜通信进行潜空间推理压缩。实验表明,Interlat在跨异构模型情况下,优于微调思维链(CoT)提示和单智能体基线,促进更富探索性的行为,并真正利用潜空间信息。进一步压缩使推理速度最高提升24倍,同时通过高效保信机制维持竞争力。本工作定位为完全潜空间智能体间通信的可行性研究,结果凸显其潜力,为未来研究提供重要洞见。代码已开源:https://github.com/XiaoDu-flying/Interlat。
原文摘要 · Abstract (English)
While natural language is the de facto communication medium for LLM-based agents, it presents a fundamental constraint. The process of downsampling rich, internal latent states into discrete tokens inherently limits the depth and nuance of information that can be transmitted, thereby hindering collaborative problem-solving. Inspired by telepathy, which bypasses symbolic language in communication, we propose Interlat (Inter-agent Latent Space Communication), a paradigm that leverages the continuous last hidden states of an LLM as a representation of its thought for direct communication (termed latent communication). An additional learned compression process further compresses latent communication via latent space reasoning. Experiments demonstrate that Interlat outperforms both fine-tuned chain-of-thought (CoT) prompting and single-agent baselines, even across heterogeneous models, promoting more exploratory behavior and enabling genuine utilization of latent information. Further compression not only substantially accelerates inference by up to 24 times but also maintains competitive performance through an efficient information-preserving mechanism. We position this work as a feasibility study of entirely latent space inter-agent communication, and our results highlight its potential, offering valuable insights for future research. Our code is available at https://github.com/XiaoDu-flying/Interlat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。