arXiv:2608.11676cs.AI2026-08被引 2

让不同大模型间通信更准更快,靠实体锚定和隐状态查询。

XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communication

论文配图:XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communication
图 1 · 摘自论文原文
  • 用词元锚定和隐状态查询实现跨架构通信
  • 在7个任务上均超越文本通信,延迟降低11倍
  • 参数少、开销低,适合异构多智能体系统

异构多智能体大模型系统中,不同模型家族协同可减少冗余推理。现有通信协议或仅通过文本传递信息(丢失内部表征),或需架构一致才能进行隐层传输。我们发现跨架构通信存在实体接地问题:跨注意力桥接在连续表征传输时会因稀有词元压缩而丢失实体身份(仅桥接时F1约30%)。为此提出XBRIDGE,一种无需解码的通信协议,包含两项机制:词汇锚定映射(LAM)将发送方上下文词元映射至接收方词汇表,提供离散实体锚点;隐状态增强桥接(LEB)允许接收方查询发送方隐藏状态以获取上下文补充。实体锚点通过接收方自注意力机制将上下文信号与具体实体绑定。在三个模型家族(Llama、Qwen、Mistral)的七个基准测试中,无论通信方向,XBRIDGE均优于文本通信,在同架构设置下也超过KV共享基线六项任务。LEB仅需264M可训练参数(占接收方3.8%),在小规模均衡数据集上训练,推理开销极低。

原文摘要 · Abstract (English)

Heterogeneous multi-agent LLM systems, where agents are powered by different model families, can outperform homogeneous configurations by reducing redundant reasoning patterns. Yet existing communication protocols either operate through text, discarding the sender's internal representations, or require architectural homogeneity for latent-level transfer. We identify the entity grounding problem in cross-architecture communication: cross-attention bridges that transfer continuous representations across different LLM families suffer from rare-token compression collapse, where entity identity is lost in the continuous bottleneck (bridge-only F1 ~30%). We propose XBRIDGE, a decode-free communication protocol that addresses this through two mechanisms. Lexical Anchor Mapping (LAM) maps the sender's original context tokens to the receiver's vocabulary, providing discrete entity anchors. A Latent Enrichment Bridge (LEB) lets the receiver query the sender's hidden states for contextual enrichment. The entity anchors ground the bridge's contextual signals to specific entities through the receiver's own self-attention. Across three model families (Llama, Qwen, and Mistral), seven benchmarks, and both communication directions, XBRIDGE outperforms text-based communication on all seven tasks for each model pair while achieving 11x lower latency, and in a same-architecture setting it also exceeds a KV-sharing baseline on six of seven tasks. LEB requires only 264M trainable parameters (3.8% of the receiver), is trained on a small balanced sample set, and adds negligible inference overhead.

大模型通信异构系统实体接地低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。