验证了多智能体大模型中缓存传递是否真能传“隐性思想”
When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs
- 通过替换缓存为错位、置零或随机匹配的版本,进行因果审计
- 需要私有信息时,正确缓存提升100%,错误缓存仅23-25%效果
- 无需私有信息时,缓存差异不显著,说明并非所有缓存都传递思想
多智能体大模型系统通过传递键值缓存而非文本,并将性能提升归因于交换‘隐性思想’。我们对这一说法进行因果审计,将缓存替换为错位(例不符)、置零及同矩随机版本,分两种场景:接收方是否需发送方私有信息。当需要时,正确缓存达100%性能,无关缓存仅23-25%;该差异在三个模型族、五个检查点及一篇论文问答任务上均复现。当不需要时,五次种子预注册实验显示性能等效,误差在2.8点内,与系统报告增益锚定一致(Holm校正TOST测试)。三组Qwen3模型和8B规模的MedQA结果中,仅一单元略超边界;另一模型族未检测到优势。大缓存效应未必源于配对效应。在自然场景中,置零缓存损失14.7点,错位缓存仅损失0.4点。需求本身不充分:同一测试下,原生传递达天花板(LatentMAS),部分层传递(KVComm)为部分提升,而释放投影器(C2C)未检测到例特定传输。基准差值无法证明隐性思想传递,必须依赖错位缓存审计,本文已公开此方法。
原文摘要 · Abstract (English)
Multi-agent LLM systems relay key-value caches instead of text and credit their gains to exchanged "latent thoughts". That credit is a claim about which example's cache is relayed, not merely that one is. We audit it causally in released systems. The cache is replaced with deranged (mismatched-example), zeroed, and moment-matched random counterparts, under two regimes defined by whether the receiver needs the sender's private information. Where it does, the battery reads ceiling: 100% against 23-25% for answer-irrelevant relays on the primary backbone, a contrast replicated across three families, five checkpoints, and a prose document-QA surface. Where it does not, a pre-registered five-seed protocol establishes equivalence within 2.8 points, a margin anchored to the audited system's reported gain, under Holm-corrected TOST on GSM8K and ARC-Challenge across three Qwen3 scales and on MedQA at 8B (one cell shows a small detected advantage inside the margin); a second family shows no detected advantage. A large cache effect need not be a pairing effect. In one natural cell, zeroing the relay costs 14.7 points; a mismatched cache, 0.4. Nor is need sufficient: under the same test, delivered channels span ceiling (LatentMAS's native relay), partial (KVComm's layer subset), and no detected example-specific transfer (C2C's released projector). Benchmark deltas do not by themselves establish latent-thought transmission; establishing it takes a mismatched-cache audit, which we release.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。