多智能体系统中,摘要会丢失使用边界信息,导致隐私泄露。
Facts Without Rules: Boundary Metadata Collapse in Multi-Agent LLM Handoffs
- 摘要压缩时优先保留操作事实,弱化使用边界元数据
- 25词预算下边界标记存活率从0.80降至0.57,事实保留率仍接近满分
- 明确标注使用权限可将泄露率降至15%以下,是关键防护手段
多智能体大模型系统常通过压缩上游交互生成交接文档,供下游智能体视为共享状态。本文发现该交接环节是隐私泄露的结构性源头:摘要倾向于保留操作事实,同时削弱控制事实使用方式的边界元数据——这一失效模式称为“摘要坍塌”。在受控多智能体协作测试平台中,通过人工验证裁判(κ=0.74)衡量标记存活率,σ_b=1表示所有边界标记完整保留,σ_b=0表示全部丢失。在GPT-5-mini与DeepSeek-R1-32B上,边界标记与操作事实存活率几乎不相关(皮尔逊r趋近零):未压缩自由文本交接的边界标记存活率σ_b≈0.80,而25词预算下σ_b降至≈0.57,操作事实存活率仍维持高位。下游控制实验表明,保护效果取决于边界显式程度:模糊表述在GPT中导致73%泄露,DeepSeek为50%,而明确约束使三模型泄露率均低于15%。无交接的单智能体对照组显示,该问题并非由多智能体结构引起,直接访问全标记仍比操作化交接更易泄露。仅靠提示词缓解或精确字符串删除仅部分有效,而基于黄金标准的受众白名单几乎完全消除泄露,表明正确识别受众边界是核心因素。
原文摘要 · Abstract (English)
Multi-agent LLM systems often coordinate by compressing an upstream interaction into a handoff artifact that downstream agents treat as shared state. We show that this handoff step is a structural source of privacy leakage: summaries preferentially preserve operational facts while weakening the boundary metadata that governs how those facts may be used---a failure mode we call \emph{summary collapse}. On a controlled multi-agent coordination testbed we measure marker survival with a human-validated judge ($κ= 0.74$), where $σ_b = 1$ means every boundary marker survives verbatim and $σ_b = 0$ means all are lost. Boundary-marker and operational-fact survival are nearly uncorrelated at the handoff level on both GPT-5-mini and DeepSeek-R1-32B (Pearson $r$ near zero): uncompressed free-text handoffs preserve boundaries at $σ_b \approx 0.80$, whereas a $25$-word budget drops $σ_b$ to ${\approx}0.57$ while operational-fact survival stays near ceiling. Controlled downstream tests reveal that protection depends on \emph{boundary explicitness}: vague languages leak in $73\%$ of GPT and $50\%$ of DeepSeek cases, while explicit constraints reduce leakage to under $15\%$ across all three tested models. A no-handoff single-agent control further shows the failure is not reducible to multi-agent topology as direct full-marker access still leaks more often than the operationalized handoff. Prompt-only mitigation and exact-string redaction only partially address the problem, while a gold-derived audience allowlist nearly eliminates leakage across models, showing that correctly identifying audience boundaries is the key factor.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。