研究双模型协作中状态压缩如何影响约束保持,发现结构化数据更利于准确决策。
State Compression in Two-Agent LLM Relays: A Closed-World Study of Constraint Preservation

- 用结构化JSON提取手把手传递信息,保留关键约束条件
- 非结构化摘要使可行解准确率降至48%,而JSON达96%
- 嵌入剪枝无需生成调用,可行性仍达88%,适合高效部署
基于大语言模型的长周期代理常积累大量中间记录,包括审计、排除和数值计算。实际中这些状态会在传递给下游决策前被压缩,形成信息瓶颈,微小遗漏可能导致严格数值或类别约束失效。本文在封闭世界旅行规划双代理协作任务中评估手把手压缩效果:研究员对固定酒店与航班库存进行50个目标实例的审计,书票员仅根据目标和传递内容选择酒店-航班组合,库存信息不透露。比较四种传递方式:无压缩、叙事摘要、基于模式的JSON提取、基于嵌入的剪枝。通过穷举法获得精确可行与最优标签。结果表明,传递表示显著影响小模型下的可行性。JSON提取可行性准确率达0.96,而叙事摘要虽压缩量最小,可行性降为0.48;嵌入剪枝在不增加生成调用情况下,可行性达0.88,接近未压缩控制组。结果说明,约束检查依赖于结构化且可审计的传递形式,而非单纯简洁。
原文摘要 · Abstract (English)
Long-running Large Language Model (LLM)-based agents often accumulate large intermediate traces containing audits, eliminations, and numeric calculations. In practice, this state is compressed before handing it to a downstream decision step, creating an information bottleneck in which small omissions can break strict numeric or categorical constraints. This paper evaluates hand-off compression in a closed-world travel-planning relay with two LLM agents. A Researcher audits a fixed inventory of hotels and flights for 50 goal instances, and a Booker selects a hotel--flight pair using only the goal and the hand-off payload, with the inventory withheld. We compare four hand-off conditions: no compression, narrative summarization, schema-constrained JSON extraction, and embedding-based pruning. Exhaustive enumeration over the fixed inventory provides exact feasible and optimal labels. Results show that hand-off representation strongly affects downstream feasibility under a small decision model. JSON extraction achieves the highest feasibility accuracy at 0.96, while narrative summarization, despite producing the smallest compressed hand-off payload, degrades feasibility to 0.48. Embedding-based pruning matches the uncompressed control on feasibility at 0.88 without an additional generative compression call. These findings indicate that constraint checking benefits from structured and auditable hand-off representations rather than relying on brevity alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。