arXiv:2608.01056cs.AIcs.CL2026-08被引 2

压缩工具使用智能体的控制指令,发现压缩后可靠性变化非线性,需实测验证。

Control Under Compression: Reliability Frontiers for Tool-Using Agents

  • 构建可验证环境,测试九种控制上下文在不同压缩比例下的表现
  • 35%保留上下文时,部分方法成功率降至20%以下,执行错误成主因
  • 压缩不是单纯省token,必须以运行结果可靠性为评价标准

工具使用型语言模型智能体不仅受任务提示影响,还受系统侧持久指令约束,包括工具、参数、策略、执行协议和恢复机制。压缩这些智能体控制上下文(ACCs)可降低输入成本与上下文占用,但现有提示压缩评估无法揭示压缩后控制是否仍可靠。我们提出CompressAgent,一个环境验证的基准,涵盖九个独立构建的ACCs、三类任务、三个固定Qwen API模型标识、六个保留上下文预算,共15,525次实验。发现压缩可靠性呈现非线性、方法依赖的前沿特性:在75%保留上下文时,通用重写与分节压缩分别达92.7%和92.4%成功率,接近93.8%的全上下文基线;但在50%至35%区间,方法差异显著,35%时分节、义务感知与通用重写成功率分别为47.0%、39.0%和19.9%;当保留上下文降至25%至10%时,可执行协议变得脆弱。可靠性在不同ACC间差异大,表明无法建立普适压缩器排序,需对每个上下文单独评估。故障分析显示,压缩主要引发工具执行与动作解析错误。研究将ACC压缩从单纯降本问题,重构为必须通过可执行结果验证的运行可靠性问题。

原文摘要 · Abstract (English)

Tool-using language-model agents are governed not only by task prompts but also by persistent system-side instructions that specify tools, arguments, policies, execution protocols, and recovery. Compressing these agent control contexts (ACCs) can reduce input cost and context use, yet existing prompt-compression evaluations do not reveal whether the resulting control remains operationally reliable. We introduce CompressAgent, an environment-verified benchmark for ACC compression across nine independently constructed ACCs, three task families, three fixed Qwen API model identifiers, six retained-context budgets, and 15,525 runs. We uncover a nonlinear, method-dependent reliability frontier. At 75% retained context, generic rewriting and section-based compression achieve 92.7% and 92.4% success, close to the 93.8% full-context baseline. Between 50% and 35%, methods diverge sharply; at 35%, section-based, obligation-aware, and generic rewriting achieve 47.0%, 39.0%, and 19.9%. At retained-context budgets from 25% to 10%, executable protocols become fragile. Reliability also varies substantially across ACCs, making universal compressor rankings inappropriate and motivating per-context qualification. Failure analysis shows that compression primarily surfaces as tool-execution and action-parsing errors. These findings recast ACC compression from token reduction into a runtime-reliability problem that must be evaluated through executable outcomes.

智能体压缩可靠性LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。