针对大模型智能体的提示压缩难题,提出无需推理的步骤级压缩方法AGORA。
AGORA: Adapter-Grounded Observation-Action Retention for Inference-Free Prompt Compression in LLM Agents

- 基于结构解析与保留关键格式内容,实现步骤级压缩。
- 在9个实验场景中8个保持超75%原始性能,最高压缩11.5倍。
- 适合需要高效推理的大模型智能体应用,尤其关注低延迟场景。
广泛使用的逐标记提取式压缩器对大模型智能体不适用:在17个(环境、主干模型、方法)组合中,所有情况下的平均奖励均≤0.05,尽管实现了1.3-13.3倍的实际压缩。我们将其归因于动作语法破坏——承载动作语义的标记(标识符、括号、动词)恰好具有最低自信息度,因此通用压缩器会可靠移除它们,导致环境拒绝残余输入。诊断指向步骤粒度压缩。我们提出AGORA,一种无需推理的步骤级压缩方法,结合结构化提示解析器、始终保留的格式与时效关键内容底限,以及一个在反事实下一步动作变化标签上训练的125M参数相关性评分器(每步~2毫秒,无每步大模型开销)。在对比的所有免推理与基于大模型的方法中,AGORA是唯一在9个实验中的8个保持≥75%未压缩性能(仅1个为73%);四向组件消融显示,结构底限是质量主导因素,而学习评分器带来1.0-11.5倍自适应端到端压缩,仅用单一固定保留率。
原文摘要 · Abstract (English)
The token-level extractive compressors widely used for general LM context are structurally inappropriate for LLM agents: across 17 (env, backbone, method) cells spanning two independent token-level method families, every cell collapses to mean reward <= 0.05 despite 1.3-13.3x realized compression. We name and characterize this failure mode as action-grammar destruction -- the tokens carrying action semantics (identifiers, brackets, action verbs) are exactly those self-information ranks lowest, so a general-purpose compressor reliably removes them and the environment rejects the residual. The diagnosis points to step-granularity compression. We introduce AGORA, an inference-free step-level compressor combining a structural prompt parser, an always-keep floor for format- and recency-critical content, and a 125M-parameter relevance scorer trained on counterfactual next-action-change labels (~2ms/step, zero per-step LLM toll). Across the compared inference-free and LLM-based methods, AGORA is the only one retaining >= 75% uncompressed performance in 8 of 9 cells (with the lone exception at 73%); a four-way component ablation isolates the structural floor as the dominant quality lever and the learned scorer as the source of 1.0-11.5x adaptive end-to-end compression from a single fixed keep ratio.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。