arXiv:2602.04284cs.AIcs.LG2026-02被引 2

让大模型智能删掉无用思考和观察,提升效率。

Agent-Omit: Adaptive Context Omission for Efficient LLM Agents

  • 根据思考与观测重要性动态删减内容,避免冗余计算。
  • 在5个基准上表现媲美顶尖模型,且更省资源。
  • 适合追求高效推理的开发者和部署场景。

在多轮智能体-环境交互中管理上下文(如思维和观测)是提升智能体效率的新策略。然而,现有研究将所有交互轨迹同等对待,忽视了不同轮次中思维必要性和观测实用性存在差异。为此,我们首先定量分析了思维与观测对智能体效果和效率的影响。基于发现,提出Agent-Omit:一种统一训练框架,使大模型智能体能够自适应地删除冗余思维与观测。具体而言,先用少量冷启动数据(包含单轮与多轮删减场景)微调智能体的删减行为;进一步引入感知删减的强化学习方法,结合双重采样机制与定制化删减奖励,激励智能体具备自适应删减能力。理论上证明了删减策略的偏差由KL散度上界控制。在五个智能体基准上的实验表明,构建的Agent-Omit-8B性能可媲美七种前沿大模型智能体,且在效果-效率平衡上优于七种高效方法。代码与数据已开源。

原文摘要 · Abstract (English)

Managing agent context (e.g., thought and observation) during multi-turn agent-environment interactions is an emerging strategy to improve agent efficiency. However, existing studies treat the entire interaction trajectories equally, overlooking the thought necessity and observation utility varies across turns. To this end, we first conduct quantitative investigations into how thought and observation affect agent effectiveness and efficiency. Based on our findings, we propose Agent-Omit, a unified training framework that empowers LLM agents to adaptively omit redundant thoughts and observations. Specifically, we first synthesize a small amount of cold-start data, including both single-turn and multi-turn omission scenarios, to fine-tune the agent for omission behaviors. Furthermore, we introduce an omit-aware agentic reinforcement learning approach, incorporating a dual sampling mechanism and a tailored omission reward to incentivize the agent's adaptive omission capability. Theoretically, we prove that the deviation of our omission policy is upper-bounded by KL-divergence. Experimental results on five agent benchmarks show that our constructed Agent-Omit-8B could obtain performance comparable to seven frontier LLM agent, and achieve the best effectiveness-efficiency trade-off than seven efficient LLM agents methods. Our code and data are available at https://github.com/usail-hkust/Agent-Omit.

大模型智能体效率优化自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。