arXiv:2512.16970cs.AIcs.CL2025-12被引 1

让大模型代理自动优化任务上下文,提升推理效率与准确性。

PAACE: A Plan-Aware Automated Agent Context Engineering Framework

  • 基于任务规划结构分析,动态压缩上下文以减少冗余。
  • 在多个长流程任务中提升准确率,峰值上下文降低超30%。
  • 适合需要高效部署的大模型代理系统,尤其关注资源受限场景。

大型语言模型(LLM)代理正被广泛应用于涉及规划、工具调用、反思及外部知识系统交互的复杂多步工作流中。这类工作流产生的上下文迅速膨胀,需持续整理、转换与压缩,以保持信息完整性、避免注意力分散并降低推理成本。现有摘要与查询感知压缩方法普遍忽视代理推理的多步与计划感知特性。本文提出PAACE(Plan-Aware Automated Context Engineering),一个统一框架,通过下一k步任务相关性建模、计划结构分析、指令共精炼与功能保持压缩,优化LLM代理的演化状态。PAACE包含:(1) PAACE-Syn——大规模合成代理工作流数据集,附带逐步骤压缩标注;(2) PAACE-FT——由成功教师示范训练出的一系列轻量级、计划感知压缩器。在长周期基准测试(AppWorld、OfficeBench、8-Objective QA)中,PAACE持续提升代理正确率,显著降低上下文负载。在AppWorld上,其准确率优于所有基线,同时峰值上下文与累计依赖下降。在OfficeBench和多跳问答中,准确率与F1均提升,步数更少,峰值令牌数更低,注意力依赖减少。经蒸馏的PAACE-FT保留97%教师性能,推理成本降低超一个数量级,使计划感知压缩可实用化部署于小型模型。

原文摘要 · Abstract (English)

Large Language Model (LLM) agents are increasingly deployed in complex, multi-step workflows involving planning, tool use, reflection, and interaction with external knowledge systems. These workflows generate rapidly expanding contexts that must be curated, transformed, and compressed to maintain fidelity, avoid attention dilution, and reduce inference cost. Prior work on summarization and query-aware compression largely ignores the multi-step, plan-aware nature of agentic reasoning. In this work, we introduce PAACE (Plan-Aware Automated Context Engineering), a unified framework for optimizing the evolving state of LLM agents through next-k-task relevance modeling, plan-structure analysis, instruction co-refinement, and function-preserving compression. PAACE comprises (1) PAACE-Syn, a large-scale generator of synthetic agent workflows annotated with stepwise compression supervision, and (2) PAACE-FT, a family of distilled, plan-aware compressors trained from successful teacher demonstrations. Experiments on long-horizon benchmarks (AppWorld, OfficeBench, and 8-Objective QA) demonstrate that PAACE consistently improves agent correctness while substantially reducing context load. On AppWorld, PAACE achieves higher accuracy than all baselines while lowering peak context and cumulative dependency. On OfficeBench and multi-hop QA, PAACE improves both accuracy and F1, achieving fewer steps, lower peak tokens, and reduced attention dependency. Distilled PAACE-FT retains 97 percent of the teacher's performance while reducing inference cost by over an order of magnitude, enabling practical deployment of plan-aware compression with compact models.

大模型代理上下文压缩计划感知推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。