arXiv:2510.11588cs.AI2025-10ACL被引 2

让大模型学会内化复杂政策文档,提升推理效率与准确性。

Analyzing and Internalizing Complex Policy Documents for LLM Agents

  • 通过分类提取政策中的事实、行为与条件,实现针对性数据合成
  • 在复杂政策下相比监督微调提升41%性能,减少97.3%提示长度
  • 适合需要处理多层级业务规则的智能代理系统开发者

基于大语言模型的智能体系统依赖上下文中的政策文档来编码多样化的业务规则。随着需求增长,这些文档迅速膨胀,带来高昂的计算开销。这促使研究将政策文档内化到模型先验中,同时保持性能。以往的提示压缩工作针对通用提示,而智能体政策文档具有多层次复杂性,需更深层次推理,使内化更具挑战。我们提出CC-Gen,一个具有可控复杂度的智能体基准生成器,涵盖四个复杂度等级,支持对智能体处理复杂性的系统评估,并提供统一框架以评估政策内化效果。分析显示,管理流程的复杂政策规范构成主要推理障碍。使用包含思维链标注的真实用户交互轨迹进行监督微调虽有效,但数据需求大,且随政策复杂度上升性能急剧下降。为缓解数据与推理负担,我们提出类别感知政策持续预训练(CAP-CPT)。自动化管道解析政策文档,提取关键规范并分为事实、行为、条件三类,分离出驱动流程复杂性的高阶条件。该结构指导目标数据合成,使智能体通过自回归预训练损失内化政策信息。实验表明,CAP-CPT在所有设置下均优于监督微调基线,在Qwen-3-32B上分别取得41%和22%的性能提升,于CC-Gen实现97.3%的提示长度缩减,并在tau-Bench上以极少微调数据进一步提升表现。

原文摘要 · Abstract (English)

Large Language Model (LLM)-based agentic systems rely on in-context policy documents encoding diverse business rules. As requirements grow, these documents expand rapidly, causing high computational overhead. This motivates developing internalization methods that embed policy documents into model priors while preserving performance. Prior prompt compression work targets generic prompts, but agentic policy documents span multiple complexity levels and require deeper reasoning, making internalization harder. We introduce CC-Gen, an agentic benchmark generator with Controllable Complexity across four levels, enabling systematic evaluation of agents' ability to handle complexity and offering a unified framework for assessing policy internalization. Our analysis shows that complex policy specifications governing workflows pose major reasoning challenges. Supporting internalization with gold user agent interaction trajectories containing chain-of-thought (CoT) annotations via supervised fine-tuning (SFT) is data-intensive and degrades sharply as policy complexity increases. To mitigate data and reasoning burdens, we propose Category-Aware Policy Continued Pretraining (CAP-CPT). Our automated pipeline parses policy documents to extract key specifications, grouping them into factual, behavioral, and conditional categories, and isolating complex conditions that drive workflow complexity. This guides targeted data synthesis and enables agents to internalize policy information through an autoregressive pretraining loss. Experiments show CAP-CPT improves SFT baselines in all settings, with up to 41% and 22% gains on Qwen-3-32B, achieving 97.3% prompt length reduction on CC-Gen and further enhancing tau-Bench with minimal SFT data.

智能代理政策内化大模型推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。