arXiv:2604.19821cs.AIcs.SE2026-04ACL被引 3

通过联合优化指令与工具描述,提升大模型在多工具场景下的调用准确率。

JTPRO: A Joint Tool-Prompt Reflective Optimization Framework for Language Agents

论文配图:JTPRO: A Joint Tool-Prompt Reflective Optimization Framework for Language Agents
图 1 · 摘自论文原文
  • 迭代式反思机制联合优化全局指令与各工具参数描述
  • 在多工具基准上整体成功率提升5%-20%(相对)
  • 适合需要高可靠工具调用的复杂任务自动化系统

大型语言模型代理在集成外部工具时,随着工具数量增加且领域专用化,常因工具描述模糊和指令不明确导致工具误选与参数错误填充。我们提出联合工具-提示反思优化框架(JTPRO),通过滚动回放驱动的反思机制,在有监督轨迹设置下协同优化全局指令与每个工具的模式/参数描述,以提高大规模工具库中工具选择与参数实例化的准确性。JTPRO仅保留完成正确消歧和槽位填充所需的局部线索。在多个多工具基准测试中,采用三项指标评估:工具选择准确率(TSA)、槽位填充准确率(SFA)与整体成功率(OSR)。JTPRO显著优于强基线模型,包括CoT风格代理及反射提示优化器GEPA,在OSR上相对提升5%-20%。消融实验表明,联合优化指令与工具模式比单独优化任一组件更有效、更鲁棒。

原文摘要 · Abstract (English)

Large language model (LLM) agents augmented with external tools often struggle as number of tools grow large and become domain-specific. In such settings, ambiguous tool descriptions and under-specified agent instructions frequently lead to tool mis-selection and incorrect slot/value instantiation. We hypothesize that this is due to two root causes: generic, one-size-fits-all prompts that ignore tool-specific nuances, and underspecified tool schemas that lack clear guidance on when and how to use each tool and how to format its parameters. We introduce Joint Tool-Prompt Reflective Optimization (JTPRO), a framework for improving tool-calling reliability in trace-supervised settings by iteratively using rollout-driven reflection to co-optimize global instructions and per-tool schema/argument descriptions for accurate tool selection and argument instantiation in large tool inventories. JTPRO is designed to preserve only tool-local cues needed for correct disambiguation and slot filling. We evaluate JTPRO across multi-tool benchmarks, which account for different number of tools using three metrics: Tool Selection Accuracy (TSA), Slot Filling Accuracy(SFA), and Overall Success Rate(OSR) (correct tool + correct slots + correct values). JTPRO consistently outperforms strong baselines, including CoT-style agents, and reflective prompt optimizers such as GEPA by 5%-20% (relative) on OSR. Ablations show that joint optimization of instructions and tool schemas is more effective and robust than optimizing either component in isolation.

语言模型工具调用优化框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。