让大模型学会判断何时该用工具,减少不必要的调用。
SMART: Self-Aware Agent for Tool Overuse Mitigation
- 引入自知机制,动态平衡内部知识与外部工具使用。
- 工具调用减少24%,性能提升超37%,7B模型媲美70B。
- 适用于资源受限场景,尤其适合追求效率的智能体设计。
当前大型语言模型代理虽具强大推理与工具使用能力,但缺乏自我意识,难以有效权衡使用策略,导致过度依赖外部工具完成本可通过参数化知识解决的任务,增加计算开销。受人类元认知启发,我们提出SMART(Strategic Model-Aware Reasoning with Tools)范式,增强代理的自我意识以优化任务处理并减少工具滥用。为此构建SMART-ER数据集,涵盖三个领域,其中推理步骤在参数化知识与工具依赖之间交替,并为每一步提供解释性理由,说明工具使用的必要性。通过监督训练,开发出SMARTAgent系列模型,可动态调节参数化知识与工具使用。评估显示,SMARTAgent将工具使用减少24%,性能提升超过37%,使7B规模模型达到70B模型及GPT-4o水平。此外,其在GSM8K和MINTQA等分布外测试数据上保持准确率,工具调用仅需五分之一。这表明战略性工具使用能提升推理效率,缓解过用问题,缩小模型规模与性能差距,推动更智能、高效的智能体设计。
原文摘要 · Abstract (English)
Current Large Language Model (LLM) agents demonstrate strong reasoning and tool use capabilities, but often lack self-awareness, failing to balance these approaches effectively. This imbalance leads to Tool Overuse, where models unnecessarily rely on external tools for tasks solvable with parametric knowledge, increasing computational overhead. Inspired by human metacognition, we introduce SMART (Strategic Model-Aware Reasoning with Tools), a paradigm that enhances an agent's self-awareness to optimize task handling and reduce tool overuse. To support this paradigm, we introduce SMART-ER, a dataset spanning three domains, where reasoning alternates between parametric knowledge and tool-dependent steps, with each step enriched by rationales explaining when tools are necessary. Through supervised training, we develop SMARTAgent, a family of models that dynamically balance parametric knowledge and tool use. Evaluations show that SMARTAgent reduces tool use by 24% while improving performance by over 37%, enabling 7B-scale models to match its 70B counterpart and GPT-4o. Additionally, SMARTAgent generalizes to out-of-distribution test data like GSM8K and MINTQA, maintaining accuracy with just one-fifth the tool calls. These highlight the potential of strategic tool use to enhance reasoning, mitigate overuse, and bridge the gap between model size and performance, advancing intelligent and resource-efficient agent designs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。