arXiv:2605.09931cs.CLcs.AI2026-05被引 2

通过推理时剪枝工具调用,提升大模型解题效率与准确率。

PruneTIR: Inference-Time Tool Call Pruning for Effective yet Efficient Tool-Integrated Reasoning

论文配图:PruneTIR: Inference-Time Tool Call Pruning for Effective yet Efficient Tool-Integrated Reasoning
图 1 · 摘自论文原文
  • 在推理时动态剪枝错误工具调用路径,避免无效尝试。
  • 显著提升通过率(Pass@1)并减少上下文长度消耗。
  • 无需训练,适合已有工具集成的大模型快速优化。

工具集成推理(TIR)使大语言模型(LLMs)通过调用外部工具(如代码解释器)增强能力。现有研究多关注如何赋予模型使用工具的能力,但对已有工具能力的模型在推理时如何进一步提升推理效果仍缺乏探索。我们发现,在工具集成的LLM推理过程中,错误工具调用的数量和比例与答案正确性呈负相关;且大多数错误可在少数后续轮次内被解决,若未能解决,则模型往往难以继续修复。基于此,我们提出PruneTIR框架,通过三个组件——成功触发剪枝、卡住触发剪枝与重采样、重试触发工具暂停——在推理时剪枝轨迹、重采样工具调用并暂停工具使用。该方法有效缓解错误调用的负面影响,防止模型陷入重复失败循环,显著提升整体性能。实验表明,PruneTIR在不增加训练成本的前提下,显著提升Pass@1,并降低工作上下文长度。

原文摘要 · Abstract (English)

Tool-integrated reasoning (TIR) enables large language models (LLMs) to enhance their capabilities by interacting with external tools, such as code interpreters (CI). Most recent studies focus on exploring various methods to equip LLMs with the ability to use tools. However, how to further boost the reasoning ability of already tool-capable LLMs at inference time remains underexplored. Improving reasoning at inference time requires no additional training and can help LLMs better leverage tools to solve problems. We observe that, during tool-capable LLM inference, both the number and the proportion of erroneous tool calls are negatively correlated with answer correctness. Moreover, erroneous tool calls are typically resolved successfully within a few subsequent turns. If not, LLMs often struggle to resolve such errors even with many additional turns. Building on the above observations, we propose PruneTIR, a rather effective yet efficient framework that enhances the tool-integrated reasoning at inference time. During LLM inference, PruneTIR prunes trajectories, resamples tool calls, and suspends tool usage through three components: Success-Triggered Pruning, Stuck-Triggered Pruning and Resampling, and Retry-Triggered Tool Suspension. These three components enable PruneTIR to mitigate the negative impact of erroneous tool calls and prevent LLMs from getting stuck in repeated failed resolution attempts, thereby improving overall LLM performance. Extensive experimental results demonstrate the effectiveness of PruneTIR, which significantly improves Pass@1 and efficiency while reducing the working context length for tool-capable LLMs.

推理优化工具调用大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。