让大模型学会判断何时该信工具结果,提升数学推理准确率。
When to Trust Tools? Adaptive Tool Trust Calibration For Tool-Integrated Math Reasoning
- 根据代码块置信度动态决定是否信任工具输出
- 在多个数据集上将错误的工具忽略率降低4.1%至7.5%
- 适用于需精准计算的数学推理任务,尤其适合开源工具集成模型
大型推理模型(LRMs)通过增加推理时计算量取得了显著性能提升,但受限于底层语言模型,其在需要精确计算和大量知识储备的任务中仍存在不足。工具集成推理(TIR)通过在推理过程中调用并执行工具,成为一种有前景的范式。尽管已有若干强大的开源TIR模型发布,我们的分析发现它们仍存在关键缺陷:当模型推理与工具结果冲突时,模型倾向于相信自身推理;且存在工具结果正确却被模型忽视的情况,我们称之为“工具忽略”。这表明模型缺乏对工具可信度的判断能力。为此,我们提出自适应工具信任校准(ATTC)框架,根据生成代码块的置信度动态决定是否信任或忽略工具结果。在不同规模的开源TIR模型及多个数据集上的实验表明,ATTC有效缓解了“工具忽略”问题,性能提升4.1%至7.5%。
原文摘要 · Abstract (English)
Large reasoning models (LRMs) have achieved strong performance enhancement through scaling test time computation, but due to the inherent limitations of the underlying language models, they still have shortcomings in tasks that require precise computation and extensive knowledge reserves. Tool-Integrated Reasoning (TIR) has emerged as a promising paradigm that incorporates tool call and execution within the reasoning trajectory. Although recent works have released some powerful open-source TIR models, our analysis reveals that these models still suffer from critical deficiencies. We find that when the reasoning of the model conflicts with the tool results, the model tends to believe in its own reasoning. And there are cases where the tool results are correct but are ignored by the model, resulting in incorrect answers, which we define as "Tool Ignored''. This indicates that the model does not know when to trust or ignore the tool. To overcome these limitations, We introduce Adaptive Tool Trust Calibration (ATTC), a novel framework that guides the model to adaptively choose to trust or ignore the tool results based on the confidence score of generated code blocks. The experimental results from various open-source TIR models of different sizes and across multiple datasets demonstrate that ATTC effectively reduces the "Tool Ignored" issue, resulting in a performance increase of 4.1% to 7.5%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。