arXiv:2511.10899cs.CLcs.LO2025-11ACL

工具增强模型虽答对题,但推理变糊,像作弊却无解释。

From Proof to Program: Characterizing Tool-Induced Reasoning Hallucinations in Large Language Models

  • 用代码工具解题时,模型把输出当答案,跳过真实推理过程。
  • 工具使用越多,推理越混乱,正确率虽升19.3%,但逻辑错更多。
  • 适合关注AI可信推理的开发者与评测研究者,警惕‘工具幻觉’。

工具增强语言模型(TaLMs)可通过调用外部工具解决超出自身参数容量的问题。然而,这种能力是否代表可信推理仍不明确。聚焦代码解释器工具,我们发现即使工具被正确选择和执行,模型仍会将工具输出视为推理替代品,生成看似正确但缺乏连贯解释的解法。我们称之为工具诱导短视(TIM)。通过PYMATH基准(包含1679道竞赛级数学题,需Python代码辅助但不足以为解),我们构建多维评估体系,量化工具使用对推理质量的负面影响。结果表明,尽管TaLM在最终答案准确率上提升最高达19.3个百分点,其推理行为却持续恶化——非工具模型在推理过程对比中胜出高达41.5%。工具使用频率越高,推理越不连贯;错误类型也从算术错误转向全局性逻辑、假设或创造失败,约55%高风险案例存在TIM现象。最后,我们提出基于偏好优化的框架,使模型将工具作为辅助证据,显著提升答案准确率与推理深度。

原文摘要 · Abstract (English)

Tool-augmented Language Models (TaLMs) can invoke external tools to solve problems beyond their parametric capacity. However, it remains unclear whether these tool-enabled gains reflect trustworthy reasoning. Focusing on the Code Interpreter tool, we show that even when tools are selected and executed correctly, TaLMs treat tool outputs as substitutes for reasoning, producing solutions that appear correct but lack coherent justification. We term this failure mode Tool-Induced Myopia (TIM), and study it using PYMATH, a benchmark of 1,679 competition-level mathematical problems for which Python code is helpful but not sufficient. We further develop a multi-dimensional evaluation suite to quantify reasoning degradation in TaLMs relative to their non-tool counterparts. Our findings reveal that while TaLMs achieve up to a 19.3 percentage point gain in final-answer accuracy, their reasoning behavior consistently deteriorates (e.g., non-tool LLMs win up to 41.5% more often in pairwise comparisons of the reasoning process). This degradation intensifies with tool use; the more frequently a model invokes tools, the less coherent its reasoning becomes. Moreover, tool use shifts errors from arithmetic mistakes toward global reasoning failures (logic, assumption, creativity); with TIM present in ~55% of high-risk cases. Finally, we propose a preference-optimization-based framework that realigns TaLMs to use tools as assistive evidence, improving both final-answer accuracy and reasoning depth under tool use. Codes and data are available at: https://github.com/megagonlabs/TIM.

大模型推理工具幻觉可信AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。