arXiv:2601.23163cs.LGcs.AI2026-01被引 4

通过截断推理过程,揭示大模型决策如何随推理进展逐步变准。

Probing the Trajectories of Reasoning Traces in Large Language Models

  • 截断不同比例的推理文本,测试其对答案分布的影响。
  • 推理越完整,准确率与判断力度越高,且由内容决定而非长度或风格。
  • 可诊断模型可靠性,适用于高效安全部署推理系统。

大语言模型(LLMs)越来越多地通过生成推理轨迹来解决复杂问题。然而,准确率和决策坚定性如何随推理过程演变,以及中间推理段是否蕴含比长度或风格更深层的信息,仍不明确。本文提出一种系统性探针协议:1)生成模型推理轨迹;2)在固定令牌百分位处截断;3)将截断部分重新输入模型(或另一模型),通过下一个词概率测量答案选择的分布。我们在开源Qwen3-4B/-8B/-14B及gpt-oss-20b/-120b模型上,针对多选题基准GPQA Diamond和MMLU-Pro进行了实验。结果表明,随着提供推理令牌的比例增加,准确率与决策坚定性持续上升。这些提升主要源于生成内容的相关性,而非上下文长度或通用“推理风格”效应。更强模型能成功从错误推理中回溯,但初始回答常固守于弱模型的错误输出。总体而言,轨迹探针可为推理模型的高效安全部署提供诊断依据,相关度量可指导实际的轨迹处理与监控策略,在不假设中间令牌是可信解释的前提下提升可靠性。

原文摘要 · Abstract (English)

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and whether intermediate trace segments provide answer-relevant information beyond generic length or stylistic effects. Here, we propose a protocol to systematically probe the trajectories of reasoning traces in LLMs by 1) generating a model's reasoning trace, 2) truncating it at fixed token-percentiles, and 3) injecting each partial trace back into the model (or a different model) to measure the induced distribution over answer choices via next-token probabilities. We apply this protocol to the open-source Qwen3-4B/-8B/-14B and gpt-oss-20b/-120b models across the multiple-choice GPQA Diamond and MMLU-Pro benchmarks. We find that accuracy and decision commitment consistently increase as the percentage of provided reasoning tokens grows. These gains are primarily driven by relevant content in the model generation rather than context length or generic "reasoning style" effects. Stronger models often backtrack successfully from incorrect partial traces, but immediate answers often remain anchored in the weaker model's incorrect response. More broadly, we show that trajectory probing provides diagnostics for efficient and safer deployment of reasoning models as the measurements can inform practical trace-handling and monitoring policies that improve reliability without assuming intermediate tokens are inherently faithful explanations.

大模型推理轨迹模型诊断可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。