arXiv:2510.24941cs.LG2025-10被引 10

提出量化思维步骤真实性的评分,发现大模型推理中大量步骤是装饰性废话。

Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thought

  • 用因果贡献度评分TTS量化每步推理对最终答案的影响
  • 30%以上推理步骤在顶级模型中属无因果影响的装饰性内容
  • 可精准删减冗余步骤,压缩66%长度仍保持性能

大型语言模型生成长序列思维链(CoT)推理,但已有研究指出其可能是事后合理化而非真实计算过程。本文提出真实思考评分(TTS),量化每个推理步骤在现实问题中对最终预测的因果贡献。在涵盖1.5B至1.1T参数的十一款模型上测试,发现多数推理链混杂着真正影响结果的步骤与看似有用却无因果影响的装饰性步骤;即使前沿模型如Kimi-K2.6,在MATH数据集上仍有超过30%的步骤被判定为装饰性(TTS ≤ 0.005)。TTS可用于有效剪枝:移除50%最低TTS步骤后,性能基本不变。基于剪枝后的推理链进行自训练,使Nemotron3-Nano-30B的推理长度减少66%且性能不变。进一步机制分析表明,可通过潜空间操控让模型启用或禁用特定推理步骤。结果表明,前沿大模型常表达非因果推理,挑战了思维链的效率与可信度。

原文摘要 · Abstract (English)

Large language models can generate long chain-of-thought (CoT) reasoning, yet prior work suggests that CoT can be post-hoc rationalization rather than a faithful reflection of the computation through explicitly designed settings. In this work, we go further and propose a True Thinking Score (TTS) to quantify the causal contribution of each step in CoT to the model's final prediction in realistic reasoning problems. Across eleven models ranging from 1.5B to 1.1T parameters on common reasoning benchmarks, we find that CoTs often interleave true-thinking steps, which causally affect the final answer, with decorative-thinking steps, which appear useful but have little causal influence; Such decorative steps remain prevalent even for frontier models: Over 30% of steps in Kimi-K2.6 are decorative on MATH with TTS <= 0.005. Furthermore, TTS enables effective CoT pruning: removing 50% of CoT steps with the lowest TTS can largely maintain the performance. Self-training on these pruned CoTs reduces reasoning length by 66% while preserving performance on Nemotron3-Nano-30B. Finally, we provide a mechanistic analysis showing that LLMs can be steered in the latent space to engage or disengage with reasoning steps. Overall, our results reveal that frontier LLMs often verbalize reasoning steps that are not causally used, challenging both the efficiency and the trustworthiness of CoT.

思维链模型解释因果分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。