arXiv:2605.10799cs.LGcs.AI2026-05

发现推理链评估中答案位置比计算步骤更重要

The Last Word Often Wins: A Format Confound in Chain-of-Thought Corruption Studies

  • 用移除答案但保留推理的对比实验,验证答案位置影响评估结果
  • 7B模型在错误答案后准确率骤降至零,大模型则随规模下降
  • 适合关注推理评估方法可靠性的研究者阅读

推理链(CoT)可信度评估常用篡改实验,通过破坏某一步骤观察准确率下降来判断其重要性。本文发现,当基准数据集(如GSM8K和MATH)的推理链以明确的答案行结尾时,此类测试实际测量的是‘答案位置’而非真实计算过程的位置。在匹配的GSM8K样本中,仅移除最终答案语句而保留全部推理,使Qwen 2.5-3B的后缀敏感性降低约19倍(N=300,p=0.022)。含正确推理但错误答案的提示,在五种开源模型家族中使7B模型准确率降至零或接近零;错误答案后的敏感性在3B–7B间较强,但在更大模型中急剧减弱。在MATH数据集上的复现、7B模型内部稳定比较及无后缀链的实验均显示相同规律:篡改敏感性始终与显式答案文本位置相关,而非固定计算深度。生成阶段探针表明,最终答案在生成过程中极少早确定(<5%早期承诺),但消费阶段的行为却系统性依赖于答案文本。该混淆主要源于链被消费时的读取效应。为此,提出包含问题对照、格式表征和全位置扫描的三要素协议,作为未来基于篡改的可信度研究的最低实践标准。

原文摘要 · Abstract (English)

Corruption studies, the standard tool for evaluating chain-of-thought (CoT) faithfulness, infer which steps are ``computationally important'' from accuracy loss when steps are corrupted. We show that when benchmark chains end with an explicit terminal answer line, as in GSM8K and MATH, these tests largely measure \emph{answer placement} rather than where intermediate computation is carried out. Using matched GSM8K examples, removing only the final answer statement while preserving all reasoning collapses suffix sensitivity by about $19\times$ for Qwen~2.5-3B ($N{=}300$, $p{=}0.022$). Conflicting-answer prompts, which contain correct reasoning but a wrong explicit final answer, drive accuracy to zero or near-zero at 7B across five open-weight model families; wrong-answer following is strong at 3B--7B and attenuates sharply at larger scales. Replications on MATH, within-stable comparisons at 7B, and suffix-free chains show the same pattern in different guises: corruption sensitivity tracks the location of explicit answer text, not a fixed computational depth in the reasoning. Generation-time probes indicate that final answers are rarely early-determined during generation (${<}5\%$ early commitment), yet consumption-time behavior systematically follows explicit answer text. The confound is therefore largely a readout effect when the chain is consumed. We propose a three-prerequisite protocol (question-only control, format characterization, and an all-position sweep) as a practical minimum for future corruption-based faithfulness studies.

推理链评估方法模型可信度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。