研究发现语言模型的思考标记可删减,不影响甚至提升推理效果。
Revisiting Anthropomorphic Reflection Markers in Large Language Model Reasoning

- 通过提示和令牌层级干预消除思考标记
- 在多个基准上删标记后性能不变或提升,尤其采样预算大时
- 标记非反思本质,适合关注推理机制的学者
大型语言模型在复杂推理中常生成显式的反思痕迹,伴随如wait、hmm、alternatively等拟人化标记。尽管这些标记常被视为反思的可见指标,其机制仍不明确,存在冗余重复引发过度思考的风险。本文重新审视拟人化反思标记,探究其对推理的必要性与作用。通过提示级和令牌级干预抑制这些标记,并在四个基准和两个模型规模下分析其对任务性能的影响。结果表明,拟人化标记并非推理性能的普遍必需:抑制它们可在多个场景中保持甚至提升性能,尤其在较大采样预算下。同时,标记抑制并未消除反思行为,模型仍能进行无标记验证。这说明拟人化标记更偏向表面线索而非反思本身的可靠代理,为未来超越显式标记模式的推理机制研究提供启示。
原文摘要 · Abstract (English)
Large Language Models (LLMs) often produce explicit reflective traces during complex reasoning, accompanied by anthropomorphic markers such as wait, hmm, and alternatively. Although these markers are commonly used as visible indicators of reflection, their mechanisms remain unclear, which leaves the risk of overthinking associated with redundant and repetitive reflection markers. In this work, we revisit anthropomorphic reflection markers, examining their necessity for reasoning and role in the reflection. We suppress these markers through prompt-level and token-level interventions, and analyze their effects on task performance across four benchmarks and two model scales. Our results show that anthropomorphic markers are not uniformly necessary for reasoning performance: suppressing them can preserve or improve performance in several settings, especially under larger sampling budgets. Meanwhile, marker suppression does not necessarily remove reflection behavior, as models can still perform marker-free verification. These suggest that anthropomorphic markers tend to be surface cues rather than reliable proxies for reflection itself, and motivate future research on reasoning mechanisms beyond explicit marker patterns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。