大模型推理前就能预判思维链成败,早停可提速不降效
Knowing Before Saying: LLM Representations Encode Information About Chain-of-Thought Success Before Completion
- 用大模型初始表示预测思维链成功率,无需生成任何词元
- 早期表示已含关键信息,后期补充未必提升判断准确率
- 发现可提前终止推理,适合想优化效率的模型部署者
我们研究零样本思维链(CoT)过程的成功能否在完成前预测。发现基于大模型表示的探测分类器在首个词元生成前即表现良好,表明关键推理信息已存在于初始阶段。相比之下,仅依赖生成词元的强基线BERT模型表现较差,可能因其依赖表层语言线索而非深层推理动态。令人意外的是,使用后期推理步骤并不总能提升分类效果;当额外上下文无帮助时,早期表示与后期更相似,说明大模型在初期就编码了核心信息。这暗示推理常可早期终止而不损失性能。通过早期停止实验验证:截断思维链仍优于不使用思维链,尽管仍逊于完整推理。但诸如监督学习或强化学习等方法若结合本分类器指导,可有效识别何时可安全早停。研究结果为优化思维链效率提供了新思路。
原文摘要 · Abstract (English)
We investigate whether the success of a zero-shot Chain-of-Thought (CoT) process can be predicted before completion. We discover that a probing classifier, based on LLM representations, performs well \emph{even before a single token is generated}, suggesting that crucial information about the reasoning process is already present in the initial steps representations. In contrast, a strong BERT-based baseline, which relies solely on the generated tokens, performs worse, likely because it depends on shallow linguistic cues rather than deeper reasoning dynamics. Surprisingly, using later reasoning steps does not always improve classification. When additional context is unhelpful, earlier representations resemble later ones more, suggesting LLMs encode key information early. This implies reasoning can often stop early without loss. To test this, we conduct early stopping experiments, showing that truncating CoT reasoning still improves performance over not using CoT at all, though a gap remains compared to full reasoning. However, approaches like supervised learning or reinforcement learning designed to shorten CoT chains could leverage our classifier's guidance to identify when early stopping is effective. Our findings provide insights that may support such methods, helping to optimize CoT's efficiency while preserving its benefits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。