用简单分类器挖掘大模型内在推理能力,提升数学题解题效果
ThoughtProbe: Classifier-Guided Thought Space Exploration Leveraging LLM Intrinsic Reasoning
- 用线性分类器检测大模型激活空间中的推理线索,定位关键层和表示类型
- 构建树状搜索框架,按推理质量优先扩展思路,覆盖更完整解题路径
- 通过聚合多分支推理得分,选出最优答案,显著提升多个数学推理基准表现
预训练大语言模型在扩展输出空间时可自然涌现出内在推理能力,但其神经表征机制及最优利用方式仍不明确。本文发现,一个简单的线性分类器能有效检测大模型激活空间中的内在推理信号,尤其在特定表示类型和网络层中。基于此,我们提出一种分类器引导的树状搜索框架:在每个节点扩展中,分类器作为评分与排序机制,高效分配计算资源,优先选择更具深度的推理方向。完成全树展开后,收集所有分支的答案形成候选池,并采用分支聚合选择方法,通过综合各支持分支的推理得分,从中识别最优答案。实验表明,该框架的全面探索不仅覆盖了有效的推理链,还精准识别出它们,在多个算术推理基准上实现显著提升。
原文摘要 · Abstract (English)
Pre-trained large language models (LLMs) have been demonstrated to possess intrinsic reasoning capabilities that can emerge naturally when expanding the response space. However, the neural representation mechanisms underlying these intrinsic capabilities and approaches for their optimal utilization remain inadequately understood. In this work, we make the key discovery that a simple linear classifier can effectively detect intrinsic reasoning capabilities in LLMs' activation space, particularly within specific representation types and network layers. Based on this finding, we propose a classifier-guided search framework that strategically explore a tree-structured response space. In each node expansion, the classifier serves as a scoring and ranking mechanism that efficiently allocates computational resources by identifying and prioritizing more thoughtful reasoning directions for continuation. After completing the tree expansion, we collect answers from all branches to form a candidate answer pool. We propose a branch-aggregation selection method that marginalizes over all supporting branches by aggregating their thoughtfulness scores, thereby identifying the optimal answer from the pool. Experimental results show that our framework's comprehensive exploration not only covers valid reasoning chains but also effectively identifies them, achieving significant improvements across multiple arithmetic reasoning benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。