用理论指导的工具揭示大模型推理能力的可激发边界。
NeuReasoner: Theory-grounded Mapping of Reasoning Elicitation Boundaries

- 结合神经与认知理论,设计模块化推理激发框架
- 在算术、代码生成等任务上达到或超越后训练模型表现
- 发现不确定性决策等任务难以通过激发恢复
大量研究表明,大语言模型的推理能力主要潜藏于基础模型中,后训练仅起放大作用而非引入新能力。但现有证据多来自数学和编码基准,缺乏对能力激发边界的具体探索——哪些认知任务可通过激发恢复,哪些无法恢复。为此,我们提出NeuReasoner,一种基于理论的激发工具。每一步由受功能特异性启发的神经透镜与源于提问论推理理论的认知透镜协同工作,通过单模型内部模块化整合输出,无需外部工具。我们在CogBench(涵盖认知心理学行为任务)及标准数学与编码基准上评估NeuReasoner,衡量其相对于原生推理的提升程度及其匹配后训练思维模式的能力。在足够规模下,NeuReasoner在算术推理、代码生成、贝叶斯推理和奖励学习任务上达到或超过后训练基线,且在与自洽性、迭代精炼等基线相同决策调用预算下仍保持优势。结果表明:风险偏好与不确定情境下的决策仍难以通过激发恢复;模型规模与激发效果存在双向交互:在某些认知特征上扩大优势,而在另一些上则消除优势。总体而言,NeuReasoner作为模块化、可解释、理论驱动的激发工具,首次实证绘制出推理激发在数学与编码以外的任务中的成功与失败边界。
原文摘要 · Abstract (English)
A growing body of work suggests that the reasoning capabilities of large language models are largely latent in their base form, with post-training primarily amplifying rather than introducing them. However, this evidence comes mainly from mathematical and coding benchmarks, leaving the boundary conditions of that claim largely unexplored, namely which cognitive tasks can be recovered through elicitation and where that recovery fails. To investigate this, we introduce NeuReasoner, a theory-grounded elicitation instrument. At each step, an orchestrator pairs a Neuro Lens, inspired by functional specificity, with a Cognitive Lens, drawn from the Erotetic Theory of Reasoning, and integrates their outputs through internal modularization of a single model, without external tools. We evaluate NeuReasoner on CogBench, a suite of behavioral tasks from cognitive psychology, alongside standard mathematical and coding benchmarks, measuring both its improvement over vanilla inference and its ability to match a model's post-trained thinking mode. At sufficient scale, NeuReasoner matches or exceeds thinking-mode baselines on arithmetic reasoning, code generation, Bayesian reasoning, and reward learning; these gains persist against self-consistency and iterative-refinement baselines matched to NeuReasoner's per-decision call budget. Using NeuReasoner allows us to find clear boundaries: risk-taking and decision making under uncertainty remains hard to recover through elicitation alone, and model scale interacts with elicitation in both directions: widening its advantage on some cognitive signatures while erasing it on others. Overall, through NeuReasoner as a modular, interpretable, theory-grounded elicitation instrument, we empirically map where reasoning elicitation succeeds and fails, beyond the mathematical and coding benchmarks where prior claims have rested.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。