用人类认知框架分析大模型推理过程,发现自我检查效果有限。
Probing the "Psyche'' of Large Reasoning Models: Understanding Through a Human Lens
- 构建五类十七种人类思维步骤分类体系
- 标注27.7万条推理步骤,发现自检多为表面操作
- 提出自动化标注工具CAPO,提升分析可扩展性
大型推理模型(LRMs)因其处理复杂任务的卓越能力受到广泛关注。受其推理过程表现出类人行为的启发,本文提出一个综合分类体系,用于刻画原子推理步骤,并从人类认知视角探究LRM的“心智”。该分类体系基于人类心理过程,包含五类17个类别,为理解LRM提供跨学科视角。将其应用于现有模型分析,构建了包含277,534个原子推理步骤的标注数据集。基于此,我们深入分析当前主流模型,提炼出若干可指导训练与后训练优化的关键启示:现有后答案阶段的“双重检查”(自监控评估)大多流于表面,极少带来实质性修正。因此,鼓励全面的多步反思,而非简单自检,或能更有效推动模型改进。为补充该分类体系,本文提出名为CAPO的自动标注框架,利用大语言模型生成基于分类体系的标注。实验表明,CAPO在与人类专家一致性上优于基线方法,支持从人类认知角度对LRM进行可扩展、全面的分析。整体而言,该分类体系、CAPO工具及衍生洞见共同提供了一条系统化、可扩展的路径,以深化对大型推理模型推理能力的理解与推进。
原文摘要 · Abstract (English)
Large reasoning models (LRMs) have garnered significant attention from researchers owing to their exceptional capability in addressing complex tasks. Motivated by the observed human-like behaviors in their reasoning processes, this paper introduces a comprehensive taxonomy to characterize atomic reasoning steps and probe the ``psyche'' of LRM intelligence. Specifically, it comprises five groups and seventeen categories derived from human mental processes, thereby grounding the understanding of LRMs in an interdisciplinary perspective. The taxonomy is then applied for an in-depth understanding of current LRMs, resulting in a distinct labeled dataset that comprises 277,534 atomic reasoning steps. Using this resource, we analyze contemporary LRMs and distill several actionable takeaways for improving training and post-training of reasoning models. Notably, our analysis reveals that prevailing post-answer ``double-checks'' (self-monitoring evaluations) are largely superficial and rarely yield substantive revisions. Thus, incentivizing comprehensive multi-step reflection, rather than simple self-monitoring, may offer a more effective path forward. To complement the taxonomy, an automatic annotation framework, named CAPO, is proposed to leverage large language models (LLMs) for generating the taxonomy-based annotations. Experimental results demonstrate that CAPO achieves higher consistency with human experts compared to baselines, facilitating a scalable and comprehensive analysis of LRMs from a human cognitive perspective. Together, the taxonomy, CAPO, and the derived insights provide a principled, scalable path toward understanding and advancing LRM reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。