用双系统理论拆解大模型的知识与推理,揭示二者分布与演化规律。
Decoupling Knowledge and Reasoning in LLMs: An Exploration Using Cognitive Dual-System Theory
- 分两阶段分析:快速思考(知识检索)与慢速思考(推理调整)
- 参数量越大,知识能力提升越明显,推理更谨慎但智力提升有限
- 知识在底层网络,推理在高层网络,适合研究模型机制与优化
大型语言模型在推理过程中同时依赖知识与推理能力,区分二者对模型分析、可解释性与开发至关重要。受双系统认知理论启发,本文提出一种认知归因框架,将模型认知分解为两个互补阶段:知识检索(第一阶段)和推理调整(第二阶段)。通过引导模型在‘快速思考’与‘慢速思考’两种认知模式下生成答案,分析其表现以量化知识与推理的贡献。该框架应用于15个大模型在3个数据集上的实验。结果表明:(1)推理调整具有领域特异性,对数学、物理、化学等推理密集型任务有益,可能损害知识密集型任务;(2)参数规模扩大同时提升知识与推理能力,其中知识提升更显著,且使模型推理更审慎,智力适度提升;(3)知识主要存在于网络底层,推理则集中在高层。该框架不仅从解耦视角深化了对大模型的理解,也为缩放定律、层级知识编辑及小模型推理局限性研究提供了新洞见。
原文摘要 · Abstract (English)
While large language models (LLMs) leverage both knowledge and reasoning during inference, the capacity to distinguish between them plays a pivotal role in model analysis, interpretability, and development. Inspired by dual-system cognitive theory, we propose a cognition attribution framework to decouple the contribution of knowledge and reasoning. In particular, the cognition of LLMs is decomposed into two distinct yet complementary phases: knowledge retrieval (Phase 1) and reasoning adjustment (Phase 2). To separate these phases, LLMs are prompted to generate answers under two different cognitive modes, fast thinking and slow thinking, respectively. The performance under different cognitive modes is analyzed to quantify the contribution of knowledge and reasoning. This architecture is employed to 15 LLMs across 3 datasets. Results reveal: (1) reasoning adjustment is domain-specific, benefiting reasoning-intensive domains (e.g., mathematics, physics, and chemistry) and potentially imparing knowledge-intensive domains. (2) Parameter scaling improves both knowledge and reasoning, with knowledge improvements being more pronounced. Additionally, parameter scaling make LLMs reasoning significantly more prudent, while moderately more intelligent. (3) Knowledge primarily resides in lower network layers, while reasoning operates in higher layers. Our framework not only helps understand LLMs from a "decoupling" perspective, but also provides new insights into existing research, including scaling laws, hierarchical knowledge editing, and limitations of small-model reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。