arXiv:2506.13464cs.CLcs.AI2025-06NeurIPS被引 4

给大模型学习能力建模,发现越大的模型越懂抽象概念。

Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study

  • 从认知心理学出发,拆解学习为三类:听讲、理解概念、积累经验。
  • 大模型在抽象理解上随规模提升,但难以从大量例子中学习。
  • 提出新评测基准,可诊断模型如何学得更像人。

大型语言模型(LLMs)在数学、编程和推理等任务中表现优异,但其适应动态环境与获取新知识的学习能力仍缺乏深入研究。本文受认知心理学与教育学启发,将通用学习能力分解为三个互补维度:从教师指导中学习(获取显性知识)、从概念中学习(内化抽象结构并泛化到新情境)、从经验中学习(通过探索与反馈调整)。我们对这三个维度开展全面实证研究,发现:(i) 互动促进学习;(ii) 概念理解是规模涌现的,大模型受益更大;(iii) LLMs 是有效的少样本学习者,但非多样本学习者。基于此框架与发现,我们构建了一个统一且真实的评估基准,用于衡量模型在三类学习认知维度上的综合学习能力,支持诊断分析,并推动更具适应性与类人特征的模型发展。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains underexplored. In this work, we address this gap by introducing a framework inspired by cognitive psychology and education. Specifically, we decompose general learning ability into three distinct, complementary dimensions: Learning from Instructor (acquiring knowledge via explicit guidance), Learning from Concept (internalizing abstract structures and generalizing to new contexts), and Learning from Experience (adapting through accumulated exploration and feedback). We conduct a comprehensive empirical study across the three learning dimensions and identify several insightful findings, such as (i) interaction improves learning; (ii) conceptual understanding is scale-emergent and benefits larger models; and (iii) LLMs are effective few-shot learners but not many-shot learners. Based on our framework and empirical findings, we introduce a benchmark that provides a unified and realistic evaluation of LLMs' general learning abilities across three learning cognition dimensions. It enables diagnostic insights and supports evaluation and development of more adaptive and human-like models.

大模型学习认知框架评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。