用大模型模拟真实学习过程,揭示LLM本质是表面努力的假学霸。
Simulating Human-Like Learning Dynamics with LLM-Empowered Agents
- 构建心理画像的AI学习者,通过时间演进追踪学习动态。
- 只有深层学习者持续进步,普通大模型默认表现像表面努力的假学霸。
- 可解释地揭示不同学习风格与自我认知演化,适合教育研究者参考。
基于深度学习方法模拟人类学习行为已成为心理学与智能系统领域的研究热点。现有方法依赖受控实验或规则模型,难以捕捉学习动态、追踪长期进展或提供可解释性。为此,我们提出LearnerAgent——一种基于大语言模型(LLMs)的多智能体框架,用于构建逼真的教学环境。我们设计了深究型、表层型、懒惰型等心理驱动型学习者,以及无角色设定的通用学习者,以考察基座LLM的默认行为。通过每周知识获取、每月策略选择、定期测试及同伴互动,可追踪个体学习者一整年的动态成长。研究发现:1)纵向分析显示,仅深究型学习者实现持续认知提升;特制“陷阱题”有效识别表层型学习者的浅层知识;2)不同学习者的言行模式与其心理画像高度一致;3)学习者自我概念评分随时间合理演变,通用学习者虽认知有限却发展出异常高的自我效能感;4)关键发现:基座LLM默认表现为“勤奋但脆弱的表层学习者”——模仿优秀学生行为,缺乏真正的泛化理解。大规模模拟实验表明,LearnerAgent与真实场景高度契合,为理解LLM行为提供了更深入洞见。
原文摘要 · Abstract (English)
Capturing human learning behavior based on deep learning methods has become a major research focus in both psychology and intelligent systems. Recent approaches rely on controlled experiments or rule-based models to explore cognitive processes. However, they struggle to capture learning dynamics, track progress over time, or provide explainability. To address these challenges, we introduce LearnerAgent, a novel multi-agent framework based on Large Language Models (LLMs) to simulate a realistic teaching environment. To explore human-like learning dynamics, we construct learners with psychologically grounded profiles-such as Deep, Surface, and Lazy-as well as a persona-free General Learner to inspect the base LLM's default behavior. Through weekly knowledge acquisition, monthly strategic choices, periodic tests, and peer interaction, we can track the dynamic learning progress of individual learners over a full-year journey. Our findings are fourfold: 1) Longitudinal analysis reveals that only Deep Learner achieves sustained cognitive growth. Our specially designed "trap questions" effectively diagnose Surface Learner's shallow knowledge. 2) The behavioral and cognitive patterns of distinct learners align closely with their psychological profiles. 3) Learners' self-concept scores evolve realistically, with the General Learner developing surprisingly high self-efficacy despite its cognitive limitations. 4) Critically, the default profile of base LLM is a "diligent but brittle Surface Learner"-an agent that mimics the behaviors of a good student but lacks true, generalizable understanding. Extensive simulation experiments demonstrate that LearnerAgent aligns well with real scenarios, yielding more insightful findings about LLMs' behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。