用大规模心理实验数据训练出能预测人类行为的通用认知模型
Centaur: a foundation model of human cognition
- 基于自然语言描述的任务,用大模型微调预测人类行为
- 在超1000万次选择中表现优于现有认知模型,且可泛化到新任务
- 内部表征与人脑神经活动更一致,适合心理学理论探索
建立统一的认知理论是心理学的重要目标。尽管已有计算模型尝试实现这一目标,但目前尚无模型能全面捕捉人类心智。本文提出Centaur,一个可在自然语言描述的任意实验中预测和模拟人类行为的计算模型。该模型通过在大规模新型数据集Psych-101上微调先进语言模型获得,Psych-101包含超过6万名参与者在160项实验中完成的超1000万次决策的逐次试验数据。Centaur不仅比现有认知模型更准确地预测未见参与者的行为,还能泛化至新的故事背景、任务结构变化及全新领域。此外,微调后模型的内部表征与人类神经活动的对齐度显著提升。结果表明,构建跨领域捕捉人类行为的计算模型是可行的。这类模型有望推动认知理论发展,并已展示其应用潜力。
原文摘要 · Abstract (English)
Establishing a unified theory of cognition has been a major goal of psychology. While there have been previous attempts to instantiate such theories by building computational models, we currently do not have one model that captures the human mind in its entirety. A first step in this direction is to create a model that can predict human behavior in a wide range of settings. Here we introduce Centaur, a computational model that can predict and simulate human behavior in any experiment expressible in natural language. We derived Centaur by finetuning a state-of-the-art language model on a novel, large-scale data set called Psych-101. Psych-101 reaches an unprecedented scale, covering trial-by-trial data from over 60,000 participants performing over 10,000,000 choices in 160 experiments. Centaur not only captures the behavior of held-out participants better than existing cognitive models, but also generalizes to new cover stories, structural task modifications, and entirely new domains. Furthermore, we find that the model's internal representations become more aligned with human neural activity after finetuning. Taken together, our results demonstrate that it is possible to discover computational models that capture human behavior across a wide range of domains. We believe that such models provide tremendous potential for guiding the development of cognitive theories and present a case study to demonstrate this.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。