用智能体自动发现人类对随机序列判断的心理理论。
auto-psych: Automating the science of mind using agent-driven theory discovery and experimentation

- 构建双层智能体系统,自动生成假设并设计在线实验。
- 在三轮真实实验中,新理论拟合度优于文献已有理论。
- 首次实现心理学理论发现的全流程自动化,适合认知科学研究者。
基于AI的科学自动化正通过智能体生成假说、设计实验和分析数据成为可能。但数据收集仍是主要瓶颈。心理学,尤其是计算认知科学,因理论常以代码形式表达,且可通过众包平台大规模程序化获取人类数据,最有望受益于AI实验。本文提出auto-psych系统,利用基于智能体的发现循环,在计算认知科学中自动探索人类行为理论。以经典认知心理学案例——判断硬币抛掷序列的主观随机性为测试场景,系统通过内层循环推测、拟合与批判概率认知模型,外层循环设计实验、在线发布并分析数据。该系统可在合成数据上快速可靠地恢复真实理论,嵌套结构对模型性能至关重要。在三轮独立的人类实验中,系统发现的理论拟合度优于文献理论。本工作验证了计算认知科学中自动化数据收集与理论发现的可行性。
原文摘要 · Abstract (English)
AI-based scientific automation is increasingly possible by using agents to generate hypotheses, design experiments, and analyze data. Data collection is a major bottleneck in this pipeline, however. Psychology, and computational cognitive science in particular, is well-positioned to benefit from AI experimentation because theories are often represented as code and crowdsourcing platforms enable programmatic human data collection at scale. Here, we apply automated discovery techniques to the project of generating theories in computational cognitive science, with an agent-based system collecting human data independently through crowdsourced survey experiments. As a testbed, we use a classic case study from cognitive psychology: judging which sequences of coin flips seem subjectively more random. Our system, auto-psych, uses nested agent-based discovery loops to generate explanatory theories of human behavior. The inner loop conjectures, fits, and critiques probabilistic cognitive models; the outer loop designs experiments to test these models, launches them online, and analyzes the data. This system can quickly and reliably recover ground-truth theories from synthetic data via systematic experimentation, but the nested structure is critical to model performance. Further, in three independent sequences of human experiments, the system finds theories that fit the data better than theories generated from the scientific literature. This work thus demonstrates the feasibility of automated data collection and theory discovery in computational cognitive science.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。