arXiv:2507.12547cs.CLcs.AI2025-07被引 19

用语言模型合成心理模型,模拟人类在新情境下的推理能力。

Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models

  • 用语言模型检索背景知识,用概率程序构建专属推理模型。
  • 在体育情境推理任务中,比纯语言模型更贴近人类判断。
  • 适合研究认知建模与开放域智能推理的学者。

面对新情境时,人类能从广泛背景知识中提取相关因素,并进行连贯推理与预测。我们提出一种计算框架——模型合成架构(MSA),结合分布式与符号化表示,利用语言模型实现基于全局相关性的知识检索与模型合成,再通过概率程序构建针对性、一致性的世界模型。我们在一个名为‘模型奥运会’的新型推理数据集上评估该架构,该数据集包含体育情景片段,要求模型对语言描述的新型因果结构做出判断,调用大量背景知识,并在引入任意新变量的情况下完成推理。MSA在直接输出和链式思维生成两种方式下,均优于仅使用语言模型的基线,表现更接近人类判断。结果表明,该架构可有效模拟人类在开放领域中对全局相关变量进行局部连贯推理的能力,为理解与复现人类推理提供了可行路径。

原文摘要 · Abstract (English)

When faced with novel situations, people are able to marshal relevant considerations from a wide range of background knowledge and put these to use in inferences and predictions. What permits us to draw in globally relevant information and reason over it coherently? Here, we explore the hypothesis that people use a combination of distributed and symbolic representations to construct bespoke mental models tailored to novel situations. We propose a computational implementation of this idea -- a ``Model Synthesis Architecture'' (MSA) -- using language models to implement global relevance-based retrieval and model synthesis and probabilistic programs to implement bespoke, coherent world models. We evaluate our MSA as a model of human judgments on a novel reasoning dataset. The dataset -- built around a `Model Olympics` domain of sports vignettes -- tests models' capacity for human-like, open-ended reasoning by requiring (i) judgments about novel causal structures described in language; (ii) drawing on large bodies of background knowledge; and (iii) doing both in light of observations that introduce arbitrary novel variables. Our MSA approach captures human judgments better than language model-only baselines, under both direct and chain-of-thought generations from the LM that supports model synthesis. These results suggest that MSAs can be implemented in a way that mirrors people's ability to deliver locally coherent reasoning over globally relevant variables, offering a path to understanding and replicating human reasoning in open-ended domains.

认知建模概率推理语言模型开放域推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。