用语言与代码混合表示知识,实现高效且可解释的推理学习。
Induction and Inquiry via Probabilistic Reasoning over Language and Code

- 将语言与代码结合为心理程序,通过贝叶斯算法逐步推断
- 在多项认知实验中复现人类归纳与主动探询行为特征
- 兼顾效率与灵活性,适合研究认知建模与智能系统设计
人类如何从稀疏、流式、嘈杂的经验数据中构建并维持抽象知识,是认知科学中的长期挑战。任何计算模型必须满足三个基本要求:(1)数据与计算高效;(2)能刻画不确定性以支持智能探询与信息获取;(3)具备足够的灵活性,以表征人类可学习和思考的无限概念。本文提出一种新模型,通过将符号知识编码为融合自然语言与源代码的心理程序,并使用大语言模型引导的贝叶斯学习算法进行序列推断。该模型在多项行为研究中成功再现了人类归纳学习与主动探询的定量特征,如锚定效应、路径依赖等。相比之下,纯大语言模型或经典贝叶斯模型要么无法完成任务,要么无法还原人类行为,或需付出极高的计算代价。结果表明,人类持续扩展知识的一种方式是:在语言与程序两种表征间维护多个假设,通过迭代修正近似贝叶斯更新,而底层神经机制(大语言模型)使推理既可行又可学习。
原文摘要 · Abstract (English)
How humans grow and maintain abstract knowledge from the sparse, streaming noisy data of experience is a longstanding challenge in cognitive science. Any computational account must satisfy at least three desiderata: It must be (1) data-efficient and compute-efficient, (2) capture gradations of uncertainty to support intelligent inquiry and information gathering, and (3) be flexible enough to mentally represent the endless range of concepts people can learn and think about. Here we introduce a computational model that captures these three properties, by encoding symbolic knowledge as mental programs that combine natural language with source code, and sequentially inferring mental programs using LLM-guided Bayesian learning algorithms. Across a range of behavioral studies this model successfully reproduces quantitative signatures of human inductive learning and active inquiry, such as anchoring, garden-pathing, and other effects. In contrast, pure LLMs and classic Bayesian models either fail at the underlying task, or do not reproduce human behavior, or succeed only at exorbitant computational cost. These results suggest that one way humans continually grow their knowledge is by mentally representing many hypotheses spanning language-like and program-like representations, then revising those hypotheses to approximate Bayesian updates, while a bottom-up neural mechanism (an LLM) makes inference both tractable and learnable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。