研究大模型如何生成和更新假设,发现其推理有系统性偏差。
Hypothesis generation and updating in large language models

- 用数列游戏测试模型假设生成与更新能力
- 模型偏好简单规则但泛化能力差
- 适合研究科学推理与认知偏差的学者
大语言模型(LLMs)在代码调试、机械维修等任务中日益发挥作用,这依赖于从部分信息中生成合理假设,并随新信息动态更新。然而,这种推理过程是否接近最优仍不明确。本文在数列游戏这一受控环境中研究该问题:学习者需根据少数正整数(如{16, 8, 2, 64})推断支持规则,如“2的幂次”或“接近20的数”。通过后验预测、假设评估与假设生成三种互补探针,测量模型对假设的后验分布,并与最优贝叶斯模型及人类行为对比。结果表明,尽管大多数模型可用两参数贝叶斯模型拟合,但存在系统性偏差:默认情况下表现出强采样假设,隐含奥卡姆剃刀倾向,偏好更窄的假设;而思维模式切换则使其更依赖先验。此外,模型存在稳定的评估-生成差距:在评估阶段更可能选择正确假设,但在生成时倾向于更简单、规则化的形式。最后,这种贝叶斯带偏见的行为无法外推——模型看似掌握规则,但在未覆盖的假设域上泛化能力差。研究揭示了大模型作为通用问题求解器的局限性,尤其在需要超越数据本身的科学推理任务中。
原文摘要 · Abstract (English)
Large language models (LLMs) increasingly help people solve problems, from debugging code to repairing machinery. This process requires generating plausible hypotheses from partial descriptions, then updating them as more information arrives. Yet how LLMs perform this form of inference, and how close it is to optimal, remains unclear. We study this question in the number game, a controlled setting in which a learner infers the hypothesis supported by a few positive integers, such as $\{16, 8, 2, 64\}$: a rule like powers of 2 or an interval like numbers near 20. We measure the posterior over hypotheses using three complementary probes: posterior prediction, hypothesis evaluation, and hypothesis generation. We then compare LLM behavior with an optimal Bayesian model and human behavior, and test whether the same posterior is expressed across probes. LLMs are often well described by a two-parameter Bayesian fit, but with systematic offsets: by default they show a strong-sampling assumption that creates an implicit Occam's razor, favoring narrower hypotheses, while thinking mode shifts them toward greater prior reliance. We also find a robust evaluation--generation gap: LLMs select more correct hypotheses during hypothesis evaluation but generate simpler, more rule-like hypotheses. Finally, this Bayesian-with-bias pattern does not extrapolate. Models can behave as if they hold rule-like hypotheses over observed examples, yet generalize poorly to parts of the hypothesis domain not covered by those examples. Our results highlight a limitation of LLMs as general problem solvers, especially for scientific inference, where hypotheses must go beyond the data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。