大模型缺的不只是身体,而是错误代价能逼它改认知。
LLMs Don't Pay for the Jump
- 用热力学耦合解释认知错误如何变成本能驱动力
- 实验证明模型熵不变,准确率却从100%跌到17%
- 适合关注智能本质、推理机制的学者
尽管大语言模型具备归纳与演绎能力,但无法完成爱因斯坦提出等效原理所需的'跳跃式'推断。本文指出,这种局限不在于是否具身模拟,而在于缺乏将认知错误转化为物理代价的机制。以普朗克解决黑体辐射问题为例,其能量量子化假设源于经典理论预测的无限能量与有限测量结果之间的矛盾,无法接受此悖论促使了新假设的提出。我们证明,仅靠归纳或演绎无法产生该假设,必须存在认知误差与物理代价的耦合机制。通过热力学耦合建模,发现固定权重的Transformer推理系统不具备此类耦合,无论规模多大。实证显示,随着任务因果难度剧增,输出熵基本不变,准确率却从100%降至17%。因此,机器推断缺失的核心可能是:错误需足够‘昂贵’,才能迫使系统修正自身。
原文摘要 · Abstract (English)
Zahavy [2026] argues that Large Language Models, despite their capabilities in induction and deduction, cannot perform the abductive "Jump" that produced Einstein's equivalence principle, and attributes this limitation to the absence of embodied simulation. Zheng-Xin [2026] and Farmer [2026] question whether embodiment is necessary for abduction, pointing to alternative routes to General Relativity and forms of abduction that require no sensorimotor grounding. Max Planck resolved the blackbody radiation problem in 1900. Planck's move to E = hν required no embodied simulation. It was motivated by a mathematical consequence of classical theory, an infinite predicted energy for a finite measured quantity, that could not be physically accepted. We show that neither induction nor deduction could have produced the postulate and argue that its adoption required a coupling between epistemic error and physical cost. We formalize this distinction through thermodynamic coupling and show that fixed-weight transformer inference lacks such coupling, regardless of model scale. This is consistent with empirical results showing that output entropy remains nearly unchanged across tasks with sharply increasing causal difficulty, even as accuracy falls from 100% to 17%. We therefore argue that the missing ingredient in machine abduction may lie deeper than embodiment: a system must have some physical mechanism through which epistemic error becomes costly enough to force revision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。