arXiv:2607.08196cs.AIcs.CL2026-07被引 1

用数学模型解释慢思考与主动感知,为大语言模型设计提供新框架。

A First-Principles Theory of Slow Thinking and Active Perception

论文配图:A First-Principles Theory of Slow Thinking and Active Perception
图 1 · 摘自论文原文
  • 基于概率分布的主动提升理论,通过采样潜变量降低不确定性。
  • 推导出慢思考模型的设计空间与训练目标,支持多模态建模。
  • 适合研究认知机制、模型可解释性与生成模型的学者参考。

作为认知功能首原理建模系列的一部分,本文尝试对思维与感知进行数学表述。通过在可观测空间与潜变量空间之间进行概率分布的提升与投影,旨在用神经网络等简单函数族表示复杂数据分布。提出名为‘主动提升’的理论,基于潜变量序列采样和以最大速率减少不确定性的内在驱动力。该理论构建了一个庞大的设计空间,其中包含慢思考模型的一个子空间,称为静态理论。这些模型位于由静态理论诱导的表示层次与采样层次上,可通过沿两个层次向上推进来升级。主动提升进一步推导出具有内部时间轴的推理过程,以及类似最小长度编码、语言发明的训练目标。因此,它刻画了感知的能动性,包括慢思考形式的涌现。技术副产品包括改进慢思考模型的三阶段路径、统一构建所有数据模态编码器与生成模型的方法、类人视觉表征的先验形成,以及解决策略坍塌的可能方案。

原文摘要 · Abstract (English)

As part of a series on first-principles modeling of cognitive functions, this paper attempts to provide a mathematical formulation of thinking and perception. It formally derives slow thinking or more generally, active perception, and encompasses the design, training and inference of slow thinking large language models. Our starting point is the lifting and projection of probability distributions on the observable and latent spaces, with the objective of representing complex data distributions by simple function families such as neural networks. A theory called "active lifting" is proposed, based on the sampling of latent sequences and an intrinsic drive to reduce uncertainty with maximum rate. It derives a large design space, containing the slow thinking models in a subspace that we call the static theory. These models are positioned on the representation hierarchy and sampler hierarchy induced by the static theory, and can be upgraded by climbing the two hierarchies. Active lifting further derives an inference process with an internal time axis, and a training objective that resembles minimum-length coding as well as the invention of languages. Thus, it characterizes the agency of perception, including the emergence of the slow thinking formats. Technical by-products of this theory include a three-stage pathway for improving slow thinking models, a unified approach to constructing encoders and generative models for all data modalities, a priori formation of human-like visual representations, and a possible solution to policy collapse.

认知建模慢思考主动感知生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。