arXiv:2512.18732cs.AIcs.LG2025-12被引 1

用最小描述长度约束概念扩展,让想象力只在有系统误差时才推动认知进步。

Counterfactual Basis Extension and Representational Geometry: An MDL-Constrained Model of Conceptual Growth

  • 基于最小描述长度准则,仅允许与经验残差方向一致的基底扩展
  • 正交于残差方向的扩展会增加描述长度,被自动排除
  • 适合研究认知发展、理论更新和想象机制的学者

概念学习只有在现有表征无法解释经验时才可能发生。然而,大多数学习与推理模型预设了固定表征基底。本文探讨一个前提问题:在何种结构条件下,表征基底能以合理且选择性的方式扩展?提出一种几何框架,将概念增长建模为满足最小描述长度(MDL)准则的可接受基底扩展。经验(无论外部观察或内部模拟)被表示为相对于当前概念子空间的向量,残差分量捕捉系统的表征失败,候选概念扩展被限制为低秩、可接受的变换。证明任何被MDL接受的扩展都可选为新方向完全位于经验诱导的残差张量内,而与该张量正交的扩展必然增加描述长度,因此被拒绝。这得出一种保守的想象与概念创新解释:内部生成的反事实表征仅当暴露或放大结构化残差误差时才促进学习,不能引入任意新颖性。进一步区分表征反事实(对概念基底的反事实)与因果或价值层级反事实,并展示MDL如何提供表征变化的规范选择原则。整体上,该框架将概念发展刻画为由误差驱动、几何受限的基底扩展过程,明确揭示了想象在学习与理论变迁中的作用与界限。

原文摘要 · Abstract (English)

Concept learning becomes possible only when existing representations fail to account for experience. Most models of learning and inference, however, presuppose a fixed representational basis within which belief updating occurs. In this paper, I address a prior question: under what structural conditions can the representational basis itself expand in a principled and selective way? I propose a geometric framework in which conceptual growth is modeled as admissible basis extension evaluated under a Minimum Description Length (MDL) criterion. Experience, whether externally observed or internally simulated, is represented as vectors relative to a current conceptual subspace. Residual components capture systematic representational failure, and candidate conceptual extensions are restricted to low-rank, admissible transformations. I show that any MDL-accepted extension can be chosen so that its novel directions lie entirely within the residual span induced by experience, while extensions orthogonal to this span strictly increase description length and are therefore rejected. This yields a conservative account of imagination and conceptual innovation. Internally generated counterfactual representations contribute to learning only insofar as they expose or amplify structured residual error, and cannot introduce arbitrary novelty. I further distinguish representational counterfactuals--counterfactuals over an agent's conceptual basis--from causal or value-level counterfactuals, and show how MDL provides a normative selection principle governing representational change. Overall, the framework characterizes conceptual development as an error-driven, geometry-constrained process of basis extension, clarifying both the role and the limits of imagination in learning and theory change.

认知科学概念学习表征扩展反事实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。