用对称性压缩感知流,揭示智能体的几何本质。
Compositional Symmetry as Compression: Lie Pseudogroup Structure in Algorithmic Agents
- 以李伪群对称性为先验,将感官流建模为低维流形上的局部作用。
- 对称性迫使智能体动态产生守恒量,轨迹被限制在低维不变流形上。
- 适合研究深度模型可解释性与自编码预测的理论工作者。
在算法(柯尔莫哥洛夫)视角下,智能体是通过生成程序追踪并压缩感官流的程序。我们提出一个框架,其中相关结构先验是简洁性(索洛莫诺夫)所理解的“组合对称性”:自然流能被有限参数李伪群在几何和拓扑复杂的低维配置流形(潜在空间)上的局部作用良好描述。将智能体建模为通用神经动力系统与这些流耦合,我们证明准确的世界追踪施加了两类约束:(i) 结构约束——智能体构成方程与输出具有协变性;(ii) 动态约束:静态输入下,对称性诱导出守恒量(类似诺特定理的标签),并将轨迹限制在低维不变流形上;缓慢漂移时,这些流形移动但保持低维性。这形成一套与伪群组合分解一致的降维流形层级,提供了深度模型中“组合性之福”的几何解释。我们将这些思想与李伪群的斯宾塞形式联系起来,并提出一种基于对称性的、自洽的预测编码版本,其中高层仅接收低层未解析的对称方向上的粗粒度残差变换(预测误差坐标)。
原文摘要 · Abstract (English)
In the algorithmic (Kolmogorov) view, agents are programs that track and compress sensory streams using generative programs. We propose a framework where the relevant structural prior is simplicity (Solomonoff) understood as \emph{compositional symmetry}: natural streams are well described by (local) actions of finite-parameter Lie pseudogroups on geometrically and topologically complex low-dimensional configuration manifolds (latent spaces). Modeling the agent as a generic neural dynamical system coupled to such streams, we show that accurate world-tracking imposes (i) \emph{structural constraints} -- equivariance of the agent's constitutive equations and readouts -- and (ii) \emph{dynamical constraints}: under static inputs, symmetry induces conserved quantities (Noether-style labels) in the agent dynamics and confines trajectories to reduced invariant manifolds; under slow drift, these manifolds move but remain low-dimensional. This yields a hierarchy of reduced manifolds aligned with the compositional factorization of the pseudogroup, providing a geometric account of the ``blessing of compositionality'' in deep models. We connect these ideas to the Spencer formalism for Lie pseudogroups and formulate a symmetry-based, self-contained version of predictive coding in which higher layers receive only \emph{coarse-grained residual transformations} (prediction-error coordinates) along symmetry directions unresolved at lower layers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。