arXiv:2608.14019cs.NEcs.LG2026-08

用极简动态系统实现智能涌现,可外推复杂任务。

Emergent Models: Intelligence from Tiny Substrates

论文配图:Emergent Models: Intelligence from Tiny Substrates
图 1 · 摘自论文原文
  • 以细胞自动机等简单规则系统为基础,通过演化搜索让计算行为自然涌现。
  • 数十至数百参数的微型模型可精确外推算术函数并支持在线自适应。
  • 适合研究机器学习本质、探索非微分架构的学者或工程师。

Emergent Models(EMs)是一种基于简单但开放的底座(如细胞自动机)的机器学习范式,将建模视为在简单动力系统中涌现解决外部任务的计算行为,而非学习封闭形式的输入输出映射。这类底座通常在隐空间中迭代固定局部规则,步数自适应,通过接口连接隐状态与外部输入/输出信号。训练采用演化搜索。我们假设部分实例具有全局泛化倾向:能捕捉数据生成规则的完整域,从而超越训练范围进行外推。理论上,我们证明某些EMs是潜在全知的:在更新规则和接口固定时,仅通过改变隐状态初始条件,即可实现任意部分可计算函数。实验上,我们在离散与连续底座上研究了一系列极简的EM实例,发现极小规模的局部递归计算(数十到数百参数)可在简单算术函数上实现精确外推,支持控制行为与在线适应,但仍存在若干局限性。该工作是基础性的:不提出竞争性架构,而是拓展机器学习设计空间,突破可微前馈映射的限制。

原文摘要 · Abstract (English)

Emergent Models (EMs) are a machine learning paradigm based on simple yet open-ended substrates, such as cellular automata, in which modeling is treated not as the learning of a closed-form input-output map but as the emergence, within simple dynamical systems, of computational behaviors that solve external tasks. Such substrates typically iterate a fixed local rule over a latent space for an adaptive number of steps, with an interface linking the latent state to external input/output signals. Training proceeds by evolutionary search. We hypothesize that some instances of this framework are biased toward global generalization: capturing the rule generating the data over its full domain, and therefore extrapolating beyond the training range. Theoretically, we prove that some EMs are latent-universal: with the update rule and interface held fixed, they can realize any partial computable function by varying only the initial condition of the latent state. Empirically, we study a zoo of minimal EM instantiations across discrete and continuous substrates, showing that local-recursive computation at a tiny scale (tens to hundreds of parameters) can extrapolate exactly on simple arithmetic functions, can support control behaviour and online adaptation, while still exposing several limitations. This work is foundational: it does not propose a competitive architecture, but a framework meant to widen the design space of machine learning beyond differentiable feed-forward maps.

智能涌现细胞自动机外推能力极简模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。