用生态演化取代优化训练,让智能自发涌现。
Cultivating Machine Intelligence: The OMEGA Shift from Top-Down Optimization to Autopoietic Cognitive Ecologies

- 以自然选择替代梯度下降,通过环境筛选生成智能。
- 在资源约束下自发出现感知专长与内在动机。
- 适合关注智能本质与可持续AI的学者与研究者。
当前主流人工智能通过梯度下降和人类反馈强化学习训练神经网络,虽强大却固有缺陷,如幻觉、谄媚、奖励劫持与对齐脆弱性。为此,我们提出RECLAIM框架——一种基于计算生态学的智能培育理论。该框架依托四大支柱:广义达尔文主义以盲变与选择替代梯度;非代理涌现使环境物理代替评价奖励,防止目标规避;Polya-Hebbian桥将Polya瓮模型引入赫布学习,实现路径依赖的专化;自由能原理被当作环境热力学而非代理目标。系统由受马尔可夫毯限定、争夺有限计算能量的自组织单元构成,嵌入由认知食物链与红皇后军备竞赛塑造的数据生态中。此设计促使双过程认知、感官专精、类比推理及内在动机等能力自然涌现。这一范式转型被称为OMEGA shift,即从优化最大化转向生成性自组织。
原文摘要 · Abstract (English)
The dominant artificial intelligence paradigm trains neural architectures via gradient descent against proxy objectives and reinforcement learning from human feedback. While remarkably capable, this top-down optimization inherently generates structural failure modes, including hallucination, sycophancy, reward hacking, and alignment fragility, which represent paradigmatic limitations rather than mere engineering defects. In response, we introduce RECLAIM (Recursive, Ecological, Cognitive, Lifelike, Adaptive, Intelligent Machine), a theoretical framework for cultivating intelligence through computational ecology rather than engineering it through strict optimization. The model is supported by four interlocking theoretical pillars. General Darwinism replaces gradients with blind variation and selective retention, while non-agentic emergence substitutes evaluative rewards with environmental physics to structurally prevent specification gaming against human intent. Concurrently, the Polya-Hebbian bridge applies Polya urn dynamics to Hebbian reinforcement for path-dependent specialization, and the free energy principle is integrated as environmental thermodynamics rather than as an agent objective. The architecture situates autopoietic units, bounded by Markov blankets and competing for finite computational energy, within a data ecology shaped by cognitive food chains and Red Queen arms races. This framework suggests the spontaneous emergence of dual-process cognition, sensory specialization, analogical reasoning, and intrinsic motivation as natural consequences of evolution under resource constraints. We conceptualize this paradigm transition as the OMEGA shift, representing a move from optimization and maximization to emergence through generative autopoiesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。