arXiv:2412.17794cs.LG2024-12被引 3

记忆让计算具备通用性,状态维持与历史访问是关键。

Memory makes computation universal, remember?

  • 通过状态递归维护和可靠历史访问实现通用计算
  • 神经网络等并行系统靠迭代状态保持实现通用性
  • 适合关注计算本质、认知科学或AI演进的读者

近年来人工智能能力的突破常归因于复杂架构与对齐技术,但更根本的原因可能是:记忆使计算具有通用性。记忆通过两个核心能力实现通用计算——递归状态维持和可靠的历史访问。我们形式化证明这两个条件既是必要也是充分的。这一原理贯穿细胞计算、神经网络到语言模型等多个层面。复杂行为并非来自复杂处理单元,而是源于跨时间的状态维护与访问。我们展示,即使基本单元有限,神经网络等并行系统也能通过迭代中维持状态实现通用计算。该理论框架揭示了一种普遍规律:计算进步始终源于更强的状态维持与访问能力,而非更复杂的底层操作。分析统一了生物系统、人工智能与人类认知中的计算理解,提醒我们:人类自身计算能力的演化,正与口头传统、书写及现代计算等记忆技术的发展同步。

原文摘要 · Abstract (English)

Recent breakthroughs in AI capability have been attributed to increasingly sophisticated architectures and alignment techniques, but a simpler principle may explain these advances: memory makes computation universal. Memory enables universal computation through two fundamental capabilities: recursive state maintenance and reliable history access. We formally prove these requirements are both necessary and sufficient for universal computation. This principle manifests across scales, from cellular computation to neural networks to language models. Complex behavior emerges not from sophisticated processing units but from maintaining and accessing state across time. We demonstrate how parallel systems like neural networks achieve universal computation despite limitations in their basic units by maintaining state across iterations. This theoretical framework reveals a universal pattern: computational advances consistently emerge from enhanced abilities to maintain and access state rather than from more complex basic operations. Our analysis unifies understanding of computation across biological systems, artificial intelligence, and human cognition, reminding us that humanity's own computational capabilities have evolved in step with our technical ability to remember through oral traditions, writing, and now computing.

计算理论记忆机制通用计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。