指出当前神经网络无法实现真正智能,因其架构缺乏理解能力。
Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI
- 将神经网络视为静态函数逼近器,缺乏动态结构重组能力
- 批判缩放定律与万能逼近定理的误用,揭示其理论局限性
- 提出区分计算底座与认知结构的新框架,为真正智能奠基
本文认为,无论规模多大,当前神经网络范式都无法催生人工通用智能(AGI),且该路径对领域发展并不健康。基于哲学(如中文房间论证、哥德尔论证)、神经科学、计算机科学及学习理论等多领域观察,指出神经网络本质上是受限编码框架下的静态函数逼近器——如同‘精巧的海绵’,虽表现出复杂行为,却无构成智能所需的结构性丰富性。论文批判了近年流行的理论基础,如神经缩放定律(以arXiv:2001.08361为例)的误读,以及万能逼近定理在错误抽象层级上适用的问题,并指出当前架构缺乏动态重构能力。为此,提出区分存在性设施(计算底座)与架构组织(解释结构)的框架,阐明真实机器智能所需原则,并勾勒出支撑神经网络系统更深层结构的构想方法。
原文摘要 · Abstract (English)
Within the limited scope of this paper, we argue that artificial general intelligence cannot emerge from current neural network paradigms regardless of scale, nor is such an approach healthy for the field at present. Drawing on various notions, discussions, present-day developments and observations, current debates and critiques, experiments, and so on in between philosophy, including the Chinese Room Argument and Gödelian argument, neuroscientific ideas, computer science, the theoretical consideration of artificial intelligence, and learning theory, we address conceptually that neural networks are architecturally insufficient for genuine understanding. They operate as static function approximators of a limited encoding framework - a 'sophisticated sponge' exhibiting complex behaviours without structural richness that constitute intelligence. We critique the theoretical foundations the field relies on and created of recent times; for example, an interesting heuristic as neural scaling law (as an example, arXiv:2001.08361 ) made prominent in a wrong way of interpretation, The Universal Approximation Theorem addresses the wrong level of abstraction and, in parts, partially, the question of current architectures lacking dynamic restructuring capabilities. We propose a framework distinguishing existential facilities (computational substrate) from architectural organization (interpretive structures), and outline principles for what genuine machine intelligence would require, and furthermore, a conceptual method of structuralizing the richer framework on which the principle of neural network system takes hold.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。