arXiv:2604.02476cs.AI2026-04被引 1

用高维空间中的阈值逻辑,重新理解生成式AI的内在机制。

Understanding the Nature of Generative AI as Threshold Logic in High-Dimensional Space

  • 将阈值函数视为神经计算的基本单元,通过高维几何实现分类。
  • 高维下单个超平面几乎可分离任意点集,突破传统感知机局限。
  • 适合研究生成模型原理、神经网络数学基础的学者阅读。

本文探讨阈值逻辑在理解生成式人工智能中的作用。阈值函数源于20世纪60年代数字电路设计,其结构透明:输入加权和与阈值比较,几何上表现为分割空间的超平面。论文指出,随着维度增加,该操作发生质变:低维时感知机为确定性逻辑分类器,由线性规划决定;高维时,单个超平面几乎可分离任意点配置(Cover, 1965),空间充满潜在分类器,感知机从逻辑设备转为导航工具,类似皮尔斯的指示符号。明斯基与帕佩特(1969)指出的感知机局限,传统解法是引入多层架构。本文提出另一路径:保持单一阈值单元,仅提升维度。认为此转变对理解神经计算具有同等重要性。深度被重新解释为通过迭代阈值操作逐次变形数据流形,使其适配高维几何赋予的线性可分性。由此形成三元统一视角——阈值函数为本体单元,维度为必要条件,深度为准备机制,为生成式AI提供基于经典数学的统一理论框架。

原文摘要 · Abstract (English)

This paper examines the role of threshold logic in understanding generative artificial intelligence. Threshold functions, originally studied in the 1960s in digital circuit synthesis, provide a structurally transparent model of neural computation: a weighted sum of inputs compared to a threshold, geometrically realized as a hyperplane partitioning a space. The paper shows that this operation undergoes a qualitative transition as dimensionality increases. In low dimensions, the perceptron acts as a determinate logical classifier, separating classes when possible, as decided by linear programming. In high dimensions, however, a single hyperplane can separate almost any configuration of points (Cover, 1965); the space becomes saturated with potential classifiers, and the perceptron shifts from a logical device to a navigational one, functioning as an indexical indicator in the sense of Peirce. The limitations of the perceptron identified by Minsky and Papert (1969) were historically addressed by introducing multilayer architectures. This paper considers an alternative path: increasing dimensionality while retaining a single threshold element. It argues that this shift has equally significant implications for understanding neural computation. The role of depth is reinterpreted as a mechanism for the sequential deformation of data manifolds through iterated threshold operations, preparing them for linear separability already afforded by high-dimensional geometry. The resulting triadic account - threshold function as ontological unit, dimensionality as enabling condition, and depth as preparatory mechanism - provides a unified perspective on generative AI grounded in established mathematics.

生成式AI阈值逻辑高维空间神经计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。