arXiv:2606.12610cs.LG2026-06

用数学框架解释AI寒冬的深层根源,揭示早期技术瓶颈的必然性。

The Mathematics of AI Winters: The mathematical Taxonomy of Paradigm Fragility in AI Winter

  • 从数学角度分析早期AI范式的根本局限:表示、优化、复杂度等
  • 指出感知机、梯度消失、高维学习等理论障碍与历史低谷的对应关系
  • 适合对AI发展史和理论边界感兴趣的科研人员与从业者

两次主要的AI研究资金缩减与信心下降时期——通常称为第一次和第二次AI寒冬——常被归因于工程失败、商业落空和期望过高。本文提出一种互补视角:当时主导的范式实际上遭遇了真实的数学障碍,包括表示能力限制、优化困难、计算复杂性、统计可学习性以及高维逼近难题。本文并非文献汇编,而是综合分析:并未声称特定定理直接导致寒冬,而是证明早期人工智能的若干重大挫折与精确的数学瓶颈高度一致。我们通过Minsky和Papert的感知机不可能性结果、Blum与Rivest关于神经网络精确训练的复杂性难题、Stone的高维非参数估计极小极大率、Hochreiter及Bengio团队的梯度消失分析,以及Vapnik-Chervonenkis、Valiant、Blumer等人的经典统计学习理论来解析这些障碍,并将它们与后来缓解而非消除这些瓶颈的技术突破相联系。

原文摘要 · Abstract (English)

Two major periods of reduced funding and confidence in artificial intelligence research, commonly called the first and second AI winters, are usually explained through engineering failure, commercial disappointment, and inflated expectations. This article develops a complementary thesis: that the dominant paradigms of those periods also met genuine formal barriers, including limitations of representation, optimisation, computational complexity, statistical learnability, and high-dimensional approximation. The contribution is synthetic rather than archival. We do not claim that particular theorems mechanically caused the winters; rather, we show that several central disappointments of early AI were aligned with mathematically precise bottlenecks. We analyse these bottlenecks through the perceptron impossibility results of Minsky and Papert, the complexity-theoretic hardness of exact neural-network training established by Blum and Rivest, minimax rates for nonparametric estimation in high dimension due to Stone, vanishing-gradient analyses by Hochreiter and by Bengio and collaborators, and classical statistical learning theory in the tradition of Vapnik and Chervonenkis, Valiant, and Blumer and collaborators. We then relate these barriers to the later breakthroughs that mitigated, rather than eliminated, them.

AI寒冬数学分析理论瓶颈学习理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。