arXiv:2505.16771cs.AI2025-05综述被引 2

梳理15年AI突破,揭示算力、数据与算法的协同进化路径。

Data-Driven Breakthroughs and Future Directions in AI Infrastructure: A Comprehensive Review

  • 从GPU训练到ImageNet,再到Transformer与GPT,串联关键创新
  • 指出数据效率与样本复杂度是突破可扩展性的核心制约
  • 适合关注AI基础设施演进与数据政策的研究者和决策者

本文综合回顾了过去十五年人工智能领域的重大突破,融合历史、理论与技术视角。通过追踪计算资源、数据获取与算法创新的交汇点,识别出多个关键转折点:研究人员实现基于GPU的模型训练,因ImageNet引发数据驱动范式转变,Transformer简化架构,GPT系列拓展建模能力。这些进展并非孤立事件,而是深层范式转移的信号。借助统计学习理论中的样本复杂度与数据效率概念,论文解释了如何将突破转化为可扩展解决方案,并强调当前必须转向数据为中心的方法。针对日益严峻的隐私担忧与监管收紧,论文评估了联邦学习、隐私增强技术(PETs)及数据站点范式等新兴方案,重新定义数据访问与安全机制。在真实数据不可用时,也分析了模拟数据与合成数据生成的效用与局限。通过将技术洞见与数据基础设施演变对齐,本研究为未来AI研究与政策制定提供战略指引。

原文摘要 · Abstract (English)

This paper presents a comprehensive synthesis of major breakthroughs in artificial intelligence (AI) over the past fifteen years, integrating historical, theoretical, and technological perspectives. It identifies key inflection points in AI' s evolution by tracing the convergence of computational resources, data access, and algorithmic innovation. The analysis highlights how researchers enabled GPU based model training, triggered a data centric shift with ImageNet, simplified architectures through the Transformer, and expanded modeling capabilities with the GPT series. Rather than treating these advances as isolated milestones, the paper frames them as indicators of deeper paradigm shifts. By applying concepts from statistical learning theory such as sample complexity and data efficiency, the paper explains how researchers translated breakthroughs into scalable solutions and why the field must now embrace data centric approaches. In response to rising privacy concerns and tightening regulations, the paper evaluates emerging solutions like federated learning, privacy enhancing technologies (PETs), and the data site paradigm, which reframe data access and security. In cases where real world data remains inaccessible, the paper also assesses the utility and constraints of mock and synthetic data generation. By aligning technical insights with evolving data infrastructure, this study offers strategic guidance for future AI research and policy development.

AI基础设施数据驱动范式演进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。