arXiv:2603.20920cs.PFcs.AI2026-03

对比四类模型在CPU与GPU上的训练效率,揭示算力差距与资源公平问题。

Democratizing AI: A Comparative Study in Deep Learning Efficiency and Future Trends in Computational Processing

  • 用TensorFlow和PyTorch在CPU与GPU上测试四类模型的训练速度
  • 轻量模型加速最高达246倍,复杂生成模型也有11倍提升
  • 强调共享GPU资源对科研公平的重要性,适合算力有限团队参考

数据爆炸式增长加剧了训练大规模深度学习模型所需的计算能力需求。然而,模型规模与复杂度的快速增加引发了对算力资源公平获取的担忧,尤其是在能源与基础设施约束下。GPU已成为加速此类任务的关键。本研究在Intel Xeon CPU与NVIDIA Tesla T4 GPU上,使用TensorFlow与PyTorch对四种模型(Conv6、VGG16、ResNet18、CycleGAN)进行基准测试。结果显示,平均而言,GPU训练相比CPU实现11倍至246倍的速度提升:轻量模型(Conv6)最高达246倍,中等模型(VGG16、ResNet18)为51-116倍,复杂生成模型(CycleGAN)为11倍。此外,在PyTorch与TensorFlow对比中,TensorFlow的内核融合优化使推理延迟降低约15%。我们还通过多项式回归分析了GPU内存使用趋势,并预测到2025年的需求。研究指出,尽管GPU是维持AI发展的关键,但实现算力的民主化与共享,对资源受限机构的科研创新至关重要。

原文摘要 · Abstract (English)

The exponential growth in data has intensified the demand for computational power to train large-scale deep learning models. However, the rapid growth in model size and complexity raises concerns about equal and fair access to computational resources, particularly under increasing energy and infrastructure constraints. GPUs have emerged as essential for accelerating such workloads. This study benchmarks four deep learning models (Conv6, VGG16, ResNet18, CycleGAN) using TensorFlow and PyTorch on Intel Xeon CPUs and NVIDIA Tesla T4 GPUs. Our experiments demonstrate that, on average, GPU training achieves speedups ranging from 11x to 246x depending on model complexity, with lightweight models (Conv6) showing the highest acceleration (246x), mid-sized models (VGG16, ResNet18) achieving 51-116x speedups, and complex generative models (CycleGAN) reaching 11x improvements compared to CPU training. Additionally, in our PyTorch vs. TensorFlow comparison, we observed that TensorFlow's kernel-fusion optimizations reduce inference latency by approximately 15%. We also analyze GPU memory usage trends and projecting requirements through 2025 using polynomial regression. Our findings highlight that while GPUs are essential for sustaining AI's growth, democratized and shared access to GPU resources is critical for enabling research innovation across institutions with limited computational budgets.

深度学习算力效率资源公平GPU优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。