arXiv:2510.19801cs.LG2025-10

研究拉美两国训练本土大模型的可行性,发现延长训练时间可降低硬件压力。

The Feasibility of Training Sovereign Language Models in the Global South: A Study of Brazil and Mexico

  • 对比不同显卡与训练时长组合,评估模型训练成本与能耗
  • H100方案总成本800万至1400万美元,优于A100方案的1900万至3200万美元
  • 适合关注技术主权、预算有限的中等收入国家参考

大规模语言模型训练所需的计算资源迅速增长,加剧了高算力地区与全球南方国家之间的结构性不平等。本文研究在硬件受限、能源不足和财政预算紧张条件下,巴西与墨西哥训练10万亿词规模模型的技术与财政可行性。采用双轴设计:比较NVIDIA H100与A100显卡,以及90天与150天训练周期。结果表明,所有配置均低于出口管制与电力基础设施阈值,但财政可行性取决于硬件效率。使用H100的方案总成本为800万至1400万美元,而A100方案需1900万至3200万美元,因能耗与硬件需求更高。研究主张延长训练周期作为政策工具,可在不参与全球前沿竞争的前提下,实现可审计、本地适配且可持续的模型生产。该研究为人工智能算力治理与技术主权议题提供了情境化策略。

原文摘要 · Abstract (English)

The rapid escalation of computational requirements for training large-scale language models has reinforced structural asymmetries between high-capacity jurisdictions and countries in the Global South. This paper examines the technical and fiscal feasibility of sovereign-scale language model training in Brazil and Mexico under conditions of constrained hardware access, energy availability, and fiscal ceilings. Using a dual-axis design that varies accelerator generation (NVIDIA H100 vs. A100) and training duration (90 vs. 150 days), we estimate compute demand, energy consumption, capital expenditures, and regulatory compatibility for the training of a 10-trillion-token model. Our findings show that while all configurations remain below export-control and electrical infrastructure thresholds, fiscal viability is determined by hardware efficiency. H100-based scenarios achieve training feasibility at a total cost of 8-14 million USD, while A100 deployments require 19-32 million USD due to higher energy and hardware demand. We argue that extending training timelines should be treated as a policy lever to mitigate hardware constraints, enabling the production of usable, auditable, and locally aligned models without competing at the global frontier. This study contributes to the discourse on AI compute governance and technological sovereignty by highlighting context-sensitive strategies that allow middle-income countries to establish sustainable and strategically sufficient AI capabilities.

技术主权大模型训练算力成本拉美研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。