arXiv:2412.07890cs.LGcs.DC2024-12被引 4

提出协议学习新范式,用去中心化网络训练大模型

Protocol Learning, Decentralized Frontier Risk and the No-Off Problem

  • 通过激励机制驱动的分布式网络训练模型,突破单体中心化算力瓶颈
  • 可整合超量计算资源,支持前所未有的模型规模与能力
  • 适合关注去中心化AI、模型安全与治理的开发者与研究者

当前前沿模型主要通过中心化专有API或开源预训练权重传播。本文提出第三种范式——协议学习:在激励参与者的去中心化网络中训练模型。该模式有望聚合远超单一中心实体的计算资源,实现空前的模型规模与能力。但同时带来新挑战:节点异构性与不可靠性、恶意参与者、需保持模型不可提取以维持激励机制,以及复杂的治理动态。迄今为止,尚无系统分析评估协议学习的可行性及其风险,特别是‘无法中断’问题——即无法单方面停止集体训练的模型。本文综述近期技术进展,表明通信高效策略与容错方法使去中心化训练成为可能;同时指出关键开放问题。与认为去中心化必然加剧风险的观点相反,我们主张协议学习的透明性、分布式治理与民主化访问最终将降低风险,优于当前中心化模式。

原文摘要 · Abstract (English)

Frontier models are currently developed and distributed primarily through two channels: centralized proprietary APIs or open-sourcing of pre-trained weights. We identify a third paradigm - Protocol Learning - where models are trained across decentralized networks of incentivized participants. This approach has the potential to aggregate orders of magnitude more computational resources than any single centralized entity, enabling unprecedented model scales and capabilities. However, it also introduces novel challenges: heterogeneous and unreliable nodes, malicious participants, the need for unextractable models to preserve incentives, and complex governance dynamics. To date, no systematic analysis has been conducted to assess the feasibility of Protocol Learning or the associated risks, particularly the 'No-Off Problem' arising from the inability to unilaterally halt a collectively trained model. We survey recent technical advances that suggest decentralized training may be feasible - covering emerging communication-efficient strategies and fault-tolerant methods - while highlighting critical open problems that remain. Contrary to the notion that decentralization inherently amplifies frontier risks, we argue that Protocol Learning's transparency, distributed governance, and democratized access ultimately reduce these risks compared to today's centralized regimes.

去中心化协议学习模型安全分布式训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。