arXiv:2605.02935cs.LGcs.AI2026-05被引 4

提出去中心化接力学习,让普通用户也能参与大模型训练并持续共享。

DeRelayL: Sustainable Decentralized Relay Learning

论文配图:DeRelayL: Sustainable Decentralized Relay Learning
图 1 · 摘自论文原文
  • 用户像接力赛一样贡献数据和算力,逐步推进模型训练。
  • 设计激励机制保障系统长期运行,避免资源枯竭。
  • 适合想参与模型训练但缺乏算力的普通用户或小型机构。

在大数据时代,大规模机器学习模型推动了各领域的显著进步,但其训练需高额资金与计算资源,仅少数科技巨头和资金充足的机构可负担。普通用户(如移动设备用户)虽是宝贵数据的真实创造者,却因门槛被排除在外,现有大模型访问方式或限制用户所有权,或难以持续。为弥合这一鸿沟,本文提出一种可持续的去中心化接力学习(DeRelayL)范式,允许无许可参与者以接力方式贡献模型训练并共享成果。本文详细阐述了DeRelayL的架构与流程,设计了保障系统可持续性的激励机制,并通过理论分析与数值模拟验证其有效性。

原文摘要 · Abstract (English)

In the era of big data, large-scale machine learning models have revolutionized various fields, driving significant advancements. However, large-scale model training demands high financial and computational resources, which are only affordable by a few technological giants and well-funded institutions. In this case, common users like mobile users, the real creators of valuable data, are often excluded from fully benefiting due to the barriers, while the current methods for accessing large-scale models either limit user ownership or lack sustainability. This growing gap highlights the urgent need for a collaborative model training approach, allowing common users to train and share models. However, existing collaborative model training paradigms, especially federated learning (FL), primarily focus on data privacy and group-based model aggregation. To this end, this paper intends to address this issue by proposing a novel training paradigm named decentralized relay learning (DeRelayL), a sustainable learning system where permissionless participants can contribute to model training in a relay-like manner and share the model. In detail, this paper presents the architecture and workflow of DeRelayL, designs incentive mechanisms to ensure sustainability, and conducts theoretical analysis and numerical simulations to demonstrate its effectiveness.

去中心化联邦学习激励机制可持续

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。