通过调整客户端语言构成,优化多语言大模型的联邦学习效果。
Optimizing Multilingual LLMs via Federated Learning: A Study of Client Language Composition
- 设计客户端自适应早停机制,提升训练效率与可持续性。
- 多语言客户端比例越高,全局模型越公平且性能越优,尤其利好低资源语言。
- 适合关注多语言模型公平性与高效训练的团队使用。
在多语言环境下,大型语言模型的联邦学习面临客户端语言分布异构和语言资源不均的挑战。为此,我们扩展了FederatedScope-LLM框架,支持多语言指令微调实验,并提出一种新型客户端本地动态早停机制(LDES-FL),使客户端根据本地验证性能自主暂停与恢复训练,提升训练效率与可持续性。通过一系列实验,我们研究了客户端语言构成(从纯单语到日益多语)对多语言质量、公平性和训练成本的影响。纯单语本地微调在单一语言专精上仍最有效,而联邦训练更适合学习均衡的多语言模型。在联邦学习中,客户端内多语言程度越高,全局模型越强且越公平,更接近集中式多语言微调表现,对低资源语言提升最大,但需更多优化步数。结果表明,客户端语言构成是多语言联邦学习的关键设计变量,直接影响性能、公平性与效率。
原文摘要 · Abstract (English)
Federated Learning (FL) of Large Language Models (LLMs) in multilingual environments presents significant challenges stemming from heterogeneous language distributions across clients and disparities in language resource availability. To address these challenges, we extended the FederatedScope-LLM framework to support multilingual instruction-tuning experiments with LLMs. We also introduced a novel client-specific early stopping mechanism, Local Dynamic Early Stopping (LDES-FL), which allows clients to pause and resume local training based on client-side validation performance, enhancing training efficiency and sustainability. Through a series of experiments, we studied how client language composition - from fully monolingual to increasingly multilingual clients - affects multilingual quality, fairness and training cost. Monolingual local fine-tuning remains the most effective for single-language specialization, whereas federated training is better suited to learning a single balanced multilingual model. In FL, increasing within-client multilinguality leads to stronger and fairer global models, narrows the gap to centralized multilingual fine-tuning, and yields the largest gains for lower-resource languages, albeit at the cost of more optimization steps. Overall, our results identify client language composition as a key design variable in multilingual FL, shaping performance, fairness and efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。