无需参数聚合,让设备端高效个性化微调大模型。
FlexP-SFT: A Flexible Aggregation-Free Framework for On-Device Personalized Split Federated Fine-Tuning of LLMs
- 摒弃客户端聚合,降低通信与延迟开销。
- 优化模型分割比例,实现资源与精度更好平衡。
- 适合边缘设备上私有数据的个性化大模型训练。
为在私有数据上微调大语言模型(LLMs),联邦学习(FL)成为有前景的范式。然而,LLMs高昂的内存与通信需求使标准FL难以在资源受限的边缘设备上运行。尽管分片联邦学习(SFL)通过模型分片减轻计算负担,现有框架仍受制于参数聚合带来的通信瓶颈和慢节点问题。为此,我们提出FlexP-SFT,一种无需聚合的个性化分片联邦微调新框架,从根本上消除客户端的聚合过程。关键在于,为在无全局同步下保证训练鲁棒性,我们引入层灵活对齐策略,以平衡个性化与泛化能力。同时,将分片比例选择建模为兼顾个性化精度与系统成本的资源感知离散优化问题。所提方案显著提升个性化性能,减少通信开销,并解决慢节点问题。大量实验表明,FlexP-SFT在准确率和延迟上均显著优于基线,且优化后的分片比例比静态或仅考虑内存的方案获得更优的资源-精度权衡。
原文摘要 · Abstract (English)
To fine-tune large language models (LLMs) over private data, federated learning (FL) has emerged as a promising paradigm. However, the prohibitive memory and communication demands of LLMs render standard FL impractical for resource-constrained edge devices. While split federated learning (SFL) alleviates the computing burdens via model partitioning, existing frameworks still suffer from communication bottlenecks and straggler problem due to the parameter aggregation process. To address these challenges, we propose FlexP-SFT, a novel aggregation-free framework for personalized split federated fine-tuning, which fundamentally eliminates the client-side aggregation process. Crucially, to ensure robust training in the absence of global synchronization, we introduce a layer-flexible alignment strategy to balance personalization and generalization capabilities. We further formulate split-ratio selection as a resource-aware discrete optimization problem that jointly accounts for personalization accuracy and system cost. Our proposed scheme simultaneously enhances personalized performance, reduces communication overhead, and resolves the straggler problem. Extensive results show that FlexP-SFT substantially outperforms baselines in both accuracy and latency, and that the optimized split ratio achieves a better resource-accuracy trade-off than static or memory-only choices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。