通过设备协作提升无线网络中分片联邦学习的同步效率
A Novel Collaborative Framework for Efficient Synchronization in Split Federated Learning over Wireless Networks
- 高效设备帮慢速设备完成后续计算层,实现动态负载分担
- 实测训练延迟显著降低,收敛速度与准确率不受影响
- 适合资源异构、高延迟的移动边缘计算场景
分片联邦学习(SFL)在无线网络中为分布式模型训练提供了新路径,融合了分层分割的优势与联邦聚合的全局收敛性。然而,在异构无线环境下,设备算力与信道条件差异导致严格轮次同步严重受慢速设备拖累,制约了效率与可扩展性。为此,我们提出协同分片联邦学习(CSFL)框架,通过设备间协作重新定义任务分配:在完成自身前向传播后,高效设备可无缝接管瓶颈设备未完成的计算层。该协作机制依托设备到设备(D2D)通信,使瓶颈设备提前卸载计算,同时保障全网进度同步。我们还探讨了隐私保护、多视角匹配及激励机制等关键技术支撑,并分析匹配均衡、隐私风险与激励可持续性等实际挑战。案例研究显示,CSFL显著降低训练延迟,且不牺牲收敛速度与精度,验证了协作是下一代无线网络中高效同步学习的关键驱动力。
原文摘要 · Abstract (English)
Split Federated Learning (SFL) offers a promising approach for distributed model training in wireless networks, combining the layer-partitioning advantages of split learning with the federated aggregation that ensures global convergence. However, in heterogeneous wireless environments, disparities in device capabilities and channel conditions make strict round-based synchronization heavily straggler-dominated, thereby limiting both efficiency and scalability. To address this challenge, we propose a new framework, called Collaborative Split Federated Learning (CSFL), that redefines workload redistribution through device-to-device collaboration. Building on the flexibility of model partitioning, CSFL enables efficient devices, after completing their own forward propagation, to seamlessly take over the unfinished layers of bottleneck devices. This collaborative process, supported by D2D communications, allows bottleneck devices to offload computation earlier while maintaining synchronized progression across the network. Beyond the system design, we highlight key technical enablers such as privacy protection, multi-perspective matching, and incentive mechanisms, and discuss practical challenges including matching balance, privacy risks, and incentive sustainability. A case study demonstrates that CSFL significantly reduces training latency without compromising convergence speed or accuracy, underscoring collaboration as a key enabler for synchronization-efficient learning in next-generation wireless networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。