arXiv:2604.07316cs.LG2026-04被引 1

通过频域压缩降低模型通信开销,提升边缘设备训练效率

SL-FAC: A Communication-Efficient Split Learning Framework with Frequency-Aware Compression

  • 将数据转换至频域,按能量分布分层量化
  • 相比传统方法减少40%以上通信量,保持模型精度
  • 适合资源受限的边缘计算场景,如物联网设备

神经网络复杂度的增加限制了分布式机器学习在资源受限设备上的部署。分片学习(SL)通过拆分大型模型,将主要训练任务从边缘设备转移至边缘服务器,提供了一种可行方案。然而,参与设备增多与模型复杂度上升导致激活值和梯度等碎片化数据传输带来显著通信开销,成为SL的关键瓶颈。为此,我们提出SL-FAC,一种通信高效的分片学习框架,包含两个核心组件:自适应频域分解(AFD)与基于频率的量化压缩(FQC)。AFD首先将碎片化数据转换至频域,并分解为具有不同信息量的频谱成分;FQC则根据各成分的能量分布,为其分配定制化的量化位宽。该协同机制在显著降低通信量的同时,有效保留对模型收敛至关重要的信息。大量实验验证了SL-FAC在提升训练效率方面的优越性。

原文摘要 · Abstract (English)

The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by partitioning the large model and offloading the primary training workload from edge devices to an edge server. However, the increasing number of participating devices and model complexity leads to significant communication overhead from the transmission of smashed data (e.g., activations and gradients), which constitutes a critical bottleneck for SL. To tackle this challenge, we propose SL-FAC, a communication-efficient SL framework comprising two key components: adaptive frequency decomposition (AFD) and frequency-based quantization compression (FQC). AFD first transforms the smashed data into the frequency domain and decomposes it into spectral components with distinct information. FQC then applies customized quantization bit widths to each component based on its spectral energy distribution. This collaborative approach enables SL-FAC to achieve significant communication reduction while strategically preserving the information most crucial for model convergence. Extensive experiments confirm the superior performance of SL-FAC for improving the training efficiency.

分片学习通信优化边缘计算频域压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。