arXiv:2509.12630cs.LG2025-09被引 1

通过频域能量集中提升联邦学习效率,降低通信开销。

High-Energy Concentration for Federated Learning in Frequency Domain

  • 在频域保留低频分量,过滤冗余噪声信息
  • 在CIFAR-10上通信成本降低37.78%,性能提升10.88%
  • 适合资源受限场景下的高效联邦学习应用

联邦学习(FL)可在不共享数据的前提下实现协同优化。现有方法利用数据蒸馏思想,通过发送合成数据保护真实数据隐私并缓解数据异质性,但其在空间域设计中仍存在冗余信息和噪声,导致通信开销增加。本文提出一种新的频域感知联邦学习方法FedFD,利用离散余弦变换的能量集中特性——能量主要集中在特定区域。原理上,高频分量通常包含冗余信息和噪声,因此过滤它们可降低通信成本并提升性能。FedFD采用二值掩码保留低频分量,并通过频域分布对齐实现最优解。同时,在损失函数中引入真实数据驱动的合成分类约束,以提升低频分量质量。在五个图像与语音数据集上,FedFD优于现有先进方法,例如在α=0.01的CIFAR-10上,通信成本最低减少37.78%,性能提升10.88%。

原文摘要 · Abstract (English)

Federated Learning (FL) presents significant potential for collaborative optimization without data sharing. Since synthetic data is sent to the server, leveraging the popular concept of dataset distillation, this FL framework protects real data privacy while alleviating data heterogeneity. However, such methods are still challenged by the redundant information and noise in entire spatial-domain designs, which inevitably increases the communication burden. In this paper, we propose a novel Frequency-Domain aware FL method with high-energy concentration (FedFD) to address this problem. Our FedFD is inspired by the discovery that the discrete cosine transform predominantly distributes energy to specific regions, referred to as high-energy concentration. The principle behind FedFD is that low-energy like high-frequency components usually contain redundant information and noise, thus filtering them helps reduce communication costs and optimize performance. Our FedFD is mathematically formulated to preserve the low-frequency components using a binary mask, facilitating an optimal solution through frequency-domain distribution alignment. In particular, real data-driven synthetic classification is imposed into the loss to enhance the quality of the low-frequency components. On five image and speech datasets, FedFD achieves superior performance than state-of-the-art methods while reducing communication costs. For example, on the CIFAR-10 dataset with Dirichlet coefficient $α= 0.01$, FedFD achieves a minimum reduction of 37.78\% in the communication cost, while attaining a 10.88\% performance gain.

联邦学习频域优化通信压缩数据蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。