用隐码中心对齐降低联邦学习通信开销并保护数据隐私
GCA: Global Centroid Alignment in Federated Learning

- 通过上传编码隐码和全局中心点,避免传输模型参数或梯度
- 在21次对比中均有效降低数据提取风险,测试准确率最高提升5.76%
- 通信量减少高达99.15%,适合资源受限且重视隐私的场景
基于自编码器(AE)的联邦学习(FL)在客户端数据有限时适用于异常检测。然而,传统方法传输AE参数或梯度,导致通信开销大且可能泄露训练数据,因自编码器旨在重构输入。本文提出全局中心对齐(GCA),一种以隐码为媒介的联邦学习协议,无需传输模型参数或梯度。每轮中:(1) 客户端先使用重建更新训练本地自编码器,并上传少量编码隐码;(2) 服务器聚合这些隐码,拟合聚类模型,并广播全局隐码中心及其支持数量;(3) 每个客户端通过逆计数加权方式,将其本地隐码对齐最近中心。该过程重复进行。由于只交换采样隐码与中心统计信息,通信成本仅取决于隐码维度、上传隐码数及返回中心数,而非模型大小。在五个表格与两个视觉基准上,GCA在全部21次对比中均显著降低服务器侧客户端数据提取风险,20/21次对比中与FedAvg、FedProx、FedNova相比余弦相似度更低,表明其强数据保护能力。同时,其测试准确率比FedAvg最高提升5.76%。GCA的防护效果接近差分隐私联邦学习(DP-FedAvg),且在后者无法降低目标相似性时仍有效,单轮通信量最多降低99.15%。
原文摘要 · Abstract (English)
Autoencoder (AE)-based federated learning (FL) is attractive for anomaly detection when clients have limited local data. However, conventional FL exchanges AE parameters or gradients, incurring substantial communication overhead and potentially exposing input training data information, since AEs are explicitly optimized to reconstruct their inputs. We introduce \emph{Global Centroid Alignment (GCA)}, a latent-code-mediated FL protocol that coordinates clients without transmitting AE parameters or gradients. In each round, (1) clients first train their local AEs using a \emph{reconstruction} update and upload a small subset of encoder latent codes to the FL server. (2) The server pools these codes, fits a clustering model, and broadcasts only \emph{global latent centroids and their support counts}. (3) Each client then updates its encoder by aligning its local latent codes with the \emph{nearest} centroid using \emph{inverse-count} weighting to emphasize globally underrepresented patterns. Steps (1)--(3) repeat over communication rounds. Because GCA exchanges only sampled latent codes and centroid statistics, its communication cost depends on latent dimensionality and the numbers of uploaded codes and returned centroids rather than on AE model size. Across five tabular and two vision benchmarks, GCA yields higher reconstruction error under a server-side client data extraction attack in all 21 comparisons and clearly lower cosine similarity in 20 of 21 comparisons with FedAvg, FedProx, and FedNova, showing its ability to protect training data. It even improves test accuracy over FedAvg by up to $5.76\%$. GCA achieves extraction defense comparable to DP-FedAvg, remains effective when DP-FedAvg does not reduce target resemblance, and lowers per-round communication by up to $99.15\%$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。