arXiv:2605.22266cs.LGcs.AI2026-05

通过激活空间变化检测联邦学习中的异常客户端

Detecting Atypical Clients in Federated Learning via Representation-Level Divergence

论文配图:Detecting Atypical Clients in Federated Learning via Representation-Level Divergence
图 1 · 摘自论文原文
  • 用共享探针集测量客户端激活分布的几何偏移
  • 能有效识别功能上偏离全局模型的异常客户端
  • 适合关注联邦学习系统可靠性与安全性的研究者

联邦学习允许多个分布式客户端在异构数据上协作训练,但数据异质性常导致更新不稳定和全局性能下降。实际部署中,客户端更新不仅受非独立同分布数据影响,还可能因分布漂移或异常输入而偏离预期行为,威胁聚合过程的可靠性。本文提出一种轻量级几何信号,量化客户端相对于全局模型的功能偏差。不同于参数或梯度比较,该方法评估每个客户端本地训练对输入空间激活诱导划分的影响,基于共享探针集计算。所得指标具有置换不变性且可解释,捕捉了模型处理数据方式的差异。实验表明,该信号能有效识别引发异常功能变化的客户端,区分稳定但异构的客户端与显著偏离全局模式的客户端。该度量为监控客户端行为、设计风险感知聚合策略提供了简单工具。

原文摘要 · Abstract (English)

Federated learning enables collaborative training across distributed clients with heterogeneous data, but such heterogeneity often leads to unstable updates and degraded global performance. Moreover, in practical deployments, client updates may deviate from the expected behavior not only due to benign not i.i.d. distributions, but also due to distributional shifts or anomalous inputs, raising concerns about the reliability of the aggregation process. In this work, we propose a lightweight geometric signal to quantify the functional deviation of a client with respect to the global model. Instead of comparing model parameters or gradients, our approach measures how the local training of each client alters the activation-induced partition of the input space, evaluated on a shared probe set. This yields a permutation-invariant, interpretable metric of client--global divergence that captures differences in how data is processed by the model. We show that this signal effectively identifies clients that induce atypical functional changes, distinguishing stable yet heterogeneous clients from those whose updates significantly diverge from the global regime. As a result, the proposed metric provides a simple tool for monitoring client behavior and enabling risk-aware aggregation strategies in federated learning systems.

联邦学习异常检测模型可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。