arXiv:2508.03579cs.LGcs.NI2025-08

提出无需感知异构性的鲁棒联邦学习框架,通过低秩适配器提升抗攻击能力。

Heterogeneity-Oblivious Robust Federated Learning

  • 仅聚合低秩适配器参数,降低攻击面。
  • 输入投影适配器比输出更稳定,可有效识别恶意客户端。
  • 适合数据异构严重、需高鲁棒性的实际联邦学习场景。

联邦学习在现实世界中面临严重的数据分布、通信能力和模型架构异构性,使中毒攻击更难检测且加剧聚合策略失效。高维模型进一步扩大攻击面。为此,我们提出Horus框架,基于低秩适配器(LoRAs)实现异构性无关的鲁棒联邦学习。不聚合完整模型参数,而是将LoRAs插入经验上稳定的层,并仅聚合这些适配器。实验发现,在异构与中毒环境下,输入投影适配器(LoRA-A)显著优于输出投影(LoRA-B)的稳定性。基于此,我们设计了异构性无关的中毒评分机制,利用LoRA-A特征筛选恶意客户端。对剩余良性客户端,提出投影感知聚合机制,通过一致性重加权更新,保留协作信号并抑制偏差漂移。在多种数据集、模型架构和攻击类型下的广泛实验表明,Horus在鲁棒性和准确率方面持续优于现有最优基线。

原文摘要 · Abstract (English)

Federated Learning (FL) remains highly vulnerable to poisoning attacks, especially under real-world hyper-heterogeneity, where clients differ significantly in data distributions, communication capabilities, and model architectures. Such heterogeneity not only undermines the effectiveness of aggregation strategies but also makes attacks more difficult to detect. Furthermore, high-dimensional models expand the attack surface. To address these challenges, we propose Horus, a heterogeneity-oblivious robust FL framework centered on low-rank adaptations (LoRAs). Rather than aggregating full model parameters, Horus inserts LoRAs into empirically stable layers and aggregates only LoRAs to reduce the attack uncover a key empirical observation that the input projection (LoRA-A) is markedly more stable than the output projection (LoRA-B) under heterogeneity and poisoning. Leveraging this, we design a Heterogeneity-Oblivious Poisoning Score using the features from LoRA-A to filter poisoned clients. For the remaining benign clients, we propose projection-aware aggregation mechanism to preserve collaborative signals while suppressing drifts, which reweights client updates by consistency with the global directions. Extensive experiments across diverse datasets, model architectures, and attacks demonstrate that Horus consistently outperforms state-of-the-art baselines in both robustness and accuracy.

联邦学习鲁棒性低秩适配中毒攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。