arXiv:2601.07177cs.CRcs.AI2026-01ACL被引 3

提出防御联邦大模型中恶意客户端攻击的新框架,提升系统安全性。

Safe-FedLLM: Delving into the Safety of Federated Large Language Models

  • 通过分析LoRA更新行为,用轻量级分类器识别恶意客户端。
  • 在高比例恶意客户端下仍保持良好防御效果,不影响训练速度。
  • 适用于关注联邦学习安全性的研究人员与开发者。

联邦学习(FL)解决了大语言模型(LLM)训练中的隐私和数据孤岛问题。以往研究多聚焦于提升联邦学习的效率,但开放环境下的安全性,尤其是对恶意客户端的防御,仍缺乏深入探索。为研究联邦大模型的安全性,本文从LoRA更新的角度分析潜在攻击面与防御特性,发现两大关键性质:1)大语言模型在联邦学习中易受恶意客户端攻击;2)LoRA更新具有可被轻量分类器有效区分的显著行为模式。基于此,我们提出Safe-FedLLM——一种基于探测的防御框架,在步骤级、客户端级和影子级三个层面构建防御机制。其核心思想是将每个客户端的本地LoRA更新视为高维行为特征,通过轻量分类器判断是否为恶意。大量实验表明,Safe-FedLLM能有效提升联邦大模型对恶意客户端的鲁棒性,同时在良性数据上保持竞争力。值得注意的是,该方法能有效抑制恶意数据影响,且不显著降低训练速度,即使在高恶意客户端比例下依然有效。

原文摘要 · Abstract (English)

Federated learning (FL) addresses privacy and data-silo issues in the training of large language models (LLMs). Most prior work focuses on improving the efficiency of federated learning for LLMs (FedLLM). However, security in open federated environments, particularly defenses against malicious clients, remains underexplored. To investigate the security of FedLLM, we conduct a preliminary study to analyze potential attack surfaces and defensive characteristics from the perspective of LoRA updates. We find two key properties of FedLLM: 1) LLMs are vulnerable to attacks from malicious clients in FL, and 2) LoRA updates exhibit distinct behavioral patterns that can be effectively distinguished by lightweight classifiers. Based on these properties, we propose Safe-FedLLM, a probe-based defense framework for FedLLM, which constructs defenses across three levels: Step-Level, Client-Level, and Shadow-Level. The core concept of Safe-FedLLM is to perform probe-based discrimination on each client's local LoRA updates, treating them as high-dimensional behavioral features and using a lightweight classifier to determine whether they are malicious. Extensive experiments demonstrate that Safe-FedLLM effectively improves FedLLM's robustness against malicious clients while maintaining competitive performance on benign data. Notably, our method effectively suppresses the impact of malicious data without significantly affecting training speed, and remains effective even under high malicious client ratios.

联邦学习大模型安全防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。