提出新型图学习攻击策略,让恶意更新骗过联邦微调中的模型聚合。
Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs

- 用图表示学习捕捉正常更新特征,生成伪装成正常的恶意更新。
- 攻击使全局模型准确率下降26%,本地模型平均准确率下降22%。
- 生成的更新在统计与几何上接近正常数据,可躲避主流防御机制。
联邦微调(FFT)作为一种保护隐私的协作方式,允许分布式参与者在不共享原始数据的前提下联合优化大型语言模型。然而,基于FFT的LLM仍易受模型操纵威胁:恶意参与者上传被篡改的模型更新,干扰聚合过程并降低全局模型性能。本文提出一种增强型模型操纵策略(AugMP),设计了一种新的图表示学习框架,用于捕捉良性更新间的特征关联,并据此生成恶意更新。通过基于增强拉格朗日对偶形式的迭代优化算法,恶意更新在嵌入对抗目标的同时,保持与良性更新相似的参数特性。实验结果表明,该策略在多个LLM骨干网络上均优于现有基线,使全局模型准确率最高下降26%,本地模型平均准确率最高下降22%。同时,其在统计与几何上与正常更新高度一致,能够有效规避基于距离和相似性的防御方法。
原文摘要 · Abstract (English)
Federated fine-tuning (FFT) has emerged as a privacy-preserving paradigm for collaboratively adapting large language models (LLMs). Built upon federated learning, FFT enables distributed agents to jointly refine a shared pretrained LLM by aggregating local LLM updates without sharing local raw data. However, FFT-based LLMs remain vulnerable to model manipulation threats, in which adversarial participants upload manipulated LLM updates that corrupt the aggregation process and degrade the performance of the global LLM. In this paper, we propose an Augmented Model maniPulation (AugMP) strategy against FFT-based LLMs. Specifically, we design a novel graph representation learning framework that captures feature correlations among benign LLM updates to guide the generation of malicious updates. To enhance manipulation effectiveness and stealthiness, we develop an iterative manipulation algorithm based on an augmented Lagrangian dual formulation. Through this formulation, malicious updates are optimized to embed adversarial objectives while preserving benign-like parameter characteristics. Experimental results across multiple LLM backbones demonstrate that the AugMP strategy achieves the strongest manipulation performance among all competing baselines, reducing the global LLM accuracy by up to \(26\%\) and degrading the average accuracy of local LLM agents by up to \(22\%\). Meanwhile, AugMP maintains high statistical and geometric consistency with benign updates, enabling it to evade conventional distance- and similarity-based defense methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。