arXiv:2607.27940cs.LGcs.CL2026-07

提出零损耗防御方案,彻底阻止语言模型微调中的隐私后门攻击

TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement

论文配图:TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement
图 1 · 摘自论文原文
  • 通过检测记忆神经元特征、梯度状态纠缠和正交投影三重机制防御
  • 使隐私数据重建率降至0%,且模型性能不受影响,计算开销小于5%
  • 适合关注联邦学习隐私安全的研究者与开发者

联邦微调大型语言模型可在不暴露原始数据的情况下实现协作训练。然而,最近的神经印记(NeuroImprint)攻击表明,恶意参数服务器可通过为每个训练样本分配专用记忆神经元,并确保每个神经元仅更新一次,实现对59%至79%客户端训练数据的高语义保真度重构。现有防御方法如本地差分隐私(LDP)和梯度裁剪,或无效或导致不可接受的性能下降。本文提出 extbf{TriShield},一种三层确定性防御机制,可在不增加通信轮次、零模型性能损失的前提下完全防止此类重构。该机制包括:(1) 参数异常检测器,在本地训练前识别分布式模型参数中的记忆神经元特征;(2) 状态化虚拟迭代机制,强制Adam/AdamW动量状态在虚拟步骤间不可逆纠缠,破坏神经印记的闭式反演;(3) 零损耗正交投影算子,将所有本地梯度更新投影到由SVD计算出的主任务语义子空间,物理消除携带私有记忆的梯度分量。理论证明,经第2、3层处理后,上传梯度与任一训练样本间的互信息为零。在GPT-2(117M)和Llama-Guard-3-1B上的实验表明,TriShield将神经印记重构率降至0%,同时保持或提升训练准确率,且额外GPU计算开销低于5%。

原文摘要 · Abstract (English)

Federated fine-tuning of large language models (LLMs) enables collaborative training without exposing raw data. However, a recent attack, NeuroImprint, demonstrates that a malicious parameter server can corrupt a PEFT adapter into a privacy backdoor: by assigning a dedicated memorization neuron to each training sample and ensuring each neuron updates at most once, the server can analytically reconstruct 59%--79% of client training data with high semantic fidelity. Existing defenses---including local differential privacy (LDP) and gradient clipping---either fail against this attack or impose unacceptable utility degradation. We present \textbf{TriShield}, a three-layer deterministic defense that completely prevents NeuroImprint-style reconstruction with zero model utility loss and no additional communication rounds. TriShield consists of: (1) a Parameter Artifact Detector that identifies memory-neuron signatures in distributed model parameters before local training begins; (2) a Stateful Virtual Iteration} mechanism that forces Adam/AdamW's momentum state to irreversibly entangle gradients across virtual steps, invalidating NeuroImprint's closed-form inversion; and (3) a Zero-Utility Orthogonal Projection operator that projects all local gradient updates onto the main-task semantic subspace computed via SVD, physically eliminating any gradient components that carry private memorization. We prove theoretically that after Layers 2 and 3, the mutual information between the uploaded gradient and any individual training sample is zero. Experiments on GPT-2 (117M) and Llama-Guard-3-1B verify that TriShield reduces NeuroImprint reconstruction rate to 0% across all tested attack variants, while maintaining or improving training accuracy, with less than 5% additional GPU computation overhead.

联邦学习隐私保护模型安全正交投影

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。