针对开源LoRA模型设计隐蔽后门攻击,无需原始数据即可高效触发。
Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models
- 通过行为探索生成任务对齐输入,避免依赖原始训练数据。
- 利用因果引导去毒策略,降低误触发率50%-70%。
- 可调节攻击强度,适配安全研究与防御评估场景。
低秩适应(LoRA)是高效微调大语言模型的常用方法,广泛应用于开源社区。然而,通过Hugging Face等平台分发的LoRA适配器存在新型安全风险:恶意适配器易被传播且难以被传统机制检测。现有后门攻击方法在此场景下表现不佳,因依赖不可访问的训练数据、忽略LoRA结构特性或误触发率(FTR)过高,影响隐蔽性。为此,我们提出因果引导去毒后门攻击(CBA),专为开放权重的LoRA模型设计。CBA无需原始训练数据,通过两个关键创新实现高隐蔽性:(1)覆盖引导的数据生成管道,通过行为探索合成任务对齐输入;(2)因果引导的去毒策略,通过保留任务关键神经元融合中毒与干净适配器。不同于以往方法,CBA可通过因果影响权重分配实现攻击强度的后训练控制,无需重复训练。在六种LoRA模型上评估,CBA实现高攻击成功率的同时,将误触发率降低50%-70%,并展现对当前先进防御手段的更强鲁棒性,凸显其隐蔽性与实用性。
原文摘要 · Abstract (English)
Low-Rank Adaptation (LoRA) has emerged as an efficient method for fine-tuning large language models (LLMs) and is widely adopted within the open-source community. However, the decentralized dissemination of LoRA adapters through platforms such as Hugging Face introduces novel security vulnerabilities: malicious adapters can be easily distributed and evade conventional oversight mechanisms. Despite these risks, backdoor attacks targeting LoRA-based fine-tuning remain relatively underexplored. Existing backdoor attack strategies are ill-suited to this setting, as they often rely on inaccessible training data, fail to account for the structural properties unique to LoRA, or suffer from high false trigger rates (FTR), thereby compromising their stealth. To address these challenges, we propose Causal-Guided Detoxify Backdoor Attack (CBA), a novel backdoor attack framework specifically designed for open-weight LoRA models. CBA operates without access to original training data and achieves high stealth through two key innovations: (1) a coverage-guided data generation pipeline that synthesizes task-aligned inputs via behavioral exploration, and (2) a causal-guided detoxification strategy that merges poisoned and clean adapters by preserving task-critical neurons. Unlike prior approaches, CBA enables post-training control over attack intensity through causal influence-based weight allocation, eliminating the need for repeated retraining. Evaluated across six LoRA models, CBA achieves high attack success rates while reducing FTR by 50-70\% compared to baseline methods. Furthermore, it demonstrates enhanced resistance to state-of-the-art backdoor defenses, highlighting its stealth and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。