模型更新后才激活的隐蔽后门,骗过检测机制。
Unlearn to Relearn Backdoors: Deferred Backdoor Functionality Attacks on Deep Learning Models
- 后门不立即生效,更新后才触发,极难发现。
- 在多种数据集和模型上成功实现,攻击隐蔽性强。
- 适合研究防御漏洞或模型生命周期安全的人看。
深度学习模型易受后门攻击,攻击者在训练阶段注入恶意功能,仅在特定触发输入下于推理时激活。现有方法虽追求隐蔽性,但仍因必须在触发时产生恶意行为而易被检测。为此,本文提出延迟激活后门功能(DABF),一种新型后门攻击范式。与传统攻击不同,DABF初始阶段对触发输入输出正常结果,完全隐藏恶意行为,从而绕过多种检测与防御机制。后门仅在模型后续更新(如使用良性数据重训)后才被激活。该攻击利用机器学习模型生命周期中常见的更新与微调实践。为实现此目标,我们设计了名为DeferBad的两阶段训练方案,使后门的遗忘过程变得脆弱,易于被取消并重新激活。在多种微调场景、攻击类型、数据集及模型架构上的实验表明,DeferBad具有高度有效性与隐蔽性。
原文摘要 · Abstract (English)
Deep learning models are vulnerable to backdoor attacks, where adversaries inject malicious functionality during training that activates on trigger inputs at inference time. Extensive research has focused on developing stealthy backdoor attacks to evade detection and defense mechanisms. However, these approaches still have limitations that leave the door open for detection and mitigation due to their inherent design to cause malicious behavior in the presence of a trigger. To address this limitation, we introduce Deferred Activated Backdoor Functionality (DABF), a new paradigm in backdoor attacks. Unlike conventional attacks, DABF initially conceals its backdoor, producing benign outputs even when triggered. This stealthy behavior allows DABF to bypass multiple detection and defense methods, remaining undetected during initial inspections. The backdoor functionality is strategically activated only after the model undergoes subsequent updates, such as retraining on benign data. DABF attacks exploit the common practice in the life cycle of machine learning models to perform model updates and fine-tuning after initial deployment. To implement DABF attacks, we approach the problem by making the unlearning of the backdoor fragile, allowing it to be easily cancelled and subsequently reactivate the backdoor functionality. To achieve this, we propose a novel two-stage training scheme, called DeferBad. Our extensive experiments across various fine-tuning scenarios, backdoor attack types, datasets, and model architectures demonstrate the effectiveness and stealthiness of DeferBad.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。