arXiv:2505.11586cs.CRcs.AI2025-05ICML被引 2

发现预训练模型后门攻击会引发意外后果,影响其他任务输出分布。

The Ripple Effect: On Unforeseen Complications of Backdoor Attacks

  • 通过多任务学习缓解后门攻击在非目标任务中的副作用。
  • 实验证明16个文本分类任务中后门样本输出分布明显异常。
  • 无需下游任务先验知识,可同时保持攻击效果与隐蔽性。

近期研究指出,第三方预训练语言模型(PTLM)可能遭受后门攻击,但此类攻击仅对特定下游任务有效。然而,这些模型常被适配至多种无关下游任务,导致未预期的输出异常,引发用户怀疑并降低攻击隐蔽性。我们称此现象为后门并发症。本文首次系统量化该问题,基于4个主流PTLM和16个文本分类基准数据集的实验表明,从带毒PTLM微调的下游模型中,触发样本的输出分布显著偏离正常样本。为此,提出一种无需下游任务先验知识的多任务学习方法,有效缓解并发症,同时维持后门攻击的效力与一致性。代码已开源。

原文摘要 · Abstract (English)

Recent research highlights concerns about the trustworthiness of third-party Pre-Trained Language Models (PTLMs) due to potential backdoor attacks. These backdoored PTLMs, however, are effective only for specific pre-defined downstream tasks. In reality, these PTLMs can be adapted to many other unrelated downstream tasks. Such adaptation may lead to unforeseen consequences in downstream model outputs, consequently raising user suspicion and compromising attack stealthiness. We refer to this phenomenon as backdoor complications. In this paper, we undertake the first comprehensive quantification of backdoor complications. Through extensive experiments using 4 prominent PTLMs and 16 text classification benchmark datasets, we demonstrate the widespread presence of backdoor complications in downstream models fine-tuned from backdoored PTLMs. The output distribution of triggered samples significantly deviates from that of clean samples. Consequently, we propose a backdoor complication reduction method leveraging multi-task learning to mitigate complications without prior knowledge of downstream tasks. The experimental results demonstrate that our proposed method can effectively reduce complications while maintaining the efficacy and consistency of backdoor attacks. Our code is available at https://github.com/zhangrui4041/Backdoor_Complications.

后门攻击语言模型多任务学习安全评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。