arXiv:2410.13910cs.CRcs.LG2024-10ICLR被引 17

提出新方法防范多任务模型合并中的后门攻击,兼顾性能与安全。

Mitigating the Backdoor Effect for Multi-Task Model Merging via Safety-Aware Subspace

  • 用双掩码机制识别共享安全子空间,同时减少任务冲突和后门风险。
  • 在多个攻击场景下,攻击成功率降低2-10个百分点,仅损失约1%准确率。
  • 适合关注模型安全的开发者、研究人员及开源模型整合场景使用。

模型合并作为低成本整合多个单任务微调模型的有效方法,近年来受到广泛关注。然而,现有方法主要聚焦于解决任务间冲突,常忽视开放源代码生态中潜在的安全威胁,尤其是后门攻击风险。本文首次研究了现有合并方法对后门攻击的脆弱性,发现两个关键问题:后门继承与后门传播。为此,我们提出防御感知合并(DAM)方法,同步缓解任务干扰与后门漏洞。DAM采用基于元学习的优化策略,结合双掩码机制:任务共享掩码用于识别跨任务有益参数,保留特定知识并降低干扰;后门检测掩码则隔离潜在有害参数,消除安全威胁。该设计实现有用知识保留与漏洞清除的精细平衡。相比现有方法,DAM在性能与安全性间取得更优权衡,攻击成功率下降2–10个百分点,精度损失仅约1%。此外,DAM在多种后门攻击类型及不同被攻陷模型数量下均表现稳健且适用广泛。代码与模型已公开于 https://github.com/Yangjinluan/DAM。

原文摘要 · Abstract (English)

Model merging has gained significant attention as a cost-effective approach to integrate multiple single-task fine-tuned models into a unified one that can perform well on multiple tasks. However, existing model merging techniques primarily focus on resolving conflicts between task-specific models, they often overlook potential security threats, particularly the risk of backdoor attacks in the open-source model ecosystem. In this paper, we first investigate the vulnerabilities of existing model merging methods to backdoor attacks, identifying two critical challenges: backdoor succession and backdoor transfer. To address these issues, we propose a novel Defense-Aware Merging (DAM) approach that simultaneously mitigates task interference and backdoor vulnerabilities. Specifically, DAM employs a meta-learning-based optimization method with dual masks to identify a shared and safety-aware subspace for model merging. These masks are alternately optimized: the Task-Shared mask identifies common beneficial parameters across tasks, aiming to preserve task-specific knowledge while reducing interference, while the Backdoor-Detection mask isolates potentially harmful parameters to neutralize security threats. This dual-mask design allows us to carefully balance the preservation of useful knowledge and the removal of potential vulnerabilities. Compared to existing merging methods, DAM achieves a more favorable balance between performance and security, reducing the attack success rate by 2-10 percentage points while sacrificing only about 1% in accuracy. Furthermore, DAM exhibits robust performance and broad applicability across various types of backdoor attacks and the number of compromised models involved in the merging process. Our codes and models are available at https://github.com/Yangjinluan/DAM.

模型合并后门攻击安全增强多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。