破解参数级防御漏洞,实现未经授权的模型合并攻击
On the Vulnerability of Parameter-Level Defenses to Model Merging

- 利用预训练模型作静态锚点,反推防御变换矩阵
- 在真实场景下成功绕过单个与复合防御机制
- 提出新型防御方法对抗该攻击,提升模型合并安全性
通过模型合并无须训练即可集成专家模型,已暴露重大安全风险,导致搭便车者可未经授权组合专用模型。近期工作提出参数级防御,采用线性参数变换以消除威胁。本文系统分析此类防御,发现其保护任务向量幅度极小,因此保护权重仍主要受预训练模型主导。基于此观察,我们将预训练模型设为静态参考锚点,提出锚点引导攻击(AGA),通过将受保护模型对齐锚点,解析恢复变换矩阵。大量实验验证,AGA在真实防御无关场景下持续绕过个体及复合防御。此外,我们提出锚点排斥微调(ARF)作为防御方法,有效缓解AGA依赖的锚点主导问题。实证结果表明ARF能有效抵御该攻击。代码已开源:https://github.com/krumpguo/secure-merge-attack。
原文摘要 · Abstract (English)
The training-free integration of expert models via model merging has exposed significant security risks, enabling free-riders to combine specialized models without authorization. Recent works propose parameter-level defenses that employ linear parameter transformations to neutralize this threat. In this paper, we systematically analyze such defenses and reveal that their protected task vectors are inherently small in magnitude. Consequently, the protected weights remain overwhelmingly dominated by the pretrained model. Based on this observation, we designate the pretrained model as a static reference anchor and propose the Anchor-Guided Attack (AGA) to circumvent existing safeguards. Specifically, AGA aligns the protected model with this anchor to recover the transformation matrix analytically. Extensive evaluations validate that AGA consistently bypasses both individual and composite defenses under realistic defense-agnostic scenarios. Furthermore, we provide Anchor-Repulsive Fine-tuning (ARF), a defense method to mitigate the anchor dominance leveraged by AGA. Empirical results confirm that ARF effectively defeats the proposed attack. Our code is available at https://github.com/krumpguo/secure-merge-attack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。