arXiv:2509.01548cs.LG2025-09被引 5

给模型加锁,防止被非法合并使用。

Model Unmerging: Making Your Models Unmergeable for Secure Model Sharing

  • 通过变换注意力参数使模型无法被合并
  • 合并后性能下降超95%,有效阻断非法使用
  • 适合需保护模型版权的开发者使用

模型合并利用多个微调专家模型低成本构建多任务模型,日益受到关注。然而,随着越来越多微调模型公开,模型合并的安全性问题浮现:未经授权的合并可能侵犯开发者权益并泄露敏感信息。现有方法多聚焦于检测合并来源,难以有效阻止非法合并。本文提出MergeLock,一种主动防护机制,通过破坏模型参数使其不可合并。具体地,利用Transformer注意力机制的固有对称性,随机选取两组可逆矩阵,分别应用于查询-键(QK)与值-输出(VO)分支。该变换保持模型输出不变,同时将参数推向其他微调模型共享参数空间之外。在视觉与语言任务上的大量实验表明,当受保护模型参与合并时,多数情况下合并模型性能下降超过95%,证明其有效性。此外,我们进一步验证,经MergeLock保护的合并模型无法通过低成本恢复方法有效复原,进一步增强了对非法合并的鲁棒性。代码已开源:https://github.com/hetailang/Merge-Lock。

原文摘要 · Abstract (English)

Model merging leverages multiple finetuned expert models to construct a multi-task model with low cost, and is gaining increasing attention. However, as a growing number of finetuned models become publicly available, concerns about the safety of model merging have emerged. Unauthorized merging may infringe on developers' rights and risk leaking sensitive personal information. Most existing methods focus on detecting whether a merged model originates from a specific source model, but fail to effectively prevent illegal merging. In this paper, we propose MergeLock, an active protection mechanism that disrupts model parameters to render them unmergeable, thereby directly preventing unauthorized model merging. Specifically, leveraging the inherent symmetry of the attention mechanism in Transformer-based models, we randomly sample two pairs of invertible matrices and apply them to the Query-Key (QK) and Value-Output (VO) branches. This transformation keeps the model's output unchanged while pushing it away from the shared parameter space of other finetuned models. Extensive experiments across both vision and language tasks demonstrate that MergeLock can degrade the performance of merged models by over 95% when a protected model is involved in most cases, demonstrating its effectiveness. Moreover, we further demonstrate that merged models protected by MergeLock cannot be effectively recovered using low-cost restoration methods, further enhancing robustness against unauthorized merging. The code is available at https://github.com/hetailang/Merge-Lock.

模型安全模型合并隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。