arXiv:2502.18077cs.CVcs.CR2025-02中稿 · BMVC 2024被引 3

基于大模型的视觉系统易被偷取,攻击成功率高达94%。

Examining the Threat Landscape: Foundation Models and Model Stealing

  • 用大模型微调的视觉模型更易遭模型窃取攻击。
  • 在CIFAR-10上,攻击者对ViT模型的预测匹配率达94.28%。
  • 适合关注模型安全的开发者与企业部署参考。

用于计算机视觉的基础模型(FMs)能学习丰富且鲁棒的表征,使它们可在无需或仅需少量微调的情况下适配特定任务或领域。然而,我们提出,这种强大表征能力反而可能使基于FMs的应用面临模型窃取攻击的风险。通过实证分析,我们发现从FMs微调的模型相比传统视觉架构(如ResNets)更易遭受模型窃取。我们推测,这是因为在预训练阶段FMs全面编码了视觉模式和特征,这些信息对攻击者和目标模型都可见。实验显示,当使用ViT-L/16作为攻击模型时,在CIFAR-10数据集上,对基于ViT-L/16的受害者模型可达到94.28%的预测一致率,而对ResNet-18模型仅为73.20%。我们首次明确指出,将基础模型用于下游任务部署时,其在商业API中的安全性存在隐患。因此,我们提醒模型所有者注意相关安全风险,并强调需建立强健的安全防护机制以抵御模型窃取。代码已公开于 https://github.com/rajankita/foundation_model_stealing。

原文摘要 · Abstract (English)

Foundation models (FMs) for computer vision learn rich and robust representations, enabling their adaptation to task/domain-specific deployments with little to no fine-tuning. However, we posit that the very same strength can make applications based on FMs vulnerable to model stealing attacks. Through empirical analysis, we reveal that models fine-tuned from FMs harbor heightened susceptibility to model stealing, compared to conventional vision architectures like ResNets. We hypothesize that this behavior is due to the comprehensive encoding of visual patterns and features learned by FMs during pre-training, which are accessible to both the attacker and the victim. We report that an attacker is able to obtain 94.28% agreement (matched predictions with victim) for a Vision Transformer based victim model (ViT-L/16) trained on CIFAR-10 dataset, compared to only 73.20% agreement for a ResNet-18 victim, when using ViT-L/16 as the thief model. We arguably show, for the first time, that utilizing FMs for downstream tasks may not be the best choice for deployment in commercial APIs due to their susceptibility to model theft. We thereby alert model owners towards the associated security risks, and highlight the need for robust security measures to safeguard such models against theft. Code is available at https://github.com/rajankita/foundation_model_stealing.

模型安全视觉模型大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。