预训练骨干模型越强大,越容易被攻击,且攻击者可利用模型共享漏洞实现高效攻击。
With Great Backbones Comes Great Adversarial Transferability
- 用代理模型模拟不同知识水平的攻击,验证了攻击迁移性随调优信息增加而增强
- 仅用骨干网络生成对抗样本即可逼近白盒攻击效果,远超黑盒攻击
- 揭示了模型共享中的重大安全风险,尤其对依赖预训练模型的开发者至关重要
自监督学习(SSL)在视觉任务中显著提升了模型表征能力与性能,催生了如ResNet、ViT等基于SSL预训练的骨干模型。由于预训练成本高,这些骨干模型被广泛采用,但其可能继承对抗攻击的脆弱性。尽管白盒和黑盒攻击已有研究,但针对此类预训练骨干模型的鲁棒性仍缺乏系统评估。本文对20,000种调优元信息组合(包括微调方法、骨干结构、数据集和攻击类型)进行了系统性评估。通过使用代理模型模拟不同目标知识水平,发现代理攻击已接近白盒攻击效果,即使仅有少量调优信息亦然。我们提出一种简单的“骨干攻击”:仅依赖骨干网络生成对抗样本,其效果超过黑盒攻击,媲美白盒攻击,凸显模型共享中的严重安全隐患。消融实验进一步量化了调优信息如何影响攻击迁移性。
原文摘要 · Abstract (English)
Advances in self-supervised learning (SSL) for machine vision have improved representation robustness and model performance, giving rise to pre-trained backbones like \emph{ResNet} and \emph{ViT} models tuned with SSL methods such as \emph{SimCLR}. Due to the computational and data demands of pre-training, the utilization of such backbones becomes a strenuous necessity. However, employing these backbones may inherit vulnerabilities to adversarial attacks. While adversarial robustness has been studied under \emph{white-box} and \emph{black-box} settings, the robustness of models tuned on pre-trained backbones remains largely unexplored. Additionally, the role of tuning meta-information in mitigating exploitation risks is unclear. This work systematically evaluates the adversarial robustness of such models across $20,000$ combinations of tuning meta-information, including fine-tuning techniques, backbone families, datasets, and attack types. We propose using proxy models to transfer attacks, simulating varying levels of target knowledge by fine-tuning these proxies with diverse configurations. Our findings reveal that proxy-based attacks approach the effectiveness of \emph{white-box} methods, even with minimal tuning knowledge. We also introduce a naive "backbone attack," leveraging only the backbone to generate adversarial samples, which outperforms \emph{black-box} attacks and rivals \emph{white-box} methods, highlighting critical risks in model-sharing practices. Finally, our ablations reveal how increasing tuning meta-information impacts attack transferability, measuring each meta-information combination.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。