通过动态选择多样模型,在不降低效率的前提下显著提升攻击迁移性。
Use as Many Surrogates as You Want: Selective Ensemble Attack to Unleash Transferability without Sacrificing Resource Efficiency
- 动态选取不同预训练模型,解耦迭代内与跨迭代多样性
- 在相同效率下比现有方法高8.5%的迁移成功率
- 适合资源受限但需高迁移性的安全测试场景
在代理模型集成攻击中,使用更多代理模型虽能提高迁移性,但会降低资源效率。这一效率与迁移性的权衡限制了现有攻击方法的应用,尽管大量预训练模型可轻松获取。本文指出,该权衡源于一个不必要的假设:所有模型在各轮迭代中必须相同。通过打破此假设,我们提出选择性集成攻击(SEA),在每轮固定少量模型以保证效率的同时,跨轮次动态选择来自20个可用模型中的4个多样化模型,从而提升迁移性。ImageNet实验表明,在相同效率下,SEA较现有方法提升8.5%的迁移成功率。该优势在真实系统(如商业视觉API和大型视觉语言模型)中也得到验证。SEA实现了根据资源需求自适应平衡迁移性与效率的可能性。
原文摘要 · Abstract (English)
In surrogate ensemble attacks, using more surrogate models yields higher transferability but lower resource efficiency. This practical trade-off between transferability and efficiency has largely limited existing attacks despite many pre-trained models are easily accessible online. In this paper, we argue that such a trade-off is caused by an unnecessary common assumption, i.e., all models should be \textit{identical} across iterations. By lifting this assumption, we can use as many surrogates as we want to unleash transferability without sacrificing efficiency. Concretely, we propose Selective Ensemble Attack (SEA), which dynamically selects diverse models (from easily accessible pre-trained models) across iterations based on our new interpretation of decoupling within-iteration and cross-iteration model diversity. In this way, the number of within-iteration models is fixed for maintaining efficiency, while only cross-iteration model diversity is increased for higher transferability. Experiments on ImageNet demonstrate the superiority of SEA in various scenarios. For example, when dynamically selecting 4 from 20 accessible models, SEA yields 8.5% higher transferability than existing attacks under the same efficiency. The superiority of SEA also generalizes to real-world systems, such as commercial vision APIs and large vision-language models. Overall, SEA opens up the possibility of adaptively balancing transferability and efficiency according to specific resource requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。