arXiv:2502.14586cs.LGcs.CR2025-02

首个针对模型选择的对抗攻击,可隐蔽操纵选型结果。

Moshi Moshi? A Model Selection Hijacking Adversarial Attack

  • 用变分自编码器构建攻击框架,无需系统先验知识
  • 平均成功率75.42%,导致泛化能力下降88.30%
  • 适合关注MLaaS安全性的研究人员与工程师

模型选择是机器学习中的基础任务,通过在特定指标上评估候选模型性能来选出最优者,确保性能、效率和任务适应性。然而,其在对抗机器学习视角下的安全性尚未被探索。在机器学习即服务(MLaaS)模式下,用户将训练和模型选择委托给第三方,这使模型选择面临攻击风险,可能损害用户和提供方利益,降低模型性能并增加运营成本。本文提出MOSHI(MOdel Selection HIjacking adversarial attack),首个专门针对模型选择的对抗攻击。基于变分自编码器框架,攻击者可在无系统先验知识情况下操纵选择数据以利于自身。我们在多个计算机视觉与语音识别基准任务及不同设置中测试,平均攻击成功率达75.42%。攻击导致平均泛化能力下降88.30%,延迟上升83.33%,能源消耗最高增加105.85%。结果揭示了模型选择流程的重大安全隐患及其对实际应用的深远影响。

原文摘要 · Abstract (English)

Model selection is a fundamental task in Machine Learning~(ML), focusing on selecting the most suitable model from a pool of candidates by evaluating their performance on specific metrics. This process ensures optimal performance, computational efficiency, and adaptability to diverse tasks and environments. Despite its critical role, its security from the perspective of adversarial ML remains unexplored. This risk is heightened in the Machine-Learning-as-a-Service model, where users delegate the training phase and the model selection process to third-party providers, supplying data and training strategies. Therefore, attacks on model selection could harm both the user and the provider, undermining model performance and driving up operational costs. In this work, we present MOSHI (MOdel Selection HIjacking adversarial attack), the first adversarial attack specifically targeting model selection. Our novel approach manipulates model selection data to favor the adversary, even without prior knowledge of the system. Utilizing a framework based on Variational Auto Encoders, we provide evidence that an attacker can induce inefficiencies in ML deployment. We test our attack on diverse computer vision and speech recognition benchmark tasks and different settings, obtaining an average attack success rate of 75.42%. In particular, our attack causes an average 88.30% decrease in generalization capabilities, an 83.33% increase in latency, and an increase of up to 105.85% in energy consumption. These results highlight the significant vulnerabilities in model selection processes and their potential impact on real-world applications.

对抗攻击模型选择MLaaS安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。