arXiv:2410.22725cs.CVcs.CR2024-10被引 5

用不可迁移的对抗提示验证图像生成模型真假

One Prompt to Verify Your Models: Black-Box Text-to-Image Models Verification via Non-Transferable Adversarial Attacks

  • 设计不可迁移的对抗性提示,让目标模型生成特定图像而其他模型不响应
  • 在多个模型上验证准确率超90%,有效识别第三方平台是否冒用模型
  • 适合关注AI模型安全与真实性验证的研究者和平台开发者

近期涌现了多种文本到图像(T2I)模型(如DALL-E和Stable Diffusion),第三方服务平台据此提供多样化的低成本API服务。然而,这引发新安全问题:这些服务是否真在使用所宣称的模型?为此,本文首次定义了T2I模型验证概念,旨在判断黑盒目标模型是否与给定白盒参考模型一致。提出VerifyPrompt方法,通过设计一种对目标模型具有特异性、无转移性的对抗提示来实现验证。该提示利用非支配排序遗传算法II(NSGA-II)优化提示文本编码的余弦相似度,生成特定验证提示。通过计算生成图像与提示间的CLIP文本相似度得分,可判定目标模型是否与参考模型一致。实验表明,VerifyPrompt在多种T2I模型上均保持超过90%的验证准确率,证明其在实际平台(如Hugging Face)中的有效性。

原文摘要 · Abstract (English)

Recently, various types of Text-to-Image (T2I) models have emerged (such as DALL-E and Stable Diffusion), and showing their advantages in different aspects. Therefore, some third-party service platforms collect different model interfaces and provide cheaper API services and more flexibility in T2I model selections. However, this also raises a new security concern: Are these third-party services truly offering the models they claim? To answer this question, we first define the concept of T2I model verification, which aims to determine whether a black-box target model is identical to a given white-box reference T2I model. After that, we propose VerifyPrompt, which performs T2I model verification through a special designed verify prompt. Intuitionally, the verify prompt is an adversarial prompt for the target model without transferability for other models. It makes the target model generate a specific image while making other models produce entirely different images. Specifically, VerifyPrompt utilizes the Non-dominated Sorting Genetic Algorithm II (NSGA-II) to optimize the cosine similarity of a prompt's text encoding, generating verify prompts. Finally, by computing the CLIP-text similarity scores between the prompts the generated images, VerifyPrompt can determine whether the target model aligns with the reference model. Experimental results demonstrate that VerifyPrompt consistently achieves over 90\% accuracy across various T2I models, confirming its effectiveness in practical model platforms (such as Hugging Face).

模型验证对抗攻击文本生成安全检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。