arXiv:2502.14285cs.CL2025-02ACL被引 6

攻击者可用少量图像盗取文本到图像模型的提示模板,威胁知识产权。

Vulnerability of Text-to-Image Models to Prompt Template Stealing: A Differential Evolution Approach

  • 用差分进化算法无须微调模型,自动演化生成高相似度提示模板。
  • 在开源与闭源模型上均实现超10%性能提升,能泛化到不同主题图像。
  • 仅需少量样本即可成功偷取,计算成本极低,适合安全评估与防御研究。

提示交易已成为近年来重要的知识产权问题,供应商通过展示样图吸引用户,再出售可生成类似图像的提示模板。本文揭示了一项关键安全漏洞:攻击者仅需少量样本图像即可盗取提示模板。为此,我们构建了Prism基准测试集,包含50个模板和450张图像,分为易、难两档难度。提出EvoStealer方法,无需模型微调,利用差分进化算法实现模板窃取。系统首先基于预设模式,由多模态大语言模型(MLLMs)初始化种群,再通过迭代生成优化后代;进化过程中,提取后代共性特征以生成通用模板。在开源模型INTERNVL2-26B及闭源模型GPT-4o、GPT-4o-mini上的全面评估表明,EvoStealer生成的模板能高度复现原图,且对新主体具有强泛化能力,平均性能优于基线方法超10%。成本分析显示其计算开销几乎可忽略。代码与数据集已公开于https://github.com/whitepagewu/evostealer。

原文摘要 · Abstract (English)

Prompt trading has emerged as a significant intellectual property concern in recent years, where vendors entice users by showcasing sample images before selling prompt templates that can generate similar images. This work investigates a critical security vulnerability: attackers can steal prompt templates using only a limited number of sample images. To investigate this threat, we introduce Prism, a prompt-stealing benchmark consisting of 50 templates and 450 images, organized into Easy and Hard difficulty levels. To identify the vulnerabity of VLMs to prompt stealing, we propose EvoStealer, a novel template stealing method that operates without model fine-tuning by leveraging differential evolution algorithms. The system first initializes population sets using multimodal large language models (MLLMs) based on predefined patterns, then iteratively generates enhanced offspring through MLLMs. During evolution, EvoStealer identifies common features across offspring to derive generalized templates. Our comprehensive evaluation conducted across open-source (INTERNVL2-26B) and closed-source models (GPT-4o and GPT-4o-mini) demonstrates that EvoStealer's stolen templates can reproduce images highly similar to originals and effectively generalize to other subjects, significantly outperforming baseline methods with an average improvement of over 10%. Moreover, our cost analysis reveals that EvoStealer achieves template stealing with negligible computational expenses. Our code and dataset are available at https://github.com/whitepagewu/evostealer.

提示窃取差分进化安全漏洞图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。