arXiv:2506.11434cs.CV2025-06被引 2

提出黑箱框架FSCA,可无须内部信息审计文生图模型数据来源。

Auditing Data Provenance in Real-world Text-to-Image Diffusion Models for Privacy and Copyright Protection

  • 基于文本图像语义一致性设计黑箱审计方法,无需访问模型内部。
  • 在10样本/用户条件下实现90%用户级准确率,优于现有方法。
  • 适用于版权与隐私保护场景,适合实际部署的审计需求。

文生图扩散模型虽具备强大生成能力,但其训练依赖大规模网络文本图像数据,带来版权合规与个人隐私泄露风险。现有审计方法多依赖模型内部知识(如中间结果),难以在真实场景应用。为此,本文提出完全黑箱的特征语义一致性审计框架FSCA,利用模型内两种语义关联进行审计,无需访问内部信息。在LAION-mi与COCO数据集上对八种先进基线方法进行对比实验,结果表明FSCA在多种指标和数据分布下均表现更优。进一步引入召回率平衡与阈值调整策略,在仅10样本/用户条件下实现高达90%的用户级准确率,验证了其在真实场景中的强审计能力。代码已开源。

原文摘要 · Abstract (English)

Text-to-image diffusion model since its propose has significantly influenced the content creation due to its impressive generation capability. However, this capability depends on large-scale text-image datasets gathered from web platforms like social media, posing substantial challenges in copyright compliance and personal privacy leakage. Though there are some efforts devoted to explore approaches for auditing data provenance in text-to-image diffusion models, existing work has unrealistic assumptions that can obtain model internal knowledge, e.g., intermediate results, or the evaluation is not reliable. To fill this gap, we propose a completely black-box auditing framework called Feature Semantic Consistency-based Auditing (FSCA). It utilizes two types of semantic connections within the text-to-image diffusion model for auditing, eliminating the need for access to internal knowledge. To demonstrate the effectiveness of our FSCA framework, we perform extensive experiments on LAION-mi dataset and COCO dataset, and compare with eight state-of-the-art baseline approaches. The results show that FSCA surpasses previous baseline approaches across various metrics and different data distributions, showcasing the superiority of our FSCA. Moreover, we introduce a recall balance strategy and a threshold adjustment strategy, which collectively allows FSCA to reach up a user-level accuracy of 90% in a real-world auditing scenario with only 10 samples/user, highlighting its strong auditing potential in real-world applications. Our code is made available at https://github.com/JiePKU/FSCA.

文生图数据溯源版权保护黑箱审计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。