用大模型自动判别图文生成是否侵权,还能修复提示词避免侵权
CopyJudge: Automated Copyright Infringement Identification and Mitigation in Text-to-Image Diffusion Models
- 通过多模型辩论模拟法院的实质性相似判断流程
- 识别侵权准确率达顶尖水平,且能解释判断依据
- 可自动优化提示词或调整噪声,适合内容安全与合规团队
判断AI生成图像是否与源作品构成实质性相似,是解决版权争议的关键步骤。本文提出CopyJudge,一种基于大视觉语言模型(LVLMs)的自动化侵权识别框架,模拟司法实践中对实质性相似性的判定过程。具体而言,采用抽象-过滤-对比测试框架,结合多LVLM辩论机制评估侵权可能性,并提供详细的判断理由。基于此判断结果,进一步提出一种通用的LVLM-based缓解策略,可自动优化具有侵权风险的提示词,在避免敏感表达的同时保留非侵权内容。此外,若输入噪声可控,该方法还可通过在扩散潜在空间中迭代探索非侵权噪声向量,无需修改原始提示词即可实现规避。实验表明,该自动化识别方法性能媲美现有最先进水平,且在各类侵权情形下具备更优泛化性与可解释性;所提缓解方法能更有效降低记忆与知识产权侵权风险,同时高度保持原始非侵权语义。
原文摘要 · Abstract (English)
Assessing whether AI-generated images are substantially similar to source works is a crucial step in resolving copyright disputes. In this paper, we propose CopyJudge, a novel automated infringement identification framework that leverages large vision-language models (LVLMs) to simulate practical court processes for determining substantial similarity between copyrighted images and those generated by text-to-image diffusion models. Specifically, we employ an abstraction-filtration-comparison test framework based on the multi-LVLM debate to assess the likelihood of infringement and provide detailed judgment rationales. Based on these judgments, we further introduce a general LVLM-based mitigation strategy that automatically optimizes infringing prompts by avoiding sensitive expressions while preserving the non-infringing content. Furthermore, assuming the input noise is controllable, our approach can be enhanced by iteratively exploring non-infringing noise vectors within the diffusion latent space, even without modifying the original prompts. Experimental results show that our automated identification method achieves comparable state-of-the-art performance, while offering superior generalization and interpretability across various forms of infringement, and that our mitigation method more effectively mitigates memorization and IP infringement with a high degree of alignment to the original non-infringing expressions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。