用向量相似性+区块链识别AI生成图像,防伪保真。
Provenance of AI-Generated Images: A Vector Similarity and Blockchain-based Approach
- 通过图像嵌入向量对比,区分AI与真人生成图片
- 即使经过中等程度修改,图像向量仍能保持相似匹配
- 适合数字版权、媒体审核等需要内容溯源的场景
生成式AI和大语言模型(如ChatGPT集成DALL-E、Stable Diffusion)可生成高度逼真且语境相关的数字内容,使AI生成图像与真人创作内容难以区分,威胁数字内容真实性。本文提出一种基于嵌入的AI图像检测框架,利用图像嵌入与向量相似性判断图像来源。核心假设是:AI生成图像在嵌入空间中彼此更接近,而真人创作图像在同一领域内聚类。我们使用五个基准嵌入模型处理包含AI与人类生成图像的多样化数据集,实验证明该方法具有鲁棒性,在中等至高等扰动下,扰动图像仍与原始版本保持高向量相似度。该方案提供了一个兼顾准确率与计算效率的通用化检测框架。
原文摘要 · Abstract (English)
Rapid advancement in generative AI and large language models (LLMs) has enabled the generation of highly realistic and contextually relevant digital content. LLMs such as ChatGPT with DALL-E integration and Stable Diffusion techniques can produce images that are often indistinguishable from those created by humans, which poses challenges for digital content authentication. Verifying the integrity and origin of digital data to ensure it remains unaltered and genuine is crucial to maintaining trust and legality in digital media. In this paper, we propose an embedding-based AI image detection framework that utilizes image embeddings and a vector similarity to distinguish AI-generated images from real (human-created) ones. Our methodology is built on the hypothesis that AI-generated images demonstrate closer embedding proximity to other AI-generated content, while human-created images cluster similarly within their domain. To validate this hypothesis, we developed a system that processes a diverse dataset of AI and human-generated images through five benchmark embedding models. Extensive experimentation demonstrates the robustness of our approach, and our results confirm that moderate to high perturbations minimally impact the embedding signatures, with perturbed images maintaining close similarity matches to their original versions. Our solution provides a generalizable framework for AI-generated image detection that balances accuracy with computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。