arXiv:2503.23226cs.CVcs.AI2025-03被引 2

用印度艺术家拉吉·罗伊风格数据集,研究扩散模型生成艺术与深度伪造检测。

Synthetic Art Generation and DeepFake Detection A Study on Jamini Roy Inspired Dataset

  • 基于稳定扩散3微调,结合ControlNet和IPAdapter生成风格化图像。
  • 发现高质量文化特定伪造作品难以通过现有方法检测。
  • 为艺术领域深度伪造检测提供新数据与评估框架,适合视觉识别研究者。

生成式AI与艺术的交汇带来机遇与挑战,尤其在识别合成艺术品方面。本研究聚焦印度艺术家拉吉·罗伊的独特风格,采用扩散模型如稳定扩散3,并结合ControlNet和IPAdapter技术生成高保真图像,构建包含真实与人工智能生成作品的新数据集。通过傅里叶域分析和自相关度量等定性和定量方法,揭示合成图像与原作之间的细微差异。研究表明,当前深度伪造检测方法在面对高质量、文化特定的伪造内容时面临严峻挑战,凸显现有技术在跨文化语境下的局限性。该工作不仅揭示了生成模型复杂性的提升,更为未来合成艺术的有效检测奠定了重要基础。

原文摘要 · Abstract (English)

The intersection of generative AI and art is a fascinating area that brings both exciting opportunities and significant challenges, especially when it comes to identifying synthetic artworks. This study takes a unique approach by examining diffusion-based generative models in the context of Indian art, specifically focusing on the distinctive style of Jamini Roy. To explore this, we fine-tuned Stable Diffusion 3 and used techniques like ControlNet and IPAdapter to generate realistic images. This allowed us to create a new dataset that includes both real and AI-generated artworks, which is essential for a detailed analysis of what these models can produce. We employed various qualitative and quantitative methods, such as Fourier domain assessments and autocorrelation metrics, to uncover subtle differences between synthetic images and authentic pieces. A key takeaway from recent research is that existing methods for detecting deepfakes face considerable challenges, especially when the deepfakes are of high quality and tailored to specific cultural contexts. This highlights a critical gap in current detection technologies, particularly in light of the challenges identified above, where high-quality and culturally specific deepfakes are difficult to detect. This work not only sheds light on the increasing complexity of generative models but also sets a crucial foundation for future research aimed at effective detection of synthetic art.

艺术生成深度伪造检测扩散模型文化特异性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。