提出可溯源AI艺术的检测工具,准确率达99.9%
ArtBrain: An Explainable end-to-end Toolkit for Classification and Attribution of AI-Generated Art and Style
- 基于ConvNeXt改进的AttentionConvNeXt模型,区分艺术风格与生成源
- 在18.5万张图像上实现99.9%的生成模型溯源准确率
- 配套网页工具ArtBrain,支持科研与公众使用
近期人工智能生成艺术的质量显著提升,导致识别合成艺术品愈发困难。然而,关于合成艺术品真实性和来源识别的研究仍有限。本文构建了包含185,015幅艺术图像的AI-ArtBench数据集,涵盖10种艺术风格,其中125,015幅为AI生成,60,000幅为人创作。提出基于ConvNeXt改进的AttentionConvNeXt模型,用于准确检测AI生成图像并追溯其来源模型,在艺术风格与生成源分类任务中取得0.869的F1分数。模型对生成模型的溯源准确率达0.999。为整合研究成果,开发了名为ArtBrain的Web应用,面向技术与非技术用户交互使用。此外,通过50人参与的艺术图灵测试发现,人类识别准确率为约58%,而模型识别准确率高达约99%。
原文摘要 · Abstract (English)
Recently, the quality of artworks generated using Artificial Intelligence (AI) has increased significantly, resulting in growing difficulties in detecting synthetic artworks. However, limited studies have been conducted on identifying the authenticity of synthetic artworks and their source. This paper introduces AI-ArtBench, a dataset featuring 185,015 artistic images across 10 art styles. It includes 125,015 AI-generated images and 60,000 pieces of human-created artwork. This paper also outlines a method to accurately detect AI-generated images and trace them to their source model. This work proposes a novel Convolutional Neural Network model based on the ConvNeXt model called AttentionConvNeXt. AttentionConvNeXt was implemented and trained to differentiate between the source of the artwork and its style with an F1-Score of 0.869. The accuracy of attribution to the generative model reaches 0.999. To combine the scientific contributions arising from this study, a web-based application named ArtBrain was developed to enable both technical and non-technical users to interact with the model. Finally, this study presents the results of an Artistic Turing Test conducted with 50 participants. The findings reveal that humans could identify AI-generated images with an accuracy of approximately 58%, while the model itself achieved a significantly higher accuracy of around 99%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。