发现AI生成艺术时会无意识复现训练数据中的风格,称为‘无声之笔’。
The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation

- 提出新评估框架Art Arena,检测模型是否在无提示时复现艺术风格
- 多模型测试显示不同作品风格编码强度不一,导致非对称风格混合
- 适合关注版权与艺术风格泄露的研究者和创作者
生成式文生图模型通常在大规模网络抓取数据集上训练,其中包含受版权保护且风格独特的艺术作品,引发所有权、署名及受保护视觉表达的意外再利用问题。一个关键问题是,模型能从数据中学习风格特征,并在生成结果中重现这些特征,而无需在提示中明确提及。我们称此现象为“无声之笔”,即这些被学习的风格即使未被要求也会在输出中出现。现有评估方法主要关注近似重复检索或成员推理,未能涵盖这种跨提示的无意风格再现。为此,我们首先制定了评估“无声之笔”的指导原则,进而提出Art Arena评估协议,用于测量艺术品被编码的强度、相互作用关系,以及其风格特征在未明确提及提示时重新出现的频率。我们在Stable Diffusion v1.5、Stable Diffusion XL(SDXL)和SANA-1.5等主流文生图扩散模型上评估了该协议,并设计其可泛化至多种文生图生成系统。结果表明,“无声之笔”源于艺术品之间表征强度和交互动态的差异,导致模型生成中出现非对称融合。代码与评估资源已公开于:https://anonymous.4open.science/r/ArtArena-EBE4。
原文摘要 · Abstract (English)
Generative text-to-image models are typically trained on large-scale web-scraped datasets that include diverse visual content such as copyrighted and stylistically distinctive artworks, raising concerns about ownership, attribution, and the unintended reuse of protected visual expressions. A key issue is that models can learn stylistic patterns from this data and reproduce them in generated outputs without any explicit reference in the prompt. We refer to this phenomenon as The Silent Brush, where such learned styles reappear even when they are not requested. Existing evaluation methods mainly focus on near-duplicate retrieval or membership inference and do not account for this form of unintended stylistic resurfacing across prompts. To address these gaps, we first formulate guiding principles for evaluation of The Silent Brush. We then introduce Art Arena, an evaluation protocol that measures how strongly artworks are encoded, how they interact, and how frequently their stylistic traits reappear in generated outputs without explicit mention in prompts. We evaluate Art Arena on widely used text-to-image diffusion models, including Stable Diffusion v1.5, Stable Diffusion XL (SDXL), and SANA-1.5, and design it to generalize across text-to-image generative systems. Our results show that The Silent Brush arises from differences in representational strength and interaction dynamics between artworks, leading to asymmetric blending in model generations. Code and evaluation resources are available at: https://anonymous.4open.science/r/ArtArena-EBE4.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。