arXiv:2511.05177cs.LG2025-11

无需控制训练过程,即可隐蔽篡改生成模型的特征关联。

Associative Poisoning to Generative Machine Learning

  • 通过扰动训练数据,操纵生成结果中的特定特征关联。
  • 可精准诱导或抑制特征关系,且输出质量与分布不变。
  • 适合研究生成模型安全、对抗攻击与防御的学者参考。

生成模型如Stable Diffusion和ChatGPT的广泛应用使其成为恶意攻击的目标,尤其面临数据投毒威胁。现有攻击通常导致生成数据整体退化或需控制训练过程,难以在真实场景中实施。本文提出一种新型数据投毒技术——关联投毒(associative poisoning),可在不控制训练过程的前提下,仅扰动训练数据,即可操控生成输出中特定特征对之间的统计关联。我们给出该攻击的数学形式化描述,并证明其理论可行性与隐蔽性。在两个前沿生成模型上的实证评估表明,该方法能有效诱导或抑制特征关联,同时保持目标特征的边缘分布和输出质量,从而规避视觉检测。结果表明,图像合成、合成数据生成及自然语言处理等生成系统易受细微但隐蔽的统计完整性破坏。针对此风险,我们分析了现有防御策略的局限性,并提出一种新型反制方案。

原文摘要 · Abstract (English)

The widespread adoption of generative models such as Stable Diffusion and ChatGPT has made them increasingly attractive targets for malicious exploitation, particularly through data poisoning. Existing poisoning attacks compromising synthesised data typically either cause broad degradation of generated data or require control over the training process, limiting their applicability in real-world scenarios. In this paper, we introduce a novel data poisoning technique called associative poisoning, which compromises fine-grained features of the generated data without requiring control of the training process. This attack perturbs only the training data to manipulate statistical associations between specific feature pairs in the generated outputs. We provide a formal mathematical formulation of the attack and prove its theoretical feasibility and stealthiness. Empirical evaluations using two state-of-the-art generative models demonstrate that associative poisoning effectively induces or suppresses feature associations while preserving the marginal distributions of the targeted features and maintaining high-quality outputs, thereby evading visual detection. These results suggest that generative systems used in image synthesis, synthetic dataset generation, and natural language processing are susceptible to subtle, stealthy manipulations that compromise their statistical integrity. To address this risk, we examine the limitations of existing defensive strategies and propose a novel countermeasure strategy.

生成模型数据投毒安全关联攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。