arXiv:2409.09569cs.LGcs.CV2024-09被引 4

文本嵌入偏见会传染给图像生成模型,导致结果不公。

Bias Begets Bias: The Impact of Biased Embeddings on Diffusion Models

  • 用内部表征定义公平性,突破传统标签依赖
  • 无偏文本嵌入是生成多样性图像的必要条件
  • 揭示评估指标本身可能放大偏见,适合安全开发参考

随着文本到图像(TTI)系统广泛应用,其社会偏见问题日益受到关注。本文系统研究了扩散模型中嵌入空间这一偏见来源。由于传统基于分类器的公平性定义需要真实标签,而生成模型中缺乏此类信息,我们提出基于模型内部表征的统计群体公平性准则。理论与实证均表明,输入提示的文本嵌入空间无偏,是扩散模型生成表征平衡图像的必要条件,即生成图像在受保护属性上的分布满足多样性要求。进一步研究发现,如CLIP这类存在偏见的多模态嵌入,会导致对表征平衡的TTI模型产生更低的对齐评分,从而奖励不公平行为。最后,我们构建理论框架以分析对齐评估中的偏见,并提出缓解方法。通过聚焦嵌入空间视角,确立了扩散模型开发与评估的新公平性标准。

原文摘要 · Abstract (English)

With the growing adoption of Text-to-Image (TTI) systems, the social biases of these models have come under increased scrutiny. Herein we conduct a systematic investigation of one such source of bias for diffusion models: embedding spaces. First, because traditional classifier-based fairness definitions require true labels not present in generative modeling, we propose statistical group fairness criteria based on a model's internal representation of the world. Using these definitions, we demonstrate theoretically and empirically that an unbiased text embedding space for input prompts is a necessary condition for representationally balanced diffusion models, meaning the distribution of generated images satisfy diversity requirements with respect to protected attributes. Next, we investigate the impact of biased embeddings on evaluating the alignment between generated images and prompts, a process which is commonly used to assess diffusion models. We find that biased multimodal embeddings like CLIP can result in lower alignment scores for representationally balanced TTI models, thus rewarding unfair behavior. Finally, we develop a theoretical framework through which biases in alignment evaluation can be studied and propose bias mitigation methods. By specifically adapting the perspective of embedding spaces, we establish new fairness conditions for diffusion model development and evaluation.

扩散模型公平性嵌入空间偏见检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。