arXiv:2503.12536cs.LGcs.CV2025-03被引 7

无需预设敏感属性,通过隐空间学习提升Stable Diffusion的公平性

Debiasing Diffusion Model: Enhancing Fairness through Latent Representation Learning in Stable Diffusion Model

  • 利用指示器学习隐空间表示以实现公平生成
  • 在不依赖预定义属性的情况下显著降低群体偏差
  • 适合关注生成模型公平性的研究者与开发者

图像生成模型,尤其是基于扩散的模型,因其生成高度逼真图像的能力而广受欢迎。然而,这些模型依赖数据训练,会继承训练数据中的偏见,导致不同群体表征失衡,加剧社会不公。传统去偏方法依赖预定义的敏感属性、相关分类器或大型语言模型来引导输出公平性,但存在无法捕捉群体间复杂连续差异的问题。为此,我们提出去偏扩散模型(DDM),在训练过程中利用指示器学习隐空间表示,实现无需预定义敏感属性的均衡表征。该方法不仅在传统场景中有效,还能在无先验属性条件下提升公平性。本文分析了现有去偏技术的局限性,阐述了DDM架构,并通过实验验证其有效性。

原文摘要 · Abstract (English)

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the training datasets, frequently leading to disproportionate group representations that exacerbate societal inequities. Traditionally, efforts to debiase these models have relied on predefined sensitive attributes, classifiers trained on such attributes, or large language models to steer outputs toward fairness. However, these approaches face notable drawbacks: predefined attributes do not adequately capture complex and continuous variations among groups. To address these issues, we introduce the Debiasing Diffusion Model (DDM), which leverages an indicator to learn latent representations during training, promoting fairness through balanced representations without requiring predefined sensitive attributes. This approach not only demonstrates its effectiveness in scenarios previously addressed by conventional techniques but also enhances fairness without relying on predefined sensitive attributes as conditions. In this paper, we discuss the limitations of prior bias mitigation techniques in diffusion-based models, elaborate on the architecture of the DDM, and validate the effectiveness of our approach through experiments.

扩散模型公平性去偏隐空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。