arXiv:2503.01872cs.LGcs.AI2025-03EMNLP被引 9

让扩散模型生成更公平,能自动调节性别等敏感属性分布。

FairGen: Controlling Sensitive Attributes for Fair Generations in Diffusion Models via Adaptive Latent Guidance

  • 用动态潜空间引导机制调控生成过程,实现精准属性控制。
  • 在稳定扩散2上减少68.5%的性别偏见,显著优于现有方法。
  • 支持用户自定义粒度控制,适合需要公平生成的应用场景。

文本到图像的扩散模型常对特定人口群体表现出偏见,例如在生成工程师图像时更多产出男性,引发伦理问题并限制其应用。本文提出FairGen,一种自适应潜空间引导机制,在推理阶段调控生成分布,以缓解对任一目标属性值(如“男性”)的生成偏见,同时保持生成质量。FairGen通过潜空间引导模块动态调整扩散过程,使生成结果符合目标公平分布;记忆模块则追踪生成统计,指导引导策略实现精准对齐。此外,针对现有数据集局限,我们引入全貌偏见评估基准HBE,覆盖多样领域并包含复杂提示,更全面评估偏见。在HBE与Stable Bias数据集上的大量实验表明,FairGen优于现有偏见缓解方法,在Stable Diffusion 2上实现68.5%的性别偏见降低。消融实验证明其可灵活控制输出分布至任意用户指定粒度,实现自适应、靶向性的偏见缓解。

原文摘要 · Abstract (English)

Text-to-image diffusion models often exhibit biases toward specific demographic groups, such as generating more males than females when prompted to generate images of engineers, raising ethical concerns and limiting their adoption. In this paper, we tackle the challenge of mitigating generation bias towards any target attribute value (e.g., "male" for "gender") in diffusion models while preserving generation quality. We propose FairGen, an adaptive latent guidance mechanism which controls the generation distribution during inference. In FairGen, a latent guidance module dynamically adjusts the diffusion process to enforce specific attributes, while a memory module tracks the generation statistics and steers latent guidance to align with the targeted fair distribution of the attribute values. Furthermore, we address the limitations of existing datasets by introducing the Holistic Bias Evaluation (HBE) benchmark, which covers diverse domains and incorporates complex prompts to assess bias more comprehensively. Extensive evaluations on HBE and Stable Bias datasets demonstrate that FairGen outperforms existing bias mitigation approaches, achieving substantial bias reduction (e.g., 68.5% gender bias reduction on Stable Diffusion 2). Ablation studies highlight FairGen's ability to flexibly control the output distribution at any user-specified granularity, ensuring adaptive and targeted bias mitigation.

扩散模型公平生成偏见缓解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。