提出新工具分析文本生成图像模型中的交叉偏见,实现更公平的去偏。
Mitigate One, Skew Another? Tackling Intersectional Biases in Text-to-Image Models
- 通过反事实干预量化不同偏见维度间的相互影响。
- 新算法InterMit降低偏见分数至0.33,减少约25%的迭代步骤。
- 无需训练,可适配现有去偏方法,适合关注公平性的研究者。
文本到图像(TTI)模型的偏见常被视作独立存在,但实际上可能深度关联。解决某一维度(如种族或年龄)的偏见,可能意外影响另一维度(如性别),加剧或缓解其不平等。理解这些关联对设计更公平的生成模型至关重要,但量化其影响仍具挑战。为此,我们提出BiasConnect,一种用于分析和量化TTI模型中偏见交互的新工具。该工具通过沿不同偏见轴进行反事实干预,揭示其内在结构,并估计消除一个偏见轴对另一轴的影响。实验显示,该估计与实际后去偏结果高度相关(相关系数+0.65)。基于BiasConnect,我们进一步提出InterMit,一种由用户定义目标分布和优先级权重指导的交叉偏见缓解算法。InterMit在平均2.38步内达成0.33的偏见分数,显著优于传统方法(0.52,平均3.15步),且生成图像质量更优。尽管本实现为免训练设计,但具备模块化特性,可集成至多种现有去偏技术,具有高灵活性和扩展性。
原文摘要 · Abstract (English)
The biases exhibited by text-to-image (TTI) models are often treated as independent, though in reality, they may be deeply interrelated. Addressing bias along one dimension - such as ethnicity or age - can inadvertently affect another, like gender, either mitigating or exacerbating existing disparities. Understanding these interdependencies is crucial for designing fairer generative models, yet measuring such effects quantitatively remains a challenge. To address this, we introduce BiasConnect, a novel tool for analyzing and quantifying bias interactions in TTI models. BiasConnect uses counterfactual interventions along different bias axes to reveal the underlying structure of these interactions and estimates the effect of mitigating one bias axis on another. These estimates show strong correlation (+0.65) with observed post-mitigation outcomes. Building on BiasConnect, we propose InterMit, an intersectional bias mitigation algorithm guided by user-defined target distributions and priority weights. InterMit achieves lower bias (0.33 vs. 0.52) with fewer mitigation steps (2.38 vs. 3.15 average steps), and yields superior image quality compared to traditional techniques. Although our implementation is training-free, InterMit is modular and can be integrated with many existing debiasing approaches for TTI models, making it a flexible and extensible solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。