对比四款文生图模型性别偏见,发现新模型更均衡,老模型偏向男性。
Evaluating and comparing gender bias across four text-to-image models
- 用统一测试集比较四款模型生成图像的性别分布。
- Stable Diffusion模型明显偏向男性,DALL-E却偏向女性。
- 新模型Emu表现更平衡,适合关注AI公平性的研究者参考。
随着人工智能在医疗、金融、电商和娱乐等领域的广泛应用,其伦理问题愈发重要,尤其是信息的包容性与公平性。本文评估并比较了四款文生图模型(Stable Diffusion XL、Stable Diffusion Cascade、DALL-E 和 Emu)的性别偏见程度。假设较早发布的DALL-E和Stable Diffusion模型存在明显的男性偏见,而较新的Meta AI模型Emu则更具平衡性。结果显示,Stable Diffusion系列确实表现出显著的男性偏见,而Emu则呈现更均衡的结果。有趣的是,OpenAI的DALL-E在多数测试中女性出现比例显著高于男性,即呈现出反向的女性偏见。这可能源于OpenAI在后台对提示词进行了修改。此外,Emu在通过WhatsApp生成图像时会利用用户信息。本文还提出应对策略,包括提升研究团队多样性及构建多样化数据集。
原文摘要 · Abstract (English)
As we increasingly use Artificial Intelligence (AI) in decision-making for industries like healthcare, finance, e-commerce, and even entertainment, it is crucial to also reflect on the ethical aspects of AI, for example the inclusivity and fairness of the information it provides. In this work, we aimed to evaluate different text-to-image AI models and compare the degree of gender bias they present. The evaluated models were Stable Diffusion XL (SDXL), Stable Diffusion Cascade (SC), DALL-E and Emu. We hypothesized that DALL-E and Stable Diffusion, which are comparatively older models, would exhibit a noticeable degree of gender bias towards men, while Emu, which was recently released by Meta AI, would have more balanced results. As hypothesized, we found that both Stable Diffusion models exhibit a noticeable degree of gender bias while Emu demonstrated more balanced results (i.e. less gender bias). However, interestingly, Open AI's DALL-E exhibited almost opposite results, such that the ratio of women to men was significantly higher in most cases tested. Here, although we still observed a bias, the bias favored females over males. This bias may be explained by the fact that OpenAI changed the prompts at its backend, as observed during our experiment. We also observed that Emu from Meta AI utilized user information while generating images via WhatsApp. We also proposed some potential solutions to avoid such biases, including ensuring diversity across AI research teams and having diverse datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。