评测主流文生图模型在职业图像生成中的偏见,引入人类偏好反馈提升公平性。
BAFIS: Dataset + Framework to assess occupational Bias and Human Preference in modern Text-to-image Models

- 构建BAFIS平台,通过人类评分收集职业图像生成中的偏见数据。
- 分析5个模型在21,140张合成图像上表现,发现性别与族裔偏差显著。
- 结果对比德国就业数据,揭示模型输出与社会现实的系统性偏差。
生成式人工智能有望提升生产力并重塑创意内容生产。然而现有研究显示,图像生成模型存在显著偏见。本文研究文生图模型在职业相关图像生成中的固有偏见及语言诱发偏见,结合人类偏好反馈补充现有评估指标。我们对五款主流模型(Midjourney v6.1、Stable Diffusion 3 Medium、DALL-E 3、Playground v2.5、FLUX.1-dev)进行了全面评估,涵盖性别与族裔偏见、图像质量与提示对齐度。为此,我们开发了“公平图像合成对抗评估平台”(BAFIS),用于收集人类对生成图像偏见的反馈,并构建了一个包含21,140张多语言提示生成的合成图像的数据集。进一步将结果与德国联邦就业局官方统计数据对比,揭示模型输出与社会现实之间的系统性偏差。研究发现,现有评估指标与主观用户评分部分相关,强调在模型开发中纳入人类偏好以实现更公平、更具包容性的文生图系统。
原文摘要 · Abstract (English)
Generative artificial intelligence has the potential to improve productivity and transform the production of creative content. However, existing research indicates that image generation models are significantly influenced by biases. This work investigates the inherent biases and language-induced biases present in text-to-image models within the context of occupation-related image generation, complementing established metrics with human preference feedback. We present a comprehensive evaluation of five current text-to-image models: Midjourney v6.1, Stable Diffusion 3 Medium, DALL-E 3, Playground v2.5, and FLUX.1-dev , focusing on gender and ethnicity bias, image quality, and prompt alignment. To facilitate this evaluation, we developed the "Battle-Arena for Fair Image Synthesis" (BAFIS), a platform designed to collect human feedback on bias in generated images. Furthermore, we created a dataset comprising 21,140 synthetic images generated using multilingual prompts, which serves as a basis for our analysis. We further place our results within a broader social context by comparing them to official statistics from the German Federal Employment Agency. Our findings reveal systematic biases in text-to-image models, with established evaluation metrics in partial correlation with subjective user ratings. Thus, our research emphasizes the need for including human preferences to develop fairer and more inclusive text-to-image models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。