检测并降低AI图像生成中的社会刻板印象,提升多样性与公平性。
Can we Debias Social Stereotypes in AI-Generated Images? Examining Text-to-Image Outputs and User Perceptions
- 提出社会刻板印象指数SSI,系统评估文本生成图像的偏见。
- 通过提示优化使三类刻板印象减少51%至69%,显著降维。
- 发现用户偏好刻板图像,警示去偏需平衡真实感与包容性。
生成式AI通过文本到图像(T2I)技术实现了视觉内容创作,但常复制和放大性别、种族与文化等社会刻板印象,引发伦理担忧。本文提出基于理论的偏见检测框架与社会刻板印象指数(SSI),对DALL-E-3、Midjourney-6.1和Stability AI Core三个主流T2I模型进行评估,使用100个查询覆盖地理文化、职业与形容词三类主题。分析显示初始输出普遍包含性别化职业、文化符号及西方审美标准等刻板视觉线索。通过大语言模型(LLM)进行针对性提示优化,使地理文化类刻板印象下降61%,职业类下降69%,形容词类下降51%。结合用户研究发现:尽管提示优化可有效减轻偏见,但可能削弱上下文一致性;有趣的是,用户往往认为带有刻板印象的图像更符合预期。研究呼吁在去偏与现实复杂性之间取得平衡,推动支持全球多样性的T2I系统发展。
原文摘要 · Abstract (English)
Recent advances in generative AI have enabled visual content creation through text-to-image (T2I) generation. However, despite their creative potential, T2I models often replicate and amplify societal stereotypes -- particularly those related to gender, race, and culture -- raising important ethical concerns. This paper proposes a theory-driven bias detection rubric and a Social Stereotype Index (SSI) to systematically evaluate social biases in T2I outputs. We audited three major T2I model outputs -- DALL-E-3, Midjourney-6.1, and Stability AI Core -- using 100 queries across three categories -- geocultural, occupational, and adjectival. Our analysis reveals that initial outputs are prone to include stereotypical visual cues, including gendered professions, cultural markers, and western beauty norms. To address this, we adopted our rubric to conduct targeted prompt refinement using LLMs, which significantly reduced bias -- SSI dropped by 61% for geocultural, 69% for occupational, and 51% for adjectival queries. We complemented our quantitative analysis through a user study examining perceptions, awareness, and preferences around AI-generated biased imagery. Our findings reveal a key tension -- although prompt refinement can mitigate stereotypes, it can limit contextual alignment. Interestingly, users often perceived stereotypical images to be more aligned with their expectations. We discuss the need to balance ethical debiasing with contextual relevance and call for T2I systems that support global diversity and inclusivity while not compromising the reflection of real-world social complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。