发现生成图像常引发恐惧感,与输入提示无关。
Generating Fearful Images: Investigating Potential Emotional Biases in Image-Generation Models
- 用跨模态情绪识别法比对提示词与生成图像的情绪
- 稳定扩散模型生成图中恐惧情绪显著高于其他五种
- 主流大模型均存在类似偏差,可能源于训练数据
本文研究生成式AI模型在图像生成中可能存在的情绪偏差,重点考察其是否倾向于引发负面情绪。通过开发并验证跨模态情绪识别方法,比较文本提示与生成图像所唤起的情绪,发现基于Stable Diffusion的模型生成的图像普遍存在恐惧情绪的过度表征,无论原始提示如何,该情绪显著高于其他五种情绪。将分析扩展至ChatGPT、Gemini等企业级模型后,仍得相似结论,表明此为系统性偏差而非单一模型问题。尽管模态间情绪对齐存在局限,但观察到的情绪偏向与训练数据中恐惧内容的过量存在一致,该偏差可能加剧数字空间中的负面情感传播,形成恶性循环。
原文摘要 · Abstract (English)
This paper examines potential biases and inconsistencies in the emotions evoked by images produced by generative artificial intelligence (AI) models and their potential bias toward negative emotions. We assess this bias by comparing the emotions evoked by an AI-produced image to the emotions evoked by prompts used to create those images. After developing and validating automated methods for emotion recognition across modalities, we examine correlations in the prevalence of emotions across text and images and measure the degree to which generative AI models tend to over-represent specific emotions in the resulting images. Findings indicate that AI-generated images from Stable Diffusion models are biased towards producing images that evoke fear, regardless of the original prompt, as metrics show a significant over-representation of that emotion compared to five other emotions. We extend this analysis to a more recent enterprise-level models, such as ChatGPT and Gemini, and find similar results, suggesting a systemic bias rather than one present only in a single model. While certain limitations in the alignment of emotions across modalities limit this work, the emotional skew we find in generative models is consistent with an over-representation of fearful content in training data, and this bias could amplify negative affective content in digital spaces further, perpetuating its prevalence and impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。