情绪提示让生成人脸更年轻、更白,且女性黑人青年几乎消失。
Happy Young Women, Grumpy Old Men? Emotion-Driven Demographic Biases in Synthetic Face Generation
- 用情绪词生成人脸,会加剧年龄、种族、性别偏见。
- 负面情绪导致白人中年男性脸占比飙升,吸引力下降。
- 单一属性审计漏掉交叉群体(如年轻黑人女性)的极端缺失。
文本到图像(T2I)模型生成的合成人脸广泛存在于数字媒体中,但其在情绪提示下的种族与感知吸引力偏差尚不明确。我们系统评估了八种模型(4种西方、4种中国)在七种提示条件(中性基准与六种情绪)下生成的56,000张人脸,使用信息论分歧度量量化性别、种族、年龄和感知吸引力的偏差。所有模型均显著过代表现年轻面孔,多数也过度表现白人特征。交叉分析显示,如“年轻×女性×黑人”等组合被严重低估甚至消失,单属性审计无法捕捉。负面情绪(如悲伤、恐惧)持续引导输出为白人、中年、男性化面孔,形成情绪价值驱动的映射,同时降低生成人脸的感知吸引力。结果表明,情绪条件会显著放大偏见,亟需在部署前开展跨文化、情绪敏感、交叉维度的多语言审计。
原文摘要 · Abstract (English)
Synthetic faces from text-to-image (T2I) models pervade digital media, yet their demographic biases under emotionally conditioned prompts remain poorly understood. We aim to systematically audit how emotionally conditioned prompts affect demographic and perceived-attractiveness biases in synthetic faces generated by T2I models, with particular attention to intersectional patterns and cross-ecosystem differences across model families. We audited eight (4 Western and 4 Chinese) T2I models and generated 56,000 faces under seven prompt conditions: a neutral baseline and six emotion conditions. We quantified biases in gender, race, age, and perceived attractiveness using information-theoretic divergence metrics. We further conducted intersectional analyses across combined demographic attributes and compared patterns between the Western and Chinese model groups to assess cross-ecosystem consistency and divergence in bias behavior. All models show strong overrepresentation of young faces, and most also overrepresent White-coded individuals. Intersectional analysis reveals compound underrepresentation or near-erasure of specific demographic combinations, such as young x female x Black faces, which are largely absent across models and are not captured by single-attribute audits. Emotion prompts act as additional demographic selectors: negatively valenced emotions (including sadness and fear) consistently shift outputs toward White, middle-aged, male-coded faces. This produces a valence-driven mapping that is also associated with lower perceived attractiveness in generated faces. These findings indicate that demographic bias in T2I face generation is both pervasive and shaped by emotional conditioning. They underscore the need for intersectional, emotion-conditioned, and multilingual demographic audits as part of standard pre-deployment evaluation practices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。