评测主流文生图模型的公平性,发现其存在显著偏见。
INFELM: In-depth Fairness Evaluation of Large Text-To-Image Models
- 用面部结构与皮肤像素优化肤色分类,准确率提升16.04%以上。
- 在六个敏感社会领域测试发现,现有模型普遍不满足公平性标准。
- 提出可推广的表示偏见评估方法,适合关注伦理AI的研究者。
大型语言模型(LLMs)和大型视觉模型(LVMs)的快速发展推动了多模态AI系统的演进,展现出模拟人类认知的工业应用潜力。然而,它们也带来显著的伦理挑战,如放大有害内容和强化社会偏见。例如,部分工业级图像生成模型中的偏见凸显了建立稳健公平性评估的紧迫性。现有评估框架虽注重全面性,但在内容生成对齐和敏感社会领域方面关注不足,且依赖像素检测技术易出错。本文提出INFELM,对广泛使用的文生图模型进行深入公平性评估。主要贡献包括:(1) 引入融合面部拓扑与精细化皮肤像素表示的先进肤色分类器,分类精度提升至少16.04%;(2) 设计社会敏感内容对齐度量以理解模型的社会影响;(3) 构建适用于多元群体的通用表示偏见评估方法;(4) 在六个社会偏见敏感领域开展大规模实验分析。结果表明,现有模型普遍未达到经验公平性标准,表示偏见通常强于对齐误差。INFELM为公平性评估建立了可靠基准,助力发展符合伦理与以人为本原则的多模态AI系统。
原文摘要 · Abstract (English)
The rapid development of large language models (LLMs) and large vision models (LVMs) have propelled the evolution of multi-modal AI systems, which have demonstrated the remarkable potential for industrial applications by emulating human-like cognition. However, they also pose significant ethical challenges, including amplifying harmful content and reinforcing societal biases. For instance, biases in some industrial image generation models highlighted the urgent need for robust fairness assessments. Most existing evaluation frameworks focus on the comprehensiveness of various aspects of the models, but they exhibit critical limitations, including insufficient attention to content generation alignment and social bias-sensitive domains. More importantly, their reliance on pixel-detection techniques is prone to inaccuracies. To address these issues, this paper presents INFELM, an in-depth fairness evaluation on widely-used text-to-image models. Our key contributions are: (1) an advanced skintone classifier incorporating facial topology and refined skin pixel representation to enhance classification precision by at least 16.04%, (2) a bias-sensitive content alignment measurement for understanding societal impacts, (3) a generalizable representation bias evaluation for diverse demographic groups, and (4) extensive experiments analyzing large-scale text-to-image model outputs across six social-bias-sensitive domains. We find that existing models in the study generally do not meet the empirical fairness criteria, and representation bias is generally more pronounced than alignment errors. INFELM establishes a robust benchmark for fairness assessment, supporting the development of multi-modal AI systems that align with ethical and human-centric principles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。