arXiv:2506.08071cs.CV2025-06ICCV被引 9

提出CuRe基准,评估文生图系统对全球南方文化的代表性不足问题。

CuRe: Cultural Gaps in the Long Tail of Text-to-Image Systems

  • 基于属性信息增量的边际效用,构建文化表征评分机制。
  • 在32个子文化类别中验证,多模型表现差异显著,尤其稳定扩散系列。
  • 适合关注AI文化偏见、公平性与跨文化生成的研究者使用。

主流文生图系统基于网络爬取数据训练,高度偏向欧美文化,忽视全球南方文化。为分析此类偏差,我们提出CuRe——一种新型可扩展的文化表征基准与评分工具,利用属性指定的边际效用作为人类判断的代理指标。CuRe数据集基于众包维基百科知识图谱构建,涵盖6大文化轴(食物、艺术、时尚、建筑、庆典、人物)下的32个子类别,共300种文化物品。该层级分类结构使评分器可通过分析文本条件信息量增加时的生成响应,实现细粒度文化对比。实证显示,该类评分器与人类对感知相似性、图文对齐及文化多样性的判断具有更强相关性,覆盖多种图像编码器(SigLIP 2、AIMV2、DINOv2)、视觉语言模型(OpenCLIP、SigLIP 2、Gemini 2.0 Flash)以及主流文生图系统(Stable Diffusion 1.5、XL、3.5 Large,FLUX.1[dev],Ideogram 2.0,DALL-E 3)。代码与数据已开源,详见 https://aniketrege.github.io/cure/。

原文摘要 · Abstract (English)

Popular text-to-image (T2I) systems are trained on web-scraped data, which is heavily Amero and Euro-centric, underrepresenting the cultures of the Global South. To analyze these biases, we introduce CuRe, a novel and scalable benchmarking and scoring suite for cultural representativeness that leverages the marginal utility of attribute specification to T2I systems as a proxy for human judgments. Our CuRe benchmark dataset has a novel categorical hierarchy built from the crowdsourced Wikimedia knowledge graph, with 300 cultural artifacts across 32 cultural subcategories grouped into six broad cultural axes (food, art, fashion, architecture, celebrations, and people). Our dataset's categorical hierarchy enables CuRe scorers to evaluate T2I systems by analyzing their response to increasing the informativeness of text conditioning, enabling fine-grained cultural comparisons. We empirically observe much stronger correlations of our class of scorers to human judgments of perceptual similarity, image-text alignment, and cultural diversity across image encoders (SigLIP 2, AIMV2 and DINOv2), vision-language models (OpenCLIP, SigLIP 2, Gemini 2.0 Flash) and state-of-the-art text-to-image systems, including three variants of Stable Diffusion (1.5, XL, 3.5 Large), FLUX.1 [dev], Ideogram 2.0, and DALL-E 3. The code and dataset is open-sourced and available at https://aniketrege.github.io/cure/.

文生图文化偏见公平性评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。