arXiv:2605.19190cs.CYcs.AI2026-05

在非洲和南亚开展本地化测试,发现主流图像生成模型存在文化盲区。

Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South

论文配图:Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South
图 1 · 摘自论文原文
  • 联合多地高校,在非西方城市开展社区参与式安全测试
  • 构建包含26000+案例的PLACES数据集,揭示本地文化漏洞
  • 适合关注AI公平性与跨文化安全的研究者参考

尽管文本到图像(T2I)模型已在全球部署,其安全框架仍以西方为中心,对全球南方地区造成显著风险。本文在加纳、尼日利亚及印度卡纳塔克邦和旁遮普邦的次级城市开展本地化社区参与式红队测试,提出兼顾地域性和参与性的双轨方法。通过组织社区研讨与培训,使本地规范得以融入评估过程。最终构建了PLACES数据集,包含超过26,000个来自当地语境的T2I模型失败案例。分析显示,这些提示在社会文化与语言特征上远超现有地理无关的众包数据集,展现出由本地文化与语言差异驱动的独特对抗模式,并在印度等地形成围绕宗教等主题的特定集群。研究还发现现有安全机制存在结构性上下文缺口,表现为对宗教规范违背、地方习俗忽视及象征性威胁等新型危害的忽略。本文主张,T2I安全的扩展需超越规模,转向深度本地化与参与式数据收集与情境化。内容警告:本文包含可能有害或冒犯性内容。

原文摘要 · Abstract (English)

Despite the global deployment of text-to-image (T2I) models, their safety frameworks are largely calibrated to a Western-centric default, creating significant vulnerabilities for the rest of the world. To embrace cultural pluralism and bring historically under-represented perspectives in T2I safety, we conduct localised community-centered red teaming studies in the Global South. Our two-fold approach prioritizes localization and participation, by focusing on secondary urban centers in these regions, and conducting community engagement and training workshops to contextualize local norms. As a result, we present PLACES, a dataset comprising over 26,000 examples of T2I model failures collected in partnership with universities in Ghana, Nigeria, and two regions of India (Karnataka and Punjab). Analysis of prompts collected reveals a wide-ranging diversity in socio-cultural and linguistic attributes, when compared to existing geography-agnostic crowdsourced red-teaming data. We observe unique adversarial patterns enabled by local cultural and linguistic nuances, and distinct clusters within region around specific themes, such as religion in India. Moreover, we uncover structural contextual gaps in existing safety frameworks by identifying novel harms showing normative dissonance (e.g., violating religious norms, ignoring local customs, and ominous symbolism). This work argues that expanding T2I safety requires moving beyond mere scale to incorporate deeply localised, participatory methodologies for data collection and contextualization. Content warning: This paper includes examples containing potentially harmful or offensive content.

AI安全文化偏见红队测试多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。