首个非洲文化语境下的大模型偏见评测数据集,揭示模型对非洲刻板印象的系统性偏好。
AfriStereo: A Culturally Grounded Dataset for Evaluating Stereotypical Bias in Large Language Models
- 基于西非三国社区共建,收集1163条跨性别/族裔/宗教等刻板印象
- 扩展至超5000对刻板-反刻板配对,9/11模型显示显著偏见(BPR 0.63~0.78)
- 为非洲语境下的公平性研究提供可复用方法,适合关注多元文化偏见的团队
现有AI偏见评测基准多反映西方视角,导致非洲语境缺位,使各类应用中出现有害刻板印象。为填补此空白,我们提出AfriStereo——首个开源的、基于本地社会文化语境的非洲刻板印象数据集与评估框架。通过在塞内加尔、肯尼亚和尼日利亚开展社区参与式工作,我们收集了1,163条涵盖性别、族裔、宗教、年龄和职业维度的刻板印象。采用少样本提示结合人工闭环验证的方法,将数据集扩充至超过5,000个刻板-反刻板配对,并通过语义聚类与具备文化背景的评审员进行手动标注验证。初步评估显示,11个模型中有9个表现出统计显著的偏见,其偏见偏好比(BPR)介于0.63至0.78之间(p ≤ 0.05),尤其在年龄、职业和性别维度上表现明显。特定领域模型在此设置下表现出较弱偏见,表明任务特定训练可能缓解部分关联。未来,AfriStereo为文化根基型偏见评估与缓解研究开辟路径,为全球包容性NLP技术发展提供关键方法论支持。
原文摘要 · Abstract (English)
Existing AI bias evaluation benchmarks largely reflect Western perspectives, leaving African contexts underrepresented and enabling harmful stereotypes in applications across various domains. To address this gap, we introduce AfriStereo, the first open-source African stereotype dataset and evaluation framework grounded in local socio-cultural contexts. Through community engaged efforts across Senegal, Kenya, and Nigeria, we collected 1,163 stereotypes spanning gender, ethnicity, religion, age, and profession. Using few-shot prompting with human-in-the-loop validation, we augmented the dataset to over 5,000 stereotype-antistereotype pairs. Entries were validated through semantic clustering and manual annotation by culturally informed reviewers. Preliminary evaluation of language models reveals that nine of eleven models exhibit statistically significant bias, with Bias Preference Ratios (BPR) ranging from 0.63 to 0.78 (p <= 0.05), indicating systematic preferences for stereotypes over antistereotypes, particularly across age, profession, and gender dimensions. Domain-specific models appeared to show weaker bias in our setup, suggesting task-specific training may mitigate some associations. Looking ahead, AfriStereo opens pathways for future research on culturally grounded bias evaluation and mitigation, offering key methodologies for the AI community on building more equitable, context-aware, and globally inclusive NLP technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。