研究大模型如何根据姓名判断性别与种族,发现其隐含社会地位偏见。
Name of Thrones: Evaluating How LLMs Rank Student Names, Race, and Gender in Status Hierarchies
- 通过分析五种族裔姓名,检验大模型对姓名的等级判断机制。
- 东亚和南亚姓名在某些情境下获更高评分,打破白人优先假设。
- 名字融合西方元素可提升亚裔学生(尤其女生)的AI感知地位。
姓名承载着深刻的个人与文化意义,也是性别、种族与社会地位的重要信号。随着大语言模型广泛应用,且姓名常作为输入,需评估其是否基于姓名将个体置于不公的地位层级。现有研究多聚焦于名姓偏见,却较少关注姓氏及名姓组合的综合影响。本研究对五种族裔的姓名变体进行大规模分析,发现大模型会反映并强化基于姓名所暗示的性别与种族地位差异,体现对能力、领导力与经济潜力的不同预期。出乎意料的是,东亚及部分情境下的南亚姓名获得更高排名,挑战了“白人优先”的普遍假设。研究还拆解亚洲群体——该群体预计到2055年将成为美国最大移民群体——揭示其内部存在复杂分层的偏见。性别调节偏见,女性在某些族裔中面临更大劣势。此外,采用西方名字可提升东亚与东南亚学生的AI感知地位,尤以女性受益显著。结果强调了在评估大模型时应采取交叉性与更细致的种族、性别与混合身份视角。
原文摘要 · Abstract (English)
Across cultures, names tell a lot about their bearers as they carry deep personal and cultural significance. Names also serve as powerful signals of gender, race, and status in the social hierarchy - a pecking order in which individual positions shape others' expectations on their perceived competence and worth. With the widespread adoption of LLMs and as names are often an input for LLMs, it is crucial to evaluate whether LLMs may sort people into status positions based on first and last names and, if so, whether it is in an unfair, biased fashion. While prior work has primarily investigated biases in first names, little attention has been paid to last names and even less to the combined effects of first and last names. In this study, we conduct a large-scale analysis of name variations across 5 ethnicities to examine how AI exhibits name biases. Our study investigates three key characteristics of inequality and finds that LLMs reflect and reinforce status hierarchies based on names that signal gender and ethnicity as they encode differential expectations of competence, leadership, and economic potential. Contrary to the common assumption that AI tends to favor Whites, we show that East and, in some contexts, South Asian names receive higher rankings. We also disaggregate Asians, a population projected to be the largest immigrant group in the U.S. by 2055. Our results challenge the monolithic Asian model minority assumption, illustrating a more complex and stratified model of bias. Gender moderates biases, with girls facing unfair disadvantages in certain racial groups. Additionally, spanning cultural categories by adopting Western first names improves AI-perceived status for East and Southeast Asian students, particularly for girls. Our findings underscore the importance of intersectional and more nuanced understandings of race, gender, and mixed identities in the evaluation of LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。