用职业身份提示揭示大模型隐含的文化偏见
Occupational Prompting Reveals Cultural Bias in Large Language Models
- 用职业角色替代国籍提示,考察专业身份如何影响模型价值观
- 不同职业引发模型在西方文化区内的显著价值偏移
- 为分析职业人格对模型表达的影响提供新框架
社会角色塑造期待、优先级与判断,但大语言模型(LLMs)如何关联职业身份与更广泛的文化价值模式尚不明确。以往研究通过基于国家的文化提示,检验模型对价值观调查问题的回答是否符合人类文化基准。本文将该框架扩展为职业提示,考察专业角色线索如何影响开放权重模型在价值观调查中的回应。基于来自综合价值观调查(Integrated Values Surveys)的问题,我们构建了基于问卷的评估流程,将模型响应投影至Inglehart--Welzel二维文化空间。对会计、教师、工程师、护士等职业身份进行提示后,分析其在文化地图上的分布。结果表明,尽管职业提示下的模型响应仍位于整体西方式文化区域,但不同职业导致内部位置发生显著偏移,形成独特的职业偏斜。这说明职业提示并非中性标签,而是激发出结构化的价值模式。研究将基于问卷的文化偏见评估从国籍提示拓展至职业提示,为探究职业身份如何塑造模型的价值表达提供了新方法。
原文摘要 · Abstract (English)
Social roles shape expectations, priorities, and judgments, yet it remains unclear how large language models (LLMs) associate occupational identities with broader cultural value patterns. Prior work used nationality-based cultural prompting to study how LLM responses to value-survey questions align with human cultural benchmarks. In this paper, we extend that framework by replacing cultural prompting with occupational prompting to examine how professional-role cues influence value-survey responses in open-weight LLMs. Using a survey-grounded evaluation pipeline based on questions from the Integrated Values Surveys, we project model responses into the two-dimensional Inglehart--Welzel cultural space. We prompt open-weight LLMs to answer questions under occupational identities such as accountant, teacher, engineer, and nurse, and then analyze how these occupation-conditioned responses are positioned on the cultural map. Our results show that when open-weight LLMs are prompted with occupations rather than national identities, their responses remain within a broadly Western-leaning region of the cultural map. However, different occupations introduce shifts within this region, producing distinct occupational skews. This indicates that occupational prompts are not treated as neutral role labels, but instead elicit structured value patterns. These findings extend survey-based evaluation of cultural bias beyond nationality-based prompting and provide a framework for studying how occupational personas shape value expression in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。