arXiv:2507.21319cs.CL2025-07被引 5

大模型难以理解跨文化道德差异,存在显著偏差。

Do Large Language Models Understand Morality Across Cultures?

  • 通过对比模型输出与调查数据的道德评分方差,评估跨文化一致性。
  • 模型压缩文化差异,与真实调查模式对齐度低。
  • 适合关注AI伦理、跨文化公平性的研究者参考。

大型语言模型(LLMs)在多个领域展现出强大能力,但其训练数据中嵌入的性别、种族和文化偏见,引发了对其伦理使用和社会影响的担忧。本研究探究了当前大模型对跨文化道德观点的理解程度,重点检验模型输出是否与国际调查数据中的道德态度模式一致。采用三种互补方法:(1) 比较模型生成的道德评分方差与调查数据的差异;(2) 进行聚类对齐分析,评估模型输出与调查数据中国家分组的一致性;(3) 通过系统选择的词对提示模型进行直接比较测试。结果显示,当前大模型通常无法再现完整的跨文化道德差异,倾向于压缩文化间差异,且与实证调查模式对齐度较低。研究强调亟需更稳健的方法来减轻偏见,提升大模型的文化代表性。最后讨论了负责任开发与全球部署的启示,突出公平性与伦理对齐的重要性。

原文摘要 · Abstract (English)

Recent advancements in large language models (LLMs) have established them as powerful tools across numerous domains. However, persistent concerns about embedded biases, such as gender, racial, and cultural biases arising from their training data, raise significant questions about the ethical use and societal consequences of these technologies. This study investigates the extent to which LLMs capture cross-cultural differences and similarities in moral perspectives. Specifically, we examine whether LLM outputs align with patterns observed in international survey data on moral attitudes. To this end, we employ three complementary methods: (1) comparing variances in moral scores produced by models versus those reported in surveys, (2) conducting cluster alignment analyses to assess correspondence between country groupings derived from LLM outputs and survey data, and (3) directly probing models with comparative prompts using systematically chosen token pairs. Our results reveal that current LLMs often fail to reproduce the full spectrum of cross-cultural moral variation, tending to compress differences and exhibit low alignment with empirical survey patterns. These findings highlight a pressing need for more robust approaches to mitigate biases and improve cultural representativeness in LLMs. We conclude by discussing the implications for the responsible development and global deployment of LLMs, emphasizing fairness and ethical alignment.

大模型道德认知文化差异偏见检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。