用购物记录测试大模型性别偏见,发现其依赖刻板印象判断性别
The LLM Wears Prada: Analysing Gender Bias and Stereotypes through Online Shopping Data
- 用美国用户购物数据测试6个大模型的性别预测能力
- 模型准确率中等,但判断依据多为产品与性别的刻板关联
- 即使提示规避偏见,仍残留性别刻板模式,适合关注AI伦理的研究者
随着大语言模型在多个领域广泛应用,其训练数据中的统计关联所隐含的细微偏见变得愈发重要。已有研究从职业、爱好和情绪等方面探讨了模型中的性别偏见。本文提出新视角:考察大模型能否仅根据在线购物历史判断个体性别,以及这种判断是否受性别偏见和刻板印象影响。基于美国用户的购物历史数据,我们评估了六个大模型的性别分类能力,并分析其推理过程及产品-性别共现模式。结果显示,尽管模型可中等程度预测性别,但其决策常源于产品类别与性别的刻板联系。此外,明确要求避免偏见虽降低了模型判断的确定性,但未能消除刻板模式。研究揭示了大模型中性别偏见的持续性,强调需建立更有效的偏见缓解策略。
原文摘要 · Abstract (English)
With the wide and cross-domain adoption of Large Language Models, it becomes crucial to assess to which extent the statistical correlations in training data, which underlie their impressive performance, hide subtle and potentially troubling biases. Gender bias in LLMs has been widely investigated from the perspectives of works, hobbies, and emotions typically associated with a specific gender. In this study, we introduce a novel perspective. We investigate whether LLMs can predict an individual's gender based solely on online shopping histories and whether these predictions are influenced by gender biases and stereotypes. Using a dataset of historical online purchases from users in the United States, we evaluate the ability of six LLMs to classify gender and we then analyze their reasoning and products-gender co-occurrences. Results indicate that while models can infer gender with moderate accuracy, their decisions are often rooted in stereotypical associations between product categories and gender. Furthermore, explicit instructions to avoid bias reduce the certainty of model predictions, but do not eliminate stereotypical patterns. Our findings highlight the persistent nature of gender biases in LLMs and emphasize the need for robust bias-mitigation strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。