arXiv:2507.19156cs.CLcs.AI2025-07被引 1

研究大模型如何在意大利语中强化性别刻板印象,发现其输出严重偏倚。

An Empirical Investigation of Gender Stereotype Representation in Large Language Models: The Italian Case

  • 用三种职业组合的无性别提示测试模型,分析其倾向性响应
  • 谷歌Gemini将100%女性代词分配给助理角色,远超管理职位
  • 揭示非英语语言下模型偏见风险,适合关注AI伦理的研究者

大型语言模型(LLMs)在多个领域广泛应用,引发对其可能延续刻板印象并生成偏见内容的担忧。本文聚焦性别与职业偏见,通过结构化实验,考察模型对无性别提示的响应方式,进而产生偏见输出。研究采用意大利语——一种具有丰富语法性别差异的语言——设计三组包含层级关系的职业组合提示,评估OpenAI ChatGPT(gpt-4o-mini)与Google Gemini(gemini-1.5-flash)两款主流聊天机器人。通过API收集共3600条响应。结果显示,模型输出显著强化性别刻板印象:如Gemini将100%的'她'代词用于'assistant'角色而非'manager';ChatGPT也达到97%。此类偏见在职场或招聘场景中可能引发严重后果,凸显伦理风险。理解这些偏差对制定缓解策略至关重要,以确保AI系统促进公平而非加剧社会不平等。未来研究可扩展至更多模型或语言,优化提示工程或扩大实验规模。

原文摘要 · Abstract (English)

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and professional bias, this work examines in which manner LLMs shape responses to ungendered prompts, contributing to biased outputs. This analysis uses a structured experimental method, giving different prompts involving three different professional job combinations, which are also characterized by a hierarchical relationship. This study uses Italian, a language with extensive grammatical gender differences, to highlight potential limitations in current LLMs' ability to generate objective text in non-English languages. Two popular LLM-based chatbots are examined, namely OpenAI ChatGPT (gpt-4o-mini) and Google Gemini (gemini-1.5-flash). Through APIs, we collected a range of 3600 responses. The results highlight how content generated by LLMs can perpetuate stereotypes. For example, Gemini associated 100% (ChatGPT 97%) of 'she' pronouns to the 'assistant' rather than the 'manager'. The presence of bias in AI-generated text can have significant implications in many fields, such as in the workplaces or in job selections, raising ethical concerns about its use. Understanding these risks is pivotal to developing mitigation strategies and assuring that AI-based systems do not increase social inequalities, but rather contribute to more equitable outcomes. Future research directions include expanding the study to additional chatbots or languages, refining prompt engineering methods or further exploiting a larger experimental base.

大模型偏见性别刻板印象AI伦理意大利语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。