分析大模型如何通过故事生成强化性别种族刻板印象
Yet another algorithmic bias: A Discursive Analysis of Large Language Models Reinforcing Dominant Discourses on Gender and Race
- 用人工分析法研究模型生成的黑人与白人女性故事
- 黑人女性被绑定于血统与反抗,白人女性多展现自我探索
- 揭示模型对主流话语的复制,适合关注AI伦理者阅读
随着人工智能发展,大型语言模型(LLMs)在诸多场景中广泛应用。本文提出一种定性、话语分析框架,以补充现有依赖量化方法的偏见检测。通过人工分析模型生成的包含黑人与白人女性的短篇故事,发现黑人女性常被刻画为与祖先和抗争相关,而白人女性则多呈现自我发现过程。这些模式反映了语言模型对固化话语的再现,强化了本质化认知与社会流动性缺失感。当被要求修正偏见时,模型仅做表面修改,未改变深层问题意义,暴露出其在构建包容性叙事上的局限。研究揭示算法背后意识形态运作机制,强调需采用跨学科批判方法,推动更具伦理意识的AI设计与部署。
原文摘要 · Abstract (English)
With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce biases, such as discrimination and racialization, while maintaining hegemonic discourses. Current bias detection approaches rely mostly on quantitative, automated methods, which often overlook the nuanced ways in which biases emerge in natural language. This study proposes a qualitative, discursive framework to complement such methods. Through manual analysis of LLM-generated short stories featuring Black and white women, we investigate gender and racial biases. We contend that qualitative methods such as the one proposed here are fundamental to help both developers and users identify the precise ways in which biases manifest in LLM outputs, thus enabling better conditions to mitigate them. Results show that Black women are portrayed as tied to ancestry and resistance, while white women appear in self-discovery processes. These patterns reflect how language models replicate crystalized discursive representations, reinforcing essentialization and a sense of social immobility. When prompted to correct biases, models offered superficial revisions that maintained problematic meanings, revealing limitations in fostering inclusive narratives. Our results demonstrate the ideological functioning of algorithms and have significant implications for the ethical use and development of AI. The study reinforces the need for critical, interdisciplinary approaches to AI design and deployment, addressing how LLM-generated discourses reflect and perpetuate inequalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。