arXiv:2504.11431cs.CLcs.AI2025-04被引 1

研究播客中性别化话语如何强化男性主导倾向,并发现大模型对此类话语的表示存在偏见。

Masculine Defaults via Gendered Discourse in Podcasts and Large Language Models

  • 通过语料分析自动识别播客中的性别化话语词汇
  • 发现男性话语在大模型中表征更稳定,导致男性用户获益
  • 揭示了语音内容与大模型共同构成的隐性男性默认机制

男性默认是一种广泛存在但常被忽视的性别偏见,其包含文化背景、男性特质行为及对这些行为的认可或奖励三个要素。本文聚焦于基于话语的男性默认,提出双阶段框架:首先利用性别化话语相关性框架(GDCF)大规模发现并分析播客中的性别化话语词;其次通过话语词嵌入关联测试(D-WEAT)测量大语言模型中的性别偏见。研究涵盖15,117集播客,使用LDA和BERTopic提取话语词汇,发现商业、科技/政治、视频游戏领域存在基于话语的男性默认现象。进一步分析OpenAI的先进模型嵌入表示,发现男性话语词的表征更稳定且鲁棒,可能使男性在下游任务中表现更优,形成系统性优势——这是典型的表征伤害与男性默认。

原文摘要 · Abstract (English)

Masculine defaults are widely recognized as a significant type of gender bias, but they are often unseen as they are under-researched. Masculine defaults involve three key parts: (i) the cultural context, (ii) the masculine characteristics or behaviors, and (iii) the reward for, or simply acceptance of, those masculine characteristics or behaviors. In this work, we study discourse-based masculine defaults, and propose a twofold framework for (i) the large-scale discovery and analysis of gendered discourse words in spoken content via our Gendered Discourse Correlation Framework (GDCF); and (ii) the measurement of the gender bias associated with these gendered discourse words in LLMs via our Discourse Word-Embedding Association Test (D-WEAT). We focus our study on podcasts, a popular and growing form of social media, analyzing 15,117 podcast episodes. We analyze correlations between gender and discourse words -- discovered via LDA and BERTopic -- to automatically form gendered discourse word lists. We then study the prevalence of these gendered discourse words in domain-specific contexts, and find that gendered discourse-based masculine defaults exist in the domains of business, technology/politics, and video games. Next, we study the representation of these gendered discourse words from a state-of-the-art LLM embedding model from OpenAI, and find that the masculine discourse words have a more stable and robust representation than the feminine discourse words, which may result in better system performance on downstream tasks for men. Hence, men are rewarded for their discourse patterns with better system performance by one of the state-of-the-art language models -- and this embedding disparity is a representational harm and a masculine default.

性别偏见大模型话语分析播客

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。