arXiv:2410.03543cs.CL2024-10EMNLP被引 19

研究标注者态度如何影响性别歧视内容识别,发现偏见会扭曲判断结果。

Re-examining Sexism and Misogyny Classification with Annotator Attitudes

  • 通过心理学量表收集标注者身份与态度数据,分析其对标签的影响。
  • 高威权主义倾向者更易标记文本为性别歧视,而新式性别歧视态度者则相反。
  • 引入标注者背景信息可提升模型性能,但复杂标签仍难处理。

性别暴力(GBV)在线上日益严重,但现有数据集未能涵盖标注者的多元视角或充分代表受影响群体。本文重新审视了GBV审核流程中的两个关键环节:(1) 人工标注;(2) 自动分类。针对(1),我们分析了两个数据集,探究标注者身份与态度与其在两项GBV标注任务中的反应关系。通过三种社会心理学验证量表收集众包标注者的族裔、性别及态度信息,发现右翼威权主义得分越高,越倾向于将文本标记为性别歧视;而社会支配取向与新式性别歧视态度得分越高,则越倾向于不标记。针对(2),我们使用大语言模型和五种提示策略进行分类实验,包括注入标注者信息的提示。结果表明:(i) 标注者态度显著影响分类器对其标签的预测能力;(ii) 使用结构化简短的标注者描述可提升模型表现;(iii) 模型难以应对新标签集带来的复杂性和类别不平衡问题。

原文摘要 · Abstract (English)

Gender-Based Violence (GBV) is an increasing problem online, but existing datasets fail to capture the plurality of possible annotator perspectives or ensure the representation of affected groups. We revisit two important stages in the moderation pipeline for GBV: (1) manual data labelling; and (2) automated classification. For (1), we examine two datasets to investigate the relationship between annotator identities and attitudes and the responses they give to two GBV labelling tasks. To this end, we collect demographic and attitudinal information from crowd-sourced annotators using three validated surveys from Social Psychology. We find that higher Right Wing Authoritarianism scores are associated with a higher propensity to label text as sexist, while for Social Dominance Orientation and Neosexist Attitudes, higher scores are associated with a negative tendency to do so. For (2), we conduct classification experiments using Large Language Models and five prompting strategies, including infusing prompts with annotator information. We find: (i) annotator attitudes affect the ability of classifiers to predict their labels; (ii) including attitudinal information can boost performance when we use well-structured brief annotator descriptions; and (iii) models struggle to reflect the increased complexity and imbalanced classes of the new label sets.

性别歧视标注偏见大模型伦理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。