用SCM模型缓解词向量中的交叉身份偏见,保持语义稳定性。
Assessing the quality and coherence of word embeddings after SCM-based intersectional bias mitigation
- 通过拼接或相加构建双重身份表示,应用三种去偏策略。
- 去偏后局部邻域仍连贯,类比关系基本保留,但存在稳定与类比的权衡。
- 部分投影法最稳健,适合对稳定性要求高的场景。
静态词向量常吸收文本中的社会偏见,并隐性影响下游系统。已有基于刻板印象内容模型(SCM)的研究多聚焦于温暖与能力维度上的单一群体偏见。本文将该视角拓展至交叉身份偏见,通过相加或拼接构建双身份复合表示,并应用三种去偏方法:减法、线性投影与部分投影。评估涵盖三类主流嵌入模型(Word2Vec、GloVe、ConceptNet Numberbatch),从两个互补角度衡量效用:局部邻域一致性与类比行为保持度。结果表明,基于SCM的去偏策略在交叉身份场景下表现良好,整体语义结构基本保持完整。主要代价在于几何稳定性与类比性能之间的权衡:越严格保持几何结构的方法越谨慎于类比,更激进的投影则可提升类比表现但牺牲邻域稳定性。部分投影始终稳健,线性投影更具攻击性,减法作为简单基线仍具竞争力。拼接与相加的选择取决于嵌入类型与应用目标。研究证明,使用SCM进行静态嵌入的交叉身份去偏是可行的,并为平衡稳定性与类比性能提供了具体配置建议。
原文摘要 · Abstract (English)
Static word embeddings often absorb social biases from the text they learn from, and those biases can quietly shape downstream systems. Prior work that uses the Stereotype Content Model (SCM) has focused mostly on single-group bias along warmth and competence. We broaden that lens to intersectional bias by building compound representations for pairs of social identities through summation or concatenation, and by applying three debiasing strategies: Subtraction, Linear Projection, and Partial Projection. We study three widely used embedding families (Word2Vec, GloVe, and ConceptNet Numberbatch) and assess them with two complementary views of utility: whether local neighborhoods remain coherent and whether analogy behavior is preserved. Across models, SCM-based mitigation carries over well to the intersectional case and largely keeps the overall semantic landscape intact. The main cost is a familiar trade off: methods that most tightly preserve geometry tend to be more cautious about analogy behavior, while more assertive projections can improve analogies at the expense of strict neighborhood stability. Partial Projection is reliably conservative and keeps representations steady; Linear Projection can be more assertive; Subtraction is a simple baseline that remains competitive. The choice between summation and concatenation depends on the embedding family and the application goal. Together, these findings suggest that intersectional debiasing with SCM is practical in static embeddings, and they offer guidance for selecting aggregation and debiasing settings when balancing stability against analogy performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。