名字会误导文本嵌入模型,匿名化可有效缓解此问题。
What is in a name? Mitigating Name Bias in Text Embeddings via Anonymization
- 推理时移除文本中的姓名,保留主题核心
- 在两个下游任务中显著提升模型性能
- 无需训练优化,适合实际部署
文本嵌入模型常因训练数据而产生偏见。本文首次研究了文本中姓名(如人名、地名、组织名)引发的偏见:该偏见会导致模型错误判断文本主题相似性——即使语义无关,仅因含相同姓名就判为相似;或因姓名不同而误判语义一致的文本不相似。我们验证了多种文本嵌入模型存在此类名字偏见,并提出推理阶段的文本匿名化方法:去除姓名引用但保留核心主题。该方法在两个下游NLP任务中表现优异,无需训练优化,提供了一种简单高效的去偏方案。
原文摘要 · Abstract (English)
Text-embedding models often exhibit biases arising from the data on which they are trained. In this paper, we examine a hitherto unexplored bias in text-embeddings: bias arising from the presence of $\textit{names}$ such as persons, locations, organizations etc. in the text. Our study shows how the presence of $\textit{name-bias}$ in text-embedding models can potentially lead to erroneous conclusions in assessment of thematic similarity.Text-embeddings can mistakenly indicate similarity between texts based on names in the text, even when their actual semantic content has no similarity or indicate dissimilarity simply because of the names in the text even when the texts match semantically. We first demonstrate the presence of name bias in different text-embedding models and then propose $\textit{text-anonymization}$ during inference which involves removing references to names, while preserving the core theme of the text. The efficacy of the anonymization approach is demonstrated on two downstream NLP tasks, achieving significant performance gains. Our simple and training-optimization-free approach offers a practical and easily implementable solution to mitigate name bias.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。