提出GUS-Net框架,实现对文本中偏见片段的细粒度检测与分析。
Responsible AI in NLP: GUS-Net Span-Level Bias Detection Dataset and Benchmark for Generalizations, Unfairness, and Stereotypes
- 采用多标签词级分类,精准定位文本中偏见出现的具体词语片段。
- 构建含69,000+标注的GUS数据集,覆盖3,739个跨领域语段。
- 可解释性强,适合用于真实NLP系统中偏见的审计与修正。
语言技术中的表征伤害常出现在看似中性的文本中,某些短语可能同时蕴含泛化、不公或刻板印象。将偏见检测视为句子级分类会掩盖具体哪些词语携带偏见及其类型,限制了可审计性与针对性缓解。我们提出GUS-Net框架,包含GUS数据集和一个多标签词级检测器,用于社会偏见的片段级分析。GUS数据集涵盖3,739个跨领域独特片段,共超过69,000个词级标注,每个词使用BIO标签标记三类表征伤害路径:泛化(Generalizations)、不公(Unfairness)、刻板印象(Stereotypes)。为确保标注可靠性,采用自动化多智能体流水线提出候选片段,再由人工专家验证与修正。我们将偏见检测建模为多标签词级分类任务,并在编码器模型(如BERT系列)与解码器型大模型(LLMs)上进行基准测试。评估涵盖词级识别、片段级实体识别及分布外泛化能力。实证结果表明,编码器模型在复杂重叠片段上表现更优且计算效率更高。该框架提供可解释的细粒度诊断,支持对现实NLP系统中表征伤害的系统性审计与缓解。
原文摘要 · Abstract (English)
Representational harms in language technologies often occur in short spans within otherwise neutral text, where phrases may simultaneously convey generalizations, unfairness, or stereotypes. Framing bias detection as sentence-level classification obscures which words carry bias and what type is present, limiting both auditability and targeted mitigation. We introduce the GUS-Net Framework, comprising the GUS dataset and a multi-label token-level detector for span-level analysis of social bias. The GUS dataset contains 3,739 unique snippets across multiple domains, with over 69,000 token-level annotations. Each token is labeled using BIO tags (Begin, Inside, Outside) for three pathways of representational harm: Generalizations, Unfairness, and Stereotypes. To ensure reliable data annotation, we employ an automated multi-agent pipeline that proposes candidate spans which are subsequently verified and corrected by human experts. We formulate bias detection as multi-label token-level classification and benchmark both encoder-based models (e.g., BERT family variants) and decoder-based large language models (LLMs). Our evaluations cover token-level identification and span-level entity recognition on our test set, and out-of-distribution generalization. Empirical results show that encoder-based models consistently outperform decoder-based baselines on nuanced and overlapping spans while being more computationally efficient. The framework delivers interpretable, fine-grained diagnostics that enable systematic auditing and mitigation of representational harms in real-world NLP systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。