arXiv:2510.18582cs.CL2025-10被引 2

构建首个双语去人性化检测数据集,覆盖隐性歧视文本

Beyond the Explicit: A Bilingual Dataset for Dehumanization Detection in Social Media

  • 基于理论指导采样,从推特和红迪网收集双语数据
  • 标注1.6万条文档与片段,涵盖显性和隐性去人性化
  • 支持零样本/少样本学习,优于现有模型表现

数字去人性化虽为关键问题,却在计算语言学与自然语言处理领域长期被忽视。当前研究多聚焦于显性负面语句,未能覆盖更广泛的去人性化形式。尤其忽视那些不明显冒犯但持续强化对边缘群体偏见的隐性表达,此类表达潜移默化地巩固负面刻板印象,难以识别却同样有害。针对此空白,我们采用多种采样方法,从推特和红迪网收集理论指导下的双语数据集。通过众包工作者与专家对16,000个实例进行文档级与跨度级标注,验证了该数据集能全面覆盖去人性化的多个维度。该数据集既可作为机器学习模型的训练资源,也可作为未来去人性化检测技术的评估基准。为验证其有效性,我们在该数据集上微调模型,在零样本与少样本上下文设置下性能超越现有最先进模型。

原文摘要 · Abstract (English)

Digital dehumanization, although a critical issue, remains largely overlooked within the field of computational linguistics and Natural Language Processing. The prevailing approach in current research concentrating primarily on a single aspect of dehumanization that identifies overtly negative statements as its core marker. This focus, while crucial for understanding harmful online communications, inadequately addresses the broader spectrum of dehumanization. Specifically, it overlooks the subtler forms of dehumanization that, despite not being overtly offensive, still perpetuate harmful biases against marginalized groups in online interactions. These subtler forms can insidiously reinforce negative stereotypes and biases without explicit offensiveness, making them harder to detect yet equally damaging. Recognizing this gap, we use different sampling methods to collect a theory-informed bilingual dataset from Twitter and Reddit. Using crowdworkers and experts to annotate 16,000 instances on a document- and span-level, we show that our dataset covers the different dimensions of dehumanization. This dataset serves as both a training resource for machine learning models and a benchmark for evaluating future dehumanization detection techniques. To demonstrate its effectiveness, we fine-tune ML models on this dataset, achieving performance that surpasses state-of-the-art models in zero and few-shot in-context settings.

去人性化双语数据隐性偏见社会媒体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。