arXiv:2504.12082cs.CLcs.AI2025-04

通过智能检索示例提升隐性仇恨言论识别准确率

Selective Demonstration Retrieval for Improved Implicit Hate Speech Detection

  • 用上下文学习自适应检索相似示例,无需微调模型
  • 在多个数据集上优于当前最优方法,降低误判率
  • 适合需要减少模型偏见的社交媒体内容审核场景

仇恨言论检测是自然语言处理中的关键研究方向,对保障网络社区安全至关重要。然而,识别隐性仇恨言论——即以微妙或间接方式传达有害意图的内容——仍是重大挑战。与显性仇恨言论不同,隐性表达依赖上下文、文化细节和隐藏偏见,难以一致识别。此外,其解读受外部知识和人口统计偏见影响,导致不同语言模型结果差异显著。大语言模型常对有毒语言及弱势群体相关表述过度敏感,引发误报(将无害语句误判为仇恨)和漏报(未能识别真实有害内容)。这要求方法不仅提升检测精度,还需降低模型偏见并增强鲁棒性。为此,我们提出一种新方法:利用上下文学习,无需模型微调,通过自适应检索聚焦相似群体或相似度最高的示例,增强上下文理解。实验表明,该方法超越现有最先进技术。实现细节与代码将在TBD处提供。

原文摘要 · Abstract (English)

Hate speech detection is a crucial area of research in natural language processing, essential for ensuring online community safety. However, detecting implicit hate speech, where harmful intent is conveyed in subtle or indirect ways, remains a major challenge. Unlike explicit hate speech, implicit expressions often depend on context, cultural subtleties, and hidden biases, making them more challenging to identify consistently. Additionally, the interpretation of such speech is influenced by external knowledge and demographic biases, resulting in varied detection results across different language models. Furthermore, Large Language Models often show heightened sensitivity to toxic language and references to vulnerable groups, which can lead to misclassifications. This over-sensitivity results in false positives (incorrectly identifying harmless statements as hateful) and false negatives (failing to detect genuinely harmful content). Addressing these issues requires methods that not only improve detection precision but also reduce model biases and enhance robustness. To address these challenges, we propose a novel method, which utilizes in-context learning without requiring model fine-tuning. By adaptively retrieving demonstrations that focus on similar groups or those with the highest similarity scores, our approach enhances contextual comprehension. Experimental results show that our method outperforms current state-of-the-art techniques. Implementation details and code are available at TBD.

仇恨言论上下文学习隐性攻击模型偏见

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。