用清单式诊断框架提升仇恨言论检测的可解释性与泛化能力
xList-Hate: A Checklist-Based Framework for Interpretable and Generalizable Hate Speech Detection
- 将仇恨言论检测拆解为多个概念级问题,由大模型逐项判断
- 在多数据集上表现更稳健,尤其在跨域场景下优于传统方法
- 决策路径透明可追溯,适合需要解释性的内容审核场景
仇恨言论检测常被当作直接的二分类任务,但其本质是受法律、平台政策和标注规范等多重因素影响的复合概念。现有监督模型易对特定数据集过拟合,面对领域迁移和标注噪声时鲁棒性差。本文提出xList-Hate,一种基于清单的诊断框架,将检测任务分解为一系列基于普遍规范准则的概念级问题,由大语言模型独立回答,生成不直接预测标签但捕捉仇恨特征的二值诊断表示。这些信号通过轻量级可解释决策树聚合,实现透明可审计的预测。在多个仇恨言论基准上评估,相比零样本大模型分类和领域内微调,该方法在跨数据集鲁棒性和领域迁移下均表现更优。定性分析显示,框架对标注不一致和上下文模糊更具容忍度。关键优势在于提供细粒度可解释性,支持逐因素分析。结果表明,将仇恨言论检测重构为诊断推理任务,可提供一种更鲁棒、可解释且可扩展的内容审核方案。
原文摘要 · Abstract (English)
Hate speech detection is commonly framed as a direct binary classification problem despite being a composite concept defined through multiple interacting factors that vary across legal frameworks, platform policies, and annotation guidelines. As a result, supervised models often overfit dataset-specific definitions and exhibit limited robustness under domain shift and annotation noise. We introduce xList-Hate, a diagnostic framework that decomposes hate speech detection into a checklist of explicit, concept-level questions grounded in widely shared normative criteria. Each question is independently answered by a large language model (LLM), producing a binary diagnostic representation that captures hateful content features without directly predicting the final label. These diagnostic signals are then aggregated by a lightweight, fully interpretable decision tree, yielding transparent and auditable predictions. We evaluate it across multiple hate speech benchmarks and model families, comparing it against zero-shot LLM classification and in-domain supervised fine-tuning. While supervised methods typically maximize in-domain performance, we consistently improves cross-dataset robustness and relative performance under domain shift. In addition, qualitative analysis of disagreement cases provides evidence that the framework can be less sensitive to certain forms of annotation inconsistency and contextual ambiguity. Crucially, the approach enables fine-grained interpretability through explicit decision paths and factor-level analysis. Our results suggest that reframing hate speech detection as a diagnostic reasoning task, rather than a monolithic classification problem, provides a robust, explainable, and extensible alternative for content moderation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。