对比多种多语言嵌入模型在仇恨言论检测中的表现,验证其跨语言有效性。
Comparison of Modern Multilingual Text Embedding Techniques for Hate Speech Detection Task

- 使用六种主流多语言编码器,统一流程评估性能
- 监督分类模型准确率最高达92.19%,优于无监督异常检测
- 主成分分析压缩特征不影响监督模型,但降低无监督效果
在线仇恨言论和攻击性语言对内容审核构成日益严峻的挑战,尤其在多语言环境及低资源语言(如立陶宛语)中。本文研究现代多语言句子嵌入模型在立陶宛语、俄语和英语中进行仇恨言论检测的有效性,及其对下游建模选择和特征维度的依赖性。我们构建了新的立陶宛仇恨言论语料库LtHate,来自新闻门户与社交网络,并在LtHate、RuToxic和EnSuperset上对六种现代多语言编码器(potion, gemma, bge, snow, jina, e5)进行了基准测试,采用统一的Python流水线。针对每种嵌入表示,训练了一类HBOS异常检测器和二类CatBoost分类器,分别搭配与不搭配主成分分析(PCA)压缩至64维特征向量。在所有数据集上,二类监督模型始终显著优于一类异常检测,最佳配置在立陶宛语中达到80.96%准确率与AUC ROC 0.887(jina),俄语中达92.19%准确率与AUC ROC 0.978(e5),英语中达77.21%准确率与AUC ROC 0.859(e5+PCA)。PCA压缩在监督设置下几乎保留全部判别能力,但在无监督异常检测中略有负面影响。结果表明,结合梯度提升决策树的现代多语言嵌入可为多语言仇恨言论检测提供稳健的软计算解决方案。
原文摘要 · Abstract (English)
Online hate speech and abusive language pose a growing challenge for content moderation, especially in multilingual settings and for low-resource languages such as Lithuanian. This paper investigates to what extent modern multilingual sentence embedding models can support accurate hate speech detection in Lithuanian, Russian, and English, and how their performance depends on downstream modeling choices and feature dimensionality. We introduce LtHate, a new Lithuanian hate speech corpus derived from news portals and social networks, and benchmark six modern multilingual encoders (potion, gemma, bge, snow, jina, e5) on LtHate, RuToxic, and EnSuperset using a unified Python pipeline. For each embedding, we train both a one class HBOS anomaly detector and a two class CatBoost classifier, with and without principal component analysis (PCA) compression to 64-dimensional feature vectors. Across all datasets, two class supervised models consistently and substantially outperform one class anomaly detection, with the best configurations achieving up to 80.96% accuracy and AUC ROC of 0.887 in Lithuanian (jina), 92.19% accuracy and AUC ROC of 0.978 in Russian (e5), and 77.21% accuracy and AUC ROC of 0.859 in English (e5 with PCA). PCA compression preserves almost all discriminative power in the supervised setting, while showing some negative impact for the unsupervised anomaly detection case. These results demonstrate how modern multilingual sentence embeddings combined with gradient boosted decision trees provide robust soft-computing solutions for multilingual hate speech detection applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。