评测大模型在多地仇恨言论检测中的表现,发现其存在准确性与鲁棒性短板。
Evaluation of Hate Speech Detection Using Large Language Models and Geographical Contextualization
- 构建三维度评估框架,涵盖二分类、地理语境感知和对抗样本防御。
- 代码类模型Codellama召回率达70.6%,但大模型对恶意文本误判率高达62.5%。
- 揭示多语言仇恨言论检测中上下文理解与抗干扰能力的权衡,适合安全研究者参考。
社交媒体上仇恨言论的泛滥已成为严重社会问题,加剧暴力、歧视与社会分裂。由于文化、语言及上下文复杂性以及对抗性操纵,仇恨言论检测本身具有高度多维性。本研究系统评估了大语言模型在多语言数据集与多样地理背景下的表现。基于来自五个不同地区的1000条评论数据,我们测试了Llama2(13b)、Codellama(7b)和DeepSeekCoder(6.7b)三种前沿LLM。Codellama在二分类任务中取得最高召回率70.6%和F1分数52.18%;DeepSeekCoder在地理敏感性方面表现最佳,正确识别出265个位置中的63个。对抗鲁棒性测试显示显著弱点:Llama2将62.5%的篡改样本错误分类。这些结果凸显当前大模型在准确性、上下文理解与鲁棒性之间的权衡,为构建具备上下文感知能力的多语言仇恨言论检测系统提供了关键洞察与可操作建议。
原文摘要 · Abstract (English)
The proliferation of hate speech on social media is one of the serious issues that is bringing huge impacts to society: an escalation of violence, discrimination, and social fragmentation. The problem of detecting hate speech is intrinsically multifaceted due to cultural, linguistic, and contextual complexities and adversarial manipulations. In this study, we systematically investigate the performance of LLMs on detecting hate speech across multilingual datasets and diverse geographic contexts. Our work presents a new evaluation framework in three dimensions: binary classification of hate speech, geography-aware contextual detection, and robustness to adversarially generated text. Using a dataset of 1,000 comments from five diverse regions, we evaluate three state-of-the-art LLMs: Llama2 (13b), Codellama (7b), and DeepSeekCoder (6.7b). Codellama had the best binary classification recall with 70.6% and an F1-score of 52.18%, whereas DeepSeekCoder had the best performance in geographic sensitivity, correctly detecting 63 out of 265 locations. The tests for adversarial robustness also showed significant weaknesses; Llama2 misclassified 62.5% of manipulated samples. These results bring to light the trade-offs between accuracy, contextual understanding, and robustness in the current versions of LLMs. This work has thus set the stage for developing contextually aware, multilingual hate speech detection systems by underlining key strengths and limitations, therefore offering actionable insights for future research and real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。