arXiv:2411.05819cs.CLcs.AI2024-11被引 3

融合情感分析的分层模型提升仇恨言论检测准确率

Hierarchical Sentiment Analysis Framework for Hate Speech Detection: Implementing Binary and Multiclass Classification Strategy

  • 构建基于Transformer的多任务模型,共享情感表征增强识别能力
  • 在多个数据集上显著降低误报率,提升仇恨言论检测精度
  • 适合需要高精度内容审核的平台或研究者参考

社交媒体中自动识别仇恨言论面临的核心挑战是区分仇恨言论与普通冒犯性语言。这类内容是网络过滤系统亟需移除的重要类别,仅靠自动化方法才能应对每日海量数据。当前自然语言处理领域正探索多种仇恨言论检测方案。然而,以往方法(如卷积神经网络、多通道BERT模型和词法检测)往往因未充分考虑情感分析与情绪分类等关联任务而精度偏低。它们常因特定词汇出现就将其归为仇恨言论,导致大量误判。本研究提出一种基于深度学习与机器学习的仇恨言论文本分类系统,设计了一种融合共享情感表征的新型多任务模型,利用Hugging Face的Transformer模型与情感分析能力,有效减少误报。结果表明,结合情感分析与基于Transformer的训练模型,在多个数据集上显著提升了仇恨言论检测性能。

原文摘要 · Abstract (English)

A significant challenge in automating hate speech detection on social media is distinguishing hate speech from regular and offensive language. These identify an essential category of content that web filters seek to remove. Only automated methods can manage this volume of daily data. To solve this problem, the community of Natural Language Processing is currently investigating different ways of hate speech detection. In addition to those, previous approaches (e.g., Convolutional Neural Networks, multi-channel BERT models, and lexical detection) have always achieved low precision without carefully treating other related tasks like sentiment analysis and emotion classification. They still like to group all messages with specific words in them as hate speech simply because those terms often appear alongside hateful rhetoric. In this research, our paper presented the hate speech text classification system model drawn upon deep learning and machine learning. In this paper, we propose a new multitask model integrated with shared emotional representations to detect hate speech across the English language. The Transformer-based model we used from Hugging Face and sentiment analysis helped us prevent false positives. Conclusion. We conclude that utilizing sentiment analysis and a Transformer-based trained model considerably improves hate speech detection across multiple datasets.

仇恨言论检测情感分析Transformer多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。