arXiv:2603.04414cs.CL2026-03中稿 · publication in the…

用知识图谱增强Transformer,提升多类别仇恨言论识别准确率

Multiclass Hate Speech Detection with RoBERTa-OTA: Integrating Transformer Attention and Graph Convolutional Networks

  • 将文本注意力与知识图谱结合,利用领域知识指导分类
  • 在3.9万样本上达96.04%准确率,关键类别提升超2.3个百分点
  • 参数增量仅0.33%,适合大规模内容审核场景

跨人群的多类别仇恨言论检测因隐含目标策略和社交媒体语言多样性仍具计算挑战。现有方法仅依赖训练数据学习表征,未显式融合可增强分类的结构化本体框架。本文提出RoBERTa-OTA,引入本体引导注意力机制,通过增强图卷积网络将文本特征与结构化知识表示联合处理。该架构结合RoBERTa嵌入、缩放注意力层与图神经网络,融合上下文语言理解与领域语义知识。在39,747个均衡样本上采用5折交叉验证,性能显著优于基线RoBERTa及现有最先进方法。RoBERTa-OTA达96.04%准确率,相较标准RoBERTa的95.02%提升明显;性别相关仇恨言论检测提升2.36个百分点,其他类别提升2.38个百分点。模型仅增加0.33%参数量,兼顾高效性,适用于需细粒度人群识别的规模化内容审核。

原文摘要 · Abstract (English)

Multiclass hate speech detection across demographic categories remains computationally challenging due to implicit targeting strategies and linguistic variability in social media content. Existing approaches rely solely on learned representations from training data, without explicitly incorporating structured ontological frameworks that can enhance classification through formal domain knowledge integration. We propose RoBERTa-OTA, which introduces ontology-guided attention mechanisms that process textual features alongside structured knowledge representations through enhanced Graph Convolutional Networks. The architecture combines RoBERTa embeddings with scaled attention layers and graph neural networks to integrate contextual language understanding with domain-specific semantic knowledge. Evaluation across 39,747 balanced samples using 5-fold cross-validation demonstrates significant performance gains over baseline RoBERTa implementations and existing state-of-the-art methods. RoBERTa-OTA achieves 96.04\% accuracy compared to 95.02\% for standard RoBERTa, with substantial improvements for challenging categories: gender-based hate speech detection improves by 2.36 percentage points while other hate speech categories improve by 2.38 percentage points. The enhanced architecture maintains computational efficiency with only 0.33\% parameter overhead, providing practical advantages for large-scale content moderation applications requiring fine-grained demographic hate speech classification.

仇恨言论检测知识图谱Transformer多分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。