arXiv:2506.16052cs.CLcs.AI2025-06被引 2

融合DeBERTa与广义学习系统的混合模型,提升英文网络欺凌检测准确率。

A Hybrid DeBERTa and Gated Broad Learning System for Cyberbullying Detection in English Text

  • 用改进的DeBERTa结合门控广义学习系统进行联合建模。
  • 在4个数据集上最高达95.41%准确率,优于现有方法。
  • 支持细粒度解释与置信度校准,适合内容审核场景。

在线通信平台的普及为全球互联带来机遇,也催生了网络欺凌等有害行为,据研究约54.4%的青少年受影响。本文提出一种混合架构,结合基于Transformer的上下文理解能力与广义学习系统的模式识别优势,实现高效网络欺凌检测。该方法将增强的Squeeze-and-Excitation块与情感分析能力融入改进DeBERTa模型,并与门控广义学习系统(GBLS)分类器结合,构建协同框架,在多个基准数据集上表现更优。所提ModifiedDeBERTa + GBLS模型在四个英文数据集上分别取得:HateXplain上79.3%准确率,SOSNet上95.41%,Mendeley-I上91.37%,Mendeley-II上94.67%。除性能提升外,框架还集成多项可解释性机制,包括词元级归因分析、LIME局部解释与置信度校准,满足自动化内容审核中的透明性需求。消融实验验证各组件有效性,失败案例分析揭示对隐含偏见与讽刺内容检测仍存挑战,为未来改进提供方向。

原文摘要 · Abstract (English)

The proliferation of online communication platforms has created unprecedented opportunities for global connectivity while simultaneously enabling harmful behaviors such as cyberbullying, which affects approximately 54.4\% of teenagers according to recent research. This paper presents a hybrid architecture that combines the contextual understanding capabilities of transformer-based models with the pattern recognition strengths of broad learning systems for effective cyberbullying detection. This approach integrates a modified DeBERTa model augmented with Squeeze-and-Excitation blocks and sentiment analysis capabilities with a Gated Broad Learning System (GBLS) classifier, creating a synergistic framework that outperforms existing approaches across multiple benchmark datasets. The proposed ModifiedDeBERTa + GBLS model achieved good performance on four English datasets: 79.3\% accuracy on HateXplain, 95.41\% accuracy on SOSNet, 91.37\% accuracy on Mendeley-I, and 94.67\% accuracy on Mendeley-II. Beyond performance gains, the framework incorporates comprehensive explainability mechanisms including token-level attribution analysis, LIME-based local interpretations, and confidence calibration, addressing critical transparency requirements in automated content moderation. Ablation studies confirm the meaningful contribution of each architectural component, while failure case analysis reveals specific challenges in detecting implicit bias and sarcastic content, providing valuable insights for future improvements in cyberbullying detection systems.

网络欺凌文本分类可解释性混合模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。