融合双层LSTM与孟加拉BERT,提升多标签网络欺凌检测准确率
A Fusion of context-aware based BanglaBERT and Two-Layer Stacked LSTM Framework for Multi-Label Cyberbullying Detection
- 用孟加拉语BERT结合两层堆叠LSTM,兼顾上下文与序列特征
- 在公开数据集上达到0.873的F1-score,有效识别威胁、骚扰等多重攻击
- 适合低资源语言文本安全分析,尤其关注社会心理健康研究者
网络欺凌已成为虚拟世界中的严重问题,若不及时发现,可能对社交和心理健康造成负面影响。现有研究多采用单标签分类,假设每条评论仅含一种攻击类型,但现实中一条评论常包含威胁、仇恨言论、骚扰等多种形式。因此,多标签检测更符合实际需求,但在低资源语言如孟加拉语中仍缺乏有效模型。本文提出一种融合架构:将孟加拉语BERT-Large与两层堆叠LSTM结合,联合建模上下文语义与时间依赖关系。模型在涵盖网络欺凌、性骚扰、威胁和垃圾信息的公开多标签孟加拉语数据集上进行微调与评估,采用不同采样策略缓解类别不平衡。使用准确率、精确率、召回率、F1分数、汉明损失、科恩卡帕系数和AUC-ROC等多指标评价,并通过5折交叉验证评估泛化能力。
原文摘要 · Abstract (English)
Cyberbullying has become a serious and growing concern in todays virtual world. When left unnoticed, it can have adverse consequences for social and mental health. Researchers have explored various types of cyberbullying, but most approaches use single-label classification, assuming that each comment contains only one type of abuse. In reality, a single comment may include overlapping forms such as threats, hate speech, and harassment. Therefore, multilabel detection is both realistic and essential. However, multilabel cyberbullying detection has received limited attention, especially in low-resource languages like Bangla, where robust pre-trained models are scarce. Developing a generalized model with moderate accuracy remains challenging. Transformers offer strong contextual understanding but may miss sequential dependencies, while LSTM models capture temporal flow but lack semantic depth. To address these limitations, we propose a fusion architecture that combines BanglaBERT-Large with a two-layer stacked LSTM. We analyze their behavior to jointly model context and sequence. The model is fine-tuned and evaluated on a publicly available multilabel Bangla cyberbullying dataset covering cyberbully, sexual harassment, threat, and spam. We apply different sampling strategies to address class imbalance. Evaluation uses multiple metrics, including accuracy, precision, recall, F1-score, Hamming loss, Cohens kappa, and AUC-ROC. We employ 5-fold cross-validation to assess the generalization of the architecture.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。