对比两种模型在印尼推特仇恨言论检测中的表现,神经网络更优。
A Comparative Study of PyCaret AutoML and CNN-BiLSTM for Binary Hate Speech Detection in Indonesian Twitter

- 用CNN-BiLSTM捕捉局部词汇与双向上下文,优于传统TF-IDF+词典方法。
- 神经分支达83.8%准确率,比传统方法高6.6个百分点。
- 适合想快速验证模型或研究短文本仇恨言论检测的人参考。
本文对比了PyCaret AutoML与CNN-BiLSTM两种方法在印尼推特仇恨言论检测中的表现,使用Ibrohim和Budi语料库的HS标签数据集。两者采用相同预处理流程,确保比较聚焦于建模差异。传统分支采用TF-IDF与基于词典的辱骂词计数,神经分支则学习密集词向量,捕捉局部短语模式与双向上下文。基准数据集共13,130条标注样本,正负类比例为58:42。在独立测试集上,CNN-BiLSTM表现最佳,准确率83.8%,精确率79.8%,召回率82.7%,F1分数81.2%。PyCaret中表现最好的是随机森林,准确率77.2%,F1分数77.0%。神经分支在准确率与F1分数上分别提升6.6与4.2个百分点。探索性分析、学习曲线与混淆矩阵显示,该数据集为短文本、中度不平衡,且分类依赖局部词汇线索与简短上下文组合,仍具挑战性。结论表明,PyCaret可作为有效传统基准,而CNN-BiLSTM是当前设置下的更强端到端模型。
原文摘要 · Abstract (English)
This paper compares a PyCaret AutoML branch and a CNN-BiLSTM branch for binary hate speech detection on Indonesian Twitter using the HS label from the corpus of Ibrohim and Budi. Both branches share the same preprocessing pipeline so that the comparison reflects modelling differences rather than inconsistent data preparation. The conventional branch uses TF-IDF with a lexicon-based abusive-word count, whereas the neural branch learns dense token representations and captures both local phrase patterns and bidirectional context. The benchmark is built from the released 13,130-row annotation table, whose HS label yields a 58:42 class ratio. On the held-out split, CNN-BiLSTM achieves the best result with 83.8% accuracy, 79.8% precision, 82.7% recall, and 81.2% F1-score. Within the PyCaret branch, Random Forest is the strongest conventional model with 77.2% accuracy and 77.0% F1-score. The neural branch therefore improves accuracy by 6.6 points and F1-score by 4.2 points. Exploratory corpus analysis, learning curves, and confusion matrices show that the dataset is short-text, moderately imbalanced, and still difficult because many decisions depend on local lexical cues plus short contextual composition. The study concludes that PyCaret AutoML is an effective conventional benchmarking framework, whereas CNN-BiLSTM is the stronger end model for the reported benchmark setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。