arXiv:2410.13281cs.CL2024-10NAACL被引 31

首个针对转写孟加拉语的多标签仇恨言论数据集,助力低资源语言内容安全

BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla

  • 构建37.3万条转写孟加拉语评论数据,支持多目标仇恨言论标注
  • 基于Transformer的模型在该数据集上达到顶尖性能,零样本下翻译提示策略更优
  • 填补低资源语言仇恨言论研究空白,适合多语言内容治理研究者

数字空间中转写文本的泛滥凸显了对非英语语言仇恨言论检测的需求,尤其在低资源语言领域。由于在线言论可能基于性别、宗教或籍贯等群体加剧歧视,多标签分类有助于理解仇恨动机并提升内容监管效率。尽管已有研究集中于单语或二分类任务,但转写孟加拉语的多标签仇恨言论识别仍无先例。本文提出BanTH,首个包含37.3万样本的转写孟加拉语多标签仇恨言论数据集,数据源自YouTube评论,每条标注一个或多个目标群体,反映地区人口结构。我们通过在转写孟加拉语语料库上进一步预训练,建立新型Transformer编码器基线;并提出一种基于翻译的LLM提示策略。实验表明,我们的进一步预训练编码器在BanTH上表现最佳,而翻译提示策略在零样本设置下优于其他方法。BanTH的引入不仅填补了孟加拉语仇恨言论研究的关键空白,也为未来代码混合与多标签分类在未充分代表语言中的探索奠定基础。

原文摘要 · Abstract (English)

The proliferation of transliterated texts in digital spaces has emphasized the need for detecting and classifying hate speech in languages beyond English, particularly in low-resource languages. As online discourse can perpetuate discrimination based on target groups, e.g. gender, religion, and origin, multi-label classification of hateful content can help in comprehending hate motivation and enhance content moderation. While previous efforts have focused on monolingual or binary hate classification tasks, no work has yet addressed the challenge of multi-label hate speech classification in transliterated Bangla. We introduce BanTH, the first multi-label transliterated Bangla hate speech dataset comprising 37.3k samples. The samples are sourced from YouTube comments, where each instance is labeled with one or more target groups, reflecting the regional demographic. We establish novel transformer encoder-based baselines by further pre-training on transliterated Bangla corpus. We also propose a novel translation-based LLM prompting strategy for transliterated text. Experiments reveal that our further pre-trained encoders are achieving state-of-the-art performance on the BanTH dataset, while our translation-based prompting outperforms other strategies in the zero-shot setting. The introduction of BanTH not only fills a critical gap in hate speech research for Bangla but also sets the stage for future exploration into code-mixed and multi-label classification challenges in underrepresented languages.

仇恨言论检测多标签分类低资源语言转写文本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。