首个多任务孟加拉语仇恨言论检测数据集,支持类型、严重程度与目标三重分析。
LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Target
- 构建首个多任务孟加拉语仇恨言论数据集BanglaMultiHate,涵盖类型、严重度与目标三类标签。
- 实验证明,在低资源场景下,经LoRA微调的LLM表现接近BanglaBERT,但预训练语言模型的文化适配性仍关键。
- 适合研究低资源语言内容安全、多任务仇恨言论检测及大模型本地化应用的学者与工程师。
在线社交媒体是日常交流与信息获取的核心平台,但也为仇恨言论、攻击性语言和针对个人、组织及社群的欺凌内容提供了温床,破坏了网络环境的安全性、参与度与公平性。可靠的内容检测系统亟需建立,尤其在资源有限的低资源语言中。尽管已有研究为孟加拉语贡献了部分资源与模型,但多数仍为单一任务(如二分类:仇恨/非仇恨),且对类型、严重程度与目标等多维信号覆盖不足。本文首次提出多任务孟加拉语仇恨言论数据集BanglaMultiHate,是迄今最大规模的人工标注语料库之一。基于该数据集,我们系统比较了传统基线、单语预训练模型与大语言模型(LLMs)在零样本提示与LoRA微调下的表现。实验揭示:尽管经LoRA微调的LLM表现可媲美BanglaBERT,但在低资源环境下,具备文化与语言背景的预训练仍对鲁棒性能至关重要。本研究为低资源语境下文化适配的社区治理工具开发建立了更强基准。为保障可复现性,数据集与所有代码将公开发布。
原文摘要 · Abstract (English)
Online social media platforms are central to everyday communication and information seeking. While these platforms serve positive purposes, they also provide fertile ground for the spread of hate speech, offensive language, and bullying content targeting individuals, organizations, and communities. Such content undermines safety, participation, and equity online. Reliable detection systems are therefore needed, especially for low-resource languages where moderation tools are limited. In Bangla, prior work has contributed resources and models, but most are single-task (e.g., binary hate/offense) with limited coverage of multi-facet signals (type, severity, target). We address these gaps by introducing the first multi-task Bangla hate-speech dataset, BanglaMultiHate, one of the largest manually annotated corpus to date. Building on this resource, we conduct a comprehensive, controlled comparison spanning classical baselines, monolingual pretrained models, and LLMs under zero-shot prompting and LoRA fine-tuning. Our experiments assess LLM adaptability in a low-resource setting and reveal a consistent trend: although LoRA-tuned LLMs are competitive with BanglaBERT, culturally and linguistically grounded pretraining remains critical for robust performance. Together, our dataset and findings establish a stronger benchmark for developing culturally aligned moderation tools in low-resource contexts. For reproducibility, we will release the dataset and all related scripts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。