用少量标注数据,跨语言检索增强仇恨言论检测。
Data-Efficient Hate Speech Detection via Cross-Lingual Nearest Neighbor Retrieval with Limited Labeled Data
- 从多语言数据池中检索最相关样本,补足目标语言稀缺标注数据。
- 仅需200条标注数据即达优异效果,8种语言均优于纯本地训练模型。
- 方法易扩展,适合低资源语言和新任务快速部署。
鉴于仇恨言论检测的重要性,获取标注数据成本高且耗时,尤其对低资源语言而言。已有研究证明跨语言迁移学习与数据增强在有限标注数据下有效提升性能。为构建高效可扩展的跨语言迁移学习方法,本文利用最近邻检索技术,基于目标语言极少量标注数据,从大规模多语言仇恨言论检测数据池中检索最相关样本以增强训练。我们在8种语言上评估该方法,结果表明其始终优于仅使用目标语言数据训练的模型,在多数情况下超越当前最优水平。特别地,该方法高度数据高效,部分场景下仅需200个实例即可保持优异性能。同时具备可扩展性,检索池易于扩充,方法可轻松适配新语言与新任务。此外,采用最大边际相关性减少冗余,过滤高度相似样本,进一步提升部分语言的检测效果。
原文摘要 · Abstract (English)
Considering the importance of detecting hateful language, labeled hate speech data is expensive and time-consuming to collect, particularly for low-resource languages. Prior work has demonstrated the effectiveness of cross-lingual transfer learning and data augmentation in improving performance on tasks with limited labeled data. To develop an efficient and scalable cross-lingual transfer learning approach, we leverage nearest-neighbor retrieval to augment minimal labeled data in the target language, thereby enhancing detection performance. Specifically, we assume access to a small set of labeled training instances in the target language and use these to retrieve the most relevant labeled examples from a large multilingual hate speech detection pool. We evaluate our approach on eight languages and demonstrate that it consistently outperforms models trained solely on the target language data. Furthermore, in most cases, our method surpasses the current state-of-the-art. Notably, our approach is highly data-efficient, retrieving as small as 200 instances in some cases while maintaining superior performance. Moreover, it is scalable, as the retrieval pool can be easily expanded, and the method can be readily adapted to new languages and tasks. We also apply maximum marginal relevance to mitigate redundancy and filter out highly similar retrieved instances, resulting in improvements in some languages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。