用机器翻译提升多语言有害内容检测效果,尤其对资源少的语言更有效。
Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classification
- 先翻译文本再分类,比直接用原语言模型更有效。
- 在16种语言中,翻译方法在13种上表现更好,且与翻译质量相关。
- 适合做大规模跨语言内容审核,尤其低资源语言场景。
多语言有害内容检测因多数语言缺乏训练数据而面临挑战。本文系统比较了基于翻译的分类与语言特定/多语言模型的方法。结果表明,在16种语言中的13种(81.3%)情况下,翻译类方法优于分布外分类器,其效果与目标语言资源水平和机器翻译质量高度相关。传统分类器在多数情况下优于大语言模型判别器,尤其在低资源语言中优势显著——在7种语言中,翻译-分类组合胜过翻译-判别组合6次。此外,针对机器翻译微调的大模型拒绝率更低,但可能降低低资源语言的检测准确率。研究为构建可扩展的多语言内容审核系统提供了实用指导。
原文摘要 · Abstract (English)
Multilingual toxicity detection remains a significant challenge due to the scarcity of training data and resources for many languages. While prior work has leveraged the translate-test paradigm to support cross-lingual transfer across a range of classification tasks, the utility of translation in supporting toxicity detection at scale remains unclear. In this work, we conduct a comprehensive comparison of translation-based and language-specific/multilingual classification pipelines. We find that translation-based pipelines consistently outperform out-of-distribution classifiers in 81.3% of cases (13 of 16 languages), with translation benefits strongly correlated with both the resource level of the target language and the quality of the machine translation (MT) system. Our analysis reveals that traditional classifiers outperform large language model (LLM) judges, with this advantage being particularly pronounced for low-resource languages, where translate-classify methods dominate translate-judge approaches in 6 out of 7 cases. We additionally show that MT-specific fine-tuning on LLMs yields lower refusal rates compared to standard instruction-tuned models, but it can negatively impact toxicity detection accuracy for low-resource languages. These findings offer actionable guidance for practitioners developing scalable multilingual content moderation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。