arXiv:2509.10737cs.CLcs.LG2025-09被引 4

对比五种多语言模型,测试跨语言假信息检测效果。

PolyTruth: Multilingual Disinformation Detection using Transformer-Based Language Models

  • 用五种多语言Transformer模型比较跨语言假信息识别能力。
  • 在60,486条跨25种语言的语料上,RemBERT在低资源语言表现最佳。
  • 公开数据集支持后续研究,适合关注多语言AI安全的团队。

假信息在语言间快速传播,但多数AI模型仍仅在英语上评估。本文系统比较了mBERT、XLM、XLM-RoBERTa、RemBERT和mT5五种多语言Transformer模型在统一真假文本分类任务中的表现。尽管这些模型在英语假信息检测中表现良好,其在多语言场景下的有效性仍有争议。为此,我们构建了PolyTruth Disinfo Corpus,包含60,486条陈述对(虚假声明与事实纠正),覆盖超过25种语言,涵盖五大语系及政治、健康、气候、金融和阴谋论等广泛主题,其中一半来自经增强的MindBugs Discovery数据集验证的假信息。实验显示性能差异显著:RemBERT整体准确率更高,尤其在低资源语言中表现突出;而mBERT和XLM在训练数据稀缺时表现明显受限。我们分析了这些模式及其对实际部署的影响。数据集已开源,鼓励进一步研究。研究揭示了当前多语言假信息检测系统的优势与局限。

原文摘要 · Abstract (English)

Disinformation spreads rapidly across linguistic boundaries, yet most AI models are still benchmarked only on English. We address this gap with a systematic comparison of five multilingual transformer models: mBERT, XLM, XLM-RoBERTa, RemBERT, and mT5 on a common fake-vs-true machine learning classification task. While transformer-based language models have demonstrated notable success in detecting disinformation in English, their effectiveness in multilingual contexts still remains up for debate. To facilitate evaluation, we introduce PolyTruth Disinfo Corpus, a novel corpus of 60,486 statement pairs (false claim vs. factual correction) spanning over twenty five languages that collectively cover five language families and a broad topical range from politics, health, climate, finance, and conspiracy, half of which are fact-checked disinformation claims verified by an augmented MindBugs Discovery dataset. Our experiments revealed performance variations. Models such as RemBERT achieved better overall accuracy, particularly excelling in low-resource languages, whereas models like mBERT and XLM exhibit considerable limitations when training data is scarce. We provide a discussion of these performance patterns and implications for real-world deployment. The dataset is publicly available on our GitHub repository to encourage further experimentation and advancement. Our findings illuminate both the potential and the current limitations of AI systems for multilingual disinformation detection.

假信息检测多语言Transformer数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。