arXiv:2607.02734cs.CLcs.AI2026-07中稿 · publication as a b…

用多模态NLP提前预警假新闻与群体暴力,准确率达98%

Echoes of Unrest: A Multimodal NLP Framework for Early Warning of Fake News and Violence-Driven Mob Activity

论文配图:Echoes of Unrest: A Multimodal NLP Framework for Early Warning of Fake News and Violence-Driven Mob Activity
图 1 · 摘自论文原文
  • 融合文本、图像与地理信息,用XLM-RoBERTa和CLIP建模
  • 在30%测试集上达到98%准确率,精度与召回均强
  • 适合关注社会安全与舆情监测的研究者与机构

社交媒体的快速发展虽促进了信息传播,但也加速了虚假信息扩散。假新闻、篡改内容和煽动性叙事正日益关联社会动荡、政治不稳定及群体暴力。南亚等地的案例显示,通过Facebook和WhatsApp传播的虚假信息常引发现实危害,且传播速度远超事实核查能力。为此,本文提出一种多语言、多模态自然语言处理框架,用于早期识别虚假信息与暴力倾向动态。通过整合多个基准数据集,构建包含138,256条孟加拉语和英语样本的融合数据集。框架采用XLM-RoBERTa进行多语言文本表示,CLIP生成视觉嵌入,并结合多头注意力机制实现多模态融合,辅以讽刺语气和地理空间元数据等特征。在分层抽样的30%子集上,测试准确率达98%,展现出多模态方法在早期虚假信息检测中的有效性,同时证实地理空间信号对预判现实升级具有额外价值。

原文摘要 · Abstract (English)

Rapid growth in social media has transformed global communication by enabling fast information exchange, but it has also accelerated the spread of misinformation. Fake news, manipulated content, and provocative narratives are increasingly linked to social unrest, political instability, and mob violence. Incidents in South Asia and elsewhere demonstrate how false information disseminated via platforms such as Facebook and WhatsApp can trigger real-world harm, often spreading faster than fact-checking efforts can respond. To address this challenge, this chapter presents a multilingual, multimodal Natural Language Processing (NLP) framework for early detection of misinformation and violence-prone dynamics. A fused dataset of 138,256 Bangla and English samples was created by combining multiple benchmark datasets. The framework integrates XLM-RoBERTa for multilingual text representation, CLIP for visual embedding, and a multi-head attention mechanism for multimodal fusion, enhanced with auxiliary features such as sarcasm and geospatial metadata. Experiments on a stratified 30% subset achieved 98% test accuracy with strong precision and recall. The outcomes show the efficacy of multimodal approaches in early misinformation detection and highlight the added value of geospatial signals for anticipating real-world escalation.

多模态NLP虚假信息检测社会安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。