arXiv:2607.12336cs.CLcs.AI2026-07

用小模型检测孟加拉语健康谣言,兼顾文化敏感性。

Evaluating Health Misinformation in Low-Resource Languages: Integrating Small Language Models with a Culturally-Sensitive Responsible NLP Framework (Bangla as a Case Study)

论文配图:Evaluating Health Misinformation in Low-Resource Languages: Integrating Small Language Models with a Culturally-Sensitive Responsible NLP Framework (Bangla as a Case Study)
图 1 · 摘自论文原文
  • 选用小语言模型,在孟加拉语数据上测试谣言识别效果。
  • Phi-4 模型在提取声明时达到最佳精确率与召回率平衡。
  • 构建负责任NLP框架,融合文化敏感与危害评估,适合低资源语言场景。

人工智能虽推动社交媒体与数字健康服务发展,却也同时助长信息谬误传播。在非英语语境及低收入群体中,因数据稀缺导致AI模型难以有效检测虚假信息,使文化语言多样性(CALD)社区难以获取可信健康资讯。现有工具因缺乏训练数据且忽略语言细微差别而表现不佳。本研究提出一种面向CALD人群的健康谣言检测系统,并开发医生可用的分析仪表板。通过使用孟加拉语翻译的谣言数据集,评估多种小语言模型(SLMs)性能。结果显示,Phi-4在声明提取任务中表现最优,兼具高精度与高召回率。为进一步克服SLMs局限,设计并验证了一种基于负责任自然语言处理(Responsible NLP)的新型检测框架,整合文化敏感性、潜在危害与沟通质量维度,为低资源语言中的谣言评估提供全面视角。

原文摘要 · Abstract (English)

Artificial Intelligence (AI) technologies, while serving as a foundational enabler for modern social media and digital health services, exert a bivalent effect by simultaneously acting as a combatant against and a spread vector for misinformation. A prevalent challenge in mitigating this issue arises in non-English contexts and low socioeconomic classes, where limited data hinders the training of AI models for effective detection. Consequently, culturally and linguistically diverse (CALD) communities struggle to access trustworthy health information through AI-driven tools. Current AI tools underperform due to a lack of training data and are largely unable to consider language nuances and traditions in non-English contexts. This research addresses these gaps by proposing a CALD-friendly AI-based health misinformation detector and providing a dashboard for medical professionals to analyse this misinformation, a critical step toward mitigating a growing concern among CALD populations. To this end, we conduct a series of experiments using a Bangla-translated health misinformation dataset to evaluate the performance of various Small Language Models (SLMs). SLMs are particularly relevant in this context given the frequent underperformance of Large Language Models (LLMs), which often stems from insufficient domain-specific knowledge and the prohibitive costs of resource-intensive fine-tuning. The results demonstrate that Phi-4 is the superior model, achieving an ideal balance between precision and recall in claim extraction. Then, to mitigate the limitations of SLMs, we design and test a novel health misinformation detection framework grounded in Responsible Natural Language Processing (NLP), which incorporates cultural sensitivity, potential for harm, and communication quality, thereby providing a holistic lens for evaluating misinformation in low-resource languages.

健康信息小模型文化敏感低资源语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。