用大模型生成针对反疫苗推文的有效反驳,提升辟谣效率。
Utilising Large Language Models for Generating Effective Counter Arguments to Anti-Vaccine Tweets
- 通过提示工程与微调优化大模型反驳生成
- 多标签分类让反驳更贴合具体质疑点
- 人类与模型评估一致,适合公共卫生应用
在社交媒体影响公共健康的背景下,应对疫苗怀疑论和虚假信息已成为关键社会目标。疫苗相关误导性叙事广泛传播,阻碍高接种率实现并削弱对健康建议的信任。尽管虚假信息检测已有进展,但实时生成针对性反驳仍研究不足。本文探索大语言模型(LLM)生成有效反驳的能力。基于现有辟谣研究,我们测试了多种提示策略与微调方法以优化反驳生成,并训练分类器将反疫苗推文分为多标签类别,如对疫苗有效性、副作用及政治因素的担忧,从而生成更具上下文感知的反驳。通过人工评估、基于LLM的判断和自动指标进行评估,结果在不同方法间高度一致。研究表明,结合标签描述与结构化微调可显著提升反驳效果,为规模化缓解疫苗虚假信息提供了可行路径。
原文摘要 · Abstract (English)
In an era where public health is increasingly influenced by information shared on social media, combatting vaccine skepticism and misinformation has become a critical societal goal. Misleading narratives around vaccination have spread widely, creating barriers to achieving high immunisation rates and undermining trust in health recommendations. While efforts to detect misinformation have made significant progress, the generation of real time counter-arguments tailored to debunk such claims remains an insufficiently explored area. In this work, we explore the capabilities of LLMs to generate sound counter-argument rebuttals to vaccine misinformation. Building on prior research in misinformation debunking, we experiment with various prompting strategies and fine-tuning approaches to optimise counter-argument generation. Additionally, we train classifiers to categorise anti-vaccine tweets into multi-labeled categories such as concerns about vaccine efficacy, side effects, and political influences allowing for more context aware rebuttals. Our evaluation, conducted through human judgment, LLM based assessments, and automatic metrics, reveals strong alignment across these methods. Our findings demonstrate that integrating label descriptions and structured fine-tuning enhances counter-argument effectiveness, offering a promising approach for mitigating vaccine misinformation at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。