大模型小模型协作迭代,提升突发假新闻识别准确率。
Collaborative Evolution: Multi-Round Learning Between Large and Small Language Models for Emergent Fake News Detection
- 大模型与小模型多轮协作,动态获取最新事实证据
- 在Pheme和Twitter16数据集上分别提升7.4%和12.8%准确率
- 适合需要快速响应新假新闻的舆情监测场景
社交媒体上假新闻泛滥已对社会产生显著影响。传统小语言模型(SLMs)依赖大量标注数据且难以适应快速变化的语境;大语言模型(LLMs)虽具备零样本能力,却因缺乏相关示例和知识动态性而难有效识别假新闻。本文提出多轮协作检测框架MRCD,融合大模型的泛化能力与小模型的专业功能。该框架采用两阶段检索模块,筛选相关且实时的示例与知识,增强上下文学习效果;并设计多轮学习机制以确保检测结果可靠性。在真实数据集Pheme和Twitter16上,相比仅使用SLMs,MRCD分别实现7.4%和12.8%的准确率提升,显著优于现有方法。
原文摘要 · Abstract (English)
The proliferation of fake news on social media platforms has exerted a substantial influence on society, leading to discernible impacts and deleterious consequences. Conventional deep learning methodologies employing small language models (SLMs) suffer from the necessity for extensive supervised training and the challenge of adapting to rapidly evolving circumstances. Large language models (LLMs), despite their robust zero-shot capabilities, have fallen short in effectively identifying fake news due to a lack of pertinent demonstrations and the dynamic nature of knowledge. In this paper, a novel framework Multi-Round Collaboration Detection (MRCD) is proposed to address these aforementioned limitations. The MRCD framework is capable of enjoying the merits from both LLMs and SLMs by integrating their generalization abilities and specialized functionalities, respectively. Our approach features a two-stage retrieval module that selects relevant and up-to-date demonstrations and knowledge, enhancing in-context learning for better detection of emerging news events. We further design a multi-round learning framework to ensure more reliable detection results. Our framework MRCD achieves SOTA results on two real-world datasets Pheme and Twitter16, with accuracy improvements of 7.4\% and 12.8\% compared to using only SLMs, which effectively addresses the limitations of current models and improves the detection of emergent fake news.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。