用大模型+提示工程,不用训练就能识别社交网络中的有组织假信息
Network-informed Prompt Engineering against Organized Astroturf Campaigns under Extreme Class Imbalance
- 基于大模型和平衡检索生成,不依赖训练
- 在极端样本不平衡下,准确率提升2到3倍
- 适合反假信息、社交媒体安全领域研究者
识别有组织的政治宣传对遏制社交媒体上的虚假信息至关重要。现有方法多依赖网络科学、图机器学习和自然语言处理技术,通过分析用户间互动(如转发)及文本相似性来识别假信息活动。尽管有效,这些方法在实际数据中常面临严重的类别不平衡问题。传统解决方案如数据增强或增加正样本,在真实场景中往往不可行。本文提出一种全新框架,仅使用大语言模型(LLMs)识别假信息活动,引入平衡检索增强生成(Balanced RAG)组件。该框架将推文文本与用户社交网络交互信息作为输入,通过精心设计的提示工程与平衡检索生成机制,使模型在无训练情况下有效检测X(Twitter)平台上的协同虚假宣传。实验表明,结合提示工程与平衡检索生成后,本框架在精确率、召回率和F1分数上相较传统图基基线实现2至3倍提升。
原文摘要 · Abstract (English)
Detecting organized political campaigns is of paramount importance in fighting against disinformation on social media. Existing approaches for the identification of such organized actions employ techniques mostly from network science, graph machine learning and natural language processing. Their ultimate goal is to analyze the relationships and interactions (e.g. re-posting) among users and the textual similarities of their posts. Despite their effectiveness in recognizing astroturf campaigns, these methods face significant challenges, notably the class imbalance in available training datasets. To mitigate this issue, recent methods usually resort to data augmentation or increasing the number of positive samples, which may not always be feasible or sufficient in real-world settings. Following a different path, in this paper, we propose a novel framework for identifying astroturf campaigns based solely on large language models (LLMs), introducing a Balanced Retrieval-Augmented Generation (Balanced RAG) component. Our approach first gives both textual information concerning the posts (in our case tweets) and the user interactions of the social network as input to a language model. Then, through prompt engineering and the proposed Balanced RAG method, it effectively detects coordinated disinformation campaigns on X (Twitter). The proposed framework does not require any training or fine-tuning of the language model. Instead, by strategically harnessing the strengths of prompt engineering and Balanced RAG, it facilitates LLMs to overcome the effects of class imbalance and effectively identify coordinated political campaigns. The experimental results demonstrate that by incorporating the proposed prompt engineering and Balanced RAG methods, our framework outperforms the traditional graph-based baselines, achieving 2x-3x improvements in terms of precision, recall and F1 scores.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。