用大模型对抗性改写情绪,提升假新闻检测的鲁棒性
Robust Fake News Detection using Large Language Models under Adversarial Sentiment Attacks
- 用大模型生成可控情绪扰动样本,模拟攻击场景
- 情绪变化使检测准确率下降超30%,暴露模型偏见
- 提出无情绪依赖训练法,对新数据和攻击都更稳定
虚假信息已成为严峻的社会挑战,亟需可靠的自动化检测方法。以往研究指出情绪是假新闻检测的重要信号,但这一特性也带来漏洞——攻击者可利用大语言模型(LLMs)操纵文章情绪以规避检测。现有研究多关注写作风格等特征,却未深入探讨情绪操控带来的威胁。本文系统研究了先进假新闻检测模型在情绪篡改下的鲁棒性,提出AdSent框架,确保原文与情绪修改后内容的判断一致。具体包括:(1) 设计基于大模型的可控情绪对抗攻击方法;(2) 分析情绪转变对检测性能的影响,发现模型严重偏向中性文本为真实,非中性文本常被误判为假新闻;(3) 提出新型无情绪依赖训练策略,增强抗扰能力。在三个基准数据集上的大量实验表明,AdSent在准确率和鲁棒性上显著优于基线方法,并能有效泛化至未见数据集与对抗场景。
原文摘要 · Abstract (English)
Misinformation and fake news have become a pressing societal challenge, driving the need for reliable automated detection methods. Prior research has highlighted sentiment as an important signal in fake news detection, either by analyzing which sentiments are associated with fake news or by using sentiment and emotion features for classification. However, this poses a vulnerability since adversaries can manipulate sentiment to evade detectors especially with the advent of large language models (LLMs). A few studies have explored adversarial samples generated by LLMs, but they mainly focus on stylistic features such as writing style of news publishers. Thus, the crucial vulnerability of sentiment manipulation remains largely unexplored. In this paper, we investigate the robustness of state-of-the-art fake news detectors under sentiment manipulation. We introduce AdSent, a sentiment-robust detection framework designed to ensure consistent veracity predictions across both original and sentiment-altered news articles. Specifically, we (1) propose controlled sentiment-based adversarial attacks using LLMs, (2) analyze the impact of sentiment shifts on detection performance. We show that changing the sentiment heavily impacts the performance of fake news detection models, indicating biases towards neutral articles being real, while non-neutral articles are often classified as fake content. (3) We introduce a novel sentiment-agnostic training strategy that enhances robustness against such perturbations. Extensive experiments on three benchmark datasets demonstrate that AdSent significantly outperforms competitive baselines in both accuracy and robustness, while also generalizing effectively to unseen datasets and adversarial scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。