用符号对抗训练模拟假新闻生成与检测的动态博弈。
A Symbolic Adversarial Learning Framework for Evolving Fake News Generation and Detection
- 以自然语言操作权重和梯度,实现非神经网络的符号化对抗训练。
- 生成的假新闻使现有检测模型性能下降最高达53.4%(中文)。
- 适合研究抗欺骗检测、安全可控生成的学者参考。
大语言模型的快速发展加剧了虚假新闻的生成风险,其内容日益复杂且动态演变。传统检测方法如微调的小型模型或基于LLM的检测器,难以应对这种演化特性。本文提出符号对抗学习框架(SALF),通过代理符号学习优化过程实现对抗训练,而非依赖数值更新。生成代理构建误导性叙事,检测代理则通过结构化辩论识别逻辑与事实漏洞,二者通过对抗交互持续迭代优化。不同于传统神经更新,我们采用符号化代理学习:可学习参数由代理提示词定义,并通过操作权重、损失和梯度的自然语言表示来模拟反向传播与梯度下降。在两个多语言基准数据集上的实验表明,SALF生成的假新闻使主流检测系统性能平均下降53.4%(中文)和34.2%(英文)。同时,检测代理经迭代优化后,对新生成内容的检测能力提升最高达7.7%。本工作旨在推动更鲁棒、自适应的虚假新闻检测体系发展。
原文摘要 · Abstract (English)
Rapid LLM advancements heighten fake news risks by enabling the automatic generation of increasingly sophisticated misinformation. Previous detection methods, including fine-tuned small models or LLM-based detectors, often struggle with its dynamically evolving nature. In this work, we propose a novel framework called the Symbolic Adversarial Learning Framework (SALF), which implements an adversarial training paradigm by an agent symbolic learning optimization process, rather than relying on numerical updates. SALF introduces a paradigm where the generation agent crafts deceptive narratives, and the detection agent uses structured debates to identify logical and factual flaws for detection, and they iteratively refine themselves through such adversarial interactions. Unlike traditional neural updates, we represent agents using agent symbolic learning, where learnable weights are defined by agent prompts, and simulate back-propagation and gradient descent by operating on natural language representations of weights, loss, and gradients. Experiments on two multilingual benchmark datasets demonstrate SALF's effectiveness, showing it generates sophisticated fake news that degrades state-of-the-art detection performance by up to 53.4% in Chinese and 34.2% in English on average. SALF also refines detectors, improving detection of refined content by up to 7.7%. We hope our work inspires further exploration into more robust, adaptable fake news detection systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。