arXiv:2608.09510cs.CLcs.AI2026-08

用迭代对抗测试暴露大模型伪造信息检测的漏洞。

Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media posts

论文配图:Build it, Break it, Repeat: Benchmarking and improving LLM-manipulated disinformation detection in social media posts
图 1 · 摘自论文原文
  • 设计循环对抗框架,模拟攻击者不断改写虚假内容。
  • 最优攻击使分类错误率达95%,仍保持原意不变。
  • 新构建模型比基线高15个百分点,适合安全研究者参考。

随着大语言模型(LLMs)普及,社交媒体上机器生成的误导性内容愈发难以识别。静态基准评估无法反映检测器在面对持续对抗性改写时的表现。本文提出迭代式‘建、破、再建’(BiBiR)框架,通过五轮对抗迭代,测试检测器在系统性逃避策略下的鲁棒性。最佳攻击方法结合回译与角色化重写,实现95%的标签翻转率(LFR),同时保持原始语义。最优生成模型采用三元组对比学习与动态锚点切换(DASS)架构,在最严苛的对抗攻击下达到72.68%平均准确率,优于微调e5-small-LoRA基线15个百分点。结果表明,迭代框架能有效暴露检测器弱点并推动鲁棒性提升;但需额外分析语义一致性,以区分真正对抗性规避与语义改变。

原文摘要 · Abstract (English)

Detecting machine-generated disinformation on social media is increasingly difficult as large language models (LLMs) make it easier to generate and rewrite misleading content at scale. Static benchmark evaluations, measuring detector performance on fixed held-out datasets, do not capture how detectors behave when posts are deliberately transformed to evade classification. This paper adapts the Build it, Break it, Fix it framework into Build it, Break it, Repeat (BiBiR): iterative sessions designed to stress-test detectors' robustness under iterative adversarial conditions, evaluating whether models remain reliable when disinformation posts are systematically transformed to evade classification. Across five iterations, the findings show that the best adversarial breakers' transformations came from a combination of back-translation and LLM persona-based rewriting, with the best performing technique achieving a 95% label flip rate (LFR), whilst still preserving the meaning of the original posts. The best builders' model was a triplet contrastive model with a dynamic anchor switching (DASS) architecture, which achieved an average accuracy of 72.68%, outperforming the strong baseline (a fine-tuned e5-small-LoRA) by 15 percentage points on the most robust set of breakers' adversarial attacks. The results demonstrate that an iterative framework best exposes detector weaknesses and pushes robustness improvements; however, it may still require semantic preservation analysis to distinguish valid adversarial evasion from transformations that changed the original disinformation claims' meaning.

对抗攻击信息检测大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。