用多个AI观察者协同检测伪造文本,提升识别鲁棒性。
MOSAIC: Multiple Observers Spotting AI Content
- 集成多个大模型的判断结果,替代单一模型检测。
- 在多种生成模型和领域上均实现高精度检测。
- 适合需要可靠内容审核的平台或研究者使用。
大规模训练的大型语言模型(LLMs)具备强大的文本生成能力,使得制造有害、有毒、虚假或伪造内容变得愈发容易。为此,已有诸多方法尝试自动区分人工撰写与机器生成的文本,通常将其视为二分类问题。早期方法通过特定检测模型评估输入文档的困惑度,认为低困惑度可指示机器生成内容。近期系统则引入两个模型,比较其对文档的概率分布差异以增强判别力,但固定模型对易导致性能脆弱。本文扩展该思路,采用多个模型的集成策略,并提出一种理论基础坚实的融合方法,有效结合各模型优势。实验表明,该方法在不同生成模型和多个领域中均表现出稳健的检测性能。代码与数据已公开于 https://github.com/BaggerOfWords/MOSAIC。
原文摘要 · Abstract (English)
The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have been made to automatically discriminate artificially generated from human-written texts, typically framing the problem as a binary classification problem. Early approaches evaluate an input document with a well-chosen detector LLM, assuming that low-perplexity scores reliably signal machine-made content. More recent systems instead consider two LLMs and compare their probability distributions over the document to further discriminate when perplexity alone cannot. However, using a fixed pair of models can induce brittleness in performance. We extend these approaches to the ensembling of several LLMs and derive a new, theoretically grounded approach to combine their respective strengths. Our experiments, conducted with various generator LLMs, indicate that this approach effectively leverages the strengths of each model, resulting in robust detection performance across multiple domains. Our code and data are available at https://github.com/BaggerOfWords/MOSAIC .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。