将人类文本视为异常值,用分布外检测更精准识别大模型生成内容。
Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detection

- 把文本检测重构为分布外识别,认为人类写作是离群点,机器生成是正常分布。
- 在DeepFake数据集上达98.3% AUROC,FPR95仅8.9%,性能显著超越传统方法。
- 适用于多语言、对抗样本及未见过的模型/领域,通用性强,适合实际部署。
大语言模型(如ChatGPT、DeepSeek、Claude)的快速发展使AI生成文本在数字交流中日益普遍,亟需可靠检测手段区分人写与机写内容。现有方法多将此任务视为二分类问题,但常因假设人类文本具统一分布而泛化能力差。本文指出,人类文本实际分布多样且难以采样覆盖,导致模型记忆特定离群特征而非本质规律。为此,我们提出将检测任务重新建模为分布外(OOD)检测:以机器生成文本为分布内(ID),人类文本为分布外异常。基于此,我们采用单类学习(DeepSVDD、HRN)与基于能量的方法构建框架,在多个数据集上验证其有效性。实验显示,该方法在DeepFake数据集上达到98.3% AUROC和AUPR,FPR95仅为8.9%。进一步测试表明,该框架在多语言、对抗攻击、未知模型与领域场景下均表现稳健,具备强泛化能力。代码、预训练权重与演示将公开发布。
原文摘要 · Abstract (English)
The rapid advancement of large language models (LLMs) such as ChatGPT, DeepSeek, and Claude has significantly increased the presence of AI-generated text in digital communication. This trend has heightened the need for reliable detection methods to distinguish between human-authored and machine-generated content. Existing approaches both zero-shot methods and supervised classifiers largely conceptualize this task as a binary classification problem, often leading to poor generalization across domains and models. In this paper, we argue that such a binary formulation fundamentally mischaracterizes the detection task by assuming a coherent representation of human-written texts. In reality, human texts do not constitute a unified distribution, and their diversity cannot be effectively captured through limited sampling. This causes previous classifiers to memorize observed OOD characteristics rather than learn the essence of `non-ID' behavior, limiting generalization to unseen human-authored inputs. Based on this observation, we propose reframing the detection task as an out-of-distribution (OOD) detection problem, treating human-written texts as distributional outliers while machine-generated texts are in-distribution (ID) samples. To this end, we develop a detection framework using one-class learning method including DeepSVDD and HRN, and score-based learning techniques such as energy-based method, enabling robust and generalizable performance. Extensive experiments across multiple datasets validate the effectiveness of our OOD-based approach. Specifically, the OOD-based method achieves 98.3% AUROC and AUPR with only 8.9% FPR95 on DeepFake dataset. Moreover, we test our detection framework on multilingual, attacked, and unseen-model and -domain text settings, demonstrating the robustness and generalizability of our framework. Code, pretrained weights, and demo will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。