用基因突变修复思路,精准识别AI生成文本
DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigm
- 借鉴基因修复机制,通过迭代优化文本片段来捕捉差异
- 在多个数据集上实现AUROC提升5.55%、F1提升2.08%
- 无需训练即可检测,对攻击和长度变化都具有强鲁棒性
大语言模型的快速发展使得人工智能生成文本与人类写作之间的界限日益模糊,带来了虚假信息、作者归属不清及知识产权等社会风险,亟需可靠的AI生成文本检测方法。然而,生成语言模型的进步导致人类写作与AI生成文本的特征分布高度重叠,分类边界模糊,检测难度增大。为此,我们提出一种受基因启发的视角,采用基于修复的过程,直接且可解释地捕捉二者之间的内在差异。在此基础上,我们构建了DNA-DetectLLM——一种零样本检测方法,为每个输入构造理想的AI生成序列,迭代修复非最优词元,并将累计修复努力作为可解释的检测信号。实证评估表明,该方法在多个公开基准数据集上达到当前最优检测性能,且对各类对抗攻击和输入长度变化表现出强鲁棒性。具体而言,相比现有方法,其在多数据集上实现5.55%的AUROC相对提升和2.08%的F1分数提升。代码与数据已公开于https://github.com/Xiaoweizhu57/DNA-DetectLLM。
原文摘要 · Abstract (English)
The rapid advancement of large language models (LLMs) has blurred the line between AI-generated and human-written text. This progress brings societal risks such as misinformation, authorship ambiguity, and intellectual property concerns, highlighting the urgent need for reliable AI-generated text detection methods. However, recent advances in generative language modeling have resulted in significant overlap between the feature distributions of human-written and AI-generated text, blurring classification boundaries and making accurate detection increasingly challenging. To address the above challenges, we propose a DNA-inspired perspective, leveraging a repair-based process to directly and interpretably capture the intrinsic differences between human-written and AI-generated text. Building on this perspective, we introduce DNA-DetectLLM, a zero-shot detection method for distinguishing AI-generated and human-written text. The method constructs an ideal AI-generated sequence for each input, iteratively repairs non-optimal tokens, and quantifies the cumulative repair effort as an interpretable detection signal. Empirical evaluations demonstrate that our method achieves state-of-the-art detection performance and exhibits strong robustness against various adversarial attacks and input lengths. Specifically, DNA-DetectLLM achieves relative improvements of 5.55% in AUROC and 2.08% in F1 score across multiple public benchmark datasets. Code and data are available at https://github.com/Xiaoweizhu57/DNA-DetectLLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。