不需训练就能识别AI生成文本,通过分析词元概率的时序变化提升检测效果。
Training-free LLM-generated Text Detection by Mining Token Probability Sequences
- 结合局部与全局统计特征,用时间序列分析捕捉词元概率动态变化。
- 在六个数据集上跨领域、跨模型检测准确率领先,黑箱白箱均表现稳定。
- 对改写攻击更鲁棒,适合需要快速部署的文本真实性验证场景。
大型语言模型在多领域生成高质量文本方面表现出色,但其潜在滥用引发广泛关注,亟需可靠的生成文本检测方法。传统基于训练的检测器泛化能力差,尤其在跨领域和跨模型场景下表现不佳。相比之下,无需训练的方法通过设计精细的统计特征,具备更强的泛化性和可解释性。然而,现有方法多依赖全局文本统计,忽视局部判别特征,限制了检测性能。本文提出一种新型无训练检测器Lastde,首次将时间序列分析引入生成文本检测,捕捉词元概率序列的时序动态。通过融合局部与全局统计特征,该方法显著揭示人类与大模型生成文本间的差异。我们还提出了高效版本Lastde++,支持实时检测。在六个数据集上的广泛实验表明,该方法在跨领域、跨模型、跨语言场景下,无论白盒还是黑盒设置,均持续达到最优性能。此外,相比基线方法,本方法对改写攻击具有更强鲁棒性。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities in generating high-quality texts across diverse domains. However, the potential misuse of LLMs has raised significant concerns, underscoring the urgent need for reliable detection of LLM-generated texts. Conventional training-based detectors often struggle with generalization, particularly in cross-domain and cross-model scenarios. In contrast, training-free methods, which focus on inherent discrepancies through carefully designed statistical features, offer improved generalization and interpretability. Despite this, existing training-free detection methods typically rely on global text sequence statistics, neglecting the modeling of local discriminative features, thereby limiting their detection efficacy. In this work, we introduce a novel training-free detector, termed \textbf{Lastde} that synergizes local and global statistics for enhanced detection. For the first time, we introduce time series analysis to LLM-generated text detection, capturing the temporal dynamics of token probability sequences. By integrating these local statistics with global ones, our detector reveals significant disparities between human and LLM-generated texts. We also propose an efficient alternative, \textbf{Lastde++} to enable real-time detection. Extensive experiments on six datasets involving cross-domain, cross-model, and cross-lingual detection scenarios, under both white-box and black-box settings, demonstrated that our method consistently achieves state-of-the-art performance. Furthermore, our approach exhibits greater robustness against paraphrasing attacks compared to existing baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。