arXiv:2509.18880cs.CLcs.AI2025-09中稿 · Transactions on Ma…被引 8

通过分析文本不可预测性波动,提升AI生成文本检测精度与可解释性。

Diversity Boosts AI-Generated Text Detection

  • 基于意外度特征捕捉文本中词汇与结构的不可预测性变化
  • 零样本检测性能比现有方法最高提升33.2%,对抗改写和攻击仍有效
  • 提供可解释的判别依据,适合需要透明检测的教育与媒体场景

检测AI生成文本在教育、合规、新闻与社交媒体中日益重要,以应对高仿真内容掩盖虚假信息或欺骗行为的风险。现有检测方法多依赖词元级概率或黑箱分类器,难以应对高质量生成内容且缺乏可解释性。本文提出DivEye框架,利用基于意外度的特征捕捉文本中不可预测性的动态变化。我们观察到人类写作在词汇与结构不可预测性上具有更丰富的变异性,而大模型输出则相对一致。DivEye通过一组可解释的统计特征提取这一信号。实验表明,该方法在多个基准上超越现有零样本检测器最高达33.2%的性能,媲美微调基线,并对改写和对抗攻击具备鲁棒性,跨领域与模型泛化能力强;作为辅助信号使用时,可使现有检测器性能提升最高18.7%。此外,DivEye还能提供可解释的判别依据,揭示节奏性不可预测性是潜在但未被充分挖掘的检测信号。

原文摘要 · Abstract (English)

Detecting AI-generated text is an increasing necessity to combat misuse of LLMs in education, business compliance, journalism, and social media, where synthetic fluency can mask misinformation or deception. While prior detectors often rely on token-level likelihoods or opaque black-box classifiers, these approaches struggle against high-quality generations and offer little interpretability. In this work, we propose DivEye, a novel detection framework that captures how unpredictability fluctuates across a text using surprisal-based features. Motivated by the observation that human-authored text exhibits richer variability in lexical and structural unpredictability than LLM outputs, DivEye captures this signal through a set of interpretable statistical features. Our method outperforms existing zero-shot detectors by up to 33.2% and achieves competitive performance with fine-tuned baselines across multiple benchmarks. DivEye is robust to paraphrasing and adversarial attacks, generalizes well across domains and models, and improves the performance of existing detectors by up to 18.7% when used as an auxiliary signal. Beyond detection, DivEye provides interpretable insights into why a text is flagged, pointing to rhythmic unpredictability as a powerful and underexplored signal for LLM detection.

文本检测可解释性大模型安全意外度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。