arXiv:2606.02158cs.CL2026-06中稿 · ICML

通过关注低概率词的不确定性,提升AI文本检测的准确性和鲁棒性。

On the Salience of Low-Probability Tokens for AI-Generated Text Detection: A Multiscale Uncertainty Perspective

论文配图:On the Salience of Low-Probability Tokens for AI-Generated Text Detection: A Multiscale Uncertainty Perspective
图 1 · 摘自论文原文
  • 聚焦低概率词的多尺度不确定性建模,减少通用词干扰。
  • 在7个数据集、16个模型上验证,检测效果显著且稳定。
  • 适合需要高可靠性检测的场景,如学术审查与信息防控。

AI生成文本日益接近人类写作,带来虚假信息、学术滥用和语料污染等风险。尽管统计检测方法在效率和泛化上具有吸引力,但存在两大局限:(i) 通用模板主导,人类与大模型共用的高频词掩盖了区分信号;(ii) 脆弱的点估计,依赖单一概率值在对抗扰动下易失效。为此,我们提出Uncertainty,一种基于多尺度不确定性的检测器,专注于具有判别力的低概率词。局部上,通过平均低概率词的对数概率缓解通用模板影响;全局上,利用Rényi熵捕捉低概率区域的分布形态,降低脆弱性。进一步通过条件独立采样扩展为Uncertainty++,实现更稳定的不确定性估计。在七个数据集和十六个LLM上的实验表明,该方法具备高效性、泛化性与鲁棒性。代码已开源:https://github.com/guoyikai2000/Uncertainty-AIGT。

原文摘要 · Abstract (English)

AI-generated text increasingly blends with human writing, raising practical risks such as misinformation, academic misuse, and corpora contamination. While statistical detectors are appealing for efficiency and generalization, they suffer from two key limitations. (i) Boilerplate dominance, boilerplate tokens shared across human and LLM writing can overwhelm discriminative signals. (ii) Brittle point estimates, relying on a single probability score yields unstable decisions under adversarial manipulations. To address these issues, we propose Uncertainty, a multiscale uncertainty estimator that focuses on informative low-probability tokens, which more clearly expose distributional discrepancies. Locally, it alleviates boilerplate dominance by averaging the log-probabilities of low-probability tokens; globally, it reduces brittleness by capturing the distributional shape of this low-probability region via Rényi entropy. We further extend the detector to Uncertainty++ via conditional independent sampling, yielding a more stable uncertainty estimation. Experiments across seven datasets and sixteen LLMs demonstrate high effectiveness, generalization, and robustness. Our code is available at https://github.com/guoyikai2000/Uncertainty-AIGT.

AI检测不确定性低概率词文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。