arXiv:2607.21458cs.AIstat.ME2026-07

精准定位人机合写文本中大模型生成的词元,支持细粒度内容溯源。

Detecting LLM-Generated Tokens in Human--LLM Coauthored Text

论文配图:Detecting LLM-Generated Tokens in Human--LLM Coauthored Text
图 1 · 摘自论文原文
  • 基于词元级得分平滑与自适应带宽选择,实现局部作者身份检测。
  • 在合成与真实数据集上均优于现有方法,误差更低。
  • 无需标注数据即可部署,开源网站可实时检测文本来源。

人机协同写作的兴起催生了对细粒度检测方法的迫切需求,以定位混合作者文档中可能由大语言模型生成的内容。现有方法多聚焦于文档级别分类,无法识别具体生成片段。本文提出一种新型词元级检测方法,基于已有词元级检测分数,通过平滑相邻词元得分以降低波动性,并采用自适应Lepski型规则根据局部作者结构动态选择平滑带宽。该方法实现简单,无需词元级标注数据训练。理论上,我们刻画了这一权衡关系,证明所提方法在估计底层信号时具有更优的均方误差表现。实证上,我们在合成数据集和真实数据集上均展现出对多种基线方法的显著优势。同时,我们公开部署了一个可访问的网站,实现该方法的在线应用。

原文摘要 · Abstract (English)

The rise of human-AI collaborative writing has created a growing need for fine-grained detection methods that support localizing likely LLM-generated content in mixed-authorship documents. Existing methods for detecting LLM-generated text mainly focus on document-level classification and cannot identify which parts of the text are generated by LLMs. This paper introduces a new method to address this urgent need. Our method operates at the token level, the natural unit of modern language models, and builds on existing token-level detection scores. The key idea is to smooth adjacent token scores to reduce their variability, while using an adaptive Lepski-type rule to select the bandwidth according to the local authorship structure. Our method is simple to implement and does not require token-level labeled data for training. Theoretically, we characterize this trade-off and show that the proposed method achieves favorable mean square error performance in estimating the underlying signal. Empirically, we demonstrate strong performance of our method against a wide range of baselines in both synthetic datasets and a realistic dataset. We deploy a publicly accessible website that implements the methods as well.

文本检测大模型词元级人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。