arXiv:2608.24780cs.CL2026-08

用简单线性探测器高效识别机器生成文本,效果优于主流方法。

Linear Probing Provides Robust and Efficient Detection of Machine-Generated Text

论文配图:Linear Probing Provides Robust and Efficient Detection of Machine-Generated Text
图 1 · 摘自论文原文
  • 通过低维空间线性可分性设计简单线性探测器。
  • 仅需少于100样本即达近峰值性能,跨域检测提升11 AUC。
  • 能捕捉文本“机器感”连续谱,适合细粒度检测场景。

由于潜在滥用风险,区分机器生成文本(MGT)与人类撰写文本(HWT)变得日益重要。然而,多数监督式检测器在跨域(OOD)场景下表现下降,且需要大量多样数据训练。本文分析MGT与HWT表征的线性特性与质量差异,发现二者在低维空间中具有线性可分性,并给出可解释原因。基于此,我们训练两种简单线性探测器,在4个基准上对比16种基线模型。探测器在跨域检测中持续提升11 AUC,仅需少于100样本即可接近最优性能。其泛化能力源于恢复共享的机器生成文本潜在方向。此外,探测向量可刻画从人类到机器生成文本的连续“机器感”谱,具备细粒度估计潜力。本工作揭示了两类文本在隐空间的差异,展示了线性探测器作为鲁棒、高效检测器的前景。代码已开源。

原文摘要 · Abstract (English)

Distinguishing machine-generated text (MGT) from human-written text (HWT) becomes increasingly important due to potential misuse. However, most supervised detectors often degrade out-of-domain (OOD) and require large, diverse training sets. In this work, we analyze the linearity and quality of MGT representations and show that simple linear probes outperform a wide range of detectors while being substantially more sample-efficient. We first show that MGT and HWT latent representations are linearly separable in low-dimensional space, and provide a plausible explanation for this separability through systematic differences in their representation quality. Motivated by these insights, we train two variants of simple linear probes and evaluate them across 4 benchmarks against 16 baselines. Probes consistently improve OOD detection (+11 AUC), requiring solely ${<}100$ samples to reach near-peak performance. We show that this transferability arises because probes recover a shared latent MGT direction that generalizes across diverse settings. Finally, we demonstrate that probing vectors capture a continuous spectrum of ``machineness'', highlighting their potential for fine-grained estimation of AI-edited text. Overall, our work provides insights into latent-space differences between MGT and HWT and demonstrates the potential of linear probes as as robust and sample-efficient MGT detectors. We release our code on~\href{https://github.com/gerritq/mgt_probes}{github}.

文本检测线性探测机器生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。