arXiv:2607.03680cs.LGcs.CL2026-07

简单微调的RoBERTa模型已能超越复杂检测器,但跨领域时性能骤降。

Rethinking AI-Generated Text Detection: A Strong Baseline and the Distribution-Shift Problem That Remains

  • 用全微调RoBERTa作为基线,效果优于专用检测器。
  • 换领域或生成模型后,基线模型准确率大幅下降。
  • 轻量级自适应方法可缓解分布偏移问题,适合实际部署场景。

近期的AI生成文本检测研究常伴随新基准与定制化检测器。本文从基线优先视角重新审视这一做法。在多个基准上,我们发现一个完全微调的RoBERTa模型表现与这些基准所依赖的专用检测器相当甚至更优,表明当前架构复杂性并非推动高精度检测的关键因素。真正挑战在于分布偏移:同一强基线模型在测试时若遇到不同主题领域或生成模型,性能急剧下降;单纯增加源数据也无法弥补差距。我们识别出关键失败模式——在分布偏移下,检测器会以高置信度将未见领域的真人文本误判为机器生成。为此,我们探索两种轻量级领域自适应方法:基于LoRA适配器的一阶MAML K-shot微调,以及基于自适应检测器构建的样本级置信加权集成。结果表明,未来检测进展应同时关注分布内表现与分布外鲁棒性。

原文摘要 · Abstract (English)

Recent AI-generated text detection work often introduces a new benchmark together with a specialized detector tailored to it. We revisit this practice from a baseline-first perspective. Across several benchmarks, we show that a plain, fully fine-tuned RoBERTa matches or exceeds the specialized detectors those benchmarks are built around. This suggests that much of the recent architectural complexity is not what drives strong in-distribution detection. The remaining challenge is the distribution shift. The same strong baseline degrades sharply when the topic domain or generating model changes at test time, and simply adding more source data does not close the gap. We identify a key failure mode: under distribution shift, the detector can assign high-confidence machine labels to human-written text from unseen domains. We then study two lightweight domain adaptation methods to address this problem: $K$-shot adaptation with first-order MAML over LoRA adapters, and a per-sample confidence-weighted ensemble built on top of the adapted detector. Overall, our results suggest that progress in AI-generated text detection should be measured not only by in-distribution performance, but also by robustness under distribution shift.

文本检测分布偏移领域自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。