arXiv:2511.00988cs.CL2025-11NeurIPS被引 2

用简单监督提升复杂文本生成检测,解决标签模糊问题。

Advancing Machine-Generated Text Detection from an Easy to Hard Supervision Perspective

  • 用较弱但稳定的监督模型,反向优化强检测器。
  • 在跨LLM、跨领域等场景下,检测准确率显著提升。
  • 适合需要高鲁棒性检测的文本安全与内容审核场景。

现有机器生成文本(MGT)检测方法隐含假设标签为“黄金标准”,但我们发现此类检测存在边界模糊性,传统训练范式因此不精确。人类认知局限与检测器超智能导致不精确学习普遍存在且不可避免。为此,我们提出从易到难的增强框架,在不精确条件下提供可靠监督。不同于知识蒸馏,该框架采用针对较长文本检测任务的简易监督模型(虽能力较弱),以提升更复杂的主检测器。首先,长文本监督理论上可缓解不精确标签的影响,奠定可靠监督基础;其次,通过将检测器结构化嵌入监督器,理论建模监督器为检测器性能下界,从而间接优化检测器,逼近潜在的“黄金”标签。在跨大语言模型、跨领域、混合文本及改写攻击等多种实际场景的大量实验表明,该框架检测效果显著。代码已开源:https://github.com/tmlr-group/Easy2Hard。

原文摘要 · Abstract (English)

Existing machine-generated text (MGT) detection methods implicitly assume labels as the "golden standard". However, we reveal boundary ambiguity in MGT detection, implying that traditional training paradigms are inexact. Moreover, limitations of human cognition and the superintelligence of detectors make inexact learning widespread and inevitable. To this end, we propose an easy-to-hard enhancement framework to provide reliable supervision under such inexact conditions. Distinct from knowledge distillation, our framework employs an easy supervisor targeting relatively simple longer-text detection tasks (despite weaker capabilities), to enhance the more challenging target detector. Firstly, longer texts targeted by supervisors theoretically alleviate the impact of inexact labels, laying the foundation for reliable supervision. Secondly, by structurally incorporating the detector into the supervisor, we theoretically model the supervisor as a lower performance bound for the detector. Thus, optimizing the supervisor indirectly optimizes the detector, ultimately approximating the underlying "golden" labels. Extensive experiments across diverse practical scenarios, including cross-LLM, cross-domain, mixed text, and paraphrase attacks, demonstrate the framework's significant detection effectiveness. The code is available at: https://github.com/tmlr-group/Easy2Hard.

文本检测机器生成监督学习鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。