发现机器生成文本中隐藏的人类写作特征,提升检测效果。
Hidden Human-Like Nature of Machine-Generated Texts: Theory and Detection Enhancement

- 将文本片段的保留决策建模为潜在变量,迭代过滤人类化片段。
- 在多个LLM和场景下,显著提升现有检测器性能。
- 无需训练即可部署,适合实际应用且扩展性强。
大型语言模型生成的机器生成文本(MGT)在各类应用中日益普遍,但其在虚假新闻传播和网络钓鱼中的滥用引发严重关切,亟需增强检测能力。现有段落级检测方法通常将MGT视为完全机器化,忽略了其中隐藏的人类写作特征:即使全由机器生成的文本也可能包含与人类写作风格高度一致的片段。本文首次揭示此类隐藏人类化片段的存在,并从理论上分析其对检测的影响:这些片段增加了检测的句子复杂度,使MGT检测本身更困难。基于此,我们提出一种模型无关的堆叠增强框架,通过减少隐藏人类化片段的影响来提升现有检测器性能。具体而言,将片段保留决策建模为潜在变量问题,并采用受硬-EM启发的优化流程,使检测器迭代地过滤出高置信度的人类化子序列,并在剩余文本上自我优化。大量实验表明,该框架在多种LLM及实际场景中均能持续提升检测效果。值得注意的是,该框架可实现无训练部署,兼具灵活性与可扩展性,适用于实际落地。
原文摘要 · Abstract (English)
Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the need for MGT detection. Existing paragraph-level detection methods commonly treat MGTs as entirely machine-like, overlooking the hidden human-like nature of machine-generated texts: even fully machine-generated texts may contain spans that are highly consistent with human writing. To this end, we first reveal the existence of such hidden human-like spans, and then theoretically analyze their impact on detection. Our analysis shows that these spans increase the sentence complexity for detection, thereby making MGT detection intrinsically harder. Based on this finding, we propose a model-agnostic stacked enhancement framework that improves existing detectors by reducing the influence of hidden human-like spans. Specifically, we model span-level retention decisions as a latent-variable problem and instantiate the optimization with a hard-EM-inspired procedure, where the detector iteratively filters confidently human-like subsequences and refines itself on the remaining text. Extensive experiments across various LLMs and practical scenarios demonstrate that the proposed framework consistently enhances existing detectors. Notably, the framework can also work in a training-free manner, offering flexibility and scalability for practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。