arXiv:2511.06942cs.CLcs.CR2025-11AAAI被引 1

让检测模型更懂人类写作习惯,提升对机器修改文本的识别能力。

HLPD: Aligning LLMs to Human Language Preference for Machine-Revised Text Detection

  • 用奖励机制引导模型偏好人类写作风格,增强对机器修订文本的敏感度。
  • 在多任务对抗测试中,检测GPT生成文本的准确率比ImBD高15.11%。
  • 适合需要高精度识别机器改写内容的研究者和安全团队使用。

为防止由大语言模型生成的可信内容引发虚假信息与社会问题,必须发展高效可靠的文本来源检测方法。以往方法在识别完全由大模型生成的文本时表现优异,但在面对更先进的大模型输出或对抗性多任务机器修订场景时,尤其在黑盒设置下(生成模型未知)性能显著下降。基于人类写作具有独特风格模式的假设,我们提出人类语言偏好检测(HLPD),采用基于奖励的对齐过程——人类语言偏好优化(HLPO),将评分模型的词元分布向人类写作风格迁移,从而提升对人类写作的敏感性,增强对机器修订文本的识别能力。我们在一个对抗性多任务评估框架中测试了HLPD,该框架利用五维提示生成器与多个先进大模型构建多样化的修订场景。当检测由GPT系列模型修订的文本时,HLPD在AUROC上相较ImBD提升15.11%,优于Fast-DetectGPT达45.56%;在先进大模型生成文本的评测中,HLPD达到最高平均AUROC,分别优于ImBD 5.53%和Fast-DetectGPT 34.14%。代码将在https://github.com/dfq2021/HLPD发布。

原文摘要 · Abstract (English)

To prevent misinformation and social issues arising from trustworthy-looking content generated by LLMs, it is crucial to develop efficient and reliable methods for identifying the source of texts. Previous approaches have demonstrated exceptional performance in detecting texts fully generated by LLMs. However, these methods struggle when confronting more advanced LLM output or text with adversarial multi-task machine revision, especially in the black-box setting, where the generating model is unknown. To address this challenge, grounded in the hypothesis that human writing possesses distinctive stylistic patterns, we propose Human Language Preference Detection (HLPD). HLPD employs a reward-based alignment process, Human Language Preference Optimization (HLPO), to shift the scoring model's token distribution toward human-like writing, making the model more sensitive to human writing, therefore enhancing the identification of machine-revised text. We test HLPD in an adversarial multi-task evaluation framework that leverages a five-dimensional prompt generator and multiple advanced LLMs to create diverse revision scenarios. When detecting texts revised by GPT-series models, HLPD achieves a 15.11% relative improvement in AUROC over ImBD, surpassing Fast-DetectGPT by 45.56%. When evaluated on texts generated by advanced LLMs, HLPD achieves the highest average AUROC, exceeding ImBD by 5.53% and Fast-DetectGPT by 34.14%. Code will be made available at https://github.com/dfq2021/HLPD.

文本检测语言偏好对抗样本大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。