研究人类改写对大模型文本检测的影响,发现改写会降低检测效果。
Understanding the Effects of Human-written Paraphrases in LLM-generated Text Detection
- 构建首个包含人类与大模型改写文本的对比数据集HLPC。
- 人类改写使检测器在1%误报率下真阳性率提升,但整体准确率下降。
- 适合关注生成内容安全、检测系统鲁棒性的研究人员。
大语言模型(LLMs)的快速发展使得自动生成文本日益普遍,公众需能识别此类内容以避免潜在风险。现有大模型文本检测器在区分大模型生成与人类撰写文本方面表现良好,但在面对改写文本时性能可能下降。本研究提出一种新型数据收集策略,构建了首个涵盖人类撰写文本及其改写、以及大模型生成文本及其改写的数据集HLPC。通过在OpenAI RoBERTa和水印检测器上测试包含来自GPT和OPT的带/不带水印大模型文本,以及DIPPER和BART生成的大模型改写文本的分类任务,结果表明:引入人类改写文本显著影响检测器性能,在1%误报率下真阳性率(TPR)可能提升,但可能导致AUROC和准确率下降。
原文摘要 · Abstract (English)
Natural Language Generation has been rapidly developing with the advent of large language models (LLMs). While their usage has sparked significant attention from the general public, it is important for readers to be aware when a piece of text is LLM-generated. This has brought about the need for building models that enable automated LLM-generated text detection, with the aim of mitigating potential negative outcomes of such content. Existing LLM-generated detectors show competitive performances in telling apart LLM-generated and human-written text, but this performance is likely to deteriorate when paraphrased texts are considered. In this study, we devise a new data collection strategy to collect Human & LLM Paraphrase Collection (HLPC), a first-of-its-kind dataset that incorporates human-written texts and paraphrases, as well as LLM-generated texts and paraphrases. With the aim of understanding the effects of human-written paraphrases on the performance of state-of-the-art LLM-generated text detectors OpenAI RoBERTa and watermark detectors, we perform classification experiments that incorporate human-written paraphrases, watermarked and non-watermarked LLM-generated documents from GPT and OPT, and LLM-generated paraphrases from DIPPER and BART. The results show that the inclusion of human-written paraphrases has a significant impact of LLM-generated detector performance, promoting TPR@1%FPR with a possible trade-off of AUROC and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。