arXiv:2410.20964cs.CLcs.AI2024-10NeurIPS被引 96

通过多层级对比学习识别文本风格差异,提升对生成文本的检测能力。

DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learning

  • 基于多任务辅助的多层级对比学习,捕捉作者写作风格特征。
  • 在跨数据集零样本测试中显著优于现有方法,准确率提升明显。
  • 无需重新训练即可适应新数据,适合实际部署场景。

当前AI生成文本检测技术多依赖人工特征设计和监督二分类,存在性能瓶颈与泛化能力差的问题,难以应对分布外(OOD)数据及新型大语言模型。本文重新审视该任务,认为关键在于区分不同作者的写作风格,而非简单二分类。为此提出DeTeCtive:一种多任务辅助、多层级对比学习框架,结合密集信息检索实现检测。该方法兼容多种文本编码器,在多个基准上显著提升各类编码器对生成文本的检测能力,达到当前最优表现。尤其在OOD零样本评估中大幅领先现有方法。此外,发现其具备无需训练的增量适应能力(TFIA),进一步增强对OOD数据的检测效能。代码已开源,以推动领域发展,保障LLM安全使用与合规性。

原文摘要 · Abstract (English)

Current techniques for detecting AI-generated text are largely confined to manual feature crafting and supervised binary classification paradigms. These methodologies typically lead to performance bottlenecks and unsatisfactory generalizability. Consequently, these methods are often inapplicable for out-of-distribution (OOD) data and newly emerged large language models (LLMs). In this paper, we revisit the task of AI-generated text detection. We argue that the key to accomplishing this task lies in distinguishing writing styles of different authors, rather than simply classifying the text into human-written or AI-generated text. To this end, we propose DeTeCtive, a multi-task auxiliary, multi-level contrastive learning framework. DeTeCtive is designed to facilitate the learning of distinct writing styles, combined with a dense information retrieval pipeline for AI-generated text detection. Our method is compatible with a range of text encoders. Extensive experiments demonstrate that our method enhances the ability of various text encoders in detecting AI-generated text across multiple benchmarks and achieves state-of-the-art results. Notably, in OOD zero-shot evaluation, our method outperforms existing approaches by a large margin. Moreover, we find our method boasts a Training-Free Incremental Adaptation (TFIA) capability towards OOD data, further enhancing its efficacy in OOD detection scenarios. We will open-source our code and models in hopes that our work will spark new thoughts in the field of AI-generated text detection, ensuring safe application of LLMs and enhancing compliance. Our code is available at https://github.com/heyongxin233/DeTeCtive.

文本检测对比学习零样本风格识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。