用微调大模型检测AI生成文本,还能识别出自哪个模型。
AI Generated Text Detection Using Instruction Fine-tuned Large Language and Transformer-Based Models
- 微调GPT-4o-mini和BERT等模型进行文本来源判别。
- 人类与AI文本区分准确率达95.47%,模型溯源准确率46.98%。
- 适合需要防范虚假信息和追踪生成源头的研究者使用。
大型语言模型(LLMs)具备生成语义连贯、风格逼真且接近人类写作的文本能力,但其被滥用于制造钓鱼邮件、传播假新闻、编写自动化犯罪代码及伪造科研文章。在实际应用中,生成文本的风格、主题及生成模型往往未知。随着AI生成文本日益普遍且逼真,检测难度持续增加。已有研究尝试通过语言学、统计学、机器学习及集成方法区分机器与人工文本。本文聚焦两个目标:任务A为区分人类与机器生成文本;任务B为识别具体生成模型。基于GPT_4o-mini、LLaMA 3 8B和BERT的微调模型完成两项任务。微调后的GPT-4o-mini在任务A上准确率达0.9547,BERT在任务B上准确率为0.4698。
原文摘要 · Abstract (English)
Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content that is both grammatically correct and semantically meaningful. Recently, LLMs have been misused to create highly realistic phishing emails, spread fake news, generate code to automate cyber crime, and write fraudulent scientific articles. Additionally, in many real-world applications, the generated content including style and topic and the generator model are not known beforehand. The increasing prevalence and sophistication of artificial intelligence (AI)-generated texts have made their detection progressively more challenging. Various attempts have been made to distinguish machine-generated text from human-authored content using linguistic, statistical, machine learning, and ensemble-based approaches. This work focuses on two primary objectives Task-A, which involves distinguishing human-written text from machine-generated text, and Task-B, which attempts to identify the specific LLM model responsible for the generation. Both of these tasks are based on fine tuning of Generative Pre-trained Transformer (GPT_4o-mini), Large Language Model Meta AI (LLaMA) 3 8B, and Bidirectional Encoder Representations from Transformers (BERT). The fine-tuned version of GPT_4o-mini and the BERT model has achieved accuracies of 0.9547 for Task-A and 0.4698 for Task-B.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。