arXiv:2511.21744cs.CLcs.AI2025-11被引 6

用轻量级特征检测AI生成文本,准确率达97%且可在普通电脑运行。

A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Features

  • 提取文本的风格与可读性特征,用小型CNN或随机森林分类
  • 在Kaggle数据集上达到97%准确率,ROC-AUC高达99.5%
  • 模型仅25MB,适合跨语言、实时场景应用

越来越多的AI生成文本引发关注。现有检测方法多依赖微调大型Transformer模型或构建集成模型,计算开销大且跨领域泛化能力有限。现有轻量级方案在大规模数据集上准确率显著偏低。本文提出NEULIF,一种轻量级检测方法,在不需大量算力的前提下实现轻量级检测器中的最优性能。将文本分解为风格特征和可读性特征,由小型卷积神经网络(CNN)或随机森林(RF)进行分类。在Kaggle AI vs. Human语料库上,CNN模型达97%准确率(约0.95 F1),随机森林达95%准确率(约0.94 F1),ROC-AUC分别为99.5%和95%。两种模型大小分别为~25 MB和~10.6 MB,远小于基于Transformer的集成模型,可在标准CPU设备高效运行,同时保持高精度。研究还表明,此类模型在多语言、多领域及流式场景中具有广泛应用潜力,证明基于结构洞察的简单设计可媲美复杂模型。

原文摘要 · Abstract (English)

A growing number of AI-generated texts raise serious concerns. Most existing approaches to AI-generated text detection rely on fine-tuning large transformer models or building ensembles, which are computationally expensive and often provide limited generalization across domains. Existing lightweight alternatives achieved significantly lower accuracy on large datasets. We introduce NEULIF, a lightweight approach that achieves best performance in the lightweight detector class, that does not require extensive computational power and provides high detection accuracy. In our approach, a text is first decomposed into stylometric and readability features which are then used for classification by a compact Convolutional Neural Network (CNN) or Random Forest (RF). Evaluated and tested on the Kaggle AI vs. Human corpus, our models achieve 97% accuracy (~ 0.95 F1) for CNN and 95% accuracy (~ 0.94 F1) for the Random Forest, demonstrating high precision and recall, with ROC-AUC scores of 99.5% and 95%, respectively. The CNN (~ 25 MB) and Random Forest (~ 10.6 MB) models are orders of magnitude smaller than transformer-based ensembles and can be run efficiently on standard CPU devices, without sacrificing accuracy. This study also highlights the potential of such models for broader applications across languages, domains, and streaming contexts, showing that simplicity, when guided by structural insights, can rival complexity in AI-generated content detection.

文本检测轻量模型风格分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。