用可解释语言特征检测跨提示的AI假新闻,效果稳定。
Cross-Prompt Generalization in Detecting AI-Generated Fake News Using Interpretable Linguistic Features

- 提取词汇多样性、可读性等可解释语言特征
- 六组跨提示测试中AUC达0.988至1.000
- 适合关注AI内容检测鲁棒性的研究者
大型语言模型生成假新闻的传播引发关注,尤其在不同提示策略下。现有检测模型多在单一生成设置中训练与评估,其跨未见提示的泛化能力不明确。本研究基于三种不同提示生成的AI文章数据集(共三组)与真实新闻结合,提取可解释的语言特征——包括词汇多样性、可读性及情感特征,并在跨提示框架下使用随机森林分类器进行评估:在一种提示上训练,在另一种上测试。六种训练-测试组合中,性能持续保持高位,AUC值范围为0.988至1.000。特征分布分析显示,相较于整体数据集,AI生成文本表现出更高的词汇多样性、更低的可读性以及显著减弱的情感强度,且不同提示间存在差异。尽管存在分布偏移,分类器仍保持强表现,表明这些特征捕捉了跨提示稳定的AI生成文本特性。结果说明,基于特征的方法可在提示变化下实现鲁棒的假新闻检测。
原文摘要 · Abstract (English)
The increasing use of large language models has raised concerns about the spread of AI-generated fake news, particularly under varying prompting strategies. Most existing detection models are trained and evaluated under a single generation setting, leaving their ability to generalize across unseen prompts unclear. In this study, we investigate cross-prompt generalization in fake news detection using three datasets of AI-generated articles produced under distinct prompts, combined with real news articles. We extract interpretable linguistic features capturing lexical diversity, readability, and emotion-based characteristics and evaluate a random forest classifier under a cross-prompt framework, where models trained on one prompt are tested on another. Across all six train-test combinations, performance remains consistently high, with AUC values ranging from 0.988 to 1.000. Analysis of feature distributions shows that AI-generated text exhibits increased lexical diversity, reduced readability, and substantially lower emotional intensity compared to the overall dataset, with variations across prompts. Despite these distributional shifts, the classifier maintains strong performance, indicating that these features capture stable properties of AI-generated text that generalize across prompting strategies. These findings suggest that feature-based approaches can provide robust detection of AI-generated fake news under prompt variability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。