AI生成和编辑文本的风格痕迹不同,需分开检测。
AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

- 用熵和词汇多样性等少数特征区分AI生成与人类写作。
- AI编辑仅小幅提升词汇多样性,降低熵值,痕迹不明显。
- 编辑痕迹以词汇密度为主,难与人类文本区分。
大型语言模型(LLMs)生成的文本已被证实具有与人类写作不同的风格特征。但如今LLMs不仅用于生成,还广泛用于编辑人类文本,其风格痕迹是否一致尚不明确。研究发现,AI生成文本在8个LLM和5个领域中均表现出一致的“风格足迹”:少量特征(主要为熵和词汇多样性)能稳定区分其与人类写作,其余特征则高度依赖领域和生成器。而AI编辑文本相对原始人类文本,仅出现词汇多样性小幅上升、熵值下降,未呈现生成文本中的双增趋势。词汇密度在编辑中成为主导信号,但对区分编辑文本与人类文本效果较差。因此,‘AI文本’并非单一现象,生成与编辑应分别研究。
原文摘要 · Abstract (English)
Text generated by large language models (LLMs) has been shown to be stylometrically distinct from human-written text \citep{andreDetectingAIAuthorship2023, shahDetectingUnmaskingAIGenerated2023, oparaStyloAIDistinguishingAIGenerated2024, soto2024fewshot, liLinguisticDifferencesAI2025, selviogluFeatureExtractionAnalysis2025}. But LLMs are increasingly used not only to generate text but also to edit human writing, and it is unclear whether the two leave the same trace. We show that AI generation leaves a consistent ``stylometric footprint'': a small subset of features, primarily entropy and lexical diversity, consistently separates AI-generated text from human writing across 8 LLMs and 5 domains, while the remaining features depend heavily on the domain and generator. AI editing, however, does not reproduce the same footprint. Relative to their human-written sources, AI-edited texts show only a small increase in lexical diversity and a decrease in entropy, rather than the joint increase that characterizes AI generation. Lexical density, which contributes little to generation, instead becomes the dominant editing-associated signal. Stylometric features therefore separate AI-edited text from AI-generated text but are substantially less effective at separating it from human-written text. Our results suggest that ``AI text'' is not a single phenomenon: generation and editing leave qualitatively different stylometric traces and should be studied separately.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。