AI生成小说虽像人写,但批量产出风格差异小。
Novels generated by language models show compressed formal variation

- 对比六类文本,发现反复生成导致句式结构压缩
- AI小说句长、标点、可读性等变化幅度远小于人类作品
- 单本可能逼真,但集体风格严重趋同,适合评估生成一致性
尽管大语言模型能生成整部小说,但对其输出在多轮生成中形式变异程度仍缺乏了解。本研究不关注单段是否为AI生成,而是考察重复生成能否达到人类作品的多样性水平。对比六类语料:20本由GPT-5.5 Thinking生成的19世纪英式现实主义小说,20本由Qwen3-14B生成的同类风格小说,20本各模型生成的当代零风格小说,205部19世纪人类创作的英国小说,以及65部当代人类创作的零风格小说。在文档层面,分析MATTE-500、香农熵、平均句长、可读性及标点率。最稳健结果为句式结构压缩:重复生成的小说间句式差异显著小于人类小说。可读性、标点率与句长变异性亦呈压缩趋势。词汇层面总体压缩,仅Qwen零风格的MATTR值例外。尽管GPT与Qwen具不同均值风格特征,但跨测量相关性无稳定模式。研究区分了方差过闭(跨小说形式范围受限)与相关性过闭(各指标间关联异常),表明单本可类人,但整体生成集形式空间极窄。
原文摘要 · Abstract (English)
While large language models can generate entire novels, there is little information about the level of formal variation in their output over many generations. Rather than asking whether individual passages can be identified as AI-generated, this study asks whether repeated AI generation can produce the same range of diversity which is found across human corpora. This paper contrasts six corpora based on generation source and target style: twenty novels generated using GPT-5.5 Thinking in a nineteenth-century British realist style, twenty novels generated using Qwen3-14B in a nineteenth-century British realist style, twenty novels generated using each of these models in a contemporary zero style, 205 nineteenth-century human-written British novels, and sixty-five contemporary human-written Zero-Style novels. At the document level, the research includes MATTR-500, Shannon entropy, average sentence length, readability, and punctuation rate measurements. The most robust and reliable result is compression of sentence structure. Repeated generations produce novels that vary far less from one another in sentence structure than human novels do. Compression is also present in the measures of readability, punctuation, and sentence length variability within novels. Lexical measures tend to be similarly compressed, with the exception of Qwen Zero-Style MATTR. Despite having distinct mean stylistic profiles, GPT and Qwen lack a stable pattern of cross-measure correlation. This article therefore distinguishes between variance overclosure, which represents a limited formal range between novels, and a more specific phenomenon of correlational overclosure. This means that an individual AI-generated novel may resemble human fiction stylistically, while a collection of AI-generated novels occupies a much narrower formal range.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。