用人类小说重构训练框架,让AI写出更像人写的书。
Towards Human-Level Book-Writing Capability

- 将人类小说拆解为多层级大纲,反向训练模型从提示生成完整书籍
- 新模型在写作质量评测中超越GPT-5.5和Claude Opus 4.8
- 适合追求文学性创作的AI研究者与内容创作者
大型语言模型虽擅长指令遵循,但在创造性写作上仍与高质量创作需求脱节。我们提出一个专为长篇创作设计的模型,其写作质量超过GPT-5.5和Claude Opus 4.8。虚构作品常依赖助手模型被刻意避免的行为,如欺骗、道德模糊与不可靠叙述,导致生成文本结构正确但风格平庸、解释过度或缺乏人类文学特征。为此,我们构建了一个基于公开领域小说的数据集与训练框架,将监督微调重定义为‘提示到全书生成’任务。从公共领域小说出发,我们提取多尺度规划骨架(Planning Scaffold),涵盖从主旨到章节、场景的逐层细化结构。训练时反向使用该结构:模型学习从提示逐步扩展为详细计划,最终生成原始人类作者的文本。该方法以人类文稿为最终监督目标,同时利用中间摘要使长篇生成可训练。我们在长上下文语言模型上进行训练,结果表明该目标能有效引导生成远离助理式表达,转向真实人类文学风格。
原文摘要 · Abstract (English)
Large language models are optimized for instruction following and agentic tasks remain poorly aligned with the requirements of high-quality creative writing. We show that a purpose-built creative writing model can outperform both GPT-5.5 and Claude Opus 4.8 on writing quality evaluation. Fiction frequently depends on behaviors that assistant-tuned models are explicitly trained to avoid, particularly deception, moral ambiguity, and unreliable narration. As a result, generated stories often appear structurally correct while remaining stylistically generic, overly explanatory, or weakly grounded in human literary behavior. We present a dataset construction and training framework for book-scale creative writing that reframes supervised fine-tuning as a prompt-to-book generation task grounded in human-authored fiction. Starting from public-domain novels, we derive a multi-resolution Planning Scaffold by summarizing each book at progressively finer levels, from a high-level premise to chapter- and scene-level structure. We then invert this hierarchy during training: the model learns to expand a prompt into increasingly detailed plans and finally into the original human-authored book text. This formulation preserves human prose as the final supervised target while using intermediate summaries to make book-scale generation learnable. We train a long-context language model on these prompt-to-book trajectories and show that this objective shifts generation away from assistant-style prose and toward human literary writing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。