让AI故事更像人写:自动评估并给出改写建议
CraftAlign: Feature-Grounded Evaluation and Revision Guidance for AI Stories

- 通过304个写作特征识别故事风格,对比人类与AI写作模式
- 能精准区分人类和AI写作,指导多策略修改故事结构与结尾
- 适合想提升故事自然度的创作者、编辑或内容生成研究者
大语言模型虽能生成流畅完整的故事,但常显公式化、不自然,存在陈词滥调、过度解释、线性因果推进和刻板结局等问题。现有评估方法多依赖标签或整体评分,修订方法则仅针对预设问题进行局部修改,难以支持多种合理改写策略或引导全篇信息释放、因果组织与结局处理的调整。我们提出CraftAlign框架,通过匹配人类叙事技巧来优化AI故事。该框架包含两个学习模块与推理时的指导流程:基于Qwen3.5-9B的特征估计器预测304个显式写作特征(涵盖风格与叙事);类条件能量模型将生成特征配置与人类及AI写作模式对比,可利用原始提示作为条件。推理阶段,CraftAlign采用符合结构规范的扰动,选择使特征配置更接近人类模式的变化,并将其转化为自然语言指导,供独立编辑重写全文。实验表明,CraftAlign能准确区分人类与AI写作模式,其指导效果在不同编辑和人工评估中均优于基线方法。
原文摘要 · Abstract (English)
Large language models can now generate fluent and complete stories, yet many outputs still feel formulaic and unnatural because of cliches, over-explanation, linear causal progression, and stereotyped endings, an immediately recognizable AI flavor. Existing detection and evaluation methods often stop at source labels or holistic scores, while revision methods typically target predefined issues through localized edits, limiting their ability to support multiple plausible revision strategies or guide story-wide changes in information release, causal organization, and ending treatment. We introduce CraftAlign, a framework that aligns AI stories with the craft of human storytelling by both assessing Human/AI writing patterns and providing revision guidance. CraftAlign comprises two learned modules and an inference-time guidance pipeline. A feature estimator built on Qwen3.5-9B predicts 304 explicit writing features spanning style and narrative. A class-conditional energy model scores the resulting feature configuration against Human and AI writing patterns, conditioning on the original writing prompt when available. At inference time, CraftAlign applies schema-valid structured perturbations, selects changes that move the feature configuration toward the Human writing pattern, and converts them into natural-language guidance for a separate editor to rewrite the full story. Experiments show that CraftAlign accurately distinguishes Human and AI writing patterns and that its guidance outperforms revision baselines across editors and in a human study.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。