arXiv:2510.14763cs.CLcs.AI2025-10被引 1

构建中文创意写作数据集,揭示思维过程对创作质量的关键作用

COIG-Writer: A High-Quality Dataset for Chinese Creative Writing with Thought Processes

  • 通过逆向工程高质文本,构建包含提示、思考过程与成品的三元组数据集
  • 发现每12个通用样本需配1个创意样本才能达到最佳表现(胜率从62.75%降至35.78%)
  • 揭示中文创意能力不可跨语言迁移,且词汇多样性越高越可能掩盖逻辑缺陷

大语言模型在创意写作上存在系统性缺陷,尤其在非英语语境下因训练数据稀缺且缺乏过程监督。本文提出COIG-Writer,一个全新的中文创意写作数据集,通过系统性逆向工程高质量文本,同时捕捉多样输出及其背后的思考过程。该数据集包含1,665个精心标注的三元组,覆盖51种体裁,每个三元组包含:(1) 逆向生成的提示,(2) 详细记录创作决策过程的推理内容,(3) 最终成文。全面实验揭示创意写作的双组件机制:叙事逻辑(由过程监督提供)与语言表达(由通用数据维持)。研究发现:(1) 过程监督极为有效,但需结合通用数据稳定;至少需1:12的创意/通用样本比才能达最优性能(低于此比例,胜率从62.75%降至35.78%);(2) 创意能力具有文化依赖性,无跨语言迁移能力(中英文表现差距达89.26个百分点);(3) 词汇多样性与创作质量呈反相关(TTR悖论),表明高多样性可能反映逻辑缺陷的补偿行为。这些发现表明,创意卓越源于逻辑框架与语言根基的交互作用,类比于数学推理增强但无法替代基础模型的语言能力。

原文摘要 · Abstract (English)

Large language models exhibit systematic deficiencies in creative writing, particularly in non-English contexts where training data is scarce and lacks process-level supervision. We present COIG-Writer, a novel Chinese creative writing dataset that captures both diverse outputs and their underlying thought processes through systematic reverse-engineering of high-quality texts. Unlike existing datasets that provide only input-output pairs, COIG-Writer comprises 1,665 meticulously curated triplets spanning 51 genres, each containing: (1) a reverse-engineered prompt, (2) detailed creative reasoning documenting decision-making processes, and (3) the final text. Through comprehensive experiments, we identify a two-component model of creative writing: narrative logic (provided by process supervision) and linguistic expression (maintained by general-purpose data). Our findings reveal three critical insights: (1) Process supervision is highly effective but requires stabilization with general data. A ratio of at least one creative sample to twelve general samples is needed to achieve optimal performance; below this threshold, the win rate progressively degrades (from 62.75% down to 35.78%)., (2) creative capabilities are culturally-bound with no cross-lingual transfer (89.26pp gap between Chinese and English performance), and (3) lexical diversity inversely correlates with creative quality (TTR paradox), suggesting high diversity signals compensatory behavior for logical deficiencies. These findings establish that creative excellence emerges from the interaction between logical scaffolding and linguistic grounding, analogous to how mathematical reasoning enhances but cannot replace linguistic competence in foundation models.

中文创作数据集思维过程创意写作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。