arXiv:2502.12568cs.CLcs.AI2025-02ACL被引 21

让大模型像人一样分步写作,生成更长更准的文本。

A Cognitive Writing Perspective for Constrained Long-Form Text Generation

  • 分步规划+并行生成,模仿人类写作的思考过程。
  • 在复杂指令下准确率超GPT-4o 22%,可生成超1万字文本。
  • 无需训练,适合需要高质量长文生成的场景。

如同人类,大语言模型在单次生成中难以产出符合严格要求的高质量长文本。这并不意外,因为根据认知写作理论,高效写作是包含迭代规划、翻译、审查与监控的复杂认知过程。受此启发,我们提出CogWriter——一种无需训练的框架,将约束性长文本生成转化为系统化的认知写作范式。该框架包含两个核心模块:(1) 分层规划的规划代理,用于任务分解;(2) 并行执行计划的多个生成代理。系统通过持续监控与审查机制维持质量,评估输出是否符合要求并触发必要修正。在LongGenBench基准测试中,即使以Qwen-2.5-14B为基底模型,CogWriter在复杂指令完成准确率上仍比GPT-4o高出22%,且能稳定生成超过10,000字的文本。

原文摘要 · Abstract (English)

Like humans, Large Language Models (LLMs) struggle to generate high-quality long-form text that adheres to strict requirements in a single pass. This challenge is unsurprising, as successful human writing, according to the Cognitive Writing Theory, is a complex cognitive process involving iterative planning, translating, reviewing, and monitoring. Motivated by these cognitive principles, we aim to equip LLMs with human-like cognitive writing capabilities through CogWriter, a novel training-free framework that transforms LLM constrained long-form text generation into a systematic cognitive writing paradigm. Our framework consists of two key modules: (1) a Planning Agent that performs hierarchical planning to decompose the task, and (2) multiple Generation Agents that execute these plans in parallel. The system maintains quality via continuous monitoring and reviewing mechanisms, which evaluate outputs against specified requirements and trigger necessary revisions. CogWriter demonstrates exceptional performance on LongGenBench, a benchmark for complex constrained long-form text generation. Even when using Qwen-2.5-14B as its backbone, CogWriter surpasses GPT-4o by 22% in complex instruction completion accuracy while reliably generating texts exceeding 10,000 words. We hope this cognitive science-inspired approach provides a paradigm for LLM writing advancements: \href{https://github.com/KaiyangWan/CogWriter}{CogWriter}.

长文本生成认知建模智能写作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。