arXiv:2608.20786cs.AIcs.IR2026-08

让AI写投标书时,读用结构化、写用自由文,效果更好。

Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring

论文配图:Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring
图 1 · 摘自论文原文
  • 读文档用结构化标记,写文档用自由段落,提升生成质量。
  • 结构化指令使回答准确率从74%降至48%,说明写时不宜用结构。
  • 明确禁止某些写法反而让问题集中在被点名的两种形式上。

多智能体文档撰写系统需同时理解请求方的格式要求并据此生成内容。我们部署了一个基于开放权重模型的投标响应系统,在主权约束下运行,并与同一组织实际提交的人类撰写标书进行盲评对比。在无参考样例的情况下,大语言模型评委认为该系统在55个真实章节中,有40项至少与人类水平相当,4项更优,无任何一项完全缺失,仅指出1处缺乏依据的陈述。分析评委识别出的所有差异发现,68%源于系统自身来源未提供信息——这些是人类作者掌握但系统未被给予的知识,因此只有6个负面评价是系统本可避免的缺陷。偏离真实结果更多是信息缺失所致而非写作质量差;若不区分两者,会低估系统能力。我们进一步揭示条件不对称性:将文档转为结构化标记虽利于信息提取,但在生成阶段使用结构化指令,会使准确率从74%下降至48%。此外,明确禁止某种写作形式反而使其残留率高达96%,集中在被命名的两类结构中;而结合随机标注与确定性窗口函数,可在字节相同的文件上将提取的需求数从68降至51。结论:结构用于阅读,自由文与自检机制用于写作。

原文摘要 · Abstract (English)

Multi-agent pipelines that author formal documents must both read a requester's forms and write against them. We report a deployed tender-response system, running an open-weights model under sovereignty constraints, and evaluate it against human-written bids the same organisation actually submitted. On a blind comparison where the system had no worked example available, an LLM judge rated its answers at least as good as the human-submitted answer on $40$ of $55$ ground-truth sections, better on $4$, missing on none, and flagged one unsupported claim in total. Classifying every gap the judge identified shows that $68\%$ were content absent from the system's own sources -- knowledge the human author held and the pipeline was never given -- so only $6$ of the $15$ adverse verdicts involve a deficiency the system could have avoided. A divergence from ground truth is more often an information-availability result than a writing-quality one, and evaluations that do not separate the two understate such systems. Against this backdrop we report a conditioning asymmetry. It is well established that rendering documents as structural markup rather than flat prose improves extraction, and we reproduce that on three reading tasks. The benefit does not transfer to conditioning: converting a bid's \emph{instruction} material from prose to nested XML dropped answer quality from $74\%$ to $48\%$ under a paired comparison. We further find that naming a forbidden construction concentrates rather than removes it -- $96\%$ of surviving defects fall in the two forms the prompt explicitly names -- and that coupling a stochastic annotation to a deterministic windowing function moves the extracted requirement count from $68$ to $51$ on a byte-identical file. Structure belongs where the model reads; prose and self-applied tests belong where it writes.

多智能体文档生成结构化输入提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。