arXiv:2602.06103cs.LG2026-02

提出结构化框架EVE,让大模型生成更完整且可信的答案。

Toward Faithful and Complete Answer Construction from a Single Document

  • 用提取-验证-枚举三阶段约束生成过程
  • 召回率、准确率分别提升24%和29%,F1提升31%
  • 适合需要高可靠性的文档问答场景

现代大语言模型(LLMs)基于统计的下一个词预测进行文本生成,虽流畅但易偏向高概率内容,缺乏对源文档的全面性和忠实性保障。为解决此问题,本文提出EVE框架,通过结构化、可验证的生成管道,将复杂推理分解为信息提取、验证与枚举三个步骤。实证表明,该设计在保持一致性的同时显著提升召回率(最高+24%)、准确率(最高+29%)及F1-score(+31%),打破传统单次生成中覆盖与准确性的权衡困境,并缓解因长度限制导致的生成截断。同时,研究指出模型性能受自然语言内在歧义制约,存在固有上限。

原文摘要 · Abstract (English)

Modern large language models (LLMs) are powerful generators driven by statistical next-token prediction. While effective at producing fluent text, this design biases models toward high-probability continuations rather than exhaustive and faithful answers grounded in source content. As a result, directly applying LLMs lacks systematic mechanisms to ensure both completeness (avoiding omissions) and faithfulness (avoiding unsupported content), which fundamentally conflicts with core AI safety principles. To address this limitation, we present EVE, a structured framework for document-grounded reasoning. Unlike free-form prompting, EVE constrains generation to a structured, verifiable pipeline that decomposes high-rigor reasoning into extraction, validation, and enumeration. Empirically, this design enables consistent and simultaneous improvements in recall, precision, and F1-score: recall and precision increase by up to 24\% and 29\%, respectively, with a corresponding 31\% gain in F1-score. This effectively breaks the long-standing trade-off between coverage and accuracy typical of single-pass LLM generation, while also mitigating generation truncation caused by length limitations. At the same time, we emphasize that EVE exhibits performance saturation due to the inherent ambiguity of natural language, reflecting fundamental limits of language-based reasoning.

大模型生成文档问答可信推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。