arXiv:2506.06589cs.CL2025-06NeurIPS被引 8

提出新任务PIC,让大模型生成时严格遵循输入事实,杜绝编造。

Precise Information Control in Long-Form Text Generation

  • 设计新任务PIC,要求模型仅基于给定陈述生成,不添加额外信息。
  • 评估显示顶尖模型在70%以上生成中仍会编造内容,准确性不足。
  • 通过弱监督训练得到的PIC-LM显著提升事实准确率,适合需要高可信度的场景。

语言模型的核心挑战之一是事实性幻觉:生成与输入上下文不符的信息。为此,我们提出精确信息控制(PIC)任务,要求模型基于一组简短自洽的陈述生成长文本,且不得添加未被支持的内容。PIC包含完整设置(需包含所有输入主张)和部分设置(仅选择相关主张)。我们构建了PIC-Bench基准,涵盖八项长文本生成任务(如摘要、传记生成),并提供可验证的输入陈述。对多种开源与闭源模型的评估发现,即使是最先进的模型,在超过70%的生成中仍存在幻觉。为缓解此问题,我们提出一种弱监督偏好数据构建的后训练框架,训练出一个80亿参数的PIC-LM,在完整PIC设置下F1从69.1%提升至91.0%。将其集成到端到端事实生成流程中,可在含检索的模糊问答任务中提升17.1%的精确匹配召回率,并在出生地事实核查任务中提高30.5%的事实精度,证明了精准接地生成的巨大潜力。

原文摘要 · Abstract (English)

A central challenge in language models (LMs) is faithfulness hallucination: the generation of information unsubstantiated by input context. To study this problem, we propose Precise Information Control (PIC), a new task formulation that requires models to generate long-form outputs grounded in a provided set of short self-contained statements, without adding any unsupported ones. PIC includes a full setting that tests a model's ability to include exactly all input claims, and a partial setting that requires the model to selectively incorporate only relevant claims. We present PIC-Bench, a benchmark of eight long-form generation tasks (e.g., summarization, biography generation) adapted to the PIC setting, where LMs are supplied with well-formed, verifiable input claims. Our evaluation of a range of open and proprietary LMs on PIC-Bench reveals that, surprisingly, state-of-the-art LMs still hallucinate against user-provided input in over 70% of generations. To alleviate this lack of faithfulness, we introduce a post-training framework that uses a weakly supervised preference data construction method to train an 8B PIC-LM with stronger PIC ability--improving from 69.1% to 91.0% F1 in the full PIC setting. When integrated into end-to-end factual generation pipelines, PIC-LM improves exact match recall by 17.1% on ambiguous QA with retrieval, and factual precision by 30.5% on a birthplace fact-checking task, underscoring the potential of precisely grounded generation.

信息控制事实幻觉生成质量大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。