arXiv:2502.13674cs.CL2025-02ICLR被引 5

通过自监督生成虚假样本,提升大模型文本生成的忠实度。

SCOPE: A Self-supervised Framework for Improving Faithfulness in Conditional Text Generation

  • 自监督构建虚假文本训练集,模拟模型常见幻觉
  • 基于偏好学习优化模型,显著提升生成内容与输入一致
  • 适合需要高可信度生成的场景,如摘要、数据转文本

大语言模型在条件化文本生成任务中常产生幻觉,即生成与输入上下文无关的内容。这类问题在文本摘要和数据到文本生成中尤为突出。当模型在特定领域微调后,仍难以忠实回应给定上下文,往往引入无关信息或错误。其根本原因在于模型过度依赖训练数据中的统计模式,从而削弱对输入上下文的遵循能力。本文提出一种新方法:先通过自监督生成大量不忠实样本,再利用偏好学习训练策略,使模型更倾向于生成有根据的输出。实验表明,该方法在自动指标、基于大模型评估及人工评测中均优于现有自监督技术,在忠实度上表现显著提升。

原文摘要 · Abstract (English)

Large Language Models (LLMs), when used for conditional text generation, often produce hallucinations, i.e., information that is unfaithful or not grounded in the input context. This issue arises in typical conditional text generation tasks, such as text summarization and data-to-text generation, where the goal is to produce fluent text based on contextual input. When fine-tuned on specific domains, LLMs struggle to provide faithful answers to a given context, often adding information or generating errors. One underlying cause of this issue is that LLMs rely on statistical patterns learned from their training data. This reliance can interfere with the model's ability to stay faithful to a provided context, leading to the generation of ungrounded information. We build upon this observation and introduce a novel self-supervised method for generating a training set of unfaithful samples. We then refine the model using a training process that encourages the generation of grounded outputs over unfaithful ones, drawing on preference-based training. Our approach leads to significantly more grounded text generation, outperforming existing self-supervised techniques in faithfulness, as evaluated through automatic metrics, LLM-based assessments, and human evaluations.

文本生成忠实度自监督大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。