arXiv:2410.14309cs.CLcs.AI2024-10ACL被引 26

让大模型生成长文本时能准确表达不确定,减少幻觉。

LoGU: Long-form Generation with Uncertainty Expressions

  • 分原子事实逐步优化不确定性表达,提升可信度。
  • 在三个数据集上准确率提升,幻觉减少且内容更完整。
  • 适合需要高可靠性长文本生成的场景,如报告撰写。

尽管大型语言模型(LLMs)表现出色,但仍会生成事实性错误内容(即幻觉)。一种有前景的缓解方法是让模型在不确定时表达不确定性。以往关于不确定性的研究主要集中在短文本问答任务,但现实应用通常需要更长的响应。本文提出长文本不确定性生成(LoGU)任务,识别出两大挑战:不确定性抑制(模型不愿表达不确定)和不确定性错位(模型表达的不确定不准确)。为此,我们提出基于提炼的数据收集框架和两阶段训练流程。该框架采用分而治之策略,基于原子陈述细化不确定性表达。收集的数据通过监督微调(SFT)和直接偏好优化(DPO)进行训练,以增强不确定性表达能力。在三个长文本指令跟随数据集上的大量实验表明,该方法显著提升了准确性,减少了幻觉,同时保持了响应的完整性。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) demonstrate impressive capabilities, they still struggle with generating factually incorrect content (i.e., hallucinations). A promising approach to mitigate this issue is enabling models to express uncertainty when unsure. Previous research on uncertainty modeling has primarily focused on short-form QA, but realworld applications often require much longer responses. In this work, we introduce the task of Long-form Generation with Uncertainty(LoGU). We identify two key challenges: Uncertainty Suppression, where models hesitate to express uncertainty, and Uncertainty Misalignment, where models convey uncertainty inaccurately. To tackle these challenges, we propose a refinement-based data collection framework and a two-stage training pipeline. Our framework adopts a divide-and-conquer strategy, refining uncertainty based on atomic claims. The collected data are then used in training through supervised fine-tuning (SFT) and direct preference optimization (DPO) to enhance uncertainty expression. Extensive experiments on three long-form instruction following datasets show that our method significantly improves accuracy, reduces hallucinations, and maintains the comprehensiveness of responses.

长文本生成不确定性表达幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。