让大模型自我修正每句话,提升回答准确性。
Generate, Discriminate, Evolve: Enhancing Context Faithfulness via Fine-Grained Sentence-Level Self-Evolution
- 通过生成、判别、进化三步,逐句优化答案
- 在两个数据集上同时超越基线,提升准确率与可信度
- 适合需要高可靠性问答的场景,如知识冲突或长文本生成
提升大语言模型在长文本问答等任务中的上下文忠实性,对构建可信赖的检索增强生成系统、减少幻觉至关重要。现有方法要么仅在推理阶段干预,无法解决模型本质缺陷,要么忽视自我改进潜力。本文提出GenDiE(Generate, Discriminate, Evolve)框架,通过细粒度句子级优化,结合生成与判别训练,赋予模型自生成和自评分能力,实现迭代式自我演化。该框架支持模型对齐的数据构建与推理阶段的评分引导搜索。通过将每个句子视为独立优化单元,克服了以往整体答案优化忽略不忠实细节的局限。在ASQA(域内长文本问答)和ConFiQA(域外反事实问答)数据集上的实验表明,GenDiE在忠实性与正确性上均优于多种基线,并具备良好的领域适应能力。
原文摘要 · Abstract (English)
Improving context faithfulness in large language models is essential for developing trustworthy retrieval augmented generation systems and mitigating hallucinations, especially in long-form question answering (LFQA) tasks or scenarios involving knowledge conflicts. Existing methods either intervene LLMs only at inference without addressing their inherent limitations or overlook the potential for self-improvement. In this paper, we introduce GenDiE (Generate, Discriminate, Evolve), a novel self-evolving framework that enhances context faithfulness through fine-grained sentence-level optimization. GenDiE combines both generative and discriminative training, equipping LLMs with self-generation and self-scoring capabilities to facilitate iterative self-evolution. This supports both data construction for model alignment and score-guided search during inference. Furthermore, by treating each sentence in a response as an independent optimization unit, GenDiE effectively addresses the limitations of previous approaches that optimize at the holistic answer level, which may miss unfaithful details. Experiments on ASQA (in-domain LFQA) and ConFiQA (out-of-domain counterfactual QA) datasets demonstrate that GenDiE surpasses various baselines in both faithfulness and correctness, and exhibits robust performance for domain adaptation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。