arXiv:2509.10208cs.CLcs.AI2025-09被引 1

通过自生成对比学习,提升大模型在知识任务中的忠实度。

SI-FACT: Mitigating Knowledge Conflict via Self-Improving Faithfulness-Aware Contrastive Tuning

  • 用自指导生成高质量对比数据,降低人工标注成本。
  • 在ECARE KRE和COSE KRE上提升上下文召回率6.2%。
  • 适合追求高可信度、低幻觉的实用型大模型应用。

大语言模型在知识密集型任务中常因知识冲突产生不忠实输出,即更依赖内部参数化知识而非提供上下文。为此,本文提出一种自改进框架——自提升忠实度感知对比微调(SI-FACT)。该框架利用自指导机制,使基础大模型自动生成高质量、结构化的对比学习数据,包括锚点样本、语义等价正样本以及模拟不忠实场景的负样本,显著降低人工标注成本。随后,通过对比学习训练模型,使其在表示空间中拉近忠实响应、推远不忠实响应。在ECARE KRE与COSE KRE知识冲突评估基准上的实验表明,基于Llama3 8B Instruct的SI-FACT模型相比最优基线方法,上下文召回率提升6.2%,同时显著减少对内部记忆的依赖。结果表明,SI-FACT在提升大模型上下文忠实度方面具有强有效性与高数据效率,为构建更主动、更可信的语言模型提供了可行路径。

原文摘要 · Abstract (English)

Large Language Models often generate unfaithful responses in knowledge intensive tasks due to knowledge conflict,that is,a preference for relying on internal parametric knowledge rather than the provided context.To address this issue,we propose a novel self improving framework,Self Improving Faithfulness Aware Contrastive Tuning.The framework uses a self instruct mechanism that allows the base LLM to automatically generate high quality,structured contrastive learning data,including anchor samples,semantically equivalent positive samples,and negative samples simulating unfaithful scenarios.This approach significantly reduces the cost of manual annotation.Subsequently,contrastive learning is applied to train the model,enabling it to pull faithful responses closer and push unfaithful responses farther apart in the representation space.Experiments on knowledge conflict evaluation benchmarks ECARE KRE and COSE KRE show that the SI FACT model based on Llama3 8B Instruct improves the Contextual Recall Rate by 6.2% over the best baseline method,while significantly reducing dependence on internal memory.The results indicate that SI FACT provides strong effectiveness and high data efficiency in enhancing the contextual faithfulness of LLMs,offering a practical pathway toward building more proactive and trustworthy language models.

大模型忠实度对比学习知识冲突

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。