arXiv:2502.07184cs.CLcs.AI2025-02ICLR被引 21

通过模仿人类学习方式,让大模型更准确地掌握知识,减少幻觉。

Refine Knowledge of Large Language Models via Adaptive Contrastive Learning

  • 基于模型对知识的掌握程度,动态构建正负样本进行对比学习。
  • 在多个数据集上显著降低幻觉率,提升事实准确性。
  • 适合关注大模型可靠性与知识对齐的研究者和开发者。

如何缓解大语言模型(LLMs)的幻觉问题,一直是该领域研究的核心目标。现有主流方法通过优化模型的知识表征来改善输出质量。鉴于知识是人类社会发展的重要基石,我们受人类学习过程启发,提出一种自适应对比学习策略。该方法根据模型对知识的实际掌握情况,灵活构造正负样本进行对比学习,帮助模型巩固已有正确知识、深化理解不完全的知识、遗忘错误信息,并诚实地承认知识盲区。在多个广泛使用的数据集上的大量实验与详细分析表明,该方法能有效提升模型的事实一致性与知识准确性。

原文摘要 · Abstract (English)

How to alleviate the hallucinations of Large Language Models (LLMs) has always been the fundamental goal pursued by the LLMs research community. Looking through numerous hallucination-related studies, a mainstream category of methods is to reduce hallucinations by optimizing the knowledge representation of LLMs to change their output. Considering that the core focus of these works is the knowledge acquired by models, and knowledge has long been a central theme in human societal progress, we believe that the process of models refining knowledge can greatly benefit from the way humans learn. In our work, by imitating the human learning process, we design an Adaptive Contrastive Learning strategy. Our method flexibly constructs different positive and negative samples for contrastive learning based on LLMs' actual mastery of knowledge. This strategy helps LLMs consolidate the correct knowledge they already possess, deepen their understanding of the correct knowledge they have encountered but not fully grasped, forget the incorrect knowledge they previously learned, and honestly acknowledge the knowledge they lack. Extensive experiments and detailed analyses on widely used datasets demonstrate the effectiveness of our method.

大模型知识对齐幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。