提出数据驱动方法,减少生成模型因知识捷径产生的幻觉。
KSHSeek: Data-Driven Approaches to Mitigating and Detecting Knowledge-Shortcut Hallucinations in Generative Models
- 在数据预处理阶段用高相似度剪枝消除虚假关联
- 实验显示该方法显著降低幻觉率且不影响问答性能
- 适合关注模型可靠性与真实性的研究人员
大语言模型(LLMs)在自然语言处理(NLP)中取得重大进展,尤其在文本生成任务如问答方面。然而,由于成因复杂,模型幻觉仍是自然语言生成(NLG)的主要挑战。本文从知识捷径视角系统分析事实性幻觉,揭示即使在正确无误的数据上也会产生幻觉,且知识捷径幻觉在生成模型中普遍存在。为缓解此问题,我们提出一种数据级的高相似度剪枝算法,以减少数据中的虚假相关性;同时设计专用检测方法评估缓解效果。实验表明,该方法在微调任务中有效降低知识捷径幻觉,且不损害问答性能。本工作引入新范式,提升生成模型在实际应用中的鲁棒性与可靠性。
原文摘要 · Abstract (English)
The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major challenge in natural language generation (NLG) tasks due to their complex causes. We systematically expand on the causes of factual hallucinations from the perspective of knowledge shortcuts, analyzing hallucinations arising from correct and defect-free data and demonstrating that knowledge-shortcut hallucinations are prevalent in generative models. To mitigate this issue, we propose a high similarity pruning algorithm at the data preprocessing level to reduce spurious correlations in the data. Additionally, we design a specific detection method for knowledge-shortcut hallucinations to evaluate the effectiveness of our mitigation strategy. Experimental results show that our approach effectively reduces knowledge-shortcut hallucinations, particularly in fine-tuning tasks, without negatively impacting model performance in question answering. This work introduces a new paradigm for mitigating specific hallucination issues in generative models, enhancing their robustness and reliability in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。