通过粗到细的关键词高亮,有效减少大模型幻觉问题。
Coarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models
- 用知识图谱提取关键实体,再按上下文权重筛选并高亮。
- 在基准测试中F1得分提升超30%,显著降低错误信息生成。
- 适合长文本问答、阅读理解等需要精准引用的任务。
生成看似合理但错误的事实信息,即幻觉,已成为研究热点。检索增强语言模型(RALM)通过引入最新知识,成为缓解幻觉的有前景方法。然而,现有RALM在处理长上下文时反而可能加剧幻觉。为此,我们提出一种新颖的粗到细高亮方法(COFT),聚焦不同粒度的关键文本,避免在冗长内容中迷失。COFT包含三个组件:回忆器(recaller)利用知识图谱提取上下文中的潜在关键实体;评分器(scorer)通过计算上下文权重衡量实体重要性;选择器(selector)采用动态阈值算法选出高权重实体,并以粗到细方式高亮对应段落、句子或词语。大量实验表明,该方法在幻觉基准测试中表现优异,F1得分提升超过30%。此外,COFT在多种长文本任务中也展现出强大泛化能力,如阅读理解与问答任务。
原文摘要 · Abstract (English)
Generation of plausible but incorrect factual information, often termed hallucination, has attracted significant research interest. Retrieval-augmented language model (RALM) -- which enhances models with up-to-date knowledge -- emerges as a promising method to reduce hallucination. However, existing RALMs may instead exacerbate hallucination when retrieving lengthy contexts. To address this challenge, we propose COFT, a novel \textbf{CO}arse-to-\textbf{F}ine highligh\textbf{T}ing method to focus on different granularity-level key texts, thereby avoiding getting lost in lengthy contexts. Specifically, COFT consists of three components: \textit{recaller}, \textit{scorer}, and \textit{selector}. First, \textit{recaller} applies a knowledge graph to extract potential key entities in a given context. Second, \textit{scorer} measures the importance of each entity by calculating its contextual weight. Finally, \textit{selector} selects high contextual weight entities with a dynamic threshold algorithm and highlights the corresponding paragraphs, sentences, or words in a coarse-to-fine manner. Extensive experiments on the knowledge hallucination benchmark demonstrate the effectiveness of COFT, leading to a superior performance over $30\%$ in the F1 score metric. Moreover, COFT also exhibits remarkable versatility across various long-form tasks, such as reading comprehension and question answering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。