arXiv:2411.12449cs.CLcs.IR2024-11

用新闻提取实体互动,让大模型回答更及时准确

Neon: News Entity-Interaction Extraction for Enhanced Question Answering

  • 从新闻中提取实体间事件,构建带时间戳的知识图谱
  • 在时效性问答任务中提升准确率,解决信息过时问题
  • 适合需实时更新的新闻、事件类问答场景

实时获取最新信息并增强现有大语言模型(LLMs)的能力,对生成及时、可靠、有依据的输出至关重要。当大模型用于快速变化领域的信息任务(如与近期或正在发生的事件相关的网络搜索)时,生成时间相关响应需要访问近实时的新闻源。然而,大模型的参数记忆常已过时,传统检索系统的结果也难以捕捉最新相关信息,且在处理动态新闻中的矛盾报道时表现不佳。为此,我们提出NEON框架,旨在从新闻文章中提取新兴实体互动(如事件或活动)。NEON构建以实体为中心的带时间戳知识图谱,从而增强与新闻事件相关的问答能力。该框架通过将开放式信息抽取(openIE)风格的三元组整合进大模型,实现上下文感知的检索增强生成。实验表明,在处理时间敏感、实体聚焦的查询时,该方法显著提升了问答性能。通过NEON,大模型可提供更准确、可靠、及时的回应。

原文摘要 · Abstract (English)

Capturing fresh information in near real-time and using it to augment existing large language models (LLMs) is essential to generate up-to-date, grounded, and reliable output. This problem becomes particularly challenging when LLMs are used for informational tasks in rapidly evolving fields, such as Web search related to recent or unfolding events involving entities, where generating temporally relevant responses requires access to up-to-the-hour news sources. However, the information modeled by the parametric memory of LLMs is often outdated, and Web results from prototypical retrieval systems may fail to capture the latest relevant information and struggle to handle conflicting reports in evolving news. To address this challenge, we present the NEON framework, designed to extract emerging entity interactions -- such as events or activities -- as described in news articles. NEON constructs an entity-centric timestamped knowledge graph that captures such interactions, thereby facilitating enhanced QA capabilities related to news events. Our framework innovates by integrating open Information Extraction (openIE) style tuples into LLMs to enable in-context retrieval-augmented generation. This integration demonstrates substantial improvements in QA performance when tackling temporal, entity-centric search queries. Through NEON, LLMs can deliver more accurate, reliable, and up-to-date responses.

知识图谱实体互动问答系统实时信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。