arXiv:2609.06065cs.CL2026-09

解决多跳问答中实体丢失问题,提升检索到生成的连贯性。

Don't Lose Entities from Retrieval to Generation: Dual Entity Recovery RAG for multi-hop QA

论文配图:Don't Lose Entities from Retrieval to Generation: Dual Entity Recovery RAG for multi-hop QA
图 1 · 摘自论文原文
  • 用双向查询分解和实体前缀保持实体信息贯穿检索与生成
  • 在三个基准上超越或匹配强基线,包括依赖复杂结构的方法
  • 无需图构建、数据修改或微调,轻量高效适合实际部署

检索增强的多跳问答将问题拆分为子问题,将语料库拆分为句子等小单元。两者虽提升流程,但均存在实体信息丢失的共同漏洞,在两个环节导致失败:一是检索阶段,子问题丢失前一跳解析的实体,使检索器无匹配依据;二是生成阶段,即使正确句子被召回,孤立句子失去指代上下文,大模型无法判断其指向哪个实体。我们识别出此为独立失败模式,称为“丢失于生成”。控制实验表明,即使提供正确证据,该问题仍会降低答案质量。为此提出双实体恢复RAG(DER-RAG),通过双向查询分解传递已解析实体,并在生成时为每句添加主语实体前缀。DER-RAG无需图结构、语料修改或微调,仅用轻量组件,在三个多跳问答基准上达到或超过强基线,包括依赖昂贵离线结构的图方法。

原文摘要 · Abstract (English)

Retrieval-augmented multi-hop question answering (QA) decomposes a query into sub-questions and decomposes the corpus into smaller retrieval units such as sentences. Both forms of decomposition improve the pipeline, but we show that both share the same vulnerability, the loss of entity information, and that this loss breaks the pipeline at two separate points. The first point is retrieval, where a sub-question loses the entity resolved at the previous hop, leaving the retriever with nothing to match against. The second point is harder to see, because retrieval still appears to succeed. Once a passage is split into sentences, an isolated sentence loses the context that grounds its pronouns, so even with the correct sentence in hand the LLM cannot tell which entity the sentence is about. We isolate this second point as a distinct failure mode that we call lost-in-generation, and a retrieval-controlled experiment shows that it degrades answers even when the gold evidence is fixed in the context. We then propose Dual Entity Recovery RAG (DER-RAG), which keeps the grounding entity explicit from retrieval through to generation with two lightweight components, a two-way query decomposition that carries the resolved entity across sub-questions and a subject entity prefix attached to each sentence at generation time. DER-RAG needs no graph construction, no corpus modification, and no fine-tuning, yet on three multi-hop QA benchmarks it matches or exceeds strong baselines, including graph-based methods that depend on costly offline structures.

多跳问答实体保持RAG大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。